The platform is designed to help overcome the barriers in communication for the deaf and hard-of-hearing community by boosting the accessibility of automated sign language translation
Baidu builds an AI sign language platform for the deaf and hard-of-hearing community. (Credit: simone.brunozzi/Wikipedia.org)
Baidu, through its cloud computing unit Baidu AI Cloud, has introduced an artificial intelligence (AI) sign language platform that is claimed to enable on-device, real-time translation from speech to hand gestures.
The Chinese technology company said that the new platform can create digital avatars within minutes for translating sign languages and live interpretation.
Rolled out as a new offering of Baidu AI Cloud’s digital avatar platform XiLing, the platform is designed to help overcome the communication barriers for the deaf and hard-of-hearing (DHH) community by increasing the accessibility of automated sign language translation.
According to Baidu, the upcoming Beijing 2022 Winter Paralympics Games will see an AI sign language interpreter, which will use the platform to carry out its duties.
Along with the platform, Baidu AI Cloud has launched two all-in-one AI sign language translators which offer solutions with an optimised set-up process and plug-and-use features.
Baidu said that the translators can be used in a variety of use scenarios, including hospitals, airports, banks, bus stations, and other public spaces.
The XiLing AI sign language platform and the sign language translators will serve the DHH community in online as well as offline settings.
For DHH persons seeking to study or socialise online, the platform can be integrated quickly into commonly used websites, mobile applications, and mini programmes within a few hours. The platform can then carry out functions such as livestream synthesis and sign language video synthesis, audio-to-sign language translations, and text-to-sign language translation.
Baidu stated: “The all-in-one translators are tailored for offline scenarios to improve the accessibility of public services.
“Baidu’s translators come with two models, a full offline version V3, and a cloud-connected version P3. Both are embedded with core functions of the AI sign-language platform, able to realize ASR speech recognition, speech translation, and portrait rendering.
“This full range of functions offers incredible potential for empowering the DHH.”
Last August, Baidu’s AI-based voice assistant spin-off Xiaodu Technology had closed a Series B funding round at a valuation of $5.1bn.