Tuesday, 23 February 2021

Google AI reads sign language too.


Google states that its new project allows smartphones to interpret and “read aloud” sign language. There’s no app, but there are algorithms developers can use to make their own apps.

Until now, this type of software has only worked on PCs, so it’s a huge and important step. The hearing-impaired community appreciated the project, but also noted that the tech might have problems fully translating some conversations.  In an AI blog, Google research engineers Valentin Bazarevsky and Fan Zhang state that the project will be “the basis for sign language understanding”. It was developed in partnership with image software company MediaPipe.

“We’re excited to see what people come up with. For our part, we will continue our research to make the technology more robust and to stabilize tracking, increasing the number of gestures we can reliably detect,” a spokeswoman told the BBC.  This is only the first step as the approach now misses any facial expressions or speed of signing and these, changing the meaning of what is being discussed.

You can learn more here.


  1. https://youtu.be/lxTRClu3_Zs

    I will have those apps on my smartphone for the world's fair in Dubai - Oct 21 - March 22
    In 2008 had one (ACCER) with Spanish Sign Langauge and Gestuno at Expo 08 Zarogoza it also has 8 languages in the captioned mode ranger device in USA at Philadelphia amd Austin
    Google uses smart city technology that I seen at Expo 15 Milan Japan uses Video/CC at Achi Expo 15
    Come and join me in Dubia as I rather see and use them then reading all about it But keep in mind they showcase things that won't be commonplace for five year or so, RCA shown the first picture phone in 1964 at NY World Fair and I use it but it took years to become a reality - World's Fairs always the first to show them years before they are marketing them at the annual Consumer Electronic Show - I have seen Atari products that you uses your mind instead of control sticks and it's far out and crazy I had doubts but damn it really works and yet it never came out. I seen sign language robots in 1990 Osaka Japan and the uses of hands instead of a mouse in Sevilla in 1992. The uses of touch screens in 1984 New Orleans Expo etc
    We may see the uses of a futuristic holographer interpreter or holography ASL communications in the future replacing the obsolete VRS system we uses today, technology is changing

    1. But speech to text as a norm is still not there on videos... nor lip-reading.