Using AI for Sign Language Translation

Thadeu Luz, Chief Product & AI Officer of Google AI Impact Challenge grantee Hand Talk, shares how his team is applying AI to build tools for sign language learning and translation.
Learn more: handtalk.me

Пікірлер: 59

  • @isaackay5887
    @isaackay58873 жыл бұрын

    I've literally spent this whole semester working on this exact idea...then I came across this finished product 😅😂Still determined to finish it though. There's plenty of space to grow here.

  • @vinaypursnani1903

    @vinaypursnani1903

    3 жыл бұрын

    Can you point me to the finished product? I need to make something like this for my Minor Project this semsester.

  • @vinaypursnani1903

    @vinaypursnani1903

    3 жыл бұрын

    semester*

  • @absurdsisyphus9017

    @absurdsisyphus9017

    2 жыл бұрын

    Same here, lol

  • @ahmedayman2047

    @ahmedayman2047

    2 жыл бұрын

    @@vinaypursnani1903 the finished product is what the're talking about in the talk it's called HandTalk

  • @callmeabd6546

    @callmeabd6546

    2 жыл бұрын

    same bro but i know it later than you

  • @mamag9673
    @mamag96732 жыл бұрын

    This will help my family. My dad had surgery and complications from the surgery caused him to be mute. He can hear and he knows how to use sign language due both my grandparents were deaf and mute. This will help my family to communicate with him much better. May God continue to bless you to grow with Hand Talk. 🙏🙌😇

  • @PriscilaKlopper
    @PriscilaKlopper10 ай бұрын

    Conheci o HandTalk quando estava iniciando, quando eu fazia faculdade e tive LIBRAS na grade curricular… Amei tanto! Muito orgulho de vocês! Great job!

  • @timothyonipad
    @timothyonipad3 жыл бұрын

    I got the same idea today and was really read to work on it glad you are doing progress on it

  • @MatthewCBridges
    @MatthewCBridges2 жыл бұрын

    Also noted that facial expressions and lip patterns are apparent on the model, excellent this is captured too.

  • @ziohalex
    @ziohalex3 жыл бұрын

    Thanks Thadeu! Really inspiring. I had the same idea some times ago...And you are doing it :-D great

  • @fernandoluizdefigueredo4993
    @fernandoluizdefigueredo49933 жыл бұрын

    Parabéns pelo trabalho surpreedente!

  • @ESoykanful
    @ESoykanful4 жыл бұрын

    great to hear this finally !

  • @manp1039
    @manp10392 жыл бұрын

    i met someone in VRchat that has devised or found a way to sign language recognize what they sign into text. They were unwilling to share with me how they did this. but this kind of technology would be great in VR social settings.. to allow communication between a deaf and non-deaf person or mute and mute or deaf and mute or mute and nondeaf etc. In VRchat there is a community of deaf or ASL enthusiasts or those who are professional ASL interpreters. and they sign back and forth with each other in VRchat using a modified version of ASL that allows for certain signs that can't be don with existing hand controllers of the Valve Index hand controllers or the Oculus Quest 2 hand controllers. However, with the Oculus Quest 2 there is a hand recognition feature that allows the use of the cameras to recognize the hands. And it also can be partially (to my knowledge) be used for making ASL signs that an avatar's hands could memic. However, the avatar would have to have 5 finger movement capabilities. Some avatars only have 1, 2, 3, or 4 fingers or even no fingers.. Some just have what looks like a mit, like in RecRoom VR.

  • @kairoslara
    @kairoslara3 жыл бұрын

    I was going to send this video to a deaf friend who is working on a similar project with me but disappointingly the video has no translation to any sign language nor even multilingual subtitles options..... 🤡🤡🤡 Even when people are working with accessibility topics the news about it are kept being spread with no accessibility. Man, it sucks to have to face this even in environments where people supposedly care about it.

  • @kardelensavran9254
    @kardelensavran92543 жыл бұрын

    This is amazing!

  • @yasaswickramathunga3869
    @yasaswickramathunga38693 жыл бұрын

    perfect idea

  • @randomvideos6117
    @randomvideos61173 жыл бұрын

    Today morning I thought of this idea and planning to develop an app for this.. and then i saw this

  • @sherbear6177
    @sherbear61772 ай бұрын

    Isnt this a one-way conversation. If the mom learns to sign what she wants to say, but then the son signs back, how will the mom understand the deaf son?

  • @a7md944
    @a7md9442 жыл бұрын

    I was teying to contact the company but unfortunately error message always occure on their website.

  • @Azzufunnyguy
    @Azzufunnyguy Жыл бұрын

    Hey Google Do we have the product launched by now? What's the accuracy? Does it convert sign language to text and speech?

  • @logicalson
    @logicalson7 ай бұрын

    Hi everybody, do you know any ai tools that auto-translate English videos into sign language?

  • @mutaherkhan2161
    @mutaherkhan21613 жыл бұрын

    sir can you share the code

  • @sherbear6177
    @sherbear61772 ай бұрын

    Are Deaf people involved with this technology? Are you using native signers? It would be great to see an interpreter on screen with you.

  • @daddyyyyyyyyyyyy
    @daddyyyyyyyyyyyy Жыл бұрын

    App name?

  • @adityagoswami6881
    @adityagoswami68813 жыл бұрын

    8:01 I had the same idea, I am trying to build app that could read sign language through camera and do real time translation to text. If you have the same idea ,We can collaborate .

  • @c0ck7aiL

    @c0ck7aiL

    3 жыл бұрын

    lol good luck bro

  • @timothyonipad

    @timothyonipad

    3 жыл бұрын

    I just got the same idea today I would love to work on it I know BSL and ASL sign language

  • @corymei2081

    @corymei2081

    3 жыл бұрын

    I got the same idea 2 yrs ago, and built a demo

  • @timothyonipad

    @timothyonipad

    3 жыл бұрын

    @@corymei2081 how did it go?

  • @karinalizeth5849

    @karinalizeth5849

    3 жыл бұрын

    Same here! I want to collab

  • @skyonyxmalone
    @skyonyxmalone7 ай бұрын

    A person live streams on tiktok. I want an onscreen sign language reader. Do you understand?

  • @cucle6362
    @cucle63623 ай бұрын

    Well! I'm not defend on this innovation, but is there any Deaf community representative have comment or approve on this?

  • @ishaaqmohamed8788
    @ishaaqmohamed87882 жыл бұрын

    nothing will stop anyone not even their disabilities. let there be a day when there will be people with hearing challenges can attend Google meet with coworkers like everyone does why not??

  • @maripellyprakash4140
    @maripellyprakash41403 жыл бұрын

    Indian sign language missed it 😭

  • @marymetilda6014

    @marymetilda6014

    3 жыл бұрын

    Work in progress...we will also get it

  • @j.u.g.y
    @j.u.g.y3 жыл бұрын

    😟