web
You’re offline. This is a read only version of the page.
close

How Artificial Intelligence and American Sign Language Are Evolving Together

There is no doubt technology is changing how we communicate every day. Earlier this month, I visited a vendor that is patiently waiting for the convergence of several pieces of technology to happen. This convergence of technologies would make their product even more useful to the public, especially for members of the Deaf and Hard of Hearing communities where artificial intelligence (AI) could offer new possibilities for video communication and real-time connection with American Sign Language (ASL).  

How Artificial Intelligence and American Sign Language Are Evolving Together 
There is no doubt technology is changing how we communicate every day. Earlier this month, I visited a vendor that is patiently waiting for the convergence of several pieces of technology to happen. This convergence of technologies would make their product even more useful to the public, especially for members of the Deaf and Hard of Hearing communities where artificial intelligence (AI) could offer new possibilities for video communication and real-time connection with American Sign Language (ASL).  

How AI Is Unlocking New Potential for ASL 
Artificial intelligence is helping build stronger bridges between signed and spoken languages. There are already programs out there that seamlessly act as a translator between two individuals who do not share a common spoken language. Technology isn’t there yet for signed languages. Emerging tools use computer vision and machine learning to recognize body movement, hand gestures, and facial expressions in real time. This technology opens exciting possibilities for accessibility: 

  • Real-Time Translation Models: Advanced machine learning tools are learning to translate ASL into text and speech, potentially helping to facilitate everyday conversations. 

  • Interactive Learning Tools: Interactive apps use camera recognition to help people learn basic sign language, practice fingerspelling, and explore Deaf culture. 

  • Enhanced Video Clarity: Smart software can improve video resolution and track movement during video calls, making sign language clearer to view. 

Leaders Driving Innovation in AI and ASL 
Major tech leaders and academic institutions are working directly with the Deaf community to ensure AI development serves authentic needs: 

  • Google: Google developed SignTown and open-source models using MediaPipe Holistic technology to recognize facial expressions, hand gestures, and body pose keypoints directly through a standard web camera. 

  • Snapchat: Led by Deaf and Hard of Hearing team members, Snapchat built custom ASL Lenses that use augmented reality and computer vision to teach users fingerspelling and basic signing. 

  • Rochester Institute of Technology (RIT): Researchers at RIT's National Technical Institute for the Deaf (NTID) created AI-powered learning tools like the Grammar Laboratory, comparing ASL and English structure to assist Deaf students. 

Technology is a double-edged sword and should always support individual choice and dignity. AI tools do not replace human interpreters or community connections. AI can provide extra options so every person who uses sign language can communicate flexibly across different environments. 

If you are exploring new ways to stay connected, you can also explore our California Connect website and explore resources to learn about accessible video phones, mobile accessories, and relay services designed for your daily routine. 

As these technologies continue to converge, we move closer to a future where communication barriers may be seamlessly dismantled. While AI can never replace human connection or culture, its evolving integration with American Sign Language offers a promising horizon; one where members of the Deaf and Hard of Hearing communities have more tools, options, and freedom to connect in real time. The journey of technological innovation is just beginning. 

About California Connect 
California Connect is a CPUC-funded assistive technology program that provides free communication devices and training to eligible Californians with speech, hearing, vision, or mobility disabilities. Learn more and apply at caconnect.org.    

Post a comment