Today’s Solutions: May 23, 2022

Two to three of every 1,000 children are born deaf or hard of hearing in the US. Though 90 percent of these kids are born to hearing parents, 72 percent of families do not sign with their deaf children.

After learning about those statistics, creative studio Hello Monday decided to create a solution that would encourage more parents of deaf children to learn sign language. The studio designed an app that teaches and corrects hand positions in real-time to facilitate people’s efforts in learning the sign language alphabet.

Designed in partnership with the American Society for Deaf Children, Fingerspelling.xyz is an app that runs in web browsers and is able to assess its user’s attempts to learn words in real-time — much like the popular language-learning app Duolingo.

Making use of a person’s webcam, the app tracks their hand movements as they attempt the hand positions of the American Sign Language (ASL) Alphabet. An algorithm trained on images of correct hand positions then analyses the accuracy of the user’s attempts, giving them feedback until they achieve the correct alignment. In ASL, fingerspelling is used for proper nouns, or when a person doesn’t know the sign for a word.

“The fingerspelling game is a great way to introduce the basics of ASL in a fun and playful way,” says Anders Jessen, Hello Monday’s founding partner. According to Jessen, the app is designed as such as to offer a more engaging learning experience than the traditional methods of learning the sign language alphabet — through reading or watching videos.

“The game leverages advanced hand recognition technology, matched with machine learning, to give you real-time feedback via the webcam for each sign and word you spell correctly,” says Jessen. “It’s fun to think about how this highly trained machine-learning model, which researchers have spent countless hours on training, now does the opposite — it now trains us back, and makes us better at fingerspelling.”

Hello Monday’s new app is mainly targeted at parents of deaf children, enabling them to encourage their child’s development by introducing them to sign language at an early stage.

Image source: Fingerspelling.xyz

Solutions News Source Print this article
More of Today's Solutions

New program seeks to break the cycle between jail and homelessness

Several factors can lead to homelessness: a lack of affordable housing, high costs of living, and even, sadly, mental illness. Another factor that contributes to homelessness, which is often overlooked, is incarceration.  Many individuals serve ... Read More

How a century-old cargo schooner is bringing back emissions-free shipping

The shipping industry is responsible for 2.5 percent of global greenhouse gas emissions — putting about 940 million tonnes of CO2 into the atmosphere every year. Before 1960, however, when containerization started to take off, ... Read More

Dam! Europe removes record number of river barriers in 2021

In 2021, Spain began a movement to remove dams from the country’s rivers to restore fish migration routes and boost biodiversity across the nation. They successfully took down 108 barriers and inspired other European countries ... Read More

This contact lens releases glaucoma medication

While it is treatable, glaucoma remains a serious eye disease that can damage the optic nerve and lead to blindness if left untreated. Open-angle glaucoma is the most common form of the disease, and research ... Read More

US soccer and national teams reach agreement to close gender pay gap

In a historic win for women’s rights, US Soccer and both the women’s and men’s national teams have proclaimed a collective bargaining agreement to close the gender pay gap and ensure that each player, regardless ... Read More

New immunotherapy drug combo slows liver cancer growth in mice

There is something of an art to the science of medicine. We’ve all heard that everyone’s different, and so is their biology. Sometimes, developing the right treatment for a patient’s condition takes dedicated and creative ... Read More