Music - Influencer: AI cannot yet recognize sign language
According to deaf music performer Cindy Klink, artificial intelligence (AI) is not yet able to recognize sign language well. "It's a work in progress, but very difficult," said the 26-year-old influencer in an interview with Deutsche Presse-Agentur.
In sign languages, not only the hands are important, but also the facial expressions and the mouth image. "If it were only about the hands, there would have been an AI that could do that long ago," she said. "But because the face is so extremely important, it's still a work in progress." For example, the BIGEKO research project is currently underway in Germany, which aims to translate sign language with the help of AI.
Performances on stage too
Cindy Klink from near Koblenz performs songs in sign language to make music accessible to people who are deaf or hard of hearing. The law student publishes videos of her performances on Instagram and Tiktok, where hundreds of thousands of people follow her. She also performs live on stage with stars such as Wincent Weiss and Die Fantastischen Vier. She recently recorded a music video with social media star Levent Geiger. She now also uses a hearing prosthesis.
The 26-year-old explains that she adapts her performance to the feelings that the song conveys. "If it's a love song, you can see that, then I look friendlier. If it's an ironic song, you can tell from my facial expressions that I'm secretly thinking: this is pure nonsense." The same applies to aggressive songs. "It's not just the facial expressions that are different, the gestures are also stronger and wilder or softer, depending on the song."
Read also:
- Telefónica targets market launch for hologram telephony
- vzbv: Internet companies continue to cheat despite ban
- Telefónica targets market launch for hologram telephony in 2026
- Worldcoin project docks onto Telegram and Reddit
- Despite the ongoing BIGEKO research project in Germany, using Artificial Intelligence (AI) to translate sign language is still considered a work in progress, as highlighted by Cindy Klink, the Deutsche Presse-Agentur interviewee.
- The German Press Agency reported that Cindy Klink, a music performer from near Coblenz, uses sign language to make music more accessible to people with hearing impairments, sharing video content on platforms like Instagram and Tiktok.
- In an interview with the German Press Agency, Klink mentioned her use of a hearing prosthesis, explaining how she adapts her sign language performance based on the emotions conveyed by different types of music, such as love songs, ironic songs, or aggressive songs.
- The German public's interest in sign language began to gain traction on the internet, with the popularity of platforms like Tiktok and Instagram leading to increased exposure and awareness of the language among non-deaf people in Germany.
- As a result, sign language has become more prominent in mainstream music performances, with artists like Cindy Klink collaborating with internet sensations like Levent Geiger to create music videos and live performances, bridging the gap between the deaf community and the mainstream music industry in Germany.
Source: www.stern.de
