Researchers at MBZUAI have developed Auto-DUB, a system using deep learning, NLP, and CV to improve audio-visual dubbing, particularly for educational videos. The three-step process generates subtitles, creates an audio representation, and synchronizes the audio with lip movements. The system aims to overcome language barriers in e-learning by providing accurate translations and lip-synced audio. Why it matters: This research addresses a critical need in online education by making content more accessible to non-native English speakers, potentially expanding access to global educational resources in the Arab world.
ElevenLabs, a voice AI research and product company, presented at MBZUAI's Incubation and Entrepreneurship Center (IEC) on the adoption of audio AI in the Middle East. Hussein Makki, general manager for the Middle East at ElevenLabs, highlighted the potential of voice-native AI across sectors like telecommunications, banking, and education. ElevenLabs focuses on making content accessible and engaging across languages and voices through its text-to-speech models. Why it matters: This signals growing interest and investment in voice AI applications within the region, potentially transforming customer service and content accessibility in Arabic.
Researchers at NYU Abu Dhabi have developed an AI system capable of translating spoken language into sign language. This innovative technology aims to enhance communication accessibility for individuals who are deaf or hard-of-hearing. The system leverages advancements in artificial intelligence, likely combining natural language processing for speech understanding and computer vision for sign generation. Why it matters: This development has the potential to significantly improve inclusion and communication for deaf communities within the Middle East and globally, bridging critical communication gaps.