MBZUAI's BiMediX2, a bilingual healthcare multi-modal model, won Meta's Llama Impact Innovation Award for its potential in solving healthcare accessibility challenges across the Middle East and Africa. Built using Llama 3.1, the model understands medical queries in both English and Arabic, interprets medical images, and is integrated as a chatbot on Telegram with speech functionality. The model was also presented at the AI for Sustainable Development Platform Launch Event and integrated into the UNDP for telemedicine. Why it matters: The model's bilingual capabilities and accessibility on low-cost devices and speech-based interaction have potential to improve healthcare access for marginalized populations in the region.
MBZUAI will present two assistive AI prototypes at GITEX 2025: smart glasses with a camera and eye tracker that identify objects and medication, and a brain-computer interface (BCI) device integrated with robotics to control a robotic dog's movements. The smart glasses use a multimodal large language model (LLM) to help visually impaired individuals, while the BCI aims to restore hands-free communication for people with mobility limitations. Hisham Cholakkal leads the research team, which received a Meta Regional Research Grant 2025 for its work on multimodal LLM for smart wearables. Why it matters: The research demonstrates the potential of AI to improve the quality of life for vulnerable populations and addresses the challenge of providing cost-effective care for aging societies.
MBZUAI showcased its AI research and innovation at GITEX Global 2022 in Dubai, featuring an interactive exhibit. The university highlighted faculty research, student innovations, and presentations, including a keynote by President Eric Xing. A key focus was on AI technologies for the metaverse, led by Hao Li, and innovations like a communication aid for speech-impaired individuals. Why it matters: MBZUAI's presence at GITEX underscores its commitment to advancing AI literacy and demonstrating practical AI applications across diverse sectors in the UAE.
MBZUAI researchers demonstrated a low-latency, multilingual multimodal AI system at GITEX that integrates speech, text, and visual capabilities for more lifelike human-machine conversation. The demo, led by Dr. Hisham Cholakkal, includes a mobile app where users can point their camera at an object and ask questions, receiving spoken answers in multiple languages. They are also integrating the model into a robot dog that can respond to voice commands. Why it matters: This work addresses key challenges in deploying LLMs to real-world applications in the Middle East, such as multilingual support and real-time responsiveness.
MBZUAI will present its latest AI research applications at GITEX 2024, focusing on computer vision, machine learning, NLP, and robotics. The university aims to demonstrate AI's potential in transforming sectors like healthcare, industry, and media, aligning with the UAE’s vision for a knowledge-based economy. MBZUAI will also showcase AI tools designed to combat misinformation and enhance digital media reliability. Why it matters: MBZUAI's presence at GITEX highlights the UAE's commitment to AI innovation and the university's role in developing AI solutions for real-world challenges.