The Autonomous Robotics Research Center (ARRC) at TII won the Nanocopter AI Challenge 2022, part of the International Micro Air Vehicle Conference. The challenge involved developing AI-enabled solutions for Bitcraze’s Crazyflie nanocopters to perform vision-based obstacle avoidance. The ARRC team's nano-drone completed a 110m flight in 5 minutes with no crashes in a dynamic environment. Why it matters: This victory demonstrates the growing expertise in autonomous robotics and AI-powered drone technology within the UAE, with potential applications in search and rescue, industrial inspection, and precision agriculture.
ARRC researchers in collaboration with the University of Bologna and ETH Zürich have developed a CNN-based AI deck to enable autonomous navigation of a 27g nano-drone in unknown environments. The CNN allows the drone to recognize and avoid obstacles using only an onboard camera, running 10x faster and using 10x less memory than previous versions. The demo also featured a swarm of nano-drones flying in formation using ultra-wideband communication. Why it matters: This advancement could significantly enhance the capabilities of nano-drones for applications such as disaster response, where quick and efficient intervention is crucial.
Researchers at MBZUAI and other institutions have published a study at ACL 2024 investigating how jailbreak attacks work on LLMs. The study used a dataset of 30,000 prompts and non-linear probing to interpret the effects of jailbreak attacks, finding that existing interpretations were inadequate. The researchers propose a new approach to improve LLM safety against such attacks by identifying the layers in neural networks where the behavior occurs. Why it matters: Understanding and mitigating jailbreak attacks is crucial for ensuring the responsible and secure deployment of LLMs, particularly in the Arabic-speaking world where these models are increasingly being used.
MBZUAI researchers presented FIRE, a new fact-checking framework for LLM outputs, at NAACL 2025. FIRE first assesses the LLM's confidence in its claims before searching the web, reducing computational cost. It also stores knowledge gained from web searches to aid in classifying other claims. Why it matters: This approach improves the efficiency and cost-effectiveness of automatically verifying the accuracy of LLMs, addressing a key limitation in their reliability.
MBZUAI researchers have developed a new benchmark for evaluating the teaching abilities of large language models (LLMs), earning the SAC Award for Resources and Evaluation at NAACL 2025. The framework aims to measure how effectively LLMs can be used for personalized tutoring, addressing the "two sigma problem" in education. Unlike rule-based tutoring systems, LLMs offer fluency but lack pedagogical principles. Why it matters: This benchmark is a crucial step towards integrating learning science into AI, potentially enabling personalized AI tutors that significantly improve educational outcomes.
MBZUAI researchers have created ArabicMMLU, the first benchmark dataset in Modern Standard Arabic for evaluating language understanding across multiple tasks. The dataset contains over 14,000 multiple-choice questions from school exams across the Arabic-speaking world and addresses the limitations of translated English datasets. It was presented at the 62nd Annual Meeting of the Association for Computational Linguistics in Bangkok. Why it matters: This benchmark enables a more accurate and culturally relevant evaluation of LLMs' capabilities in Arabic, which is crucial for developing AI tailored to the Arab world.
MBZUAI researchers presented EXAMS-V, a new benchmark dataset for evaluating the reasoning and processing abilities of vision language models (VLMs). EXAMS-V contains over 20,000 multiple-choice questions across 26 subjects and 11 languages, including Arabic. The dataset presents the questions within images, testing the VLM's ability to integrate visual and textual information. Why it matters: This dataset fills a gap in VLM evaluation, providing a valuable resource for assessing and improving the multimodal reasoning capabilities of these models, particularly in diverse languages like Arabic.
MBZUAI published over 300 papers at top-tier AI venues between January and June 2024, including 39 papers at ICLR 2024, building on 612 papers published in 2023. MBZUAI is now ranked among the world's top 100 universities in computer science and top 20 globally in AI-related fields. One standout paper, 'M4,' won the Best Resource Paper Award at EACL 2024 for its work on detecting LLM-generated text across multiple languages and domains. Why it matters: This continued research output and rising rankings solidify MBZUAI's position as a leading AI research institution in the GCC region and globally.