MBZUAI releases BiMediX2, a bilingual (Arabic-English) Bio-Medical Large Multimodal Model, along with the BiMed-V dataset (1.6M samples) and BiMed-MBench evaluation benchmark. BiMediX2 supports multi-turn conversation in Arabic and English and handles diverse medical imaging modalities. The model achieves state-of-the-art results on medical LLM and LMM benchmarks, outperforming existing methods and GPT-4 in specific evaluations.
MBZUAI researchers introduce BiMediX, a bilingual (English and Arabic) mixture of experts LLM for medical applications. The model is trained on BiMed1.3M, a new 1.3 million bilingual instruction dataset and outperforms existing models like Med42 and Jais-30B on medical benchmarks. Code and models are available on Github.
MBZUAI's BiMediX2, a bilingual healthcare multi-modal model, won Meta's Llama Impact Innovation Award for its potential in solving healthcare accessibility challenges across the Middle East and Africa. Built using Llama 3.1, the model understands medical queries in both English and Arabic, interprets medical images, and is integrated as a chatbot on Telegram with speech functionality. The model was also presented at the AI for Sustainable Development Platform Launch Event and integrated into the UNDP for telemedicine. Why it matters: The model's bilingual capabilities and accessibility on low-cost devices and speech-based interaction have potential to improve healthcare access for marginalized populations in the region.
Pierre Baldi from UC Irvine presented applications of AI to biomedicine, covering molecular-level analysis of circadian rhythms, real-time polyp detection in colonoscopy videos, and prediction of post-operative adverse outcomes. He discussed integrating AI in future AI-driven hospitals. The presentation was likely part of a panel discussion hosted by MBZUAI in collaboration with the Manara Center for Coexistence and Dialogue. Why it matters: This highlights the growing interest in AI applications within the healthcare sector in the UAE, particularly through institutions like MBZUAI.
Researchers at MBZUAI have introduced TiBiX, a novel approach leveraging temporal information from previous chest X-rays (CXRs) and reports for bidirectional generation of current CXRs and reports. TiBiX addresses two key challenges: generating current images from previous images and reports, and generating current reports from both previous and current images. The study also introduces a curated temporal benchmark dataset derived from the MIMIC-CXR dataset and achieves state-of-the-art results in report generation.
MBZUAI's Institute of Foundation Models (IFM) has launched five new specialized language and multimodal models, including BiMediX, PALO, GLaMM, GeoChat, and MobiLLaMA. These models address real-world applications in healthcare, visual reasoning, multilingual capabilities, geospatial analysis, and mobile device efficiency. BiMediX is a bilingual medical LLM, while GLaMM generates natural language responses related to objects in an image at the pixel level. Why it matters: This launch demonstrates MBZUAI's commitment to advancing AI research and developing practical AI solutions for various industries, especially with a focus on Arabic language capabilities.
MBZUAI's BioMedIA lab, led by Mohammad Yaqub, is developing AI solutions for healthcare challenges in cardiology, pulmonology, and oncology using computer vision. Yaqub's previous research analyzed fetal ultrasound images to correlate bone development with maternal vitamin D levels. The lab is now applying image analysis to improve the treatment of head and neck cancer using PET and CT scans. Why it matters: This research demonstrates the potential of AI and computer vision to improve diagnostic accuracy and accessibility of healthcare in the region and beyond.
Dr. Min Xu joins MBZUAI as Affiliated Assistant Professor in Computer Vision to advance AI-based biomedical image analysis. His research focuses on cellular cryo-electron tomography (Cryo-ET) 3D image analysis, spatial transcriptomics, digital pathology, and automated science. Xu will collaborate with MBZUAI faculty and advise master’s students, leveraging his expertise in computational biology and bioinformatics. Why it matters: This appointment strengthens MBZUAI's capabilities in applying AI to critical areas of biomedical research, potentially leading to breakthroughs in disease understanding and treatment.