MBZUAI researchers introduce XrayGPT, a conversational medical vision-language model for analyzing chest radiographs and answering open-ended questions. The model aligns a medical visual encoder (MedClip) with a fine-tuned large language model (Vicuna) using a linear transformation. To enhance performance, the LLM was fine-tuned using 217k interactive summaries generated from radiology reports.
The Abu Dhabi Department of Health (DoH) has partnered with MBZUAI and Core42 to launch the Global AI Healthcare Academy. The academy will provide AI training to healthcare workers in Abu Dhabi, aiming to improve diagnostics, operational efficiency, and patient care. The initiative includes mass training sessions for up to 100 attendees and customized courses in areas like AI for radiology and cardiology. Why it matters: This partnership signals a strategic push to integrate AI into Abu Dhabi's healthcare system, potentially establishing the emirate as a leader in technology-driven healthcare.
Mausam, head of Yardi School of AI at IIT Delhi and affiliate professor at University of Washington, will discuss Neuro-Symbolic AI. The talk will cover recent research threads with applications in NLP, probabilistic decision-making, and constraint satisfaction. Mausam's research explores neuro-symbolic machine learning, computer vision for radiology, NLP for robotics, multilingual NLP, and intelligent information systems. Why it matters: Neuro-Symbolic AI is gaining importance as it combines the strengths of neural and symbolic approaches, potentially leading to more robust and explainable AI systems.
IBM Fellow Dr. Tanveer Syeda-Mahmood gave a talk on the evolution of foundational models, covering multimodal fusion in healthcare and neuro-inspired AI for computer vision. She also discussed image-driven fact-checking of generative AI textual reports for responsible models. Dr. Syeda-Mahmood leads IBM's work in Multimodal Bioinspired AI and WatsonX features, and previously led the Medical Sieve Radiology Grand Challenge. Why it matters: The talk highlights the ongoing development and application of AI foundational models in critical areas like healthcare and responsible AI development, showing IBM's continued investment in these areas.
MBZUAI researchers developed Human-in-the-Loop for Prognosis (HuLP), a new AI system designed to help physicians assess cancer progression by providing information about its predictions and allowing user intervention. The system aims to foster collaboration between physicians and AI, rather than replacing doctors. It was presented at the 27th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI). Why it matters: This research highlights the potential of AI to augment physician expertise in critical areas like cancer prognosis, improving patient care and treatment decisions.