The paper introduces MedPromptX, a clinical decision support system using multimodal large language models (MLLMs), few-shot prompting (FP), and visual grounding (VG) for chest X-ray diagnosis, integrating imagery with EHR data. MedPromptX refines few-shot data dynamically for real-time adjustment to new patient scenarios and narrows the search area in X-ray images. The study introduces MedPromptX-VQA, a new visual question answering dataset, and demonstrates state-of-the-art performance with an 11% improvement in F1-score compared to baselines.
MBZUAI researchers developed FetalCLIP, an AI model trained on 210,000 ultrasound images for fast and reliable interpretation of fetal scans. MBZUAI's President Eric Xing contributed to the General Expression Transformer (GET), an AI foundation model acting as a biological simulator to predict gene behavior. MBZUAI and Carleton University created MedPromptX for quicker disease diagnosis and treatment plans using multimodal AI. Why it matters: These AI advancements from MBZUAI have the potential to revolutionize healthcare in the region and globally, from prenatal care to drug discovery and personalized medicine.
MBZUAI doctoral student Mai A. Shaaban and colleagues developed MedPromptX, a system that analyzes chest X-rays and patient data to aid lung disease diagnoses. MedPromptX uses multimodal large language models with visual grounding and few-shot prompting, trained on a new dataset of 6,000 patient records (MedPromptX-VQA) derived from MIMIC-IV and MIMIC-CXR. The system addresses the challenge of incomplete electronic health records by leveraging the knowledge embedded in large language models to interpret lab results. Why it matters: This research advances AI-driven medical diagnostics by integrating diverse data sources and addressing data gaps, potentially leading to quicker and more accurate diagnoses.