The paper introduces MedPromptX, a clinical decision support system using multimodal large language models (MLLMs), few-shot prompting (FP), and visual grounding (VG) for chest X-ray diagnosis, integrating imagery with EHR data. MedPromptX refines few-shot data dynamically for real-time adjustment to new patient scenarios and narrows the search area in X-ray images. The study introduces MedPromptX-VQA, a new visual question answering dataset, and demonstrates state-of-the-art performance with an 11% improvement in F1-score compared to baselines.
MBZUAI researchers introduce XrayGPT, a conversational medical vision-language model for analyzing chest radiographs and answering open-ended questions. The model aligns a medical visual encoder (MedClip) with a fine-tuned large language model (Vicuna) using a linear transformation. To enhance performance, the LLM was fine-tuned using 217k interactive summaries generated from radiology reports.
Researchers from MBZUAI have developed XReal, a diffusion model for generating realistic chest X-ray images with precise control over anatomy and pathology location. The model utilizes an Anatomy Controller and a Pathology Controller to introduce spatial control in a pre-trained Text-to-Image Diffusion Model without fine-tuning. XReal outperforms existing X-ray diffusion models in realism, as evaluated by quantitative metrics and radiologists' ratings, and the code/weights are available.
This paper introduces Pulmonary Embolism Detection using Contrastive Learning (PECon), a supervised contrastive pretraining strategy using both CT scans and EHR data to improve feature alignment between modalities for better PE diagnosis. PECon pulls sample features of the same class together while pushing away features of other classes. The approach achieves state-of-the-art results on the RadFusion dataset, with an F1-score of 0.913 and AUROC of 0.943.
A KAUST team led by Xin Gao developed an AI model for COVID-19 detection from CT scans, addressing limitations of existing methods. The model incorporates a novel embedding strategy, a CT scan simulator, and a 2.5D deep-learning algorithm. Tested at King Faisal Specialist Hospital, the model demonstrated high accuracy in detecting COVID-19 cases. Why it matters: This research provides a valuable tool for rapid and accurate COVID-19 diagnosis in the region, especially in early-stage infections, improving healthcare outcomes.
Researchers at KAUST have developed a nanocomposite material that converts X-rays into light with nearly 100% efficiency. The material combines a metal-organic framework (MOF) containing zirconium with an organic TADF chromophore. This design achieves high resolution and sensitivity in X-ray imaging, potentially reducing medical imaging doses by a factor of 22. Why it matters: This innovation could lead to more efficient and safer medical imaging and security screening technologies in the region and beyond.