Researchers at MBZUAI introduce FissionFusion, a hierarchical model merging approach to improve medical image analysis performance. The method uses local and global aggregation of models based on hyperparameter configurations, along with a cyclical learning rate scheduler for efficient model generation. Experiments show FissionFusion outperforms standard model souping by approximately 6% on HAM10000 and CheXpert datasets and improves OOD performance.
Researchers propose a universal anatomical embedding (UAE) framework for medical image analysis to learn appearance, semantic, and cross-modality anatomical embeddings. UAE incorporates semantic embedding learning with prototypical contrastive loss, a fixed-point-based matching strategy, and an iterative approach for cross-modality embedding learning. The framework was evaluated on landmark detection, lesion tracking and CT-MRI registration tasks, outperforming existing state-of-the-art methods.
MBZUAI researchers developed a new approach called Multimodal Optimal Transport via Grounded Retrieval (MOTOR) to improve the accuracy of vision-language models for medical image analysis. MOTOR combines retrieval-augmented generation (RAG) with an optimal transport algorithm to retrieve and rank relevant image and textual data. Testing on two medical datasets showed that MOTOR improved average performance by 6.45%. Why it matters: This technique addresses the challenges of limited specialized medical datasets and computational costs associated with training AI models for medical image interpretation, offering a more efficient and accurate solution.
MBZUAI researchers have developed GeoPixel, a new multimodal model for pixel grounding in remote sensing images. GeoPixel associates individual pixels with object categories, enabling detailed image analysis by linking language to objects at the pixel level. The model was trained on a new dataset and benchmark, outperforming existing systems in precision. Why it matters: This advancement enhances the utility of remote sensing data for critical applications like environmental management and disaster response by providing more granular and accurate image interpretation.
MBZUAI, in partnership with IBM Research, is developing GeoChat+, a vision-language model (VLM) for multi-modal, temporal remote sensing image analysis. GeoChat+ builds on the previous GeoChat model, enhancing capabilities with multi-modal images from various Earth observation systems like Sentinel-1, Sentinel-2, Landsat, and high-resolution imagery. GeoChat+ will integrate data from multiple satellites at different times to detect environmental changes and analyze the impact on soil quality, air quality, and erosion. Why it matters: This advancement promises to revolutionize geographic data analysis, providing detailed reports for high-risk regions and aiding reforestation efforts.
KAUST showcased its smart health technologies at the Global Health Exhibition in Riyadh, including AI-driven tools for autism diagnosis, SkinGPT-4 for dermatological image analysis, and nanobodies for detecting dengue and Zika viruses. They also presented a wirelessly connected smart bandage for monitoring wound parameters. KAUST signed agreements with Saudi partners for research collaborations during the event. Why it matters: KAUST's efforts in smart health innovation are poised to strengthen healthcare systems in Saudi Arabia and beyond, addressing critical medical challenges through advanced technologies.
KAUST alumna Justine Braguy co-founded Thya Technology, an AI startup that automates image and video analysis. The company's platform allows users to upload and label images to generate AI detection models without coding. Thya Technology was born out of a tool developed at KAUST to count plant seeds and won the TAQADAM showcase in 2022. Why it matters: This highlights KAUST's role in fostering AI entrepreneurship and translating research into practical applications, particularly in automating scientific processes.
Dr. Alison Noble from the University of Oxford presented her work on smart medical ultrasound technology at the KAUST Research Open Week, focusing on automated image analysis and deep learning. Her research aims to improve data collection, patient-doctor relations, and accessibility of healthcare. Portable ultrasound technology can increase accessibility for patients in remote areas. Why it matters: AI-enhanced ultrasound has the potential to significantly improve healthcare delivery and diagnostics in Saudi Arabia and the broader region, especially in underserved communities.