This study investigates methods to steer Arabic Large Language Models (LLMs) towards generating specific dialects, addressing the challenge of data scarcity for dialectal Arabic. Researchers identified sparse neuron populations encoding dialect-specific features and developed a vector-steering approach using dialect-specific activation directions. These inference-time methods allow for controlling dialectal output by amplifying or suppressing neuron activity or injecting specific vectors. Why it matters: This research offers a principled, interpretability-grounded framework to improve dialectal accuracy in Arabic LLMs without fine-tuning, crucial for enhancing their utility in the diverse Arabic-speaking world.
MBZUAI researchers developed FeSViBS, a new federated split learning technique for vision transformers that addresses data scarcity and privacy concerns in healthcare image classification. The method combines federated learning and split learning to train models collaboratively without sharing sensitive patient data directly. It overcomes limitations of traditional centralized training and vulnerabilities in federated learning. Why it matters: This approach enables the development of AI-powered healthcare applications while adhering to stringent data privacy regulations, unlocking the potential of machine learning in medical imaging.
AI models frequently encounter significant challenges in accurately processing and interpreting the Arabic language, leading to misinterpretations in various applications. These difficulties stem from Arabic's complex morphology, diverse dialects, and the relative scarcity of high-quality, comprehensive datasets for training. The article highlights how such linguistic nuances can cause AI systems to confuse similar words or fail to grasp contextual meanings, impacting their effectiveness. Why it matters: This underscores a fundamental obstacle for advancing robust and culturally relevant AI solutions tailored for the Arabic-speaking world, emphasizing the urgent need for dedicated research and data initiatives.
Researchers at the Rosalind Franklin Institute are using generative AI, including GANs, to augment limited biological datasets, specifically mirtron data from mirtronDB. The synthetic data created mimics real-world samples, facilitating more comprehensive training of machine learning models, leading to improved mirtron identification tools. They also plan to apply Large Language Models (LLMs) to predict unknown patterns in sequence and structure biology problems. Why it matters: This research explores AI techniques to tackle data scarcity in biological research, potentially accelerating discoveries in noncoding RNA and transposable elements.
Thamar Solorio from the University of Houston will discuss machine learning approaches for spontaneous human language processing. The talk will cover adapting multilingual transformers to code-switching data and using data augmentation for domain adaptation in sequence labeling tasks. Solorio will also provide an overview of other research projects at the RiTUAL lab, focusing on the scarcity of labeled data. Why it matters: This presentation addresses key challenges in Arabic NLP related to data scarcity, which is a persistent obstacle in developing effective AI applications for the region.
Pascal Fua from EPFL gave a talk at MBZUAI on physics-based deep learning for medical imaging. The talk covered how self-supervision and knowledge of human anatomy and physics can improve deep learning algorithms when training data is limited. Applications discussed included endoscopic heart surgery, colonoscopy, and intubation. Why it matters: This highlights the growing importance of domain knowledge and self-supervision in overcoming data scarcity challenges for AI in healthcare applications within the region.
Dr. Hao Dong from Peking University presented research on addressing the challenge of limited large-scale training data in embodied AI, particularly for manipulation, task planning, and navigation. The presentation covered simulation learning and large models. Dr. Dong is a chief scientist of China's National Key Research and Development Program and an area chair/associate editor for NeurIPS, CVPR, AAAI, and ICRA. Why it matters: Overcoming data scarcity is crucial for advancing embodied AI research and enabling more sophisticated robotic applications in the region.
Michael Kampffmeyer from UiT The Arctic University of Norway presented a talk at MBZUAI on representation learning for deep clustering and few-shot learning. The talk covered deep clustering in multi-view settings and the influence of geometrical representation properties on few-shot classification performance. He specifically discussed embedding representations on the hypersphere and its connection to the hubness phenomenon. Why it matters: This highlights MBZUAI's role in hosting discussions on advanced machine learning topics like few-shot learning, which are crucial for addressing data scarcity challenges in the region and beyond.