Monojit Choudhury, formerly of Microsoft Research and Project Turing, has joined MBZUAI as a professor of natural language processing. Choudhury's work at Microsoft involved developing NLP applications and responsible AI, including manually programming LLMs to prevent toxic or biased content. He was impressed by GPT-4's capabilities and believes academia is the best place for deep research in NLP. Why it matters: Choudhury's experience at Microsoft, including his work on responsible AI and LLMs, could contribute to MBZUAI's NLP research and the development of more inclusive LLMs.
Researchers from MBZUAI, University of Washington, and other institutions presented studies at EMNLP 2024 exploring how LLMs represent cultures. A survey analyzed dozens of recent studies on LLMs and culture and proposes a new framework for future research. The survey found that there is no widely accepted definition of 'culture' in NLP, making it challenging to interpret how models represent culture through language. Why it matters: This highlights a key gap in the field and emphasizes the need for a more rigorous and consistent understanding of culture in AI, especially as LLMs become more globally integrated.
MBZUAI has been actively involved in developing AI and generative models, contributing to models like Llama 2, Jais, Vicuna, and LaMini. Professor Preslav Nakov notes Llama 2's improvements in size and carbon footprint over Llama 1. MBZUAI aims to tackle challenges like information accuracy, economic costs, and the scarcity of Arabic online content. Why it matters: MBZUAI's work helps address the limitations of current LLMs, particularly for Arabic, and promotes sustainable AI development in the region.
MBZUAI Professor Timothy Baldwin reflects on his decision to move from the University of Melbourne to help build MBZUAI. He emphasizes the importance of inclusive AI education to ensure the benefits of AI are shared globally. Baldwin notes the concentration of AI innovation in a few countries, leading to disparities in language model performance for non-dominant languages. Why it matters: The article highlights MBZUAI's role in addressing the global imbalance in AI development and promoting inclusivity in AI education and research, particularly for Arabic and other underrepresented languages.
MBZUAI is prioritizing natural language processing (NLP) research, aiming to be a top university in the field within 12-18 months according to Professor Timothy Baldwin. MBZUAI's NLP department is focusing on deep learning, algorithmic fairness, computational social science and social media analytics. A key area is Arabic NLP, addressing the challenges of dialectal variations and code-switching in social media. Why it matters: This focus on Arabic NLP and real-world problem-solving will contribute to the UAE's ambitious agenda of growing a local AI industry and integrating AI into various sectors.