The Hala technical report introduces a family of Arabic-centric instruction and translation models developed using a translate-and-tune pipeline. A strong Arabic-English teacher model is compressed to FP8 and used to create bilingual supervision data. The LFM2-1.2B model is fine-tuned on this data and used to translate English instruction sets into Arabic, creating a million-scale corpus. Why it matters: The release of models, data, evaluation tools, and recipes will accelerate research and development in Arabic NLP, providing valuable resources for the community.
Nanovate, an Arabic AI startup, has secured $1 million in pre-seed funding. The round was led by Hala Ventures, with participation from angel investors. Nanovate plans to use the funds to scale its operations across the GCC region. Why it matters: This investment highlights the growing interest in Arabic-focused AI solutions and the potential for startups to address specific regional needs.
The paper introduces ALLaM, a series of large language models for Arabic and English, designed to support Arabic Language Technologies. The models are trained with language alignment and knowledge transfer in mind, using a decoder-only architecture. ALLaM achieves state-of-the-art results on Arabic benchmarks like MMLU Arabic and Arabic Exams. Why it matters: This work advances Arabic NLP by providing high-performing LLMs and demonstrating effective techniques for cross-lingual transfer learning and alignment with human preferences.
Princess Hala bint Khalid bin Sultan discussed the Khaled bin Sultan Living Oceans Foundation's marine preservation work at KAUST's Enrichment in the Fall program. The foundation focuses on research, education, and communication to preserve marine environments locally, regionally, and globally. Key projects include a five-year research expedition across 15 countries and the Mangroves Program in Jamaican and Bahamian schools. Why it matters: This highlights the ongoing efforts and commitment within Saudi Arabia to address critical environmental challenges in marine ecosystems through research and education.