Technology Innovation Institute (TII) in the UAE has launched Falcon 180B, an open access large language model with 180 billion parameters trained on 3.5 trillion tokens. Falcon 180B ranks first on the Hugging Face Leaderboard for pretrained LLMs, outperforming Meta's LLaMA 2 and nearing the performance of OpenAI's GPT-4 and Google's PaLM 2. The model is available for research and commercial use under the 'Falcon 180B TII License', based upon Apache 2.0. Why it matters: This release strengthens the UAE's position in AI development and promotes open access to advanced AI technology, fostering innovation and collaboration.
TII's Falcon 40B, a 40-billion-parameter open-source AI model, has ranked #1 on Hugging Face's Open LLM Leaderboard, surpassing models like LLaMA and StableLM. The leaderboard uses benchmarks like AI2 Reasoning Challenge, HellaSwag, MMLU, and TruthfulQA. Trained on one trillion tokens, Falcon 40B's weights are available for research and commercial use. Why it matters: This achievement positions the UAE as a leader in generative AI and promotes transparent, inclusive AI development.
TII in Abu Dhabi has launched Falcon Arabic, the first Arabic language model in the Falcon series, which is now the best-performing Arabic AI model in the region. They also released Falcon H1, a new model designed for performance and portability, outperforming Meta’s LLaMA and Alibaba’s Qwen in the small-to-medium size category. Falcon Arabic is built on Falcon 3-7B and trained on a high-quality native Arabic dataset. Why it matters: These releases strengthen the UAE's position as a leader in Arabic language AI and democratize access to high-performance AI models.
Technology Innovation Institute (TII) has released Falcon Mamba 7B, a new large language model and the first State Space Language Model (SSLM) in its Falcon series. Falcon Mamba 7B is the top-ranked open-source SSLM globally, outperforming Meta's Llama 3.1 8B, Llama 3 8B, and Mistral’s 7B on HuggingFace benchmarks. SSLMs excel at understanding complex, evolving situations and have applications in NLP tasks like machine translation and text summarization. Why it matters: This release strengthens the UAE's position as an AI hub, demonstrating TII's commitment to pioneering research and open-source AI development in the region.
The Technology Innovation Institute (TII) in Abu Dhabi has launched Falcon 2, a new series of large language models including the Falcon 2 11B and Falcon 2 11B VLM. The Falcon 2 11B outperforms Meta’s Llama 3 (8B) and performs on par with Google’s Gemma 7B, as verified by Hugging Face. Falcon 2 11B VLM is TII's first multimodal model with vision-to-language capabilities and is open-source, making it accessible to developers. Why it matters: This release strengthens the UAE's position in AI research and development, providing open-source models that can be deployed on smaller infrastructures and used in diverse sectors.
The Technology Innovation Institute (TII) in the UAE has made its Falcon 40B large language model royalty-free for commercial and research use. Falcon 40B is ranked #1 on Hugging Face's leaderboard for LLMs, outperforming models like LLaMA. The model is now available under the Apache 2.0 license, promoting open access and collaboration in AI. Why it matters: This decision could accelerate AI innovation in the region by providing easier access to a state-of-the-art LLM for both public and private sector applications.
The QU-NLP team presented their approach to the QIAS 2025 shared task on Islamic Inheritance Reasoning, fine-tuning the Fanar-1-9B model using LoRA and integrating it into a RAG pipeline. Their system achieved an accuracy of 0.858 on the final test, outperforming models like GPT 4.5, LLaMA, and Mistral in zero-shot settings. The system particularly excelled in advanced reasoning, achieving 97.6% accuracy. Why it matters: This demonstrates the effectiveness of domain-specific fine-tuning and retrieval augmentation for Arabic LLMs in complex reasoning tasks, even surpassing frontier models.
The authors introduce Nile-Chat, a collection of LLMs (4B, 3x4B-A6B, and 12B) specifically for the Egyptian dialect, capable of understanding and generating text in both Arabic and Latin scripts. A novel language adaptation approach using the Branch-Train-MiX strategy is used to merge script-specialized experts into a single MoE model. Nile-Chat models outperform multilingual and Arabic LLMs like LLaMa, Jais, and ALLaM on newly introduced Egyptian benchmarks, with the 12B model achieving a 14.4% performance gain over Qwen2.5-14B-Instruct on Latin-script benchmarks; all resources are publicly available. Why it matters: This work addresses the overlooked aspect of adapting LLMs to dual-script languages, providing a methodology for creating more inclusive and representative language models in the Arabic-speaking world.