Technology Innovation Institute (TII) has released Falcon Mamba 7B, a new large language model and the first State Space Language Model (SSLM) in its Falcon series. Falcon Mamba 7B is the top-ranked open-source SSLM globally, outperforming Meta's Llama 3.1 8B, Llama 3 8B, and Mistral’s 7B on HuggingFace benchmarks. SSLMs excel at understanding complex, evolving situations and have applications in NLP tasks like machine translation and text summarization. Why it matters: This release strengthens the UAE's position as an AI hub, demonstrating TII's commitment to pioneering research and open-source AI development in the region.
Abu Dhabi’s Technology Innovation Institute (TII) has launched Falcon-H1 Arabic, a new large language model based on a hybrid Mamba-Transformer architecture. The Falcon-H1 family comes in 3B, 7B, and 34B parameter sizes and outperforms existing models on the Open Arabic LLM Leaderboard (OALL). The model features improvements in data quality, dialect coverage, and long-context stability. Why it matters: This release strengthens the UAE's position in Arabic AI and provides a high-performing model tailored to the linguistic and cultural needs of the region.
Technology Innovation Institute (TII) in the UAE has launched Falcon 180B, an open access large language model with 180 billion parameters trained on 3.5 trillion tokens. Falcon 180B ranks first on the Hugging Face Leaderboard for pretrained LLMs, outperforming Meta's LLaMA 2 and nearing the performance of OpenAI's GPT-4 and Google's PaLM 2. The model is available for research and commercial use under the 'Falcon 180B TII License', based upon Apache 2.0. Why it matters: This release strengthens the UAE's position in AI development and promotes open access to advanced AI technology, fostering innovation and collaboration.
The Technology Innovation Institute (TII) in Abu Dhabi has launched Falcon LLM, a 40 billion parameter large language model (LLM). Developed by the AI and Digital Science Research Center (AIDRC), Falcon LLM outperforms GPT-3 while using less training compute. The model was trained on one trillion tokens and will impact fields like education and healthcare. Why it matters: This release establishes the UAE as a major player in generative AI and supports the nation's AI strategy.
The Technology Innovation Institute (TII) in Abu Dhabi has launched Falcon 40B, a 40-billion parameter large language model, as open source for research and commercial use. Falcon 40B was trained on one trillion tokens. TII is offering access to the model's weights and compute power for selected research proposals via VentureOne. Why it matters: This open-source release with commercial licensing disrupts LLM access in the region, fostering AI innovation and enabling diverse applications across sectors.