Skip to content
GCC AI Research

UAE’s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture

TII · · Significant research

LLM Research Product Arabic AI UAE

Summary

Technology Innovation Institute (TII) has released Falcon Mamba 7B, a new large language model and the first State Space Language Model (SSLM) in its Falcon series. Falcon Mamba 7B is the top-ranked open-source SSLM globally, outperforming Meta's Llama 3.1 8B, Llama 3 8B, and Mistral’s 7B on HuggingFace benchmarks. SSLMs excel at understanding complex, evolving situations and have applications in NLP tasks like machine translation and text summarization. Why it matters: This release strengthens the UAE's position as an AI hub, demonstrating TII's commitment to pioneering research and open-source AI development in the region.

Keywords

Falcon Mamba 7B · TII · SSLM · LLM · Hugging Face

Read original article →

Get the weekly digest

Top AI stories from the GCC region, every week.

Related

Abu Dhabi’s TII Launches Falcon-H1 Arabic, Establishing the World’s Leading Arabic AI Model

TII ·

Abu Dhabi’s Technology Innovation Institute (TII) has launched Falcon-H1 Arabic, a new large language model based on a hybrid Mamba-Transformer architecture. The Falcon-H1 family comes in 3B, 7B, and 34B parameter sizes and outperforms existing models on the Open Arabic LLM Leaderboard (OALL). The model features improvements in data quality, dialect coverage, and long-context stability. Why it matters: This release strengthens the UAE's position in Arabic AI and provides a high-performing model tailored to the linguistic and cultural needs of the region.

Abu Dhabi-based Technology Innovation Institute Introduces Falcon LLM: Foundational Large Language Model (LLM) outperforms GPT-3 with 40 Billion Parameters

TII ·

The Technology Innovation Institute (TII) in Abu Dhabi has launched Falcon LLM, a 40 billion parameter large language model (LLM). Developed by the AI and Digital Science Research Center (AIDRC), Falcon LLM outperforms GPT-3 while using less training compute. The model was trained on one trillion tokens and will impact fields like education and healthcare. Why it matters: This release establishes the UAE as a major player in generative AI and supports the nation's AI strategy.