Technology Innovation Institute (TII) in Abu Dhabi, in collaboration with LightOn, has launched NOOR, a 10 billion parameter Arabic natural language processing (NLP) model. The model was trained on a large, high-quality cross-domain Arabic dataset including web data, books, poetry, news, and technical information. It enables applications in automated summarization, chatbots, and personalized marketing. Why it matters: NOOR represents a significant advancement in Arabic NLP, potentially enabling more sophisticated AI applications tailored to the Arabic language and regional needs.
TII and LightOn have partnered to build the NOOR Platform for exascale computing, aimed at developing foundation models. The collaboration will leverage LightOn's expertise in large language models, with the first output being the largest Arabic language model to date. The platform will provide high-quality data pipelines and facilitate extreme-scale distributed training and serving. Why it matters: This partnership aims to establish Abu Dhabi as a center of AI excellence and boost the UAE's ambitions in high-tech innovation and NLP research.
The Technology Innovation Institute (TII) in Abu Dhabi has launched Falcon LLM, a 40 billion parameter large language model (LLM). Developed by the AI and Digital Science Research Center (AIDRC), Falcon LLM outperforms GPT-3 while using less training compute. The model was trained on one trillion tokens and will impact fields like education and healthcare. Why it matters: This release establishes the UAE as a major player in generative AI and supports the nation's AI strategy.
Abu Dhabi’s Technology Innovation Institute (TII) has launched Falcon-H1 Arabic, a new large language model based on a hybrid Mamba-Transformer architecture. The Falcon-H1 family comes in 3B, 7B, and 34B parameter sizes and outperforms existing models on the Open Arabic LLM Leaderboard (OALL). The model features improvements in data quality, dialect coverage, and long-context stability. Why it matters: This release strengthens the UAE's position in Arabic AI and provides a high-performing model tailored to the linguistic and cultural needs of the region.
The Technology Innovation Institute (TII) in Abu Dhabi has launched Falcon 40B, a 40-billion parameter large language model, as open source for research and commercial use. Falcon 40B was trained on one trillion tokens. TII is offering access to the model's weights and compute power for selected research proposals via VentureOne. Why it matters: This open-source release with commercial licensing disrupts LLM access in the region, fostering AI innovation and enabling diverse applications across sectors.