Abu Dhabi-based Technology Innovation Institute Introduces Falcon LLM: Foundational Large Language Model (LLM) outperforms GPT-3 with 40 Billion Parameters
The Technology Innovation Institute (TII) in Abu Dhabi has launched Falcon LLM, a 40 billion parameter large language model (LLM). Developed by the AI and Digital Science Research Center (AIDRC), Falcon LLM outperforms GPT-3 while using less training compute. The model was trained on one trillion tokens and will impact fields like education and healthcare. Why it matters: This release establishes the UAE as a major player in generative AI and supports the nation's AI strategy.
The Technology Innovation Institute (TII) in Abu Dhabi has launched Falcon 40B, a 40-billion parameter large language model, as open source for research and commercial use. Falcon 40B was trained on one trillion tokens. TII is offering access to the model's weights and compute power for selected research proposals via VentureOne. Why it matters: This open-source release with commercial licensing disrupts LLM access in the region, fostering AI innovation and enabling diverse applications across sectors.
Technology Innovation Institute (TII) in the UAE has launched Falcon 180B, an open access large language model with 180 billion parameters trained on 3.5 trillion tokens. Falcon 180B ranks first on the Hugging Face Leaderboard for pretrained LLMs, outperforming Meta's LLaMA 2 and nearing the performance of OpenAI's GPT-4 and Google's PaLM 2. The model is available for research and commercial use under the 'Falcon 180B TII License', based upon Apache 2.0. Why it matters: This release strengthens the UAE's position in AI development and promotes open access to advanced AI technology, fostering innovation and collaboration.
The Technology Innovation Institute (TII) in Abu Dhabi has launched Falcon 2, a new series of large language models including the Falcon 2 11B and Falcon 2 11B VLM. The Falcon 2 11B outperforms Meta’s Llama 3 (8B) and performs on par with Google’s Gemma 7B, as verified by Hugging Face. Falcon 2 11B VLM is TII's first multimodal model with vision-to-language capabilities and is open-source, making it accessible to developers. Why it matters: This release strengthens the UAE's position in AI research and development, providing open-source models that can be deployed on smaller infrastructures and used in diverse sectors.
The Technology Innovation Institute (TII) in Abu Dhabi has launched Falcon 3, a new series of open-source large language models. Falcon 3 models range in size from 1B to 10B parameters and have been trained on 14 trillion tokens. Falcon 3 achieved the top spot on Hugging Face's LLM leaderboard for models under 13 billion parameters. Why it matters: This release democratizes access to high-performance AI by enabling efficient operation on laptops and light infrastructure, solidifying the UAE's position as a leader in open-source AI development.