Technology Innovation Institute (TII) won the UAE AI Award for Emirati AI Solutions for its Falcon LLM series. AI71 also won for LAW71, an AI-powered legal solution, and RAZI71, an AI-powered healthcare solution. The award recognizes AI innovations made in the UAE that demonstrate innovation, AI ethics compliance, maturity, and scalability. Why it matters: The award highlights the UAE's commitment to developing local AI talent and solutions, particularly in open-source models, for global collaboration and positive transformation.
Technology Innovation Institute (TII) and AI71 are collaborating with Amazon Web Services (AWS) to expand global access to TII’s Falcon models and AI71’s enterprise AI products. TII already offers Falcon LLMs through Amazon SageMaker, and new models will be available via Amazon Bedrock. AI71’s products are already available in the AWS Marketplace, providing access for millions of customers globally. Why it matters: This partnership enhances the accessibility of UAE-developed AI technologies and strengthens the UAE's position as a leader in AI innovation by leveraging AWS's global infrastructure and customer base.
H.E. Faisal Al Bannai, Secretary General of the Advanced Technology Research Council (ATRC), has been named one of TIME's 100 most influential people in AI. Al Bannai's leadership at ATRC has driven AI advancements through the Falcon LLM series developed by TII and the launch of AI71, which delivers AI solutions across sectors like medicine and education. This recognition reflects the UAE’s commitment to using AI for global good. Why it matters: The award highlights the UAE's growing prominence and strategic vision in shaping the global AI landscape, particularly through open-source initiatives.
The Technology Innovation Institute (TII) in Abu Dhabi has launched Falcon LLM, a 40 billion parameter large language model (LLM). Developed by the AI and Digital Science Research Center (AIDRC), Falcon LLM outperforms GPT-3 while using less training compute. The model was trained on one trillion tokens and will impact fields like education and healthcare. Why it matters: This release establishes the UAE as a major player in generative AI and supports the nation's AI strategy.
This paper introduces SimulMask, a new paradigm for fine-tuning large language models (LLMs) for simultaneous translation. SimulMask utilizes a novel attention masking approach that models simultaneous translation during fine-tuning by masking attention for a desired decision policy. Applied to a Falcon LLM on the IWSLT 2017 dataset, SimulMask achieves improved translation quality compared to state-of-the-art prompting optimization strategies across five language pairs while reducing computational cost. Why it matters: The proposed method offers a more efficient way to adapt LLMs for real-time translation, potentially enhancing multilingual communication tools and services.
The paper introduces Sparse-Quantized Representation (SpQR), a new compression format and quantization technique for large language models (LLMs). SpQR identifies outlier weights and stores them in higher precision while compressing the remaining weights to 3-4 bits. The method achieves less than 1% accuracy loss in perplexity for LLaMA and Falcon LLMs and enables a 33B parameter LLM to run on a single 24GB consumer GPU. Why it matters: This enables near-lossless compression of LLMs, making powerful models accessible on resource-constrained devices and accelerating inference without significant accuracy degradation.
Technology Innovation Institute (TII) will host the inaugural Open Source AI Summit Abu Dhabi on November 26-27, convening AI scientists and industry experts from Meta, Google DeepMind, Oxford, Tsinghua, and local institutions to discuss open-source AI. Key topics include AI accessibility, safety, ethics, governance, compute power, and international alliances. TII was among the first to open source a LLM with Falcon 40B in May 2023. Why it matters: The summit highlights the UAE's growing role in shaping the global conversation around open and responsible AI development.
Technology Innovation Institute (TII) has appointed Dr. Hakim Hacid as Chief Researcher of its AI and Digital Science Research Center (AIDRC), the home of the Falcon LLM series. Dr. Hacid previously served as Executive Director and Acting Chief Researcher at TII, after joining in 2022 from Zayed University. He brings expertise in AI, ML, data science, and information retrieval, with prior experience at Bell Labs and Macquarie University. Why it matters: The appointment strengthens TII's leadership in AI research and development, particularly for the Falcon series of open-source LLMs that have gained global recognition.