MBZUAI, Petuum, and LLM360 have launched K2-65B, an open-source 65B parameter LLM, trained on 1.4T tokens using 480 A100 GPUs. K2-65B outperforms Llama 2 70B while using 35% fewer resources, emphasizing sustainable AI development. The model and its chat variant, K2-Chat, excel in math, coding, medicine, and human-like response generation, with the model available under the Apache 2.0 license. Why it matters: This launch highlights the UAE's increasing capabilities in developing efficient and high-performing LLMs, promoting open-source collaboration and setting new standards for sustainable AI practices in the region.
Researchers from MBZUAI, UC Berkeley, CMU, Stanford, and UC San Diego collaborated to create Vicuna, an open-source chatbot that costs $300 to train, unlike ChatGPT which costs over $4 million. Vicuna achieves 90% of ChatGPT's subjective language quality while being far more energy-efficient and can run on a single GPU. It was fine-tuned from Meta AI’s LLaMA model using user-shared conversations and has gained significant traction on GitHub. Why it matters: This research demonstrates that high-quality chatbots can be developed at a fraction of the cost and environmental impact, opening up new possibilities for sustainable AI development in the region.
MBZUAI President Eric Xing led a global collaboration to develop Vicuna, an LLM alternative to GPT-3 addressing the unsustainable costs of training LLMs. OpenAI CEO Sam Altman acknowledged Abu Dhabi's role in the global AI conversation, building off of achievements like Vicuna. Xing and colleagues are publishing research at MLSys 2023 on "cross-mesh resharding" to improve computer communication in deep learning, aiming for low-carbon, affordable, and miniaturized AI. Why it matters: This research signals a push towards sustainable AI development in the region, emphasizing efficiency and reduced environmental impact.
The article likely explores the growing link between artificial intelligence development and global energy consumption. It probably examines how the substantial power demands of AI infrastructure, particularly data centers, pose challenges to energy security for nations. The piece likely discusses policy considerations and strategic investments required to ensure sustainable AI growth alongside energy stability. Why it matters: This analysis is critical for regions like the Middle East, where significant investments in AI necessitate integrated strategies for energy supply and infrastructure.
The article discusses the critical need for UAE banks to address the existing 'AI accountability gap' within their operations. It likely emphasizes the challenges and potential risks that arise from deploying artificial intelligence systems without clear frameworks for responsibility. The analysis suggests that establishing robust governance mechanisms is essential for mitigating these risks and ensuring the ethical adoption of AI in the financial sector. Why it matters: Closing this accountability gap is crucial for maintaining public trust, ensuring regulatory compliance, and promoting responsible and sustainable AI innovation across the UAE's vital banking industry.
The Technology Innovation Institute (TII) in Abu Dhabi inaugurated the Open-Source AI Summit, gathering over 300 international AI experts, including representatives from Meta and Google DeepMind. Discussions centered on ethical considerations in AI ownership, sustainable AI computing innovations, and compute power challenges. TII leadership emphasized the importance of open-source models like Falcon AI for fostering collaborative innovation and global access. Why it matters: The summit highlights the UAE's commitment to shaping the global AI agenda by promoting open-source AI development and addressing critical governance and ethical issues.
Professor Mérouane Debbah, Chief Researcher at AIDRC, and his co-authors received the 2022 IEEE TAOS TC Best GCSN Paper Award for their work on federated quantized neural networks. The paper, presented at IEEE ICC 2022, explores the tradeoff between energy, precision, and accuracy in these networks. The research proposes an optimal quantization level to minimize energy consumption during training, making it less prohibitive for mobile devices. Why it matters: The award recognizes work that reduces the carbon footprint of large-scale AI systems, a key challenge for sustainable AI deployment in the region and globally.
MBZUAI's Prof. Mérouane Debbah will receive two awards at the 2022 IEEE ICC in Seoul. One paper analyzes reconfigurable intelligent surfaces (RISs) for 6G, highlighting spectral efficiency gains. The other paper explores energy-efficient distributed AI algorithms using quantized neural networks. Why it matters: This recognition highlights MBZUAI's contributions to cutting-edge research in wireless communications and sustainable AI, positioning the institute as a leader in these fields.