Large language model K2-65B launches globally, setting a new standard for sustainable performance

Summary

MBZUAI, Petuum, and LLM360 have launched K2-65B, an open-source 65B parameter LLM, trained on 1.4T tokens using 480 A100 GPUs. K2-65B outperforms Llama 2 70B while using 35% fewer resources, emphasizing sustainable AI development. The model and its chat variant, K2-Chat, excel in math, coding, medicine, and human-like response generation, with the model available under the Apache 2.0 license. Why it matters: This launch highlights the UAE's increasing capabilities in developing efficient and high-performing LLMs, promoting open-source collaboration and setting new standards for sustainable AI practices in the region.