Skip to content
GCC AI Research

Breathing life into the AI operating system

MBZUAI · Notable

Summary

MBZUAI faculty Eric Xing and Qirong Ho are developing AI operating systems (AI OS) for efficient AI development, similar to mobile OS. They co-founded AI startup Petuum and lead the CASL community, which focuses on composable, automatic, and scalable learning. CASL provides a unified toolkit for distributed training and compositional model construction, with contributions from MBZUAI, CMU, Berkeley, and Stanford. Why it matters: The development of AI OS aims to optimize AI applications by efficiently connecting software and hardware, fostering innovation and broader adoption of AI solutions across industries in the region.

Get the weekly digest

Top AI stories from the GCC region, every week.

Related

Mass production of AI solutions

MBZUAI ·

MBZUAI Assistant Professor Qirong Ho is researching AI operating systems to standardize algorithms and enable non-experts to create AI applications reliably. He emphasizes that countries mastering mass production of AI systems will benefit most from the Fourth Industrial Revolution. Ho is co-founder and CTO at Petuum Inc., an AI startup creating standardized building blocks for affordable and scalable AI production. Why it matters: This research aims to democratize AI development and promote widespread adoption across industries in the UAE and beyond.

Climate conscious computing

MBZUAI ·

MBZUAI's Qirong Ho and colleagues are developing an Artificial Intelligence Operating System (AIOS) for decarbonization, aiming to reduce energy waste in AI development. The AIOS focuses on improving communication efficiency between machines during AI model training, as inefficient communication leads to prolonged tasks and increased energy consumption. This system addresses the high computing power demands of large language models like ChatGPT and LLaMA-2. Why it matters: By optimizing energy usage in AI development, the AIOS could significantly reduce the carbon footprint of AI technologies in the region and globally.

Sustainable AI at scale

MBZUAI ·

MBZUAI is developing the AI Operating System (AIOS) to reduce the energy, time, and talent costs of AI computing. AIOS aims to make AI models smaller, faster, and more efficient, reducing reliance on expensive hardware and speeding up compute operations. It also enables cost-aware model tuning and standardizes AI modules for reliable operation. Why it matters: By addressing the environmental impact and resource demands of AI, AIOS could promote more sustainable and accessible AI development in the region and globally.

InfiAgent: A Multi-Tool Agent for AI Operating Systems

MBZUAI ·

InfiAgent is a new agent framework comparable to GPT4-Agent, developed by replicating Codex. It includes InfiCoder, an open-source model for text-to-code, code-to-code, and freeform code-related QA tasks. The framework focuses on data analysis and integrates an LLM with programming capabilities and a sandbox environment for executing Python code. Why it matters: This research demonstrates the potential for advancements in AI operating systems and highlights areas where current models like GPT-4V can be improved, contributing to the broader development of more capable and versatile AI agents.