MBZUAI Assistant Professor Qirong Ho is researching AI operating systems to standardize algorithms and enable non-experts to create AI applications reliably. He emphasizes that countries mastering mass production of AI systems will benefit most from the Fourth Industrial Revolution. Ho is co-founder and CTO at Petuum Inc., an AI startup creating standardized building blocks for affordable and scalable AI production. Why it matters: This research aims to democratize AI development and promote widespread adoption across industries in the UAE and beyond.
Qirong Ho, co-founder and CTO of Petuum Inc., will be contributing to the "ML Systems for Many" initiative. Petuum is recognized for creating standardized building blocks for AI assembly. Ho also holds a Ph.D. from Carnegie Mellon University and is part of the CASL open-source consortium. Why it matters: Showcases the ongoing efforts to democratize AI development and deployment, making it more accessible and sustainable, although the specific initiative is not further detailed.
A presentation discusses using programmable network devices to reduce communication bottlenecks in distributed deep learning. It explores in-network aggregation and data processing to lower memory needs and increase bandwidth usage. The talk also covers gradient compression and the potential role of programmable NICs. Why it matters: Optimizing distributed deep learning infrastructure is critical for scaling AI model training in resource-constrained environments.
MBZUAI's Qirong Ho and colleagues are developing an Artificial Intelligence Operating System (AIOS) for decarbonization, aiming to reduce energy waste in AI development. The AIOS focuses on improving communication efficiency between machines during AI model training, as inefficient communication leads to prolonged tasks and increased energy consumption. This system addresses the high computing power demands of large language models like ChatGPT and LLaMA-2. Why it matters: By optimizing energy usage in AI development, the AIOS could significantly reduce the carbon footprint of AI technologies in the region and globally.
Abdulrahman Mahmoud, a postdoctoral fellow at Harvard University, discusses software-directed tools and techniques for processor design and reliability enhancement in ML systems. He emphasizes the need for a nuanced approach to numerical data formats supported by robust hardware. He advocates for integrating reliability as a foundational element in the design process. Why it matters: This research addresses the critical challenge of hardware reliability in AI processors, particularly relevant as the field moves towards hardware-software co-design for sustained growth.
MBZUAI is hosting a talk by Professor Eric Xing on the challenges of moving from performance-oriented AI to production and industrial AI. The talk will cover theoretical foundations for panoramic learning, compositional strategies for building Pan-ML programs, optimization methods for tuning systems, and systems frameworks for scaling ML production. Professor Xing was previously a professor at Carnegie Mellon University and the founder of Petuum Inc. Why it matters: Bridging the gap between academic AI and real-world industrial applications is critical for unlocking the economic potential of AI in the UAE and beyond.
MBZUAI is developing the AI Operating System (AIOS) to reduce the energy, time, and talent costs of AI computing. AIOS aims to make AI models smaller, faster, and more efficient, reducing reliance on expensive hardware and speeding up compute operations. It also enables cost-aware model tuning and standardizes AI modules for reliable operation. Why it matters: By addressing the environmental impact and resource demands of AI, AIOS could promote more sustainable and accessible AI development in the region and globally.
Machine learning (ML) algorithms use data to make decisions or predictions, improving over time as more data is provided. ML is a subset of AI, focused on models that learn from data, contrasting with rule-based systems. ML is superior in scenarios where rules are not exhaustive, such as medical scans, but rule-based systems and ML often complement each other. Why it matters: This overview clarifies the role of machine learning within the broader field of AI, highlighting its data-driven approach and its advantages over traditional rule-based systems in complex decision-making scenarios.