MBZUAI's Samuel Horváth presented a new framework called Maestro at ICML 2024 for efficiently training machine learning models in federated settings. Maestro identifies and removes redundant components of a model through trainable decomposition to increase efficiency on edge devices. The approach decomposes layers into low-dimensional approximations, discarding unused aspects to reduce model size. Why it matters: This research addresses the challenge of running complex models on resource-constrained devices, crucial for expanding AI applications while preserving data privacy.
KAUST held a research workshop on Optimization and Big Data, gathering researchers to discuss challenges and opportunities in the field. Speakers presented novel optimization algorithms and distributed systems for handling large datasets. The workshop featured 20 speakers from KAUST, global universities, and Microsoft Research. Why it matters: The event highlights KAUST's role as a regional hub for advancing research and development in big data and optimization, crucial for AI and various computational fields.
Holger Pirk from Imperial College London is developing a novel approach to data management system composition called BOSS. The system uses a homoiconic representation of data and code and partial evaluation of queries by components, drawing inspiration from compiler-construction research. BOSS achieves a fully composable design that effectively combines different data models, hardware platforms, and processing engines, enabling features like GPU acceleration and generative data cleaning with minimal overhead. Why it matters: This research on composable database systems can broaden the applicability of data management techniques in the GCC region, enabling more flexible and efficient data processing for various applications.
Ang Chen from the University of Michigan presented a talk at MBZUAI on reducing cloud manageability burdens. The talk covered detecting semantic errors before cloud deployment and curating datasets for automated generation of cloud management programs. He introduced the concept of "cloudless computing" to free tenants from cloud management tasks. Why it matters: This research direction could simplify cloud infrastructure management for businesses in the UAE and beyond, allowing them to focus on core activities.
KAUST is hosting a workshop on distributed training in November 2025, led by Professors Peter Richtarik and Marco Canini, focusing on scaling large models like LLMs and ViTs. Richtarik's team recently solved a 75-year-old problem in asynchronous optimization, developing time-optimal stochastic gradient descent algorithms. This research improves the speed and reliability of large model training and supports applications in distributed and federated learning. Why it matters: KAUST's focus on scalable AI and federated learning contributes to Saudi Arabia's Vision 2030 goals and addresses critical challenges in AI deployment and data privacy.
The paper introduces a novel method for short-term, high-resolution traffic prediction, modeling it as a matrix completion problem solved via block-coordinate descent. An ensemble learning approach is used to capture periodic patterns and reduce training error. The method is validated using both simulated and real-world traffic data from Abu Dhabi, demonstrating superior performance compared to other algorithms.
Eliseo Ferrante from NYU Abu Dhabi presented work on increasing the controllability of swarm robotics systems. The research covers microscopic control via implicit intelligent leaders and macroscopic control via automated generation of swarm behaviors. Grammatical evolution and generative AI methods are used to produce collective behaviors aligned with human specifications. Why it matters: This research enhances the applicability of swarm robotics in real-world scenarios by improving control and coordination, potentially impacting industries like logistics, environmental monitoring, and disaster response in the region.
A KAUST team led by Hossein Fariborzi won second place in the MEMS Design Contest for their "MEMS Resonator for Oscillator, Tunable Filter and Re-Programmable Logic Applications." The device is runtime-reprogrammable, allowing the function of each device in the circuit to be changed during operation. The KAUST team demonstrated that two MEMS resonators could replace over 20 transistors in applications like digital adders, reducing digital circuit complexity. Why it matters: This innovation could significantly reduce power consumption, chip area, and manufacturing costs in microprocessors, advancing the development of energy-efficient microcomputers in the region.