Soufiane Hayou of the National University of Singapore presented a talk at MBZUAI on principled scaling of neural networks. The talk covered leveraging mathematical results to efficiently scale neural networks. He obtained his PhD in statistics in 2021 from Oxford. Why it matters: Understanding neural network scaling is crucial for developing more efficient and powerful AI models in the region.
Axel Sauer from the University of Tübingen presented research on scaling Generative Adversarial Networks (GANs) using pretrained representations. The work explores shaping GANs into causal structures, training them up to 40 times faster, and achieving state-of-the-art image synthesis. The presentation mentions "Counterfactual Generative Networks", "Projected GANs", "StyleGAN-XL”, and “StyleGAN-T". Why it matters: Scaling GANs and improving their training efficiency is crucial for advancing image and video synthesis, with implications for various applications in computer vision, graphics, and robotics.
MBZUAI's AI Quorum launched its second workshop, "Building Ecosystems for AI at Scale," focusing on AI scalability and business applications. The first CASL workshop aims to define steps for organizations to become self-sufficient with AI and explore new use cases. Speakers include MBZUAI faculty and researchers from CMU, Stanford, KAUST, UC Berkeley, and Google. Why it matters: The workshop highlights the UAE's growing role in fostering AI innovation and bridging the gap between academic research and industry applications in the region.
KAUST is hosting a workshop on distributed training in November 2025, led by Professors Peter Richtarik and Marco Canini, focusing on scaling large models like LLMs and ViTs. Richtarik's team recently solved a 75-year-old problem in asynchronous optimization, developing time-optimal stochastic gradient descent algorithms. This research improves the speed and reliability of large model training and supports applications in distributed and federated learning. Why it matters: KAUST's focus on scalable AI and federated learning contributes to Saudi Arabia's Vision 2030 goals and addresses critical challenges in AI deployment and data privacy.
A new mini-batch strategy using aggregated relational data is proposed to fit the mixed membership stochastic blockmodel (MMSB) to large networks. The method uses nodal information and stochastic gradients of bipartite graphs for scalable inference. The approach was applied to a citation network with over two million nodes and 25 million edges, capturing explainable structure. Why it matters: This research enables more efficient community detection in massive networks, which is crucial for analyzing complex relationships in various domains, but this article has no clear connection to the Middle East.
MBZUAI is developing the AI Operating System (AIOS) to reduce the energy, time, and talent costs of AI computing. AIOS aims to make AI models smaller, faster, and more efficient, reducing reliance on expensive hardware and speeding up compute operations. It also enables cost-aware model tuning and standardizes AI modules for reliable operation. Why it matters: By addressing the environmental impact and resource demands of AI, AIOS could promote more sustainable and accessible AI development in the region and globally.
KAUST representatives participated in COP27 in Sharm El Sheikh, Egypt, engaging in panels, presentations, and exhibits. They promoted KAUST's projects and explored collaborations in areas like carbon capture, food security, and water conservation. KAUST experts engaged with global stakeholders to discuss climate action goals and the need for public-private collaboration. Why it matters: This participation highlights KAUST's commitment to sustainability research and its role in addressing global climate challenges through technological innovation and international partnerships.
KAUST researchers are exploring novel chemical reactors and separation processes using mathematical design, with a focus on time and shape variables to enhance transport, heat transfer, and mass transfer. By aligning design, modeling, and 3D printing, they create customized shapes with great complexity and less material. This approach allows for the creation of bespoke reactors and separation processes tailored to specific applications, improving efficiency and reducing energy consumption. Why it matters: This research demonstrates the potential of advanced manufacturing techniques to revolutionize industrial design in the Middle East's chemical and pharmaceutical sectors.