MBZUAI's Dr. Hao Li is working on using AI and 3D telepresence to transform communication, work, and education by replacing physical transportation with virtual teleportation. His research focuses on the intersection of computer graphics, computer vision, and AI, specifically virtual avatar creation and facial performance capture. Li aims to improve communication using AI to achieve what cannot be done in real life. Why it matters: This research has the potential to reduce carbon footprints by enabling remote work and virtual collaboration, while also positioning MBZUAI and the UAE as leaders in AI-driven metaverse technologies.
MBZUAI researchers are working on digital twin technology that can replicate human beings in detail, with real-time data flow between the physical and virtual. This project aims to extend digital twins from objects to organic entities like humans, plants and animals. The technology mines data from cameras, sensors, wearables, and other sources to predict health issues before they arise. Why it matters: This research has the potential to transform healthcare by enabling the prediction and prevention of health issues.
TII's Secure Systems Research Center (SSRC) in Abu Dhabi has launched a motion capture (MOCAP) facility for testing drones in augmented reality, the first such facility outside the US. SSRC's MOCAP facility will simulate environments like Abu Dhabi city to enable high-precision ground truth for experiments. The facility will allow the modelling and operation of a cloud-based secure autonomous system of drones. Why it matters: This positions the UAE as a leader in drone security research, enabling advanced testing and development of secure drone systems for various critical applications.
KAUST has launched vFabLab™, its first virtual lab, to provide online distance learning for semiconductor fabrication. The virtual environment trains users on end-to-end device fabrication sequences using CMOS technology. Developed by KAUST's CEMSE division, each training session includes an interactive Q&A. Why it matters: This virtual lab expands access to crucial experimental modules in semiconductor fabrication, particularly benefiting students and enthusiasts lacking access to expensive cleanroom facilities in the region.
MBZUAI's Metaverse Lab is developing AI algorithms for photorealistic virtual humans and dynamic environments. Hao Li, Director of the lab, envisions using the metaverse for immersive learning experiences related to history and culture. He is also working on tools to prevent deepfakes and other cyberthreats. Why it matters: This research at MBZUAI aims to advance AI and immersive technologies for education and address potential risks in the metaverse.
The paper introduces OmniGen, a unified framework for generating aligned multimodal sensor data for autonomous driving using a shared Bird's Eye View (BEV) space. It uses a novel generalizable multimodal reconstruction method (UAE) to jointly decode LiDAR and multi-view camera data through volume rendering. The framework incorporates a Diffusion Transformer (DiT) with a ControlNet branch to enable controllable multimodal sensor generation, demonstrating good performance and multimodal consistency.