KAUST's Peter Wonka discusses the challenges and advancements in creating data-rich, three-dimensional maps for various applications. His team is working with Boeing on 3D modeling tools for aerospace design. KAUST-funded FalconViz uses UAV drones to create 3D maps of disaster areas for first responders. Why it matters: This highlights KAUST's contribution to cutting-edge 3D modeling and its practical applications in industries like aerospace and disaster response in the region.
KAUST researchers used 3D mapping technology via remote control helicopter to survey and create detailed renderings of Jeddah's Al Balad, a UNESCO World Heritage Site. The team, from KAUST's Visual Computer Center and FalconViz, captured high-definition images from about 50 meters above street level. This enabled the creation of accurate 3D models, showing building shifts and potential problems for urban planners. Why it matters: This method provides a rapid and accurate way to document and preserve historical landmarks, especially in areas where traditional surveying is difficult or infeasible, aiding in cultural heritage preservation efforts.
Pascal Fua from EPFL presented an approach to implementing convolutional neural nets that output complex 3D surface meshes. The method overcomes limitations in converting implicit representations to explicit surface representations. Applications include single view reconstruction, physically-driven shape optimization, and bio-medical image segmentation. Why it matters: This research advances geometric deep learning by enabling end-to-end trainable models for 3D surface mesh generation, with potential impact on various applications in computer vision and biomedical imaging in the region.
Dr. Xiaoming Liu from Michigan State University discussed computer vision techniques for 3D world understanding at a talk hosted by MBZUAI. The talk covered 3D reconstruction, detection, depth estimation, and velocity estimation, with applications in biometrics and autonomous driving. Dr. Liu also touched on anti-spoofing and fair face recognition research at MSU's Computer Vision Lab. Why it matters: Showcasing international experts and research directions helps to catalyze computer vision and 3D understanding research efforts within the UAE's AI ecosystem.
FalconViz, a KAUST-based startup co-founded by alumnus Luca Passone, specializes in 3D surveying and mapping using unmanned aerial systems. Established in 2015, the company offers services such as topographical surveys, mining assessments, and flood modeling to clients in Saudi Arabia and beyond. KAUST provided FalconViz with early funding, training, and ongoing support. Why it matters: The success of FalconViz highlights KAUST's role in fostering technological innovation and entrepreneurship in Saudi Arabia, contributing to the Kingdom's growing technology sector.
MBZUAI researchers have introduced SURPRISE3D, a benchmark for evaluating 3D spatial reasoning in AI systems, along with a 3D Spatial Reasoning Segmentation (3D-SRS) task. The benchmark includes over 900 indoor scenes and 200,000 language queries paired with 3D masks, emphasizing spatial relationships over object naming. A companion paper, MLLM-For3D, explores adapting 2D multimodal LLMs for 3D reasoning. Why it matters: This work addresses a key limitation in current AI, pushing towards embodied AI that can understand and act in 3D environments based on human-like spatial reasoning.
Egor Zakharov from ETH Zurich AIT lab will present research on creating controllable and detailed 3D head avatars using data from consumer-grade devices. The presentation will cover high-fidelity image-based facial reconstruction/animation and video-based reconstruction of detailed structures like hairstyles. He will showcase integrating human-centric assets into virtual environments for real-time telepresence and entertainment. Why it matters: This research contributes to advancements in digital human modeling and telepresence, with applications in communication and gaming within the region.