The article discusses immersive analytics, which uses VR and AR to visualize data in 3D and embed it into the user's environment, and reviews systems and techniques from the Data Visualisation and Immersive Analytics lab at Monash University. It explores the concept of "embodied sensemaking" and its potential to improve how people work with complex data. Professor Tim Dwyer directs the Data Visualisation and Immersive Analytics Lab at Monash University. Why it matters: Immersive analytics could significantly enhance data comprehension and decision-making across various sectors in the Middle East, where large-scale projects and smart city initiatives generate vast datasets.
This article discusses the evolution of mobile extended reality (MEX) and its potential to revolutionize urban interaction. It highlights the convergence of augmented and virtual reality technologies for mobile usage. A novel approach to 3D models, characterized as urban situated models or “3D-plus-time” (4D.City), is introduced. Why it matters: The development of MEX and 4D.City could significantly enhance user experience and analog-digital convergence in urban environments, offering new possibilities for human-computer interaction.
Tetsunari Inamura's talk explores using VR to collect HRI data and tailor assistive robotic functionalities to individual users. He discusses symbol emergence via multimodal interaction, interactive behavior generation through symbol manipulation, and VR for data collection. The talk emphasizes long-term human capability enhancement and avoiding over-reliance on technology. Why it matters: This research promotes independence and growth in human-robot interactions, potentially revolutionizing assistive technologies in the region.
KAUST alumnus Ronell Sicat (M.S. '10, Ph.D. '15) is developing immersive data visualization tools using augmented and virtual reality (AR/VR). After a postdoc at Harvard, Sicat returned to KAUST as a research scientist in the Visual Computing Center. Sicat developed a tool called DXR to help researchers prototype immersive visualizations. Why it matters: This highlights KAUST's role in fostering talent and innovation in AR/VR, a growing area with applications across various sectors in Saudi Arabia.
Egor Zakharov from ETH Zurich AIT lab will present research on creating controllable and detailed 3D head avatars using data from consumer-grade devices. The presentation will cover high-fidelity image-based facial reconstruction/animation and video-based reconstruction of detailed structures like hairstyles. He will showcase integrating human-centric assets into virtual environments for real-time telepresence and entertainment. Why it matters: This research contributes to advancements in digital human modeling and telepresence, with applications in communication and gaming within the region.
KAUST students Daniya Boges and Dr. Corrado Calì developed an AR tool for medical applications, leading to the startup IntraVides. The project was supported by KAUST's Smart Health Initiative, which provided access to AR/VR facilities and seed funding through the KAUST Innovation Fund. The KAUST Entrepreneurship Center also helped incubate the idea from concept to business. Why it matters: This highlights KAUST's role in fostering innovation and entrepreneurship in healthcare through strategic investments in advanced technology and dedicated support programs.
MBZUAI's Dr. Hao Li is working on using AI and 3D telepresence to transform communication, work, and education by replacing physical transportation with virtual teleportation. His research focuses on the intersection of computer graphics, computer vision, and AI, specifically virtual avatar creation and facial performance capture. Li aims to improve communication using AI to achieve what cannot be done in real life. Why it matters: This research has the potential to reduce carbon footprints by enabling remote work and virtual collaboration, while also positioning MBZUAI and the UAE as leaders in AI-driven metaverse technologies.
Eyal Ofek of Microsoft Research is researching how to augment users' senses and use scene understanding to create more inclusive workspaces, especially for remote work. His work involves designing applications flexible to changing environments and personalized to each user. Ofek's background includes computer vision, augmented reality, and leading research groups at Microsoft. Why it matters: This research aims to improve remote collaboration and adapt technology to individual user needs, which could enhance productivity and inclusivity in the evolving work landscape of the GCC region.