This article discusses the evolution of mobile extended reality (MEX) and its potential to revolutionize urban interaction. It highlights the convergence of augmented and virtual reality technologies for mobile usage. A novel approach to 3D models, characterized as urban situated models or “3D-plus-time” (4D.City), is introduced. Why it matters: The development of MEX and 4D.City could significantly enhance user experience and analog-digital convergence in urban environments, offering new possibilities for human-computer interaction.
The article discusses immersive analytics, which uses VR and AR to visualize data in 3D and embed it into the user's environment, and reviews systems and techniques from the Data Visualisation and Immersive Analytics lab at Monash University. It explores the concept of "embodied sensemaking" and its potential to improve how people work with complex data. Professor Tim Dwyer directs the Data Visualisation and Immersive Analytics Lab at Monash University. Why it matters: Immersive analytics could significantly enhance data comprehension and decision-making across various sectors in the Middle East, where large-scale projects and smart city initiatives generate vast datasets.
KAUST students Daniya Boges and Dr. Corrado Calì developed an AR tool for medical applications, leading to the startup IntraVides. The project was supported by KAUST's Smart Health Initiative, which provided access to AR/VR facilities and seed funding through the KAUST Innovation Fund. The KAUST Entrepreneurship Center also helped incubate the idea from concept to business. Why it matters: This highlights KAUST's role in fostering innovation and entrepreneurship in healthcare through strategic investments in advanced technology and dedicated support programs.
Eyal Ofek of Microsoft Research is researching how to augment users' senses and use scene understanding to create more inclusive workspaces, especially for remote work. His work involves designing applications flexible to changing environments and personalized to each user. Ofek's background includes computer vision, augmented reality, and leading research groups at Microsoft. Why it matters: This research aims to improve remote collaboration and adapt technology to individual user needs, which could enhance productivity and inclusivity in the evolving work landscape of the GCC region.
TII's Secure Systems Research Center (SSRC) in Abu Dhabi has launched a motion capture (MOCAP) facility for testing drones in augmented reality, the first such facility outside the US. SSRC's MOCAP facility will simulate environments like Abu Dhabi city to enable high-precision ground truth for experiments. The facility will allow the modelling and operation of a cloud-based secure autonomous system of drones. Why it matters: This positions the UAE as a leader in drone security research, enabling advanced testing and development of secure drone systems for various critical applications.
This article discusses a talk on "Assistive Augmentation," designing human-computer interfaces to augment human abilities. Examples include 'AiSee' for blind users, 'Prospero' for memory training, and 'MuSS-Bits' for deaf users to feel music. Suranga Nanayakkara from the National University of Singapore will present the talk, highlighting insights from psychology, human-centered machine learning, and design thinking. Why it matters: Such assistive technologies can significantly improve the quality of life for individuals with disabilities and extend human capabilities.
Tetsunari Inamura's talk explores using VR to collect HRI data and tailor assistive robotic functionalities to individual users. He discusses symbol emergence via multimodal interaction, interactive behavior generation through symbol manipulation, and VR for data collection. The talk emphasizes long-term human capability enhancement and avoiding over-reliance on technology. Why it matters: This research promotes independence and growth in human-robot interactions, potentially revolutionizing assistive technologies in the region.
MBZUAI's Dr. Hao Li is working on using AI and 3D telepresence to transform communication, work, and education by replacing physical transportation with virtual teleportation. His research focuses on the intersection of computer graphics, computer vision, and AI, specifically virtual avatar creation and facial performance capture. Li aims to improve communication using AI to achieve what cannot be done in real life. Why it matters: This research has the potential to reduce carbon footprints by enabling remote work and virtual collaboration, while also positioning MBZUAI and the UAE as leaders in AI-driven metaverse technologies.