MBZUAI's Metaverse Center is developing technologies for realistic avatar generation. Hao Li and colleagues presented a novel approach at CVPR 2024, collaborating with ETH Zurich, VinAI Research, and Pinscreen. The technology addresses the challenge of mapping 2D images to 3D avatars, accounting for poses, expressions, and views. Why it matters: Creating realistic and efficient avatar generation could improve user experience and accessibility in virtual environments across the Middle East.
Ekaterina Radionova from Smarter AI (formerly Samsung AI Center) presented an approach to generating lifelike real-time avatars. The work focuses on generating high-quality video with authentic facial features to support online generation. Radionova's master's degree is from Skoltech on Data Science program and Bachelor degree at Moscow Institute of Physics and Technology on Applied Math. Why it matters: Achieving realistic real-time avatars is critical for applications in online communication, entertainment, and virtual reality within the region.
Egor Zakharov from ETH Zurich AIT lab will present research on creating controllable and detailed 3D head avatars using data from consumer-grade devices. The presentation will cover high-fidelity image-based facial reconstruction/animation and video-based reconstruction of detailed structures like hairstyles. He will showcase integrating human-centric assets into virtual environments for real-time telepresence and entertainment. Why it matters: This research contributes to advancements in digital human modeling and telepresence, with applications in communication and gaming within the region.
MBZUAI's Dr. Hao Li is working on using AI and 3D telepresence to transform communication, work, and education by replacing physical transportation with virtual teleportation. His research focuses on the intersection of computer graphics, computer vision, and AI, specifically virtual avatar creation and facial performance capture. Li aims to improve communication using AI to achieve what cannot be done in real life. Why it matters: This research has the potential to reduce carbon footprints by enabling remote work and virtual collaboration, while also positioning MBZUAI and the UAE as leaders in AI-driven metaverse technologies.
MBZUAI welcomes Hao Li, CEO of Pinscreen, as a new faculty member specializing in virtual humans. Li envisions a future where virtual humans facilitate interactions and overcome limitations of physical presence, citing benefits like improved education and remote collaboration. His work focuses on the intersection of computer vision, computer graphics, and machine learning to enable immersive digital experiences. Why it matters: This signals MBZUAI's commitment to advancing research in virtual reality and the metaverse, potentially positioning the UAE as a leader in this emerging field.
MBZUAI has launched a Metaverse Lab led by Hao Li, focusing on integrating computer vision, graphics, and machine learning for metaverse applications. The lab aims to develop AI algorithms for photorealistic virtual humans and dynamic environment digitization. Pinscreen, Li's AI startup, previously created avatars for Expo 2020 Dubai. Why it matters: This initiative positions MBZUAI and the UAE as key players in the development of core technologies underpinning the metaverse and digital communication.
Researchers at MBZUAI developed a method to measure vital signs using webcams by analyzing color intensity changes in facial blood flow. They built a digital twin system that uses machine learning to combine heart rate, respiratory rate, and blood oxygen level measures. The system displays real-time vital sign information, enabling remote patient triage. Why it matters: This research contributes to the advancement of telemedicine, potentially improving healthcare access in underserved regions and aligning with UN Sustainable Development Goal #3.
MBZUAI's Metaverse Lab is developing AI algorithms for photorealistic virtual humans and dynamic environments. Hao Li, Director of the lab, envisions using the metaverse for immersive learning experiences related to history and culture. He is also working on tools to prevent deepfakes and other cyberthreats. Why it matters: This research at MBZUAI aims to advance AI and immersive technologies for education and address potential risks in the metaverse.