KAUST computer scientist Mohamed Elhoseiny and his VISION CAIR team developed Creative Walk Adversarial Networks (CWAN) for novel art generation. CWAN learns from existing art styles and deviates using 'random walk deviation' methods. Human evaluators preferred CWAN-generated art compared to other methods like StyleGAN2. Why it matters: The research demonstrates AI's potential as a valuable tool for artists, enabling the creation of unique and meaningful art, and explores more effective emotional language in image captioning.
This paper introduces a method using Stable Diffusion XL (SDXL) fine-tuned with LoRA to generate culturally relevant coloring templates based on Emirati Al-Sadu weaving patterns for mental health therapy. The approach aims to leverage coloring therapy's stress-relieving benefits while embedding cultural resonance, potentially aiding in the treatment of Generalized Anxiety Disorder (GAD). Future research will explore the impact of Emirati heritage art on Emirati individuals using biosignals to assess engagement and effectiveness.
VinAI Research presented research projects focused on advancing image generation and manipulation using GANs and Diffusion Models. The research aims to improve GANs regarding utility, coverage, and output consistency. For Diffusion Models, the work focuses on improving the models’ speed to approach real-time performance and prevent negative social impact of diffusion-based personalized text-to-image generation. Why it matters: This talk indicates ongoing research and development in generative AI in Southeast Asia, an area of growing interest globally.
Nicu Sebe from the University of Trento presented recent work on video generation, focusing on animating objects in a source image using external information like labels, driving videos, or text. He introduced a Learnable Game Engine (LGE) trained from monocular annotated videos, which maintains states of scenes, objects, and agents to render controllable viewpoints. Why it matters: This talk highlights advancements in cross-modal AI, potentially enabling new applications in gaming, simulation, and content creation within the region.
Dr. James She from Hamad Bin Khalifa University will give a talk on AI for Art, Culture and Heritage, covering history, trends, opportunities, and potential impacts in the Gulf region. His research focuses on AI and multimedia technologies for art, media, culture, and human creativity, with recent artworks using AI for cultural or heritage content in Arabic regions. He was also a visiting artist-in-residency at Fire Station Museum, Qatar Museums in 2020-2021. Why it matters: This lecture highlights the growing interest and applications of AI in preserving and promoting cultural heritage within the Gulf region, potentially fostering innovation in art and culture.
KAUST held its second annual "Science as Art" competition, sponsored by the KAUST student chapter of the Materials Research Society (MRS). Over 25 KAUST students and postdoctoral fellows participated, showcasing artistic research images from their lab work. The competition aimed to bridge the gap between the scientific community and the general public by presenting science from an artistic point of view. Why it matters: Such initiatives at KAUST can foster interdisciplinary thinking and enhance public engagement with science and technology in Saudi Arabia.
Dr. David Edwards from Harvard University spoke at KAUST about creativity in innovative communities. He believes that we are at the dawn of a grassroots renaissance in the arts, sciences and engineering. Edwards highlighted the importance of learning, experimentation, and production centers in fostering innovation. Why it matters: This talk suggests KAUST is looking to foster a cross-disciplinary culture of innovation, aligning with broader trends in AI and technology development that require diverse skill sets.
Dr. Zeke Xie from HKUST(GZ) presented research on noise initialization and sampling strategies for diffusion models. The talk covered golden noise for text-to-image models, zigzag diffusion sampling, smooth initializations for video diffusion, and leveraging image diffusion for video synthesis. Xie leads the xLeaF Lab, focusing on optimization, inference, and generative AI, with previous experience at Baidu Research. Why it matters: The work addresses core challenges in improving the quality and diversity of generated content from diffusion models, a key area of advancement for AI applications in the region.