Nicu Sebe from the University of Trento presented recent work on video generation, focusing on animating objects in a source image using external information like labels, driving videos, or text. He introduced a Learnable Game Engine (LGE) trained from monocular annotated videos, which maintains states of scenes, objects, and agents to render controllable viewpoints. Why it matters: This talk highlights advancements in cross-modal AI, potentially enabling new applications in gaming, simulation, and content creation within the region.
A new content improvement system has been developed to address issues of randomness and incorrectness in text generated by deep learning models like GPT-3. The system uses text mining to identify correct sentences and employs syntactic/semantic generalization to substitute problematic elements. The system can substantially improve the factual correctness and meaningfulness of raw content. Why it matters: Improving the quality of automatically generated content is crucial for ensuring reliability and trustworthiness across various AI applications.
This article discusses retrieval augmentation in text generation, where information retrieved from an external source is used to condition predictions. It references recent work on retrieval-augmented image captioning, showing that model size can be greatly reduced when training data is available through retrieval. The author intends to continue this work focusing on the intersection of retrieval augmentation and in-context learning, and controllable image captioning for language learning materials. Why it matters: This research direction has the potential to improve transfer learning in vision-language models, which could be especially relevant for downstream applications in Arabic NLP and multimodal tasks.
Entrepreneur Alexandru Ionut Budisteanu spoke at KAUST's 2018 Winter Enrichment Program (WEP) about pursuing one's passion to achieve their dreams. Budisteanu shared his journey of creating video games and building an autonomous self-driving car prototype. He emphasized the importance of finding a job or activity that one loves and working with passion. Why it matters: Showcases KAUST's efforts to host inspiring speakers and promote entrepreneurship among students.
Thamar Solorio from the University of Houston presented preliminary work on multimodal representation learning for detecting objectionable content in videos at MBZUAI. The research investigates two multimodal pretraining mechanisms, finding contrastive learning more effective than unimodal representation prediction. The study also assesses the value of common multimodal corpora for this task. Why it matters: This research contributes to the development of AI techniques for content moderation, an important issue for online platforms in the Middle East and globally.
LUMA AI is expanding its presence in Saudi Arabia, establishing its regional headquarters in the Kingdom. The company is partnering with HUMAIN, a Saudi entity, to support the creative industry through AI tools. LUMA AI's technology enables the creation of 3D models from images and videos, catering to the growing demand for digital content in the region. Why it matters: This move signals increasing investment and interest in AI-driven solutions for creative applications within the Saudi Arabian market.
The KAUST community held the opening night of its 2016 Enrichment in the Fall program. The event's theme was "Food for All." Photos from the event were taken by Meres Weche. Why it matters: This community event highlights KAUST's engagement with broader social themes, though the AI relevance is low.