From Abu Dhabi to Silicon Valley: MBZUAI students advance computer vision at Meta

Summary

MBZUAI Ph.D. students Muhammad Maaz and Hanoona Rasheed interned at Meta, developing a vision encoder for images and videos. They created PerceptionLM, a multimodal language model, to generate synthetic video-caption data to train the Perception Encoder. The team addressed the challenge of limited labeled video data by building a multimodal language model called PerceptionLM to understand video's spatial and temporal aspects. Why it matters: This highlights MBZUAI's strength in computer vision and provides students opportunities to contribute to cutting-edge research at global tech firms.