Researchers at MBZUAI introduce "Interactive Video Reasoning," a new paradigm enabling models to actively "think with videos" by performing iterative visual actions to gather and refine evidence. They developed Video CoM, which reasons through a Chain of Manipulations (CoM), and constructed Video CoM Instruct, an 18K instruction tuning dataset for multi-step manipulation reasoning. The model is further optimized via reinforcement learning with reasoning aware Group Relative Policy Optimization (GRPO), achieving strong results across nine video reasoning benchmarks.
MBZUAI Professor Sami Haddadin and his team developed a new framework called Tactile Skills to teach robots manual skills through touch and trial and error. This framework aims to address the gap in robots' ability to learn basic physical tasks compared to AI's advancements in language and image generation. The research, published in Nature Machine Intelligence, focuses on enabling robots to perform manipulation skills at industrial levels with low energy and compute demands. Why it matters: This research could lead to robots capable of performing household maintenance, industrial tasks, and even assisting in medical or rehabilitation settings, potentially solving labor shortages in various sectors in the region and beyond.
A KAUST team developed piRNAi, a gene-silencing tool in nematode worms using synthetic RNA sequences interacting with the piRNA pathway. They successfully silenced genes involved in sex determination and other functions, demonstrating multiplexed gene silencing. The gene silencing lasted for varying durations across generations, up to six generations. Why it matters: This expands the molecular toolkit for gene manipulation and offers potential therapeutic applications in humans, given the presence of the same gene-silencing pathway.
Team NimbRo presented four UAVs tailored for the MBZIRC 2020 challenges, including target chasing, wall building, and fire fighting. The UAVs utilized onboard object detection, aerial manipulation, LiDAR, and thermal cameras to perform their tasks autonomously. The team's software stack, which is mostly open-source, includes tools for system configuration, monitoring, and agile trajectory generation. Why it matters: The work demonstrates advanced robotics capabilities developed in the context of a major regional competition, advancing machine vision and trajectory generation, and showcasing potential applications in various sectors.
The paper examines the performance of pre-trained Arabic language models on Arabic text intentionally stripped of diacritical dots to evade content classification. It proposes methods to support these "undotted" texts without retraining the models. The proposed methods achieve nearly perfect performance on one downstream task. Why it matters: The research highlights a vulnerability in Arabic NLP and offers solutions to maintain performance in the face of adversarial text manipulation.
A Carnegie Mellon team (Tartan) presented their approach to rapidly deployable and robust autonomous aerial vehicles at the 2020 Mohamed Bin Zayed International Robotics Challenge (MBZIRC). The system utilizes common techniques in vision and control, encoding robustness into mission structure through outcome monitoring and recovery strategies. Their system placed fourth in Challenge 2 and seventh in the Grand Challenge, with achievements in balloon popping, block manipulation, and autonomous firefighting. Why it matters: The work highlights strategies for building robust autonomous systems that can operate without central communication or high-precision GPS in challenging real-world environments, directly addressing key needs in the development of field robotics for the Middle East.
This paper presents the synthesis of a 1-DoF six-bar gripper mechanism for aerial grasping, designed for a task in the Mohamed Bin Zayed International Robotics Challenge (MBZIRC) 2020. The synthesis process involves selecting the mechanism class, determining the number of links and joints using algebraic methods, and optimizing link dimensions via geometric programming. The gripper was modeled in CAD software, additively manufactured, and mounted on a UAV with a DC motor for gripping spherical objects. Why it matters: The research contributes to advancements in robotics and aerial manipulation, with potential applications in various industries, particularly for tasks requiring remote object retrieval and manipulation.
This paper presents two robotic systems developed for the MBZIRC 2020 competition, designed for autonomous wall construction. The systems utilize a UGV with 3D LiDAR for precise brick pose estimation and a UAV employing real-time visual servoing. The authors report results from the competition and lab experiments, discussing lessons learned from the autonomous wall-building task. Why it matters: The work highlights advancements in mobile manipulation and autonomous robotics, with potential applications in construction and infrastructure development in the region.