arXiv ·
Researchers from the National Center for AI in Saudi Arabia investigated the sensitivity of Large Language Model (LLM) leaderboards to minor benchmark perturbations. They found that small changes, like choice order, can shift rankings by up to 8 positions. The study recommends hybrid scoring and warns against over-reliance on simple benchmark evaluations, providing code for further research.
SDAIA ·
The Saudi Data and Artificial Intelligence Authority (SDAIA) was established in 2019 to drive the national AI strategy in Saudi Arabia. SDAIA's main entities include the National Data Management Office (NDMO), the National Center for AI (NCAI), and the National Information Center (NIC). SDAIA has launched initiatives like the Tuwaiq AI Challenge and the Global AI Summit. Why it matters: SDAIA is central to Saudi Arabia's Vision 2030 plan to diversify the economy and develop AI capabilities.
KAUST ·
KAUST hosted Fireside Talks during its Spring Career Fair, focusing on aligning talent development with Saudi Arabia's evolving workforce needs in AI and sustainability. Speakers included KAUST's VP for Strategic National Advancement, a KAUST Ph.D. student/entrepreneur, the director of KAUST's AI Initiative, and the CEO of the National Center for AI (SDAIA). Discussions covered entrepreneurship, the transformative role of AI, and the importance of human-AI collaboration. Why it matters: The event highlights KAUST's key role in developing a skilled workforce to support Saudi Arabia's ambitions in AI and sustainable technologies.