Feb 24 – Mar 2, 2025

Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMs

arXiv · Feb 28 · NLP LLM

A new culturally inclusive and linguistically diverse dataset called Palm for Arabic LLMs is introduced, covering 22 Arab countries and featuring instructions in both Modern Standard Arabic (MSA) and dialectal Arabic (DA) across 20 topics. The dataset was built through a year-long community-driven project involving 44 researchers from across the Arab world. Evaluation of frontier LLMs using the dataset reveals limitations in cultural and dialectal understanding, with some countries being better represented than others.

LLM Post-Training: A Deep Dive into Reasoning Large Language Models

arXiv · Feb 28 · NLP LLM

A new survey paper provides a deep dive into post-training methodologies for Large Language Models (LLMs), analyzing their role in refining LLMs beyond pretraining. It addresses key challenges such as catastrophic forgetting, reward hacking, and inference-time trade-offs, and highlights emerging directions in model alignment, scalable adaptation, and inference-time reasoning. The paper also provides a public repository to continually track developments in this fast-evolving field.

Language Models' Factuality Depends on the Language of Inquiry

arXiv · Feb 25 · NLP LLM

Researchers introduce a benchmark to evaluate the factual recall and knowledge transferability of multilingual language models across 13 languages. The study reveals that language models often fail to transfer knowledge between languages, even when they possess the correct information in one language. The benchmark and evaluation framework are released to drive future research in multilingual knowledge transfer.

Utilizing Social Media Analytics to Detect Trends in Saudi Arabias Evolving Market

arXiv · Feb 24 · Research NLP