Skip to content
GCC AI Research

AraDetox: A Multi-Dialect Arabic Detoxification Dataset

arXiv · · Significant research

Summary

Researchers introduce AraDetox, a new multi-dialect Arabic detoxification dataset containing 10,500 harmful social-media posts and 84,000 detoxified rewrites. The rewrites were generated using GPT-5 and Gemini 2.5 Flash, covering Modern Standard Arabic, Gulf, Levantine, and Egyptian Arabic. Human and automatic evaluations confirmed successful harmful language removal, semantic preservation, and dialectal alignment. The dataset is publicly available to support future research in Arabic detoxification and safe text generation. Why it matters: This dataset addresses the underexplored area of Arabic text detoxification, providing a large-scale, multi-dialect resource critical for developing more ethical and robust Arabic NLP applications.

Get the weekly digest

Top AI stories from the GCC region, every week.

Related

AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs

arXiv ·

Researchers introduce AraDiCE, a benchmark for Arabic Dialect and Cultural Evaluation, comprising seven synthetic datasets in various dialects and Modern Standard Arabic (MSA). The benchmark includes approximately 45,000 post-edited samples and evaluates LLMs on dialect comprehension, generation, and cultural awareness across the Gulf, Egypt, and Levant. Results show that Arabic-specific models like Jais and AceGPT outperform multilingual models on dialectal tasks, but challenges remain in dialect identification, generation, and translation. Why it matters: This benchmark and associated datasets will help improve LLMs' ability to understand and generate diverse Arabic dialects and cultural contexts, addressing a significant gap in current models.

ADAB: Arabic Dataset for Automated Politeness Benchmarking -- A Large-Scale Resource for Computational Sociopragmatics

arXiv ·

The paper introduces ADAB (Arabic Politeness Dataset), a new annotated Arabic dataset for politeness detection collected from online platforms. The dataset covers Modern Standard Arabic and multiple dialects (Gulf, Egyptian, Levantine, and Maghrebi). It contains 10,000 samples across 16 politeness categories and achieves substantial inter-annotator agreement (kappa = 0.703). Why it matters: This dataset addresses the under-explored area of Arabic-language resources for politeness detection, which is crucial for culturally-aware NLP systems.

ALDi: Quantifying the Arabic Level of Dialectness of Text

arXiv ·

The paper introduces the concept of Arabic Level of Dialectness (ALDi), a continuous variable representing the degree of dialectal Arabic in a sentence, arguing that Arabic exists on a spectrum between MSA and DA. They present the AOC-ALDi dataset, comprising 127,835 sentences manually labeled for dialectness level, derived from news articles and user comments. Experiments show a model trained on AOC-ALDi can identify dialectness levels across various corpora and genres. Why it matters: ALDi provides a more nuanced approach to analyzing Arabic text than binary dialect identification, enabling sociolinguistic analysis of stylistic choices.