Researchers introduced HalluTruthQA-4K, an expanded corpus comprising 4,000 expert-curated Arabic question-answering instances designed for hallucination detection and truth verification. This resource spans four knowledge-intensive domains: Islamic knowledge, history, science, and geography, and serves as the official dataset for Track 2 of the HalluScoring 2026 shared task. For hallucinated responses, the corpus provides character-level erroneous spans, human-written explanations, and hierarchical hallucination types, alongside verified reference answers and distractors. Why it matters: HalluTruthQA-4K provides a crucial fine-grained resource for evaluating and improving the factual reliability and trustworthiness of Arabic large language models.
Researchers introduce HalluTruthQA, a new fine-grained benchmark designed for hallucination detection, localization, and explanation in Arabic question answering. This benchmark comprises 2,400 expert-curated examples across Islamic knowledge, history, science, and geography, featuring character-level error spans, human explanations, and various hallucination types. The study evaluated four open-source Arabic LLMs (ALLaM-7B, Falcon-H1R-7B, Qwen3-32B, SILMA) across detection, localization, factual verification, and explanation tasks, revealing no single model outperforms others across all metrics. Why it matters: HalluTruthQA provides a critical tool for advancing the factual accuracy and reliability of Arabic LLMs by enabling more granular and comprehensive hallucination evaluation beyond response-level detection.
Researchers have introduced HalluTruthQA, a new fine-grained benchmark designed for hallucination detection, localization, and explanation in Arabic Question Answering. The benchmark comprises 2,400 expert-curated examples spanning four knowledge-intensive domains: Islamic knowledge, history, science, and geography, with detailed annotations including character-level erroneous spans and human-written explanations. Four open-source LLMs ( extsc{Allam}, extsc{Falcon-H1}, extsc{Qwen32}, and extsc{Silma}) were evaluated, demonstrating varied performance across detection, localization, factual verification, and explanation tasks. Why it matters: This benchmark offers a comprehensive tool for evaluating and enhancing the factual accuracy and trustworthiness of Arabic LLMs, promoting more sophisticated assessment beyond simple hallucination detection.