MBZUAI · Notable
MBZUAI researchers developed a symbolic adversarial learning framework (SALF) for fake news detection using LLM-powered agents. SALF employs a generator and a detector in a debate-like setup, judged by another LLM, to improve the agents' ability to create and identify fake news. Testing showed that the SALF generator degraded the performance of existing fake news detectors by 53.4% on Chinese and 34.2% on English datasets. Why it matters: This research offers a novel approach to combating the evolving threat of LLM-generated disinformation, a critical issue for maintaining reliable information ecosystems in the region and globally.
fake news detection · LLM · MBZUAI · symbolic learning · adversarial learning
Get the weekly digest
Top AI stories from the GCC region, every week.
arXiv ·
A novel agent-based framework called FIRE is introduced for fact-checking long-form text. FIRE iteratively integrates evidence retrieval and claim verification, deciding whether to provide a final answer or generate a subsequent search query. Experiments show FIRE achieves comparable performance to existing methods while reducing LLM costs by 7.6x and search costs by 16.5x.
arXiv ·
This paper provides an overview of the UrduFake@FIRE2021 shared task, which focused on fake news detection in the Urdu language. The task involved binary classification of news articles into real or fake categories using a dataset of 1300 training and 300 testing articles across five domains. 34 teams registered, with 18 submitting results and 11 providing technical reports detailing various approaches from BoW to Transformer models, with the best system achieving an F1-macro score of 0.679.
arXiv ·
This paper introduces ProgramFC, a fact-checking model that decomposes complex claims into simpler sub-tasks using a library of functions. The model uses LLMs to generate reasoning programs and executes them by delegating sub-tasks, enhancing explainability and data efficiency. Experiments on fact-checking datasets demonstrate ProgramFC's superior performance compared to baseline methods, with publicly available code and data.
MBZUAI ·
Iryna Gurevych from TU Darmstadt discussed challenges in using NLP for misinformation detection, highlighting the gap between current fact-checking research and real-world scenarios. Her team is working on detecting emerging misinformation topics and has constructed two corpora for fact checking using larger evidence documents. They are also collaborating with cognitive scientists to detect and respond to vaccine hesitancy using effective communication strategies. Why it matters: Addressing misinformation is crucial in the Middle East, especially regarding public health and socio-political issues, making advancements in NLP-based fact-checking highly relevant.