A study by MBZUAI's Preslav Nakov and Cornell co-authors examines how to develop systems that detect fake news in a landscape where text is generated by humans and machines. The research, presented at the 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics, analyzes fake news detectors' ability to identify human- and machine-written content. The study highlights biases in current detectors, which tend to classify machine-written news as fake and human-written news as true. Why it matters: Addressing these biases is crucial as machine-generated content becomes more prevalent in both real and fake news, requiring more nuanced detection methods.
MBZUAI researchers developed a symbolic adversarial learning framework (SALF) for fake news detection using LLM-powered agents. SALF employs a generator and a detector in a debate-like setup, judged by another LLM, to improve the agents' ability to create and identify fake news. Testing showed that the SALF generator degraded the performance of existing fake news detectors by 53.4% on Chinese and 34.2% on English datasets. Why it matters: This research offers a novel approach to combating the evolving threat of LLM-generated disinformation, a critical issue for maintaining reliable information ecosystems in the region and globally.
MBZUAI Professor Preslav Nakov believes AI can outpace human fact-checkers in detecting fake news by analyzing language and sentence structure. AI systems can identify common sources of fake news and flag domains for blocking. Nakov's research focuses on disinformation, fact checking, and media bias detection. Why it matters: AI-driven solutions for combating fake news could help mitigate the spread of misinformation and its impact on society, especially in the Arabic-speaking world.
This paper provides an overview of the UrduFake@FIRE2021 shared task, which focused on fake news detection in the Urdu language. The task involved binary classification of news articles into real or fake categories using a dataset of 1300 training and 300 testing articles across five domains. 34 teams registered, with 18 submitting results and 11 providing technical reports detailing various approaches from BoW to Transformer models, with the best system achieving an F1-macro score of 0.679.
Researchers from MBZUAI and other institutions presented a study at ACL 2024 on combatting misinformation by identifying misrepresented scientific research. They compiled a dataset called MISSCI, comprised of real-world examples of misinformation gathered from the HealthFeedback fact-checking website. The annotators classified the different types of errors in reasoning into nine different classes. Why it matters: This work addresses a critical need to combat the spread of scientific falsehoods online, especially given the challenges of manual fact-checking.