Researchers developed an Arabic NLP framework designed for large-scale financial sentiment analysis specifically tailored to the Saudi market. The framework integrates official financial news and social media, constructing an 84K-sample Arabic financial corpus through a multi-stage pipeline encompassing data collection, cleaning, and sentiment annotation. It employs Transformer-based NER and a curated company lexicon to link textual mentions to canonical company identifiers, assigning five-class sentiment labels for analyzing sentiment dynamics relative to stock market behavior on the Saudi Exchange. Why it matters: This research addresses a critical gap in Arabic financial NLP resources, offering a scalable method to understand investor sentiment in a key Middle Eastern market.
This paper introduces AraDhati+, a new comprehensive dataset for Arabic subjectivity analysis created by combining existing datasets like ASTD, LABR, HARD, and SANAD. The researchers fine-tuned Arabic language models including XLM-RoBERTa, AraBERT, and ArabianGPT on AraDhati+ for subjectivity classification. An ensemble decision approach achieved 97.79% accuracy. Why it matters: The work addresses the under-resourced nature of Arabic NLP by providing a new dataset and demonstrating strong results in subjectivity classification, advancing sentiment analysis capabilities for the Arabic language.
The paper introduces MultiProSE, the first multi-label Arabic dataset for propaganda, sentiment, and emotion detection. It extends the existing ArPro dataset with sentiment and emotion annotations, resulting in 8,000 annotated news articles. Baseline models, including GPT-4o-mini and BERT-based models, were developed for each task, and the dataset, guidelines, and code are publicly available. Why it matters: This resource enables further research into Arabic language models and a better understanding of opinion dynamics within Arabic news media.
This paper explores the impact of tokenization strategies and vocabulary sizes on Arabic language model performance across NLP tasks like news classification and sentiment analysis. It compares four tokenizers, finding that Byte Pair Encoding (BPE) with Farasa performs best overall due to its morphological analysis capabilities. The study surprisingly found limited impact of vocabulary size on performance with fixed model sizes, challenging assumptions about vocabulary size and model performance. Why it matters: The findings provide insights for developing more effective and nuanced Arabic language models, particularly for handling dialectal variations and promoting responsible AI development in the region.
The paper introduces ArabianGPT, a suite of transformer-based language models designed specifically for Arabic, including versions with 0.1B and 0.3B parameters. A key component is the AraNizer tokenizer, tailored for Arabic script's morphology. Fine-tuning ArabianGPT-0.1B achieved 95% accuracy in sentiment analysis, up from 56% in the base model, and improved F1 scores in summarization. Why it matters: The models address the gap in native Arabic LLMs, offering better performance on Arabic NLP tasks through tailored architecture and tokenization.
The paper introduces AraELECTRA, a new Arabic language representation model. AraELECTRA is pre-trained using the replaced token detection objective on large Arabic text corpora. The model is evaluated on multiple Arabic NLP tasks, including reading comprehension, sentiment analysis, and named-entity recognition. Why it matters: AraELECTRA outperforms current state-of-the-art Arabic language representation models, given the same pretraining data and even with a smaller model size, advancing Arabic NLP.
Researchers at the American University of Beirut (AUB) have released AraBERT, a BERT model pre-trained specifically for Arabic language understanding. The model was trained on a large Arabic corpus and compared against multilingual BERT and other state-of-the-art methods. AraBERT achieved state-of-the-art performance on several tested Arabic NLP tasks including sentiment analysis, named entity recognition, and question answering. Why it matters: This release provides the Arabic NLP community with a high-performing, open-source language model, facilitating further research and development.
A study focused on developing a model for spam and sentiment detection in Arabic tweets, specifically targeting customer feedback for Saudi Telecom Company (STC). Researchers trained the MARBERT model using a dataset of 24,513 Arabic tweets, which included various sentiment categories like positive, negative, neutral, sarcasm, and indeterminate. The primary objective was to analyze tweet sentiments to enhance STC's customer service, with the proposed scheme demonstrating promising accuracy compared to existing techniques. Why it matters: This research contributes to Arabic Natural Language Processing (NLP) by providing a practical application for sentiment analysis in customer service within the Middle East, addressing a recognized gap in Arabic AI research.