Skip to content
GCC AI Research

Search

Results for "transformer"

LLM-Based Financial Sentiment Analysis in Arabic: Evidence from Saudi Markets

arXiv ·

Researchers developed an Arabic NLP framework designed for large-scale financial sentiment analysis specifically tailored to the Saudi market. The framework integrates official financial news and social media, constructing an 84K-sample Arabic financial corpus through a multi-stage pipeline encompassing data collection, cleaning, and sentiment annotation. It employs Transformer-based NER and a curated company lexicon to link textual mentions to canonical company identifiers, assigning five-class sentiment labels for analyzing sentiment dynamics relative to stock market behavior on the Saudi Exchange. Why it matters: This research addresses a critical gap in Arabic financial NLP resources, offering a scalable method to understand investor sentiment in a key Middle Eastern market.

Technology Innovation Institute Announces Falcon-H1 model availability as NVIDIA NIM to Deliver Sovereign AI at Scale

TII ·

Technology Innovation Institute (TII) will make its Falcon-H1 large language model available as an NVIDIA NIM microservice. Falcon-H1 features a hybrid Transformer–Mamba architecture supporting context windows of up to 256k tokens. The model's availability on NVIDIA NIM aims to provide enterprises with a plug-and-play asset for building AI systems. Why it matters: This integration will simplify deployment and scaling of Falcon-H1 for enterprises, potentially accelerating the adoption of sovereign AI solutions in the region.

Scientists Develop Ground-breaking Deep Learning Model for Real-time Security Environments

TII ·

Researchers including Dr. Najwa Aaraj developed ML-FEED, a new exploit detection framework using pattern-based techniques. The model is 70x faster than LSTMs and 75,000x faster than Transformers in exploit detection tasks, while also being slightly more accurate. The "ML-FEED" paper won best paper at the 2022 IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications. Why it matters: This research enables more efficient real-time security applications and highlights growing AI expertise in the Arab world.

Abu Dhabi’s TII Launches Falcon-H1 Arabic, Establishing the World’s Leading Arabic AI Model

TII ·

Abu Dhabi’s Technology Innovation Institute (TII) has launched Falcon-H1 Arabic, a new large language model based on a hybrid Mamba-Transformer architecture. The Falcon-H1 family comes in 3B, 7B, and 34B parameter sizes and outperforms existing models on the Open Arabic LLM Leaderboard (OALL). The model features improvements in data quality, dialect coverage, and long-context stability. Why it matters: This release strengthens the UAE's position in Arabic AI and provides a high-performing model tailored to the linguistic and cultural needs of the region.

TII Launches Falcon Reasoning: Best 7B AI Model Globally, Also Outperforms Larger Models

TII ·

Technology Innovation Institute (TII) has launched Falcon H1R 7B, an open-source 7B parameter AI model with reasoning capabilities. It outperforms larger models like Microsoft Phi 4 Reasoning Plus 14B, Alibaba Qwen3 32B, and NVIDIA Nemotron H 47B on key benchmarks. The model uses a hybrid Transformer–Mamba architecture for improved accuracy and speed and is available on Hugging Face under the Falcon TII License. Why it matters: This release highlights the UAE's growing role in AI innovation by providing an efficient and accessible model for global research and development.

OmniGen: Unified Multimodal Sensor Generation for Autonomous Driving

arXiv ·

The paper introduces OmniGen, a unified framework for generating aligned multimodal sensor data for autonomous driving using a shared Bird's Eye View (BEV) space. It uses a novel generalizable multimodal reconstruction method (UAE) to jointly decode LiDAR and multi-view camera data through volume rendering. The framework incorporates a Diffusion Transformer (DiT) with a ControlNet branch to enable controllable multimodal sensor generation, demonstrating good performance and multimodal consistency.

Continuous Saudi Sign Language Recognition: A Vision Transformer Approach

arXiv ·

The researchers introduce KAU-CSSL, the first continuous Saudi Sign Language (SSL) dataset focusing on complete sentences. They propose a transformer-based model using ResNet-18 for spatial feature extraction and a Transformer Encoder with Bidirectional LSTM for temporal dependencies. The model achieved 99.02% accuracy in signer-dependent mode and 77.71% in signer-independent mode, advancing communication tools for the SSL community.

ArabianGPT: Native Arabic GPT-based Large Language Model

arXiv ·

The paper introduces ArabianGPT, a suite of transformer-based language models designed specifically for Arabic, including versions with 0.1B and 0.3B parameters. A key component is the AraNizer tokenizer, tailored for Arabic script's morphology. Fine-tuning ArabianGPT-0.1B achieved 95% accuracy in sentiment analysis, up from 56% in the base model, and improved F1 scores in summarization. Why it matters: The models address the gap in native Arabic LLMs, offering better performance on Arabic NLP tasks through tailored architecture and tokenization.