AceGPT
🇸🇦KAUST · Saudi Arabia · Arabic LLM
Arabicized LLM from KAUST, built by fine-tuning Llama 2 on Arabic instruction data. Introduces an Arabic chat format aligned to regional preferences and cultural context.
AceGPT-v1 was released in late 2023. The model uses a two-stage training process: first adapting Llama 2's vocabulary and pre-training on Arabic text, then fine-tuning with Arabic instruction-response pairs. Evaluated on MMLU-AR, AlGhafa, and custom Arabic benchmarks.
Sizes:7B, 13B