pith. sign in

arxiv: 2503.14603 · v1 · pith:4MUGWSYFnew · submitted 2025-03-18 · 💻 cs.CL · cs.LG

Command R7B Arabic: A Small, Enterprise Focused, Multilingual, and Culturally Aware Arabic LLM

classification 💻 cs.CL cs.LG
keywords arabicdataenterprisemodelsmalltrainingachievingaddress
0
0 comments X
read the original abstract

Building high-quality large language models (LLMs) for enterprise Arabic applications remains challenging due to the limited availability of digitized Arabic data. In this work, we present a data synthesis and refinement strategy to help address this problem, namely, by leveraging synthetic data generation and human-in-the-loop annotation to expand our Arabic training corpus. We further present our iterative post training recipe that is essential to achieving state-of-the-art performance in aligning the model with human preferences, a critical aspect to enterprise use cases. The culmination of this effort is the release of a small, 7B, open-weight model that outperforms similarly sized peers in head-to-head comparisons and on Arabic-focused benchmarks covering cultural knowledge, instruction following, RAG, and contextual faithfulness.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Context-Aware Dialectal Arabic Machine Translation with Interactive Region and Register Selection

    cs.CL 2026-04 unverdicted novelty 6.0

    A metadata-conditioned mT5 model trained on rule-augmented dialectal Arabic data produces translations that better match intended regional varieties than high-resource baselines, despite lower BLEU scores.

  2. Think in English, Answer in Korean: Efficient Adaptation of Multilingual Tool-Using Agents

    cs.AI 2026-06 unverdicted novelty 3.0

    LuckyStar 111B adapts Cohere's Command A model with four scaling techniques to improve tool-use, math reasoning, and NL2SQL in Korean-English while preserving general instruction following.