Gherbal v4: Comprehensive Evaluation Report — Language Identification Across 214 Languages

Overview

This technical report presents the most comprehensive language identification evaluation we are aware of: 10 models tested across 8 benchmarks under 5 scoping regimes, covering 214 languages.

Key Findings

• Gherbal v4 achieves 0.836 average accuracy — the best accuracy-to-compute ratio of any model tested
• Outperforms OpenLID v2 (0.824), GlotLID (0.803), and NLLB-LID (0.711)
• Only model to identify all 16 Arabic dialect variants tested
• Only model to detect Arabizi (Latin-script Darija) — all competitors score 0%
• Best-in-class on West/Central African languages (Kituba, Dyula, Kamba, Twi)

Data Quality Pipeline

Gherbal v4 is trained on high-quality curated data. The 4-pass cleaning pipeline includes:

1. Script validation
2. Cross-language deduplication
3. Self-prediction disambiguation
4. Content-aware resampling

Resources

• Full Report (PDF)
• One-Pager (PDF)
• Language list
• Sawalni API — access Gherbal v4 via API