Terms of use

Last updated 12 October 2026

In short: Naija Eval is independent research, published free. It is a first pass on 100 items per language and direction, not a certification. Quote it and cite it, but test models on your own data before you rely on them.

1. About these terms

These terms apply when you use naija-eval.extrafemi.com, published by Extrafemi Labs. By using the site you agree to them. If you do not agree, please do not use it.

2. This is research, not advice

Naija Eval reports how models scored on public test sets under the method described on the page. It is not legal, procurement, investment or policy advice, and it is not an endorsement or a criticism of any organisation. Results may change as we test more data, more models or newer versions.

3. Limits of the results

The method section of the report lists the limits, including sample size, 4-bit quantization of the local models, possible training-data contamination, and the gap between clean read speech and real voice notes. Scores describe these tests only. Do not use them alone for decisions about safety, health, law, money or people's rights.

4. Using and citing the results

You may quote and share the findings and figures with credit to "Naija Eval, Extrafemi Labs" and a link to this site. Example sentences from FLORES, and model translations of them, are shared under CC BY-SA 4.0 and stay under that licence when you reuse them. Do not present our results as your own, or edit them in a way that changes what they say.

5. Reproducing the tests

Running the evaluation yourself means downloading the models and data from their owners. You must accept and follow their licences, including the N-ATLaS licence from NCAIR and Awarri, the Llama 3.1 Community License, and the terms of any hosted model provider you use.

6. Third parties and links

N-ATLaS and the other models belong to their makers. Naija Eval is not affiliated with or endorsed by any of them; see Legal and licences. Links to other websites are for convenience. We are not responsible for their content or their privacy practices.

7. No warranty

The site and its results are provided "as is" and "as available", without warranties of any kind, including accuracy, completeness and fitness for a particular purpose, to the extent the law allows.

8. Limitation of liability

To the extent the law allows, Extrafemi Labs is not liable for any indirect or consequential loss, or for any loss arising from reliance on the results. Nothing in these terms limits liability that cannot be limited by law.

9. Changes

We may update these terms. The date at the top shows the latest version. If you keep using the site after a change, the new terms apply.

10. Governing law and contact

These terms are governed by the laws of the Federal Republic of Nigeria. Questions or corrections? Use the Extrafemi Labs contact form.