Teanga Bench: English tutoring for Portuguese, Spanish, Vietnamese and Japanese speakers
Teanga Bench measures how well large language models tutor English for people whose first language is Portuguese, Spanish, Vietnamese or Japanese. Every model answers the same few hundred items per test, taken from the Tonada course and a public corpus of sentence edits: closed exercises with the instruction in the learner's language, and finding and fixing errors in English sentences as a tutor would. Each item is asked several times. The score is the share of items answered correctly.
Leaderboard
Ranked by overall score, every test weighted equally. Cost is one run of this suite, judges included.
| Rank | Model | Score | 95% interval | Items | Cost per run | Cost per correct answer |
|---|---|---|---|---|---|---|
| 1 | openai/gpt-6-luna | 84.0% | 81.6% to 86.3% | 760 | $0.81 | $0.000419 |
Results by test
Lesson exercises
Closed English exercises from the Tonada course, with the instruction in the learner's first language, marked against the accepted answers.
Tutor accuracy
Find and fix the error in an English sentence, or leave a correct sentence alone; an item counts only when the error is found and fixed and nothing else is changed.
By first language
Score by first language: the mean of the per-test scores, every test weighted equally. Darker cells are higher. Intervals are on the model pages.
| Model | Portuguese | Spanish | Vietnamese | Japanese |
|---|---|---|---|---|
| openai/gpt-6-luna | 85% | 83% | 84% | 85% |
Score against cost
- openai/gpt-6-luna: 84.0% for $0.81
The numbers on this page are also available as JSON. Full results files for every run are in the repository.