jev-cyrillic-audit
tonysafonov/jev-cyrillic-audit
Does TypeSafe's Jev keep its accuracy and calibration on Russian? Independent RU vs EN audit (ECE, reliability diagrams, paired bootstrap) on parallel human-labelled data.
Python
- Stars
- 0
- Forks
- 0
Why it is listed
The README reports a preregistered, paired Jev evaluation on Russian versus English XNLI items and says Russian accuracy and calibration were lower; results were not reproduced here.