All projects

jev-cyrillic-audit

tonysafonov/jev-cyrillic-audit

Does TypeSafe's Jev keep its accuracy and calibration on Russian? Independent RU vs EN audit (ECE, reliability diagrams, paired bootstrap) on parallel human-labelled data.

Python
Stars
0
Forks
0

Why it is listed

The README reports a preregistered, paired Jev evaluation on Russian versus English XNLI items and says Russian accuracy and calibration were lower; results were not reproduced here.