arXiv cs.CLPaper
Lost in Translation: Why Lower Bias Scores Don't Mean Fairer Models
This punctures a common misreading of multilingual model evaluations: non-English scores are systematically lower due to translation and StereoSet items, not fairer reasoning. If you're building multilingual systems and comparing fairness metrics across languages, you're probably misinterpreting lower scores as improvement. Fix your benchmarking assumptions before shipping claims about multilingual fairness. This is important for accuracy in public statements about your models.