OpenAI starts creating new benchmarks that more accurately evaluate AI models across different languages and cultures

English is only spoken by about 20% of the world’s population, yet existing AI benchmarks for multilingual models are falling short. For example, MMMLU has become saturated to the point that top models are clustering near high scores, and OpenAI says this makes them a poor indicator of real progress. Additionally, the existing multilingual benchmarks … continue reading

The post OpenAI starts creating new benchmarks that more accurately evaluate AI models across different languages and cultures appeared first on SD Times.