When LLMs don't know a Greek word, they make one up

This is a submission for the Kaggle Benchmarking Challenge. What I Benchmarked Ask a model to describe waves on a beach in Greek and you may get «το φλάφισμα των κυμάτων». It reads like Greek, it is spelled like Greek, and it does not exist. The real word is θρόισμα (rustle). Gemini 3 Flash wrote φλάφισμα during our calibration runs, probably... Weiterlesen: When LLMs don't know a Greek word, they make one up