Microsoft Mechanics: Azure AI Foundry: Generate Synthetic Test Data

No eval dataset? Azure AI Foundry generates a synthetic one for you.

Instead of uploading an existing dataset in Microsoft Foundry (formerly Azure AI Foundry), guide it with a prompt like "Create a dataset for evaluating a coding agent," pick the number of rows, and it auto-generates 90 rows of test data. Then choose your evaluation criteria from built-in evaluators for agents, quality, and safety — remove the ones you don't need, keep the seven safety evaluators, and submit.

▶ Full episode: https://youtu.be/gS3dvMzm89M
▶ Get started: https://ai.azure.com

#Shorts #MicrosoftFoundry #AIAgents #AgentOps