Yes, most of it can. You can auto-generate the boring parts: test case templates, prompt wrappers, JSON checks, basic metrics, and a simple report. The key is to keep it repeatable, not fancy.

If your eval setup takes “a full day every time,” you’re not alone. This is one of the biggest hidden time drains in AI work.

Why eval feels painful (and...