I gave GLM-4.5-Air (106B, open weights) 12 coding tasks through
Setup
RTX 3090 (24 GB) + 128 GB RAM, models via ollama, Q4 quants, temp 0.2
5 recent open models × 2 orchestrators (opencode vs custom LangGraph ReAct with ollama-native tool-calling)
17 graded tasks (12 coding in Python/JS/C++ + 5 general-agent) with hidden unit tests
Every run priced in GPU watts via my open-source ]
⭐ Every number was priced in watts by homelab-monitor — my open-source tool that turns your GPU's power draw into per-task cost. Star it if you want the same receipts for your own rig. Harness + tasks + leaderboard code are reproducible.
↗ Original-Artikel auf dev.to lesenVollständiger Original-BerichtAusführliche Details, Code-Beispiele & Hersteller-Stellungnahme auf dev.to.
SOCIAL SHARE CARD GENERATOR