🔧 Programmierung 🕛 vor 2 Monaten 10 Min Lesezeit
0

Don't take the model's word for it

↗ Quelle (dev.to)
🗣️ Stimme:
📑 Inhaltsübersicht

A while back, a "read-only" code reviewer I was running rewrote my git history. Read-only, as it turns out, holds right up until the model decides a fix is tidier than a comment. Pretty cool! You point a general-purpose agent at your codebase, call it a reviewer, and "read-only" quietly downgrades itself from a guarantee to a vibe - held right up until the model talks itself out of it.



That was one of two small things I built recently. The other was a - lives at the second. Both are very specifically scoped, and focus on refusing to take the model's word for it.






Bounding what the model can emit



The generative-UI demo does the obvious thing first: you type a prompt (or fire off the default placeholder), the model streams back a short intro and then emits typed tool-calls, and each tool-call renders as an on-screen artifact - a chart, a table, a metric card, a prose block - as it arrives.





An honest limit baked into this piece - this isn't a type proof running all the way from the model to the screen. The wire carries untyped data - it's unknown until safeParse catches it. So what I've actually got is single-source derivation plus runtime validation at the boundary, not a compile-time guarantee end to end. It's a focused demo: four artifact kinds, no persistence, no auth, no chat history. It's there to show the pattern, not to be adopted as a product. And the pattern is the bit that travels: give the model a fixed, typed palette, and validate at the edge where its output meets your code.






Refusing to believe what it emitted



Sceptic comes at the other end. It's a small adversarial code reviewer built on



The mirror image matters just as much. A reviewer that invents serious bugs in clean code is arguably worse than one that misses them, because it teaches you to ignore it. So I pointed it at a correct utility and watched it decline to invent one - it surfaced two NaN edge cases, one it rated medium and one low, was candid that their severity was arguable, and refused to manufacture a high-severity bug to look busy.




Summary: No correctness or security defects were found — the function is a pure, textbook clamp with no attack surface, and the test suite passes 6/6. The only substantive observations are two NaN-related contract gaps, both firsthand-verified but of contested severity because the docstring leaves NaN handling unspecified. This is close to clean code; I did not manufacture high-severity findings where none exist.




, that the useful move with a sycophantic model is building in resistance on purpose. Same instinct, different week. It doesn't much care whether the model is drawing a chart, reviewing your code, or telling you what you want to hear. Don't take its word for it. Build the thing that checks instead.

Vollständiger Original-Artikel
Den kompletten Beitrag mit allen Details direkt auf dev.to lesen.
↗ Original-Artikel auf dev.to lesen
Wie bewertest du diesen Beitrag?
1 Klick Feedback
Teilen mit Netzwerk & Team:

Community-Analysen & Experten-Meinungen 0

Verfasse deine eigene Analyse, teile Workarounds oder diskutiere diesen Vorfall im Blog.
Noch keine Community-Analyse verfasst. Markiere einen Textabschnitt oder klicke oben auf Eigene Analyse verfassen“!
Community Pulse: Relevanz-Einschätzung
1 Klick Experten-Votum
🔴 Akute Relevanz 0%
🟡 In Evaluierung 0%
🟢 Keine Auswirkung 0%
Spannende Innovation 0%
Verwandte Story-Cluster & Quellen (Vektor-KI)
Port 8095 Engine
6 Quellen
CVE-2022-44255 | TOTOLINK LR350 9.3.5u.6369_B20220309 buffer overflow (EUVD-2022-47204)
2 Quellen
CVE-2026-68426 | Linux Kernel up to 6.18.41/7.1.5/7.2-rc3 xfrm validate_xmit_skb_list use after free (Nessus ID 346426)
1 Quelle
Windows 11 Probleme mit gültiger Domänenanmeldung nach September-Update [Workaround]
Ähnliche Beiträge
🔍 Verwandte News

Auch interessante Nachrichten Don't take the model's word for it

Thematisch verwandte Begriffe: Dont, take, models, word · 6 Treffer

Laden...

Beiträge werden geladen ...

Laden...

Videos werden geladen ...

Laden...

Beiträge werden geladen ...

Laden...

Videos werden geladen ...

Laden...

Beiträge werden geladen ...

Laden...

Videos werden geladen ...

Laden...

Beiträge werden geladen ...

Laden...

Videos werden geladen ...