🕵️ Reverse EngineeringHow not to solve Jane Street's ASIC puzzle. Kinda.(17.09.2026 um 21:27 Uhr)
🔧 ProgrammierungHTMX is fine until the third stakeholder wants a modal(17.09.2026 um 21:13 Uhr)
🕵️ Reverse EngineeringHow not to solve Jane Street's ASIC puzzle. Kinda.(17.09.2026 um 21:27 Uhr)
🔧 ProgrammierungHTMX is fine until the third stakeholder wants a modal(17.09.2026 um 21:13 Uhr)
🔧 Programmierung 🕛 vor 1 Monat 5 Min Lesezeit
0

We Open Sourced R-CLI, the Coding Harness Above Every Published Terminal Bench 2.1 Result

↗ Quelle (dev.to)
🗣️ Stimme:
📑 Inhaltsübersicht

R-CLI is now open source. MIT license. The whole harness.



Repo:



Same model, better harness. Claude Opus 4.8, full Terminal Bench 2.1 submission shape: 89 tasks, 5 attempts each, 445 trials, no concessions. R-CLI scored 85.4 percent. Claude Code's published score with the same model is 78.9 percent. That is +5.14 points with exactly one variable changed. The result sits above all 17 published entries. It has not yet been submitted for judge review, so treat it as a published run with public logs, not a leaderboard entry.



No frontier model in the run. Moonshot AI's Kimi K3 via OpenRouter, with DeepSeek V4 Flash handling subagent work. Single attempt per task: 91.0 percent (81 of 89). Total cost for the entire run: $28.72. About 32 cents per task. Caveat carried in the report itself: single-attempt runs have a roughly ±3 percent confidence interval and this is not a judged submission. Even at the bottom of that interval, an open-weight model in this harness is playing at the top of the benchmark for a rounding error of the usual cost.



One run shows the harness lifts a frontier model past its own tooling. The other shows the harness makes frontier-level coding nearly free. Same engine both times.






What you actually get




  • Terminal-native coding agent: inspects files, edits, runs commands, searches the web

  • The recursive engine: off-model delegation, bounded child contexts, context compression

  • Hundreds of pre-loaded skills, browsable with /skills, plus your own in .agents/skills/

  • Hundreds of MCP connections, managed with /mcp

  • Permission modes: manual, acceptEdits, bypass. You decide what it can touch

  • Checkpoints: undo and redo agent changes, reviewable diffs

  • Session logging, one-shot mode, JSON output for scripting, hooks via /hooks
    ## Any model. Your keys.



R-CLI is model-agnostic, with a path to hundreds of models. Bring your own key for OpenAI, OpenRouter, Anthropic, or Grok, or sign in with Backboard. Switch with /model. When a better or cheaper model ships next month, you change one setting. No re-platforming, no new tool.






The part that matters most: run it where your code lives



Every closed coding tool ships your source to a vendor API. That is the deal, whether the marketing says so or not.



Pair R-CLI with an open model you host yourself and that deal is off. Frontier-level coding where your code never leaves your infrastructure. The Kimi K3 run is the proof that this path is not a performance downgrade.



And now the harness itself is MIT. You can read it, audit it, fork it, and run it inside your own walls. Nobody can policy-block it, deprecate it, or reprice it out from under you.






Why open source it



Because the thesis demands it. If we claim the harness is the dominant variable, the harness should be inspectable. Benchmarks with public verifier logs were half of that. Open code is the other half.



And because ownership is the whole point of what we build. Own the model. Own the harness. Run both in your own cloud.






The ask, one more time



We gave away the harness. You star and share it. That is the trade.



Vollständiger Original-Artikel
Den kompletten Beitrag mit allen Details direkt auf dev.to lesen.
↗ Original-Artikel auf dev.to lesen
Wie bewertest du diesen Beitrag?
1 Klick Feedback
Teilen mit Netzwerk & Team:

Community-Analysen & Experten-Meinungen 0

Verfasse deine eigene Analyse, teile Workarounds oder diskutiere diesen Vorfall im Blog.
Noch keine Community-Analyse verfasst. Markiere einen Textabschnitt oder klicke oben auf Eigene Analyse verfassen“!
Community Pulse: Relevanz-Einschätzung
1 Klick Experten-Votum
🔴 Akute Relevanz 0%
🟡 In Evaluierung 0%
🟢 Keine Auswirkung 0%
Spannende Innovation 0%
Verwandte Story-Cluster & Quellen (Vektor-KI)
Port 8095 Engine
1 Quelle
Microsoft gibt Fehler zu – Vorsicht! Windows-Update sperrt Nutzer vom PC aus - Heute.at
1 Quelle
How not to solve Jane Street's ASIC puzzle. Kinda.
1 Quelle
Revolut-Hacker fordern 6.000 Monero nach Datendiebstahl - Kryptorevolution