AI coding tools that last past the demo

By Rogier Muller03.29.26
AI coding tools that last past the demo

An AI coding tool earns a permanent place when a reviewer can defend its output without replaying the session. A lasting tool is one that leaves a written answer to the question every reviewer eventually asks: why did the agent touch this file? Everything else is a trial that has not ended yet.

The demo is the easy part. Claude Code will produce a confident diff. Cursor will too. So will Codex CLI. The diff usually compiles and often works. What separates a keeper from a regret is whether someone who never watched the session can trace the intent, the scope, and the proof from files alone.

Check whether the output survives a cold review

Adoptions rarely die at the demo. They die in week three, when a stranger inherits a pull request and the only record of why a file changed lives in a chat window nobody saved.

So run the cold review on purpose. Hand each candidate tool a real task, let it finish, then give the resulting PR to a teammate who did not see the session. If they can reconstruct intent, scope, and verification without asking you a single question, the tool fits. If they have to come find you, you have bought a habit you cannot scale.

This filters for durability instead of charisma. A tool that dazzles in a demo and goes quiet in review is the most expensive kind to adopt, because the cost shows up after everyone has committed to it.

Leave a receipt where the failure used to be

Most post-adoption pain is a missing contract, not a missing feature. Four contracts cover the failures I see most, and each one is a small file you write once.

Permission creep is the first. On a shared laptop, bash approvals turn into reflex, and the agent quietly widens its own scope. Put a precedence clause at the top of CLAUDE.md that states which hooks win, which folders need human eyes, and where temporary overrides live. The Claude Code quickstart guide sets up the agent but leaves that file to you.

Replay gaps are the second. Teams on Codex CLI merge passing builds that no reviewer ever traced, because the Codex CLI docs is fast precisely where review needs detail. Fix it with a replay sandwich in AGENTS.md: an intent line, then the command transcript, then a diff summary, before any PR opens. Review becomes reproducible without standing behind a terminal.

MCP blast radius is the third. A connector wired in a hurry ends up reaching data nobody drew on the diagram. The Model Context Protocol specification defines what a server can do; the OWASP Top 10 for LLM applications lists what unbounded capability costs. Write one connector card per server: allowed actions, forbidden actions, owner, rollback.

Recursive handoff blur is the fourth. Chained agents hand back tidy summaries that hide the paths a child agent actually edited. Require a child receipt: every delegated run returns the paths it touched, the commands it ran, and the tests that prove its regression guards. Parents stop green-lighting diffs they cannot see.

Carry one boundary file across every vendor

You do not need a different ritual per tool. One small markdown file holds the delegation boundary, and you adapt the globs to your repo:

---
description: Delegation boundary snapshot (adapt globs to your repo)
globs:
  - "**/*"
alwaysApply: false
---

- Cursor: keep scopes explicit in `.mdc`; forbid undeclared MCP domains.
- Claude Code: cite `CLAUDE.md` precedence before expanding bash scope.
- Codex: ensure `AGENTS.md` carries replay-friendly verification notes for CLI runs.

The Cursor agent docs explain what the agent can do. The snapshot above is the part Cursor cannot write for you, because it encodes your team's rules, not the tool's. The point of putting it in a file is that the handoff survives without the original operator in the room.

Score the four review gates

Once the contracts exist, grading a tool gets simple. Ask whether these four questions have file-backed answers, then keep the tool a stranger could review.

Gate Question
Connector truth Which MCP servers fired, and were they expected?
Reviewer path Can someone unfamiliar trace intent without chat replay?
Risk routing Were red folders touched, and who approved?
Replay proof Which commands prove regression guards?

Drop the same checks into your PR template so they run on every merge, not just the ones you remember to inspect:

  • MCP connectors mentioned (if any) list owners.
  • Verification command output is pasted or linked.
  • Forked agent work lists parent and child responsibilities.
  • Red-folder paths received explicit human acknowledgement.

None of this replaces architecture judgement. Agents speed up execution, not ownership, and the NIST AI Risk Management Framework draws the same line at organizational scale: the risk decisions stay with the people who answer for them. Receipts are how you keep those people in the loop after the demo crowd goes home. The habit lives under Document before it ever reaches Review in our methodology, and it underpins the broader practice of agentic coding governance.

Start with one receipt

Pick the replay sandwich, add it to AGENTS.md on your next PR, and watch how much review chat it removes. Our training runs this evaluation live on your repos, with your tools, until the receipts are habit.