Skip to main content
Lab Grimoire
TW EN
Coffee
AI Makes You Code Faster. It Doesn't Make You Ship Faster.
Agent Architecture

AI Makes You Code Faster. It Doesn't Make You Ship Faster.

On this page

The framing: Your team's AI adoption might be at 100%. Your delivery speed improvement might be at 0%. That's not a paradox — it's a systems problem.


TL;DR

  • AI tools speed up the "writing code" part — what's called the inner loop — but leave the outer loop (code review, testing, CI/CD, deployment) completely untouched
  • The bottleneck isn't how fast you write; it's how long you wait
  • AI adoption and delivery speed improvement can be two perfectly parallel lines that never intersect
  • The fix: put AI to work in the outer loop, not just the inner one

You Upgraded the Engine. The Road Is Still Jammed.

Picture this: your engineers are producing three times more code per day than they were a year ago. Sounds like a win, right?

Now ask yourself — what happens after the code is written? Is your code review still taking two days? Does your CI pipeline take forty minutes to run? Do deployments require a manual approval chain? Is your test environment only available a few times a week?

If any of that sounds familiar, here's the uncomfortable truth: your engineers can write all day at triple speed, and the time-to-ship for any given feature barely moves.

That's the outer loop bottleneck in a nutshell.

Inner vs. outer loop bottleneck Figure 1: The inner loop is lightning fast. The outer loop is a parking lot.

Software delivery has two distinct cycles. The inner loop is what each engineer does individually — think, write, test locally, iterate. The outer loop is everything that has to happen between "code is done" and "feature is live" — pull request review, automated testing, CI/CD pipelines, deployment approvals, monitoring sign-off.

Every major AI coding tool on the market today — Copilot, Cursor, various coding agents — is laser-focused on the inner loop. They autocomplete your functions, suggest refactors, generate boilerplate. Your personal output genuinely goes up.

But the outer loop? Nobody touched it.


DORA Has Been Trying to Tell You This for Years

The DORA (DevOps Research and Assessment) team has spent years tracking what actually separates high-performing software teams from everyone else. Their answer has never been "lines of code written." It's always been four outer-loop metrics:

  • Deployment frequency — How often do you actually ship to production?
  • Lead time for changes — From commit to live, how long does it take?
  • Change failure rate — What percentage of releases cause problems?
  • Mean time to restore — When something breaks, how fast do you recover?

Here's the gap: when teams report on their AI adoption success, the numbers they share are almost always inner-loop metrics. Developer satisfaction is up. Code output is up. Individual productivity feels great.

The outer-loop numbers? Mostly flat.

This doesn't mean AI tools are useless. It means your organization is pointing them at the wrong part of the process. Imagine hiring the fastest typist in the world, then routing every document they produce through three layers of manual approval before anyone can read it. Does their typing speed matter at that point?


We're Using AI as a Fancy Autocomplete

The way most teams adopt AI tools is straightforward: drop them into the existing workflow. Engineers use AI to write code, then hand it off to the same process as before.

That approach leaves the real opportunity on the table.

The genuine potential of AI agents isn't just writing functions faster — it's taking over the parts of the outer loop that require human time but not necessarily human judgment.

Code review is the most obvious place to start. The average pull request spends three to five times longer waiting for review than it does being reviewed. AI is already capable of doing a solid first pass — catching common error patterns, checking test coverage, flagging security issues, verifying that the code does what the PR description claims. That frees your engineers to focus their attention on the decisions that actually require judgment.

Testing is the second blind spot. AI can generate tests today with reasonable quality, but most teams are still using it for "help me finish this function" rather than "cover all the edge cases for this logic before I submit." More importantly: if your AI agent defines its own completion criteria before starting a task and validates against them before handing off, a huge chunk of the testing back-and-forth in the outer loop disappears.

Deployment trigger logic is the third. Your CI/CD pipeline is already automated, sure — but many of the decisions around deployment (do we ship now? which environment goes first? do we roll back?) are still manual calls based on rules that exist in someone's head. A lot of those decisions are rule-based enough that an AI can handle them consistently and faster than any human on-call rotation.


Where to Actually Start

If you want AI to have a real impact on delivery speed, here are three places to focus:

1. Measure outer-loop metrics. Stop reporting code output. Next week, replace "number of features AI helped ship" in your status update with "average PR wait time" and "average commit-to-deploy time." You'll immediately see where your actual bottleneck lives.

2. Require AI agents to define done criteria before they start. This sounds small, but the impact is significant. Before an agent begins any task, have it state explicitly: "Here's how I'll know when this is finished, and here's how I'll verify it." Then have it run that verification before handing off. You'll cut a surprising amount of outer-loop rework.

3. Pick one outer-loop stage and run a focused pilot. Don't try to transform your entire delivery process at once. Find the single slowest step in your outer loop — it's usually code review or test coverage — and add AI there specifically. Measure wait time before and after. Data gives you the mandate to expand.


The Illusion of Speed vs. the Reality of Shipping

There's a real feeling of momentum when you use AI to write code. The flow state is genuine, the suggestions are good, the boilerplate disappears. That experience is real.

But it's inner-loop momentum. And inner-loop momentum doesn't automatically become shipped features.

Real productivity improvement isn't everyone going faster individually — it's the total waiting time in your pipeline going down. You can have 100% AI adoption and 0% delivery improvement at the same time. In fact, without intentionally targeting the outer loop, that's the most likely outcome.

The engine is upgraded. Now clear the road.


References

  1. DORA (2024). State of DevOps Report: Software Delivery Performance Metrics. DORA / Google Cloud.
  2. Dora Metrics Working Group (2024). AI acceleration of inner loop versus outer loop bottlenecks — systemic analysis of developer workflows. Internal Research / Blog Post.
  3. Agent Engineering Team (2024). Done criteria first — the design philosophy of self-verifying agent instructions. Internal Knowledge Base.
  4. Malleable Software Collective (2024). Malleable software — opinionated system design principles for the agent era. Blog / Talk.

Found this useful?

Follow for new AI × biomedical research notes:

Or buy me a coffee to keep new content coming.

☕ Buy Me a Coffee