In the Loop

"In the Loop" is a collaborative mode in which humans review and correct AI agent outputs one by one. While quality control is reliable, it tends to create a bottleneck where human review cannot keep pace with the agent's generation speed.
One of the three collaboration modes between humans and AI agents (Outside the Loop / In the Loop / On the Loop) organized by Birgitta Böckeler, co-author with Martin Fowler. It refers to a way of working in which humans review each piece of code or output generated by an agent and directly correct any issues found.
Why It Becomes a Bottleneck
An agent can generate code in seconds, but human review takes anywhere from several minutes to tens of minutes. This asymmetry is the fundamental limitation of In the Loop. A queue of items awaiting review accumulates, making it impossible to fully leverage the agent's high-speed generation capabilities. In the author's own experience, it was not uncommon for an agent to create five PRs in 30 minutes, only for the reviews to take half a day.
When In the Loop Is Appropriate
That said, there are cases where In the Loop is effective. Infrastructure changes that directly affect production environments, authentication and authorization implementations involving security, financial or medical code subject to regulatory compliance—in these domains, the cost of having humans verify each step is worth paying. The key is to not operate everything under In the Loop. A practical balance is to apply In the Loop only to high-risk changes and shift everything else to On the Loop.
Articles covering this term
- What Is a Token Trap? Practical Token Consumption Management to Prevent Hidden Cost Explosions in AI AgentsLearn how "token traps" cause billing spikes in high-frequency agent loops, and how to prevent cost explosions with budget caps, throttling, and smart loop design.
- How to Deploy AI Agents in Production? Practical Steps from Pilot to Scale5 barriers to moving AI agents from pilot to production—and how to overcome them. Practical steps for quality control, system integration, governance & org structure.
- What is Loop Engineering? The New Standard in AI Agent Design Coming After Prompt EngineeringFrom prompting to designing "loops" where AI works autonomously. We explain Loop Engineering—its meaning, evolution, components, and implementation considerations.
- What is Human-in-the-Loop (HITL)? The Basics of "Human Participation" Design for Establishing AI-Driven Business Process AutomationHITL design—where AI processes and humans verify—is key to sustainable automation. Covers confidence routing, 5 implementation steps & industry cases for DX leaders.
Related Terms

Ambient AI
Ambient AI refers to an AI system that is seamlessly embedded in the user's environment, continuousl

Claude Code
Claude Code is a terminal-resident AI coding agent developed by Anthropic. It is a CLI tool that ena

Harness Engineering
Harness engineering is a methodology for designing structural constraints—such as prompts, tool defi

OpenClaw
OpenClaw is an open-source personal AI agent framework that runs in a local environment, featuring l



