In the Loop

"In the Loop" is a collaborative mode in which humans review and correct AI agent outputs one by one. While quality control is reliable, it tends to create a bottleneck where human review cannot keep pace with the agent's generation speed.
One of the three collaboration modes between humans and AI agents (Outside the Loop / In the Loop / On the Loop) organized by Birgitta Böckeler, co-author with Martin Fowler. It refers to a way of working in which humans review each piece of code or output generated by an agent and directly correct any issues found.
Why It Becomes a Bottleneck
An agent can generate code in seconds, but human review takes anywhere from several minutes to tens of minutes. This asymmetry is the fundamental limitation of In the Loop. A queue of items awaiting review accumulates, making it impossible to fully leverage the agent's high-speed generation capabilities. In the author's own experience, it was not uncommon for an agent to create five PRs in 30 minutes, only for the reviews to take half a day.
When In the Loop Is Appropriate
That said, there are cases where In the Loop is effective. Infrastructure changes that directly affect production environments, authentication and authorization implementations involving security, financial or medical code subject to regulatory compliance—in these domains, the cost of having humans verify each step is worth paying. The key is to not operate everything under In the Loop. A practical balance is to apply In the Loop only to high-risk changes and shift everything else to On the Loop.
Related Terms

AI ROI (Return on Investment in AI)
AI ROI is a metric that quantitatively measures the effects obtained — such as operational efficienc

AI Observability
An operational practice of continuously monitoring and visualizing the inputs/outputs, latency, cost

Ambient AI
Ambient AI refers to an AI system that is seamlessly embedded in the user's environment, continuousl

BPO (Business Process Outsourcing)
BPO refers to a form of outsourcing in which a company delegates specific business processes to an e