// AGENT OPS · MACHINE-WORKER MANAGEMENT · June 21, 2026

Agent Ops Need Graduation Criteria Before Shadow Workers Touch Production

Shadow mode is not a waiting room. It is a proof phase, and every machine worker needs explicit graduation criteria before it earns production authority.

WhatPromotion evidence

Graduation criteria convert shadow-mode performance into measurable proof: what the worker predicted, skipped, escalated, and recovered.

WhyDemos hide edge cases

Agents can look competent on happy paths while failing quietly on stale data, conflicting policy, unusual customers, and ambiguous authority.

ConsequenceTrustworthy autonomy

Operators can promote machine workers in stages without turning a promising assistant into an unreviewed production actor.

Most shadow-mode programs end with a feeling.

The team watches an agent for a while. It drafts the right notes. It flags the right accounts. It summarizes calls well enough. It saves time. Eventually someone says the obvious thing: why are we still reviewing every output?

That question is fair. The answer cannot be enthusiasm.

Shadow mode only matters if the company knows what evidence it is collecting. Otherwise it becomes theater: humans manually approve the agent until confidence rises, then the worker receives write access because the room got bored of supervising it.

Five gates before a shadow worker touches production.

01Accuracy under normal load

Measure correct decisions against human-reviewed outcomes, not against whether the output sounded plausible or matched the prompt.

02Restraint on bad inputs

The worker must prove it can refuse, pause, or escalate when records are stale, signals conflict, or required evidence is missing.

03Exception discipline

Edge cases should land in the right lane with a complete handoff packet, not become creative autonomous guesses.

04Blast-radius limit

Promotion should start with bounded objects, segments, fields, volumes, and time windows before broader authority is granted.

05Recovery proof

The team must be able to identify, reverse, quarantine, and learn from a bad action before the worker creates one at scale.

The dangerous worker is the one that is almost right.

A useless agent is easy to stop. A brilliant agent with one untested failure mode is harder. It wins trust on the routine cases, then burns that trust when an unusual account, stale field, or contradictory instruction appears.

Consider a GTM scoring worker. In shadow mode it correctly identifies most high-intent accounts. The team promotes it to update CRM stages automatically. Two weeks later, it advances enterprise accounts based on product-usage spikes caused by implementation troubleshooting, not buying intent. Sales chases noise, CS gets surprised, and forecast starts absorbing fake momentum.

The failure was not that the worker made one wrong call. The failure was that nobody required it to prove restraint on the specific pattern where a correct-looking signal should not become production truth.

The graduation ledger

Candidate worker

Name the agent, version, workflow, owner, model/tool stack, and the exact authority being requested.

Shadow dataset

Record the cases observed, volume, time window, segments, customer risk classes, and excluded surfaces.

Decision outcomes

Compare recommendations against human decisions, downstream results, reversals, ignored outputs, and late-discovered defects.

Stop behavior

Measure when the worker paused, escalated, refused, asked for evidence, or chose draft mode instead of auto-action.

Promotion scope

Define the first production slice: allowed fields, objects, customer tiers, volume, hours, expiry, and rollback owner.

Promotion should be staged, not binary.

Do not move a worker from shadow mode to full production in one jump. Give it a narrow authority slice that matches the evidence it actually proved.

If the worker performed well on SMB renewals, do not let it touch enterprise expansions. If it proved draft quality, do not grant send permission. If it handled clean records, do not let it resolve policy conflicts. Production authority should follow the test boundary, not the ambition of the roadmap.

This is how machine-worker management becomes boring in the best way. The agent earns more autonomy because the operating system can say exactly what it has proven.

A shadow worker graduates when evidence says it is safe, not when supervision gets annoying.
Operator checks

Three signs your graduation process is too soft

01No denominator

The team remembers impressive examples but cannot say how many cases were observed, rejected, corrected, or reversed.

02No edge-case file

The worker is judged on normal work while exceptions, conflicts, stale data, and customer-sensitive cases are left untested.

03No rollback drill

Everyone assumes bad actions can be fixed, but nobody has proven the audit query, revocation path, owner, or customer correction loop.

Install graduation criteria this week.

PickOne shadow worker

Choose a machine worker currently producing recommendations, drafts, routes, scores, summaries, or field updates.

ScoreFour behaviors

Track accuracy, restraint, escalation quality, and recovery readiness across a real operating window.

BoundThe first authority

Limit production access by segment, field, action type, volume, hours, customer tier, and expiry.

ReviewThe promotion

Require an owner to sign the ledger, set a recheck date, and define the rollback drill before write access expands.

Concrete takeaway for this week

Write a graduation ledger for one shadow-mode worker before granting any production authority.

The blunt rule: no machine worker leaves shadow mode until it has proven not just action quality, but stop quality.