// AGENT OPS · MACHINE-WORKER MANAGEMENT · June 21, 2026
Agent Ops Need Graduation Criteria Before Shadow Workers Touch Production
Shadow mode is not a waiting room. It is a proof phase, and every machine worker needs explicit graduation criteria before it earns production authority.
WhatPromotion evidence
Graduation criteria convert shadow-mode performance into measurable proof: what the worker predicted, skipped, escalated, and recovered.
WhyDemos hide edge cases
Agents can look competent on happy paths while failing quietly on stale data, conflicting policy, unusual customers, and ambiguous authority.
ConsequenceTrustworthy autonomy
Operators can promote machine workers in stages without turning a promising assistant into an unreviewed production actor.
Most shadow-mode programs end with a feeling.
The team watches an agent for a while. It drafts the right notes. It flags the right accounts. It summarizes calls well enough. It saves time. Eventually someone says the obvious thing: why are we still reviewing every output?
That question is fair. The answer cannot be enthusiasm.
Shadow mode only matters if the company knows what evidence it is collecting. Otherwise it becomes theater: humans manually approve the agent until confidence rises, then the worker receives write access because the room got bored of supervising it.
Five gates before a shadow worker touches production.
01Accuracy under normal load
Measure correct decisions against human-reviewed outcomes, not against whether the output sounded plausible or matched the prompt.
02Restraint on bad inputs
The worker must prove it can refuse, pause, or escalate when records are stale, signals conflict, or required evidence is missing.
03Exception discipline
Edge cases should land in the right lane with a complete handoff packet, not become creative autonomous guesses.
04Blast-radius limit
Promotion should start with bounded objects, segments, fields, volumes, and time windows before broader authority is granted.
05Recovery proof
The team must be able to identify, reverse, quarantine, and learn from a bad action before the worker creates one at scale.
The dangerous worker is the one that is almost right.
A useless agent is easy to stop. A brilliant agent with one untested failure mode is harder. It wins trust on the routine cases, then burns that trust when an unusual account, stale field, or contradictory instruction appears.
Consider a GTM scoring worker. In shadow mode it correctly identifies most high-intent accounts. The team promotes it to update CRM stages automatically. Two weeks later, it advances enterprise accounts based on product-usage spikes caused by implementation troubleshooting, not buying intent. Sales chases noise, CS gets surprised, and forecast starts absorbing fake momentum.
The failure was not that the worker made one wrong call. The failure was that nobody required it to prove restraint on the specific pattern where a correct-looking signal should not become production truth.
The graduation ledger
Candidate worker
Name the agent, version, workflow, owner, model/tool stack, and the exact authority being requested.
Shadow dataset
Record the cases observed, volume, time window, segments, customer risk classes, and excluded surfaces.
Decision outcomes
Compare recommendations against human decisions, downstream results, reversals, ignored outputs, and late-discovered defects.
Stop behavior
Measure when the worker paused, escalated, refused, asked for evidence, or chose draft mode instead of auto-action.
Promotion scope
Define the first production slice: allowed fields, objects, customer tiers, volume, hours, expiry, and rollback owner.
Promotion should be staged, not binary.
Do not move a worker from shadow mode to full production in one jump. Give it a narrow authority slice that matches the evidence it actually proved.
If the worker performed well on SMB renewals, do not let it touch enterprise expansions. If it proved draft quality, do not grant send permission. If it handled clean records, do not let it resolve policy conflicts. Production authority should follow the test boundary, not the ambition of the roadmap.
This is how machine-worker management becomes boring in the best way. The agent earns more autonomy because the operating system can say exactly what it has proven.
A shadow worker graduates when evidence says it is safe, not when supervision gets annoying.
Operator checks
Three signs your graduation process is too soft
01No denominator
The team remembers impressive examples but cannot say how many cases were observed, rejected, corrected, or reversed.
02No edge-case file
The worker is judged on normal work while exceptions, conflicts, stale data, and customer-sensitive cases are left untested.
03No rollback drill
Everyone assumes bad actions can be fixed, but nobody has proven the audit query, revocation path, owner, or customer correction loop.
Install graduation criteria this week.
PickOne shadow worker
Choose a machine worker currently producing recommendations, drafts, routes, scores, summaries, or field updates.
ScoreFour behaviors
Track accuracy, restraint, escalation quality, and recovery readiness across a real operating window.
BoundThe first authority
Limit production access by segment, field, action type, volume, hours, customer tier, and expiry.
ReviewThe promotion
Require an owner to sign the ledger, set a recheck date, and define the rollback drill before write access expands.
Concrete takeaway for this week
Write a graduation ledger for one shadow-mode worker before granting any production authority.
Name the authority requested: draft, route, score, write, send, suppress, approve, or escalate.
Name the evidence window: cases, dates, volume, segments, reviewers, and excluded risk classes.
Name the pass line: accuracy, restraint, escalation quality, defect rate, and rollback readiness.
Name the first production slice: exact objects, fields, customers, hours, volume, expiry, and owner.
Name the next review: when promotion is renewed, narrowed, expanded, or revoked.
The blunt rule: no machine worker leaves shadow mode until it has proven not just action quality, but stop quality.