
A cheaper model that drops quality is debt, not a saving.
One task class, both routes, hundreds of runs, scored against the check you ratified. Promote only when the cheaper route clears the bar on enough evidence and costs less; otherwise the verdict is hold: keep paying, now proven to earn its keep. The bar is ours today. What an outcome is worth to you should set it, and that is a number we will never guess.
The same 116 tasks, both arms run in full on a live tagging workflow. Each cell is one task. The gate reads the pairing, not the averages: which outcomes the cheaper arm keeps, which it drops, and which it finds that the incumbent missed.
Held. The cheaper arm keeps 88 of the incumbent’s outcomes, drops 20, and finds 4 of its own — a net 16 forfeited to save $0.0372. Break‑even: $0.0023 an outcome. Value a finished outcome above that and refusing was the right trade.
is_simulated=falsecaptured 2026-08-19Source: the committed artifact provenance/autoroute_defended_savings_frac.json. Every cell derives from its per-call rows at build time; none is typed.
The same model at a lower thinking budget, 115 trials on a live reasoning workflow. The first route the gate has passed in a paired eval: not worse than the incumbent task for task, and cheaper.
Promoted. The bar is parity with the incumbent, not an absolute rate: over 115 shared tasks the lower budget was not worse task for task, so the gate passed it on 2026-09-19.
is_simulated=falsecaptured 2026-09-19Source: the committed artifact provenance/reasoning_effort_savings_frac.json. Both panels derive from it at build time.
Figs. 01 and 02 each stayed inside one vendor’s house. The front page says cross-provider, so here the incumbent is Google’s gemini-2.5-flash and the challenger DeepSeek’s deepseek-v4-flash-0731, both run in full over 91 tasks on the same frozen check.
Refused. A different provider and 85% cheaper, turned down because the challenger landed 63% of outcomes to the incumbent’s 92%. A genuine rival, not a cheaper tier of the same house, and the gate ruled on it exactly as it ruled on one. That is what makes the neutrality real.
is_simulated=falsecaptured 2026-09-13Source: the committed artifact provenance/autoroute_cross_provider_algorithm.json. The first real face-off across two providers; both panels derive from it at build time, and the vendor names are read off the model ids, never typed.
Held, on the arithmetic alone. 117 of 120 is the ordinary pass, and most tooling would ship it. Its lower bound sits under our bar, so the gate would keep paying for the incumbent and ask for more evidence. The clean 120 of 120 is not a promotion yet either: the gate never reads one arm alone. It runs the incumbent down the same prompts and rules on the pair, the way Figs. 01–03 were ruled.
Source: the example run card on openrouter.ai/ori (ori eval · standup-summarizer · 120 prompts · run #42), read 16 September 2026. OpenRouter is not a customer and has not evaluated Margin; its card is cited for its counts, not its verdicts, and the same three counts on any eval page would read the same way here. The bounds are computed at build time by the same Wilson form the gate runs; the card’s judge scores are not used.
Under these verdicts sits one piece of algebra.
Every mix of models that lands the same outcome is a curve; the cheapest mix that still lands it is where your budget line touches that curve. The gate’s whole job is to keep you on the curve — a point below it costs less and delivers less, and no per-token dashboard can tell the two apart.
The parity engine, written up →- The Meter: measures every call, its cost, tokens, substrate, and whether it worked.
- The Estate: the org chart of your AI workforce.
- The Money Map: where the spend goes, decomposed by step.
- The Parity Gate: proves the cheaper route held quality before it ships.
- The Governor: acts with a human ratifying, and a revert armed; if quality slips it reverts and the loop re-runs.
Watch the loop run on real spend.
The console shows the loop on open-source agents we metered ourselves: measured spend, recorded face-offs and the gate’s verdicts, every number tagged real or sample. No live route has slipped yet, so the revert has not fired.