All posts AI spend

Why Tokenmaxxing Is Wrong (And Why the Industry's Fixes Fail Too)

November 2, 20265 min read

Between late 2022 and mid-2026, the price of GPT-4-equivalent intelligence fell 98%, from $20 per million tokens to $0.40. Over the same period, enterprise AI bills rose an estimated 320%. The culprit was a management doctrine the industry came to call tokenmaxxing: treating raw token consumption as a proxy for engineering productivity.

+320%rise in enterprise AI bills after token prices fell 98%
10x / 2xtokens burned by heavy users for twice the output
93–99%of coding-agent tokens are cached history re-reads

Early in 2026, leadership teams pushed engineers to burn more tokens. Meta and Amazon stood up internal token leaderboards; both shut them down after engineers ran scripts to burn millions of tokens on throwaway loops. By spring, the bills landed: Uber exhausted its 2026 AI coding budget by April and capped engineers at $1,500 a month, Microsoft pulled direct Claude Code licenses in favor of Copilot Auto Mode, and Priceline saw a Cursor renewal come back four to five times higher.

Commentaries like Engineer's Codex nailed the cultural failure: Goodhart's Law turns any token leaderboard into a cobra bounty, and raw output does not equal business outcome. When you inspect coding-agent traffic on the wire, you see why both tokenmaxxing and the industry's knee-jerk reactions fail.

1. Why token volume is an anti-signal

Tokenmaxxing rests on a chatbot intuition: more tokens sent must mean more work done. That held when a chat query used 300 tokens ($0.04). It fails when a coding session in Claude Code, Cursor, or Codex consumes 500K to several million tokens (1,000 to 5,000 times more).

A coding agent is stateless across HTTP calls. Turn N re-sends the system prompt, tool definitions, every file read on turns 1 through N−1, and every test log. Across our audited corpora, 93% to 99.2% of input tokens are cache_read_input_tokens, and a handful of marathon sessions drives 66% to 78% of total spend. A 100-turn session isn't 100 units of work—it's Turn 1 paid 100 times.

Token and cost inflation for the identical 3-file bug fix

Specific prompt$0.31 · 335K
35 KB log paste$0.41 · +44%
Vague prompt$0.51 · +69%
Source: ZuzAI 30-run Claude Code benchmark (30/30 unit tests passing in every run); plus up to 28.2% hidden agent_summary calls in multi-agent sessions.

Worse, what inflates token counts is usually bad workflow hygiene or client overhead:

  • Vague prompts and log dumps: Typing "the tests are failing, fix them" burned 69% more tokens (+65% cost) than naming the failing module for the exact same commit; pasting a raw 35 KB log added 44% more tokens.
  • Hidden client timers: In our 379-session sub-agent audit, a 30-second UI timer (agent_summary) sent 191K tokens per call to Opus—up to 28.2% of requests—while writing skipTranscript: true so zero records appeared in local .jsonl logs. That's why internal log parsers never match the vendor bill (and naive line-by-line JSONL scripts over-count streaming chunks by ~150%).
  • Client cache bugs: When a February 2026 Claude Code release broke prompt caching (hotfixed in v2.1.62), bills jumped 3x to 4x overnight.

2. Where the 10x-for-2x leak happens

Jellyfish found that per-developer token use rose 18.6x in nine months, and the heaviest users were twice as productive—but burned 10x the tokens to get there. Tracing sessions from the wire to Git 30 days later shows where the other 8x goes:

  • ~31% of spend lands in sessions with zero commits: Driven by 5-minute idle-gap cache rebuilds (stepping into a 15-minute standup forces a full context rewrite at 1.25x input price, or 12.5x cached read price), restarting warm sessions after one error, and runaway 200+ turn SDK loops.
  • Raw PR count is Promomaxxing 2.0: Stanford's ~100K-developer study found AI raised PR volume 14% but net effective output by ~1% after 2.5x higher rework; Larridin found review times jumped 50% across 25 orgs.
  • Skipping tests multiplies rework: In our session-to-Git data, agent sessions that stop after editing files without running the test suite require 2.6x to 2.9x more follow-up fix commits within 7 days.

3. Why the industry's four fixes backfire

Burned by tokenmaxxing, enterprises reach for four obvious fixes that ignore how prompt caches and coding binaries work:

  1. Naive per-turn model routers: Prompt caches belong to one model. Seven turns into an Opus 4.6 session (76K context), switching Turn 8 to "half-price" Sonnet 4.6 forces a cold cache write costing $0.205 instead of $0.045—4.5x more (The Model-Switch Toll). Across 4,187 Claude Code turns, prompt-only routers scored 0.51–0.56 AUC (a coin flip), and pointing ANTHROPIC_BASE_URL at a naive proxy disables ToolSearch (+48.4% solve cost). Route only at cold-cache boundaries (Turn 0, >5m cache expiry, post-compaction, or sub-agent spawn).
  2. Flat $1,500 monthly caps: Freezing a $100–$150/hr engineer mid-migration for two hours wastes $200–$300 of payroll over $2–$5 of tokens—a 100-to-1 loss (The Budget Deadlock) and pushes top builders onto personal credit cards.
  3. Unstructured main-session exploration: Exploring three dead ends inside a warm 120K+ session pins every file read in context for the rest of the day. Delegating exploration to an isolated sub-agent compresses context 33 to 1 and beat inline exploration in 92.7% of runs (101 of 109), provided you cap the 6% of runaway sub-agents (>50 turns).
  4. In-code Python SDKs and monthly CSV dashboards: You cannot pip install a @track decorator into closed-source binaries like Claude Code or Cursor (55% of departmental AI spend), and monthly invoice-to-Git dashboards cannot see or stop waste on the wire.
DimensionTokenmaxxingKnee-jerk fixWire-level economics
Primary metricTokens per developer$1,500 cap or PR countCost per durable change (≥80% standing at Day 30)
Model routingAlways max-effort OpusPer-turn router (4.5x cache toll)Cold-cache boundaries + Step-2 (K2) signal
ExplorationDump dead ends in main sessionRation exploration quotaIsolated sub-agents (33:1 compression) + 50-turn cap
GuardrailsUnbounded until budget blows upHard individual cutoffs (100:1 loss)Runaway loop breakers + project/repo burst budgets

What to measure instead

Stop ranking developers by tokens burned or capping top builders mid-task. Audit cache efficiency and hidden client traffic first, route models only when the cache is cold, isolate exploration into bounded sub-agents, and judge spend by cost per durable change—merged code that survives 30 days in Git without rework.

Where ZuzAI fits

ZuzAI sits on the wire across your coding agents and LLM providers inside your own tenant—preserving ToolSearch and warm caches, exposing hidden skipTranscript calls, reconciling hybrid contracts, and linking every session dollar to 30-day durable code changes.

Published by ZuzAI on November 2, 2026.

Runs inside your own tenant. Governs every AI tool your teams already use.See every AI flow.
Govern every AI dollar.

Talk to Us

Works with

  • Claude
  • ChatGPT
  • Gemini
  • xAI
  • Microsoft 365 Copilot
  • GitHub Copilot
  • Cursor
  • Amazon Web Services
  • Microsoft Azure
  • Google Cloud