AI spend variance: volume, rate, mix, and efficiency
Updated August 27, 2026 · first published August 27, 2026
An AI spend variance is useful only when it points to an action. Split the movement from forecast to actual into four causes: volume, rate, mix, and efficiency. The categories are simple; the discipline is joining them to invoices, usage, and owners without double-counting.
Volume
Volume is demand: requests, users, tokens, or completed workflows. Compare actual usage with the forecast at the same traffic and context assumptions. If volume is the driver, update adoption and capacity forecasts rather than blaming engineering for serving demand.
Rate
Rate is the price paid per unit: provider tariff, discount, exchange rate, or commitment. Use the rate actually billed by provider, model, and token type. A cheaper list price does not count until it appears on the invoice or the contract assumption is explicitly marked.
Mix
Mix is where usage moved: model, provider, region, workload, customer tier, or synchronous versus batch path. A stable token total can cost more after a feature moves to a reasoning model. Tag the workload so the change has a technical and business owner.
Efficiency
Efficiency is cost for the same useful outcome. Include prompt growth, retries, fallbacks, tool fan-out, cache behavior, and human repair. Use cost per successful task and quality metrics to avoid calling degraded output an efficiency gain.
Build the bridge
Start with the prior forecast, apply rate, then volume, mix, and efficiency, and investigate the residual. Each line needs evidence, dollar impact, owner, and next action. The bridge becomes operational when it changes routing, product limits, contracts, or the next forecast.
Variance analysis is not a monthly explanation ritual. It is the shared language that lets finance and engineering decide what to change next.
Related
- LLM cost monitoring
- AI cost allocation
- How to budget for AI spend
Related
Want this applied to your own LLM spend? FinOps LLM runs a free audit of your AI costs and shows where the savings are. Book free audit →