We scan new podcasts and send you the top 5 insights daily.
AI vendors can increase effective costs without altering their price-per-token sheets. When Anthropic updated its model, a new tokenizer produced ~30% more tokens for the same text. While the sticker price was unchanged, real-world bills grew 12-27%—a classic case of 'shrinkflation' applied to AI.
While the cost-per-token is decreasing as models become more efficient, this efficiency gain drives a massive increase in new use cases and overall consumption. This economic principle, Jevons Paradox, explains why total enterprise spending on model inference is skyrocketing, even as the unit cost falls.
For years, flat-rate AI subscriptions heavily subsidized power users, masking the true cost of token consumption. As providers shift to usage-based billing, this subsidy is ending. Enterprises now face "sticker shock" and must justify AI spend with clear ROI, moving from rampant experimentation to cost-conscious implementation.
Flat-rate AI plans are becoming economically unviable due to token-hungry agents. Companies like Google and Microsoft are pushing usage-based billing, forcing enterprises to confront the surprisingly high real cost of running models at scale, which was previously hidden by subsidized pricing experiments.
It's counterintuitive, but using a more expensive, intelligent model like Opus 4.5 can be cheaper than smaller models. Because the smarter model is more efficient and requires fewer interactions to solve a problem, it ends up using fewer tokens overall, offsetting its higher per-token price.
Newer AI models may have low per-token prices but are often "token hungry," requiring more tokens to complete a task. This can make them more expensive overall. The true measure of economic viability is the final cost-per-task, not the misleading per-token price.
A paradox exists where the cost for a fixed level of AI capability (e.g., GPT-4 level) has dropped 100-1000x. However, overall enterprise spend is increasing because applications now use frontier models with massive contexts and multi-step agentic workflows, creating huge multipliers on token usage that drive up total costs.
A model with a low per-token price can be more expensive if it's inefficient, verbose, or requires multiple attempts ('overthinking'). The actual invoice depends on the total tokens needed to complete a task, making token efficiency a hidden multiplier that savvy enterprises are now tracking to determine the true cost.
Sticker price per token is a misleading metric for AI models. A cheaper model may require more retries or reasoning, making it more expensive overall. The true metric is 'cost per accepted task,' which accounts for total resources needed to get a reliable, usable result, providing a true apples-to-apples comparison.
Anthropic's Fable 5 costs twice as much per token as its predecessor. However, its increased intelligence leads to fewer errors and more direct solutions, reducing the total tokens needed for a task and making the overall cost more competitive.
AI agents burn tokens at a much higher rate than anticipated. This unforeseen compute cost is the direct catalyst for labs like Anthropic and OpenAI killing popular products and overhauling their pricing structures.