NIFTY 24,102 +0.4% SENSEX 79,310 +0.3% S&P 500 5,820 -0.2% GOLD 2,640 +0.6% USD/INR 84.1 -0.1% BTC 71,200 +1.2% BRENT 77.4 -0.8% NIFTY 24,102 +0.4% SENSEX 79,310 +0.3% S&P 500 5,820 -0.2% GOLD 2,640 +0.6% USD/INR 84.1 -0.1% BTC 71,200 +1.2% BRENT 77.4 -0.8%
AI

The quiet race to make AI cheaper than the cloud bill

Inference costs, not model size, are now the line item CFOs argue about.

By Meera Kulkarni · 7 min read · 9 Nov 2026

Every product team has had the same meeting this year: the demo is dazzling, and the invoice is not. The conversation has moved from what a model can do to what it costs to do it a million times a day.

Engineers describe it as a plumbing problem. Smarter routing, smaller specialised models and caching are doing more for margins than any headline benchmark.

Where the money actually goes

Training grabs the headlines, but for most companies the recurring cost is inference: every query, every summary, every agent step. Teams that measure cost per successful task, rather than cost per token, tend to find the biggest savings.

The winners won’t have the biggest model. They’ll have the cheapest correct answer.

What investors should watch

The signal is simple: watch gross margin per user, not parameter counts. Companies that can hold quality steady while cutting unit cost will compound faster than those that simply buy more compute.

This is a sample article for layout preview. Replace it with your real stories.

MK
Meera Kulkarni
Covers AI infrastructure and policy.

Keep reading