Cost Control for LLM Apps: Caching, Batching, Model TiersscienceDeep Dive AI Engineering · Aug 3, 2026 · 7 min readThe levers that actually move an Azure OpenAI bill — model tier, the four caches, output discipline, batching — in order of impact.
