https://devopstoolkit.live/ai/llm-inference-explained-12-concepts-you-actually-need-to-know/index.htmlContinuous batching. Paged attention. Prefix caching. Speculative decoding. Prefill-decode disaggregation. If you’ve been anywhere near a conversation about running your own models lately, you’ve heard every one of those. Probably in the same sentence. Probably from somebody saying them very quickly. And there’s a decent chance you nodded. So this is everything you wanted to know about inference but were afraid to ask. We’re going through the whole machine in one pass. What an engine actually is, what it’s holding on that GPU, and every bit of jargon stacked on top of it. 12 ideas, give or take, a couple of minutes each. One thing to listen for as we go. These ideas don’t all arrive at once. Some bite the moment you deploy anything at all. Some wait until fifty people are talking to it. Some you may genuinely never need.Hugoen-us