Inference
Prefix Cache vs KV Cache in LLM Inference
Distinguish the attention state stored during generation from reuse of that state across requests.
Documentation-based guideINFERENCE LAB / INFERENCE
SGLang
Deploy, serve and optimize. Practical notes on the engines behind LLM inference.
Inference
Qwen3.8-27B on 4×RTX 4090: Deployment Guide
A deployment validation plan for Qwen3.8-27B, covering hardware inventory, version pinning and a reproducible acceptance test.
Documentation-based guideInference
SGLang MTP / NEXTN Explained
Separate speculative decoding concepts from model- and release-specific launch options.
Documentation-based guideInference
vLLM vs SGLang: Choosing an Inference Engine
Choose an inference engine using workload compatibility, reproducibility and operational requirements—not an unqualified leaderboard.
Documentation-based guide