Popular repositories Loading

1. Efficient-LLM-Inference-Serving-Systems Efficient-LLM-Inference-Serving-Systems Public

   Why is LLM inference slow — and how do you make it fast? A hands-on, first-principles course: roofline → KV cache → quantization → parallelism → vLLM/SGLang, with GPU labs on open models.

   Python 19 1