Fast & Efficient LLM Inference with vLLM: A New Course with DeepLearning.AI
·5 min read
What the DeepLearning.AI vLLM course teaches: optimizing, deploying, and benchmarking LLM inference with LLM Compressor quantization, GuideLLM, KV cache sizing, serving, and memory tradeoffs.