PD Serving of Qwen3.8-2.4TSep 21, 2026·17 min readHow vLLM reaches 5K throughput and 180 interactivity on Qwen3.8-2.4T with GB300 NVL72 PD serving and how to reproduce results yourself.
