Scaling Kimi K3 on AMD Instinct MI355X: Matching NVIDIA HGX B300 Throughput per GPU on AgentX
·24 min read
Inside the Kimi K3 optimization effort: understanding the bottlenecks and the decisions that made inference faster
#models
4 posts
Kimi K3 Performance Optimizations in vLLM: The Road to 2.8× Throughput
·7 min read
Kimi K3 serving optimizations across scheduling, KDA prefix caching, ReplaySSM state recovery, PD disaggregation and state offload, parallelism, MoE, and GPU kernels.
Kimi K3 Is Here: Efficient Day-0 Support on vLLM
·24 min read
vLLM delivers day-0 Kimi K3 serving with hybrid KDA prefix caching, DSpark speculative decoding, production-scale disaggregation, and optimized kernels across NVIDIA and AMD GPUs.
A Preview of Production-Scale Kimi K3 Support on vLLM
·13 min read
A preview of production-scale Kimi K3 support in vLLM, including KDA-aware prefix caching, fused kernels, optimized MXFP4 MoE, multimodal integration, and initial NVIDIA and AMD paths.