Figure 4 · Wide-EP decode kernels

Decode is bound by the memory path, so that is where the step time went

Wide-EP decode, 20 requests × 6 tokens per rank. Schematic; only the last step's bars are to scale.

One Rubin GPU, 212 SMs, two memory domains. Kernel names are DeepSeek's.

the change in this step unchanged work waiting, or not yet written