Throughput vs. Latency
Latency
Median (p50)
Sample p95
Sample p99
Curves
All MXFP8 curves
MXFP8 / SP4
Rubin MXFP8
Test setup