Figure 3 · Packed KV cache: block ID → byte address
One flat allocation; every cache finds its bytes from the same block ID
Per GPU at TP8. The attention group and the three KDA groups share one pool of block rows; a block ID belongs to one group at a time. Each cache reads the row through its own view: offset + layer × layer_stride + b × block_stride + position.
MLA latent
Index keys
Views of the pool (bytes)
MLA latent pages
index-key pages
KDA states
unused / free
selected
Pick a token and layers
Block table