Figure 3 · Packed KV cache: block ID → byte address

One flat allocation; every cache finds its bytes from the same block ID

Per GPU at TP8. The attention group and the three KDA groups share one pool of block rows; a block ID belongs to one group at a time. Each cache reads the row through its own view: offset + layer × layer_stride + b × block_stride + position.

MLA latent
Index keys

Views of the pool (bytes)

MLA latent pages index-key pages KDA states unused / free selected

Pick a token and layers

Block table