Disaggregated Serving for Hybrid SSM Models in vLLM
·15 min read
How vLLM extends NIXL prefill/decode disaggregation to hybrid SSM-attention models with dual descriptor views, physical-logical block bridging, and Mamba conv-state transfer support.
#mamba
1 post