#speculators

2 posts

Parallel All the Way Down: Beyond Single-Token Generation with Speculative Decoding

Jul 28, 2026·7 min read

Speculators and vLLM now support P-EAGLE, DFlash, and DSpark — three parallel drafting algorithms that move beyond sequential token generation to deliver faster, simpler, and more scalable speculative decoding for LLM serving.

Accelerating Laguna XS.2 Inference with vLLM, Speculators, and LLM Compressor

May 28, 2026·3 min read

How Laguna XS.2 is served and optimized in vLLM using first-class model integration, a DFlash speculator trained with Speculators, and FP8, NVFP4, INT4, and INT8 checkpoints from LLM Compressor.