This post introduces the journey of dynamic speculative decoding in SGLang and covers a bit on our spec decode training setup at LinkedIn.

This post summarizes how we used Flex Attention and custom triton kernels to support long context training for a EAGLE3 model in SpecForge.

A code walkthrough of of speculative decoding algorithm EAGLE3's implementation in Sglang.