Commit Graph
1 Commits
Author SHA1 Message Date
jzzliu 046b09c88f Add speculative decoding with exact-distribution tests; expand README
Draft proposes gamma tokens, target verifies them in one pass using rejection sampling
with residual resampling, and both KV caches roll back to the accepted prefix. Tests
check greedy equivalence and compare sampled output against the brute-force target
distribution; mutation checks confirm the test fails on deliberately broken variants.
2026-11-07 20:33:28 -07:00