jzzliu/microgpt
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6 Commits 1 Branch 0 Tags
57106ca776cc7bf4ea45ad69fd94f2b5d3d5978f
Commit Graph
4 Commits
Author SHA1 Message Date
jzzliu 57106ca776 Add speculative decoding with exact-distribution tests; expand README 
Draft proposes gamma tokens, target verifies them in one pass using rejection sampling
with residual resampling, and both KV caches roll back to the accepted prefix. Tests
check greedy equivalence and compare sampled output against the brute-force target
distribution; mutation checks confirm the test fails on deliberately broken variants.
 2026-11-07 20:33:28 -07:00
jzzliu e8a20db1a3 README: correct model line count 2026-11-07 20:19:18 -07:00
jzzliu 2ce8b739ed Add microgpt: from-scratch GPT with RoPE, KV cache, sampling, tests and benchmark 2026-11-07 20:19:10 -07:00
jzzliu d21736432e Initial commit 2026-11-08 02:55:44 +00:00