jzzliu/microgpt
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6 Commits 1 Branch 0 Tags
046b09c88f1dcf92c1e708df30ff5747ab7793d6
Commit Graph
4 Commits
Author SHA1 Message Date
jzzliu 046b09c88f Add speculative decoding with exact-distribution tests; expand README 
Draft proposes gamma tokens, target verifies them in one pass using rejection sampling
with residual resampling, and both KV caches roll back to the accepted prefix. Tests
check greedy equivalence and compare sampled output against the brute-force target
distribution; mutation checks confirm the test fails on deliberately broken variants.
 2026-11-07 20:33:28 -07:00
jzzliu 3657ef88a8 README: correct model line count 2026-11-07 20:19:18 -07:00
jzzliu 6b7927c16c Add microgpt: from-scratch GPT with RoPE, KV cache, sampling, tests and benchmark 2026-11-07 20:19:10 -07:00
jzzliu 5c1eb15b0a Initial commit 2026-11-08 02:55:44 +00:00