jzzliu/microgpt
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

README: correct model line count

Browse Source
This commit is contained in:
jzzliu
2026-11-07 20:19:18 -07:00
parent 6b7927c16c
commit 3657ef88a8
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+1 -1
View File
@@ -5,7 +5,7 @@ production LLM systems: rotary position embeddings, RMSNorm, SwiGLU, an incremen
**KV cache**, nucleus sampling, and a test suite that proves each piece is correct. **KV cache**, nucleus sampling, and a test suite that proves each piece is correct.
No `nn.Transformer`, no Hugging Face. Attention, masking, caching and sampling are all No `nn.Transformer`, no Hugging Face. Attention, masking, caching and sampling are all
written out explicitly (~250 lines of model code) so every line can be reasoned about. written out explicitly (~220 lines of model code) so every line can be reasoned about.
## What's inside ## What's inside