Thread
Stories related to "microgpt - GPT in 200 lines" across the full archive.
The release of microgpt by Andrej Karpathy is a foundational moment for AI transparency. In exactly 243 lines of pure, dependency-free Python, Karpathy has implemented the complete GPT algorithm from scratch. As a PhD scholar investigating AI and Blockchain, I see this as the ultimate tool for movin...
TL;DR: Pure C99 GPT-2 engine, zero dependencies. Sub-1M-parameter “organelles” coordinate via a Planner-Worker-Judge pipeline and beat random opponents up to 91 % on logic games, all on CPU.<p>I’m a C/C++ architect focused on low-latency systems. Last year, I tried building agentic pipelines wi...
Show HN: Microgpt-ts – Full GPT in 500 lines of TypeScript, zero dependencies
(microgpt-ts.vercel.app)
I ported Karpathy's microgpt [1] to TypeScript. It implements a complete GPT-2 architecture (autograd, tokenizer, multi-head attention, RMSNorm, and Adam optimizer), all in ~500 lines with zero runtime dependencies. It runs natively in the browser, no Python runtime or backend needed.<p>You can...