🦞🌯 Lobster Roll

Stories by jpreagan

Show HN: llmnop – Rust CLI for benchmarking LLM endpoints (github.com)
I built this because I needed to benchmark LLM inference endpoints and the existing tools required Python environments. I wanted a single binary I could grab quickly on any server.<p>I&#x27;ve also become interested in performance metrics like time to first token, inter-token latency, throughput, an...
Is AI eating your coding skills? (jpreagan.com)
Llmnop, a tiny Rust rewrite of LLMPerf (github.com)
How I Learned to Stop Worrying and Love OpenClaw (jpreagan.com)