Stories by Maro
I've been wondering about this for a while. Although building a competitive production-grade LLM [like ChatGPT-4o] is very far from trivial and the devil is in the details, the basic ideas and architecture is fairly well understood.<p>For a while, I've been wondering how production serving...
I noticed today in my Windows 11 Task Manager that I have ~10,000 threads. If I kill all traces of Chrome it's still at ~8,000. Sorting by thread count, System is ~500, Explorer is ~350, then it tails off. I do wonder why Dropbox.exe needs 250+ or Steamwebhelper.exe (Steam itself is not running...