Top all-time · #15090
Kartikey Chauhan
Personal blog · carteakey.devaiprogrammingdata
Kartikey Chauhan's personal blog at carteakey.dev covers ai, programming and data. Since 2025, 5 different Hacker News readers have linked it 8 times, most often “Local LLM Inference Optimization: The Complete Guide”. It is still writing: the last post was on 2026-10-29, and you can follow it by feed.
Too few sampled comments (2) to say how often HN recommends it.?
Why HN links it
HN readers link Kartikey Chauhan's writing on local LLM inference, including guides on optimizing gpt-oss-120b and running models locally. Commenters point to it as background for CPU versus GPU and memory-bandwidth trade-offs.
Summarised by Claude from a sample of 2 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Personal workbench and writing index of Kartikey Chauhan. Senior Data Analyst at McAfee, exploring analytics, local AI, and homelabs.
Most-linked posts?
- Local LLM Inference Optimization: The Complete Guide2 people · 2 mentions · first linked 2026-06-22
What Hacker News says?
There was an interesting post to r/LocalLLaMA yesterday from someone running inference mostly on CPU: https://carteakey.dev/optimizing%20gpt-oss-120b-local%20infe... One of the observations is how much difference memory speed and bandwidth makes, even for CPU inference. Obviously a CPU isn't going to match a GPU for inference speed, but it's an affordable way to run much larger models than you can fit in 24GB or eve…
Comment linking /optimizing%20gpt-oss-120b-local%20inference/
on “25L Portable NV-linked Dual 3090 LLM Rig”Submitted The Rise of Overfit Inference Engines as a story · 3 points
HN discussionIt depends what your goals are and what you are using it for. This space is fluid and my answer last week would be different than my answer today! That said there’s no substitute for hard work, here are some resource to get you up to up to speed: https://carteakey.dev/blog/local-inference/local-llm-optimiz... https://botmonster.com/ai/self-hosted-ai-agent-frameworks-20... Personally I find myself swapping models dep…
Comment linking /blog/local-inference/local-llm-optimization/
on “AI's Affordability Crisis”Submitted Ghiblify Everything, or Should We? as a story · 3 points
HN discussionSubmitted The Unforwarder: How I stopped backing up junk photos as a story · 3 points
HN discussionSubmitted Rooting a locked-down Hisense VIDAA TV and running Doom as a story · 2 points
HN discussionSubmitted Local LLM Inference Optimization: The Complete Guide as a story · 2 points
HN discussionSubmitted Don't give away to the gradient descent as a story · 1 points
HN discussion