Top all-time · #8154
kipply's blog
Personal blog · kipp.ly/blogaiprogramming
kipply's blog is a personal blog at kipp.ly about ai and programming. Since 2022, 10 different Hacker News readers have linked it 13 times, most often “Transformer Inference Arithmetic”. It is still writing: the last post was on 2026-10-07, and you can follow it by feed.
Too few sampled comments (4) to say how often HN recommends it.?
Why HN links it
HN readers link kipp.ly posts on transformer inference arithmetic, which explains how to estimate LLM compute and cost, and on transformer taxonomy, a literature review of model architectures.
Summarised by Claude from a sample of 4 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Most-linked posts?
- Transformer Inference Arithmetic3 people · 3 mentions · first linked 2023-04-19
- Transformer Inference Arithmetic2 people · 2 mentions · first linked 2023-11-13
- Job Search Love Letters2 people · 2 mentions · first linked 2022-07-08
- Transformer Taxonomy (the last lit review)2 people · 2 mentions · first linked 2023-03-30
What Hacker News says?
Naively, yes, but you can cache the bulk of that "rerunning" [1]. That said the (non-flash) attention costs go up with the length of the sequence so perhaps this is just a simpler way to approximate these costs. [1] https://kipp.ly/blog/transformer-inference-arithmetic/
Comment linking /blog/transformer-inference-arithmetic/
on “Anthropic - Introducing 100K Token Context Windows, Around 75,000 Words”Submitted Transformer Inference Arithmetic as a story · 4 points
HN discussion"it depends" https://kipp.ly/transformer-inference-arithmetic/
Comment linking /transformer-inference-arithmetic/
on “Nvidia H200 Tensor Core GPU”Submitted Transformer Taxonomy (the last lit review) as a story · 4 points
HN discussionTwo other recent literature reviews worth reading: "Transformer Taxonomy" - https://kipp.ly/blog/transformer-taxonomy/ "Five years of progress in GPTs" - https://finbarrtimbers.substack.com/p/five-years-of-progress...
Comment linking /blog/transformer-taxonomy/
on “Understanding Large Language Models”Submitted Job Search Love Letters as a story · 3 points
HN discussionAnother related one: https://kipp.ly/blog/transformer-inference-arithmetic/
Comment linking /blog/transformer-inference-arithmetic/
on “EleutherAI: Transformer Math 101”Submitted Job Search Love Letters as a story · 2 points
HN discussionSubmitted System Design Interview Meta as a story · 2 points
HN discussionSubmitted Deep Dive into JIT Compiler Optimisations as a story · 2 points
HN discussionSubmitted Exploration of Escape Analysis in Language Implementations as a story · 2 points
HN discussionSubmitted Transformer Inference Arithmetic as a story · 1 points
HN discussionSubmitted Transformer Inference Arithmetic as a story · 1 points
HN discussion