Top all-time · #6854
Insanity Industries
Personal blog · insanity.industriessystemsprogramming
Insanity Industries is a personal blog at insanity.industries about systems and programming. Since 2020, 11 different Hacker News readers have linked it 12 times, most often “Pareto-Optimal Compression (2021)”. The last post was in 2022, but the archive is still widely read.
Too few sampled comments (5) to say how often HN recommends it.?
Why HN links it
HN readers link this blog for its compression analysis arguing that zstd is Pareto optimal, which commenters cite as the reference point in compression debates. A data-integrity post is also linked.
Summarised by Claude from a sample of 5 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Industrial production of readable insanity
Most-linked posts?
- Pareto-Optimal Compression (2021)6 people · 6 mentions · first linked 2022-04-24
- Preserving data integrity: A ZFS-inspired storage system3 people · 3 mentions · first linked 2020-03-07
- Simple Networking (2020)2 people · 2 mentions · first linked 2023-08-04
What Hacker News says?
If you're looking for a debate against ZStandard, its hard to argue against it. ZStandard is Pareto optimal. For the argument why, I really recommend this investigation. https://insanity.industries/post/pareto-optimal-compression/
Comment linking /post/pareto-optimal-compression/
on “Pack: A new container format for compressed files”Submitted Preserving data integrity: A ZFS-inspired storage system as a story · 56 points
HN discussionI bookmarked a ZFS-inspired storage system for preserving data integrity, and dm-integrity has a role there: https://insanity.industries/post/preserving-data-integrity/ Hacker News discussion: https://news.ycombinator.com/item?id=24372662
Comment linking /post/preserving-data-integrity/
on “A modular, extensible DIY NAS”Submitted Preserving data integrity: A ZFS-inspired storage system as a story · 5 points
HN discussionSomeone posted this [1] here recently which I found extremely informative. Unless I've missed something zstd outperforms bzip2 in all cases there? [1] https://insanity.industries/post/pareto-optimal-compression/
Comment linking /post/pareto-optimal-compression/
on “Bzip2 Format Specification (2016) [pdf]”Submitted Simple Networking (2020) as a story · 3 points
HN discussion> meant to have good ratios and good (de)compression speeds as compared to other tools That does not mean it's Pareto optimal; Pareto-optimality forms a curve and while zstd, LZMA, LZ4, ZPAQ all want to be as close as possible to the curve, they focus on different parts of it. In particular zstd tries to stay on the part of the curve where the curve has slope close to 1, while LZMA and LZ4 focus on opposite sides __…
Comment linking /post/pareto-optimal-compression/
on “An Ode to Bzip”Submitted Pareto-Optimal Compression (2021) as a story · 3 points
HN discussionThere was an analysis which argued that zstd is pareto optimal. https://insanity.industries/post/pareto-optimal-compression/
Comment linking /post/pareto-optimal-compression/
on “An Ode to Bzip”Submitted Pareto-Optimal Compression (2021) as a story · 2 points
HN discussionSubmitted Simple Networking in Linux as a story · 2 points
HN discussionSubmitted Reducing SATA power consumption under Linux as a story · 2 points
HN discussion