Top all-time · #5293
blog.aggregateknowledge.com
Company blog · blog.aggregateknowledge.comdataprogramming
blog.aggregateknowledge.com is the company blog at blog.aggregateknowledge.com, writing about data and programming. Since 2011, 15 different Hacker News readers have linked it 23 times, most often “Sketch of the Day: HyperLogLog — Cornerstone of a Big Data Infrastructure”. No feed was found, so read it on the site itself.
Too few sampled comments (9) to say how often HN recommends it.?
Why HN links it
HN readers link this blog for clear explanations of probabilistic data structures, especially HyperLogLog, with graphs and a JavaScript demo, and for its comparisons of hash functions.
Summarised by Claude from a sample of 9 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Most-linked posts?
- Sketch of the Day: HyperLogLog — Cornerstone of a Big Data Infrastructure6 people · 6 mentions · first linked 2012-10-29
- Choosing a Good Hash Function3 people · 4 mentions · first linked 2012-05-29
- AWS Redshift: How Amazon Changed The Game2 people · 2 mentions · first linked 2013-05-16
What Hacker News says?
Here's an interesting probabilistic way to sample up to the median: http://blog.aggregateknowledge.com/2013/09/16/sketch-of-the-...
Comment linking /2013/09/16/sketch-of-the-day-frugal-streaming/
on “Don't use Hadoop when your data isn't that big”Submitted AWS Redshift: How Amazon Changed The Game as a story · 187 points
HN discussionThe top answer about HyperLogLog on stackoverflow links to this awesome visualization: http://www.aggregateknowledge.com/science/blog/hll.html SO Answer: http://stackoverflow.com/a/13074072/307293 Full blog post: http://blog.aggregateknowledge.com/2012/10/25/sketch-of-the-...
Comment linking /2012/10/25/sketch-of-the-day-hyperloglog-cornerstone-of-a-big-data-infrastructure/
on “Redis new data structure: the HyperLogLog”Submitted Sketch of the Day: HyperLogLog — Cornerstone of a Big Data Infrastructure as a story · 6 points
HN discussionA very good post helping explain HyperLogLog : http://blog.aggregateknowledge.com/2012/10/25/sketch-of-the-...
Comment linking /2012/10/25/sketch-of-the-day-hyperloglog-cornerstone-of-a-big-data-infrastructure/
on “Redis new data structure: the HyperLogLog”Submitted Sketch of the Day: HyperLogLog — Cornerstone of a Big Data Infrastructure as a story · 4 points
HN discussionFound these by coincidence, might be interesting to some of you.. (can't speak to the content) http://blog.aggregateknowledge.com/2011/12/05/choosing-a-goo... http://blog.aggregateknowledge.com/2011/12/29/choosing-a-goo... http://blog.aggregateknowledge.com/2012/02/02/choosing-a-goo...
Comment linking /2012/02/02/choosing-a-good-hash-function-part-3/
on “Which hashing algorithm is best for uniqueness and speed?”Submitted Adventures in Concurrency as a story · 4 points
HN discussionNice analysis. Since that post was submitted Murmurhash 3 and a number of other notable hash functions have been released. If you liked the linked post you should go read Aggregate Knowledge's series of posts on hash functions for a look at some newer algorithms: http://blog.aggregateknowledge.com/2012/02/02/choosing-a-goo...
Comment linking /2012/02/02/choosing-a-good-hash-function-part-3/
on “Which hashing algorithm is best for uniqueness and speed?”Submitted Streaming Algorithms and Sketches as a story · 4 points
HN discussionAccording to this comment http://blog.aggregateknowledge.com/2012/10/25/sketch-of-the-... , it's custom made and based on d3.
Comment linking /2012/10/25/sketch-of-the-day-hyperloglog-cornerstone-of-a-big-data-infrastructure/
on “Bloom Filters by example”Submitted Open Source Release: postgresql-hll (postgres hyperloglog) as a story · 3 points
HN discussionWell, there you are: a nice explanation of HyperLogLog, along with graphs, and a javascript demo to play with. And a tribute to Philippe Flajolet who came up with the algorithm. http://blog.aggregateknowledge.com/2012/10/25/sketch-of-the-... The Aggregate Knowledge blog is mind blowing for everything sketch related.
Comment linking /2012/10/25/sketch-of-the-day-hyperloglog-cornerstone-of-a-big-data-infrastructure/
on “Bloom Filters by example”- ot · 2013-03-08
Submitted Choosing a Good Hash Function as a story · 2 points
HN discussion Ingenious! This should work -- the uniform distribution property of hash functions is relied upon very heavily by other streaming algorithms such as HyperLogLog, and there has been sound empirical evaluation by the guys at Aggregate Knowledge of the properties of various hash functions: http://blog.aggregateknowledge.com/2012/02/02/choosing-a-goo... (Dunno why you include a prefix in the calculation above. hash(obj)…
Comment linking /2012/02/02/choosing-a-good-hash-function-part-3/
on “Algorithms Every Data Scientist Should Know: Reservoir Sampling ”Submitted Big Memory, Part 3 as a story · 2 points
HN discussionUse wix.com[1], learn to code[2]. In your description you say you have set up an OpenStack install at home, HTML/CSS is a walk in the park compared to that. Use launchrock[3] or mailchimp[4] to collect e-mails. "big data" really means big - as in millions of dollars big, tera/petabyte scale. Not going to happen with $5k. You will suffer to get anything close to AWS prices[5]. You could brand the service as "fat" ser…
Comment linking /2013/05/16/aws-redshift-how-amazon-changed-the-game/
on “Ask HN: What's 'Due Diligence' when vetting co-founders?”Submitted Choosing a Good Hash Function, Part 2 as a story · 2 points
HN discussion- ot · 2014-03-06
Submitted HyperLogLog – Cornerstone of a Big Data Infrastructure as a story · 1 points
HN discussion Submitted HyperLogLog Venn diagram in JavaScript as a story · 1 points
HN discussionSubmitted Postgres HLL Intersections as a story · 1 points
HN discussion
