Top all-time · #4886
Tumblr
Company blog · word.bitly.comprogrammingsystems
Tumblr is the company blog at word.bitly.com, writing about programming and systems. Since 2012, 16 different Hacker News readers have linked it 20 times, most often “Bitly's realtime distributed message queue: processing at scale”. The last post was in 2017, but the archive is still widely read.
Too few sampled comments (10) to say how often HN recommends it.?
Why HN links it
Bitly's engineering blog, linked in HN threads for posts on NSQ, the messaging system Bitly built, and on running Go in production. Most commenters link it as background or an example.
Summarised by Claude from a sample of 10 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
The Bitly engineering blog
Most-linked posts?
- Bitly's realtime distributed message queue: processing at scale4 people · 6 mentions · first linked 2012-10-09
- /post/29550171827/go-go-gadget3 people · 3 mentions · first linked 2012-10-26
- Joining Bitly Engineering2 people · 2 mentions · first linked 2014-02-20
What Hacker News says?
I had asked a similar question on Quora [1] few years back. Here is the summary: - Facebook: https://www.facebook.com/Engineering?sk=notes - Google: http://google-engtools.blogspot.com/ - Twitter: http://engineering.twitter.com/ - Linkedin: http://engineering.linkedin.com/blog - Dropbox: https://tech.dropbox.com/ - Instagram: http://instagram-engineering.tumblr.com/ - Netflix: http://techblog.netflix.com/ - Flickr:…
Comment linking /
on “Ask HN: Which companies have the best blogs written by their engineering team?”Submitted Things We Forgot to Monitor as a story · 232 points
HN discussionThere are plenty accounts of Go in production: (Google's dl.google.com) https://groups.google.com/d/msg/golang-nuts/BNUNbKSypE0/E4qS... , (CloudFlare's Railgun) http://blog.cloudflare.com/go-at-cloudflare , (Bit.ly) http://word.bitly.com/post/29550171827/go-go-gadget , (SoundCloud) http://backstage.soundcloud.com/2012/07/go-at-soundcloud/ , (Disqus's realtime-backend) http://blog.disqus.com/post/51155103801/trying-o…
Comment linking /post/29550171827/go-go-gadget
on “Go After 2 Years in Production”Submitted Bitly's realtime distributed message queue: processing at scale as a story · 4 points
HN discussionI do believe marketing has something to do with it. I don't believe a random Google employee is allowed to disclose stuff about their infra permission is granted. This is not a bad thing mind you. Google is merely trying to win minds in the most friendly way possible. Neither did I said that this was a 'major' differentiator between Go and D. Just 'a' differentiator and not a major one at that. I have become slightl…
Comment linking /post/29550171827/go-go-gadget
on “dl.google.com now served by Go”Submitted Speeding things up with RedShift as a story · 2 points
HN discussion> Apart from Google (who uses it for Youtube), Go hasn't really been used in large projects. I don't know how large each of these projects is, but a growing number of companies are using it for serious projects: Iron.io: How We Went from 30 Servers to 2 with Go http://blog.iron.io/2013/03/how-we-went-from-30-servers-to-2... Behind the Scenes: Big Data at Torbit http://torbit.com/blog/2013/02/19/big-data-at-torbit/ p…
Comment linking /post/29550171827/go-go-gadget
on “Go 1.1 beta 1 Released”Submitted Lessons learned while post-processing 1.75 billion lines of Hadoop output as a story · 2 points
HN discussionbeanstalkd is a great project and it certainly inspired some of our thinking. I think of beanstalkd as a more fully functional alternative to simplequeue (what we built/used prior to NSQ - more details in our blog post http://word.bitly.com/post/33232969144/nsq ). Some of the goals of NSQ transcended just replacing our specific daemon that buffered and delivered messages (most importantly the interactions with the l…
Comment linking /post/33232969144/nsq
on “NSQ: Realtime distributed message processing at scale (in Go)”Submitted Introducing the Bitly Tech Podcast as a story · 1 points
HN discussionAgreed, a comparison would be helpful for highlighting the tradeoffs behind the choices we made. We do talk about the evolution of our infrastructure and the genesis of NSQ in our blog post, http://word.bitly.com/post/33232969144/nsq .
Comment linking /post/33232969144/nsq
on “NSQ: Realtime distributed message processing at scale (in Go)”Submitted Front End Dependency Management with Browserify as a story · 1 points
HN discussionSome of the background behind our decisions are on our blog post http://word.bitly.com/post/33232969144/nsq In terms of manual de-duping, we strive internally for idempotent message processing so it's fairly irrelevant, but to handle cases where it matters, all of our messages have unique id's added to them outside of NSQ. The actual cases where messages are handled multiple times is limited to when a client disappe…
Comment linking /post/33232969144/nsq
on “NSQ: Realtime distributed message processing at scale (in Go)”Submitted Joining Bitly Engineering as a story · 1 points
HN discussionprobably better off looking at http://word.bitly.com/post/33232969144/nsq http://nsq.io/
Comment linking /post/33232969144/nsq
on “NSQ – A realtime distributed messaging platform designed to operate at scale”Submitted 10 things Bit.ly forgot to monitor as a story · 1 points
HN discussiondisclaimer: co-author of NSQ [1] here Agreed. Message queues play an important role for us (bitly) in being a layer of fault tolerance, buffering, and a means to perform various operational tasks. They're so important to us that we decided to build something that worked exactly like we wanted. NSQ is a realtime distributed message processing system where we've taken the approach of focussing on making it ops friendl…
Comment linking /post/33232969144/nsq
on “Asynchronous Processing in Web Apps, Part 1: A Database Is Not a Queue”Submitted Building NSQ Client Libraries as a story · 1 points
HN discussionhttp://word.bitly.com/post/21721687297/clickatron
Comment linking /post/21721687297/clickatron
on “Bityl's Metric system Clickatron”Submitted Joining Bitly Engineering as a story · 1 points
HN discussion