Top all-time · #579
Tech Blog
Personal blog · tech.marksblogg.com · on HN as marklitdataprogramming
Tech Blog is a personal blog at tech.marksblogg.com about data and programming. Since 2014, 103 different Hacker News readers have linked it 357 times, most often “Summary of the 1.1B Taxi Rides Benchmarks”. It is still writing: the last post was on 2026-09-16, and you can follow it by feed.
Rarely recommended · 5 of 40 sampled comments recommend it?
Why HN links it
HN readers link Mark Litwintschik's tech blog for its database benchmarks on NYC taxi rides, which commenters call among the best for data engineering. Many comments are MapD job posts citing it.
- Recommended for · 5 comments
- Called amazing and a fantastic series; one commenter says it paints a clear picture of GPU performance.
Summarised by Claude from a sample of 40 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
Most-linked posts?
- /benchmarks.html18 people · 20 mentions · first linked 2018-11-30
- Summary of the 1.1B Taxi Rides Benchmarks17 people · 24 mentions · first linked 2017-01-25
- 1.1B Taxi Rides on Kdb+/q and 4 Xeon Phi CPUs6 people · 6 mentions · first linked 2017-01-25
- The Fastest FizzBuzz Implementation5 people · 5 mentions · first linked 2021-11-25
- A Billion Taxi Rides in PostgreSQL4 people · 4 mentions · first linked 2016-03-27
- Rocket: A Web Framework for Rust3 people · 5 mentions · first linked 2021-09-16
- 1.1 Billion Taxi Rides with MapD & 8 Nvidia Pascal Titan Xs3 people · 4 mentions · first linked 2016-08-15
- IPinfo's Free IP Address Location Database3 people · 4 mentions · first linked 2023-05-25
- 1.1B Taxi Rides Using Hydrolix on AWS3 people · 3 mentions · first linked 2021-02-04
- 1.1B Taxi Rides Using OmniSciDB and a MacBook Pro3 people · 3 mentions · first linked 2020-07-21
What Hacker News says?
Nothing matches kdb's speed except GPU-accelerated DBs: https://tech.marksblogg.com/benchmarks.html
Comment linking /benchmarks.html
on “Jd”Submitted OpenStreetMap's New Vector Tiles as a story · 497 points
HN discussionSharing for anyone who didn't know there is a very good dataset you can use now. If you don't have a nvme ssd in your computer, I highly recommend getting one for fast i/o. http://commoncrawl.org/ http://commoncrawl.org/the-data/ http://index.commoncrawl.org/ related.. Mark's blog is amazing and worth more than any data science degree imho. https://tech.marksblogg.com/petabytes-of-website-data-spark-... https://tech…
Comment linking /
on “To Break Google’s Monopoly on Search, Make Its Index Public”Submitted A Minimalist Guide to SQLite as a story · 472 points
HN discussionMapD | San Francisco (city) | Backend Developer, Frontend Visualization Developer, Technical Marketing Director (ONSITE) MapD ( https://www.mapd.com ) is a Google Ventures/Nvidia/Verizon Ventures/Vanedge/In-Q-Tel backed Series A startup that builds a lightning-fast GPU-accelerated database and visual analytics platform that takes advantage of the massive parallelism and high memory bandwidth of GPUs. We can literall…
Comment linking /billion-nyc-taxi-rides-nvidia-tes...
on “Ask HN: Who is hiring? (November 2016)”Submitted The iPhone 15 Pro’s Depth Maps as a story · 358 points
HN discussionVery little, I'm guessing; cstore_fdw is not remotely competitive with mature analytics DBMS. see here: https://tech.marksblogg.com/benchmarks.html
Comment linking /benchmarks.html
on “Microsoft acquires Citus Data (YC S11)”Submitted 1.1B Taxi Rides on Kdb+/q and 4 Xeon Phi CPUs as a story · 316 points
HN discussionMapD | San Francisco (city) | Backend Developer, Frontend Visualization Developer, Developer Advocate (ONSITE/REMOTE) MapD ( https://www.mapd.com ) is a NEA/Google Ventures/Nvidia/Verizon Ventures/Vanedge/In-Q-Tel backed Series B startup that builds a lightning-fast open source GPU-accelerated database and visual analytics platform that takes advantage of the massive parallelism and high memory bandwidth of GPUs. We…
Comment linking /billion-nyc-taxi-rides-nvidia-pascal-titan-x-mapd.html
on “Ask HN: Who is hiring? (October 2017)”Submitted MeiliSearch: A Minimalist Full-Text Search Engine as a story · 315 points
HN discussionMapD | San Francisco (city), | Backend Developer, Frontend Visualization Developer, Developer Advocate (ONSITE/REMOTE) MapD ( https://www.mapd.com ) is a NEA/Google Ventures/Nvidia/Verizon Ventures/Vanedge/In-Q-Tel backed Series B startup that builds a lightning-fast open source GPU-accelerated database and visual analytics platform that takes advantage of the massive parallelism and high memory bandwidth of GPUs. W…
Comment linking /billion-nyc-taxi-rides-nvidia-tes...
on “Ask HN: Who is hiring? (October 2017)”Submitted Pretty maps in Python as a story · 301 points
HN discussionMapD | San Francisco (city) | MapD Community Manager, Backend Developer, Director of Application Design, Frontend Engineer, Senior Graphics Engineer, other roles (ONSITE/REMOTE) MapD ( https://www.mapd.com ) is an open source NEA/Google Ventures/Nvidia/Verizon Ventures/Vanedge/In-Q-Tel backed Series B startup that builds a lightning-fast GPU-accelerated database and visual analytics platform that takes advantage of…
Comment linking /billion-nyc-taxi-rides-nvidia-tes...
on “Ask HN: Who is hiring? (July 2017)”Submitted The Fastest FizzBuzz Implementation as a story · 261 points
HN discussionMapD | San Francisco (city) | Backend Developer, Frontend Visualization Developer, Technical Marketing Director (ONSITE) MapD ( https://www.mapd.com ) is a Google Ventures/Nvidia/Verizon Ventures/Vanedge/In-Q-Tel backed Series A startup that builds a lightning-fast GPU-accelerated database and visual analytics platform that takes advantage of the massive parallelism and high memory bandwidth of GPUs. We can literall…
Comment linking /billion-nyc-taxi-rides-nvidia-tes...
on “Ask HN: Who is hiring? (January 2017)”Submitted MinIO: A Bare Metal Drop-In for AWS S3 as a story · 260 points
HN discussionXOR is used in one of the LEET fizzbuzz answers: https://tech.marksblogg.com/fastest-fizz-buzz.html
Comment linking /fastest-fizz-buzz.html
on “XOR”Submitted Satellogic's Open Satellite Feed as a story · 256 points
HN discussion> Today, we’re very happy with Redshift, and we have 5 billion rows stored in our database. 1.4 billion of our connection logs (24 fields) takes up 89G on my clickhouse VM. 5 billion records would take ~320G. Based on http://tech.marksblogg.com/benchmarks.html a 6-node ds2.8xlarge redshift cluster is about as fast as clickhouse on a single i5.
Comment linking /benchmarks.html
on “Don't use Hadoop when your data isn't that big (2013)”Submitted Satellites Spotting Aircraft as a story · 233 points
HN discussionMapD | San Francisco (city), | Backend Developer, Frontend Visualization Developer, Developer Advocate (ONSITE/REMOTE) MapD ( https://www.mapd.com ) is a NEA/Google Ventures/Nvidia/Verizon Ventures/Vanedge/In-Q-Tel backed Series B startup that builds a lightning-fast open source GPU-accelerated database and visual analytics platform that takes advantage of the massive parallelism and high memory bandwidth of GPUs. W…
Comment linking /billion-nyc-taxi-rides-nvidia-pascal-titan-x-mapd.html
on “Ask HN: Who is hiring? (December 2017)”Submitted American solar farms as a story · 223 points
HN discussionQGIS is the shit. I absolutely love it, great for visualizing GeoJSON, GeoTIFF files, open data feeds, etc. My one gripe is that their macOS installers have been out of date for ages now, the best way I've found is to actually install from Conda Forge directly: > brew install micromamba > mamba install qgis It's really crazy the number of open geospatial data feeds that exist out there from NASA, NOAA, and ESA. If y…
Comment linking /
on “QGIS is a free, open-source, cross platform geographical information system”Submitted Wyvern's Open Satellite Feed as a story · 205 points
HN discussionMapD | San Francisco (city) | Backend Developer, Frontend Visualization Developer (ONSITE) MapD ( http://www.mapd.com ) is a Google Ventures/Nvidia/Verizon Ventures/Vanedge backed Series A startup that builds a lightning-fast GPU-accelerated database and visual analytics platform that takes advantage of the massive parallelism and high memory bandwidth of GPUs. We can literally run queries orders of magnitude faster…
Comment linking /billion-nyc-taxi-rides-nvidia-tesla-mapd.html
on “Ask HN: Who is hiring? (July 2016)”Submitted 1.1B Taxi Rides Using OmniSciDB and a MacBook Pro as a story · 205 points
HN discussion> The only taxi problem that comes to mind It's the problem that I linked to previously. http://tech.marksblogg.com/benchmarks.html Finding good benchmarks is hard: Business problems are a good one because these are the ways experts will solve problems using these tools, and we can discuss the choice of tooling, whether this is the right way to solve the problem, and even what the best tools for this problem is -- i…
Comment linking /benchmarks.html
on “The JVM is not that heavy”Submitted Satellites Spotting Ships as a story · 195 points
HN discussion> Who said the 10MB is all used at once? The parent was suggesting that this was all that was actually needed out of the 100mb or so downloadable. If you think the JVM is smaller, how small is it exactly? > If you were referring strictly to CPU cache, then I'm even more confused, because the entire existence of that stuff is predicated on it being faster than memory, so... (and even still, if your total CPU cache is…
Comment linking /benchmarks.html
on “The JVM is not that heavy”Submitted Planet Labs' open satellite feed as a story · 192 points
HN discussion
