Top all-time · #1334
Todd W. Schneider
Personal blog · toddwschneider.com · on HN as lil_teedataeconomics
Todd W. Schneider's personal blog at toddwschneider.com covers data and economics. Since 2014, 55 different Hacker News readers have linked it 91 times, most often “Analyzing 1.1B NYC Taxi and Uber Trips”. The last post was in 2020, but the archive is still widely read.
Hi, I'm Todd. Sometimes I write about things that I find interesting, which can be anything from math to business to sports or culture.
Most-linked posts?
- Analyzing 1.1B NYC Taxi and Uber Trips12 people · 12 mentions · first linked 2015-11-17
- Taxi and Ridehailing Usage in New York City3 people · 6 mentions · first linked 2019-03-05
- A Tale of Twenty-Two Million Citi Bikes: Analyzing the NYC Bike Share System3 people · 3 mentions · first linked 2016-01-13
- Interactive NBA Shot Charts with R and Shiny3 people · 3 mentions · first linked 2016-03-08
- The Traveling Salesman with Simulated Annealing, R, and Shiny3 people · 3 mentions · first linked 2014-09-17
- Show HN: Hacker News Front Page Trends2 people · 3 mentions · first linked 2019-05-13
- When Citi Bikes Are Faster Than Taxis in New York City2 people · 2 mentions · first linked 2017-09-26
- /dashboards/hacker-news-trends/?q=lisp%2C+rust&f=title&s=text&m=frac_items&t=year2 people · 2 mentions · first linked 2022-09-14
- Ride-hailing’s NYC dominance, and the impact of DeleteUber2 people · 2 mentions · first linked 2018-03-14
- Taxi and Ridehailing Usage in Chicago2 people · 2 mentions · first linked 2019-11-19
What Hacker News says?
The share of taxi rides in Manhattan has decreased by almost the same amount Lyft and Uber rides have increased [1]. The overall number of rides has increased in the other boroughs due to Lyft and Uber ridership. 1. http://toddwschneider.com/posts/analyzing-1-1-billion-nyc-ta...
Comment linking /posts/analyzing-1-1-billion-nyc-taxi-and-uber-trips-with-a-vengeance/
on “Uber Founder Travis Kalanick Resigns as C.E.O.”Submitted The Reddit Front Page Is Not a Meritocracy as a story · 485 points
HN discussion50-50 seems unlikely: http://toddwschneider.com/posts/taxi-uber-lyft-usage-new-yor...
Comment linking /posts/taxi-uber-lyft-usage-new-york-city/
on “Ride-hailing apps may help to curb drunk driving”Submitted Open-Source Loan-Level Analysis of Fannie and Freddie as a story · 280 points
HN discussion> market capture really work if they had to raise their prices so much as to make the service unworkable for most people? Hate to say it, but in this case you’re not the market so you are irrelevant. Here’s data from Chicago, USA, showing Uber and Lyft dominate the market now, so yes, it worked. https://toddwschneider.com/dashboards/chicago-taxi-ridehaili...
Comment linking /dashboards/chicago-taxi-ridehailing-data/
on “Amazon Is Gutting Its AI Division After Sustained Failure”Submitted When Citi Bikes Are Faster Than Taxis in New York City as a story · 204 points
HN discussionread the report https://transparencyreport.uber.com/ the 12M users are mostly demands from regulatory authorities - 6M is California, likely CPUC - 3M is New York, probably the TLC there that's how you get the data sets for analysis like http://toddwschneider.com/posts/analyzing-1-1-billion-nyc-ta... which appear on HN periodically and are eagerly upvoted the regulators make this a requirement for Uber to open or co…
Comment linking /posts/analyzing-1-1-billion-nyc-taxi-and-uber-trips-with-a-vengeance/
on “Uber says it gave U.S. agencies data on more than 12M users”Submitted The Simpsons by the Data as a story · 158 points
HN discussionAccording to this[1], 4% of all front page links (4/day) in 2019 have been to NYT articles. That was only one example, and it doesn't account for time on the front page, which is almost certainly much longer for NYT links. [1] https://toddwschneider.com/dashboards/hacker-news-trends/?q=...
Comment linking /dashboards/hacker-news-trends/?q=wsj.com&f=domain&s=text&m=frac_items&t=year
on “Quiet Hacker News (2017)”Submitted The Traveling Salesman with Simulated Annealing, R, and Shiny as a story · 158 points
HN discussionI recently attended a talk about the growth in volume of rides in NYC that Uber has been providing. It was contrasted against a mostly flat (if slightly declining) volume for yellow cabs (remember, they're not making any more medallions). He blogged about it here: http://toddwschneider.com/posts/analyzing-1-1-billion-nyc-ta... - chart here: http://toddwschneider.com/data/taxi/uber_vs_taxi_pickups_bro... He deplores…
Comment linking /data/taxi/uber_vs_taxi_pickups_brooklyn.png
on “Douglas Rushkoff: I’m thinking it may be good to be off social media altogether”Submitted A Tale of Twenty-Two Million Citi Bikes: Analyzing the NYC Bike Share System as a story · 152 points
HN discussionIf you will use S3 as a storage for cold data it can be become just S3(or other object storage) cost. And ClickHouse compression rates for Twitter-like data can be 10x or better as you do not store raw data and data in stored in columns. Concerning ingestion costs, I think it took me ~10 hours of 4vCPU vm last time, when I loaded 1.5 TB data to ClickHouse from this dataset: http://toddwschneider.com/posts/analyzing-…
Comment linking /posts/analyzing-1-1-billion-nyc-taxi-and-uber-trips-with-a-vengeance/
on “Twitter plans to comply with Musk’s demands for data”Submitted Using Countdown Clock Data to Understand the New York City Subway as a story · 151 points
HN discussionFor ridesharing apps, at least, it seems clear that the gig economy has grown the total market and hence the number of workers needed to serve this market. Before Uber entered New York there were ~500k cab trips per day: now, yellow cabs only serve 250k trips but 700k trips are performed by ridesharers [1]. The negative effect on employment is about 3x smaller than the positive one. [1] https://toddwschneider.com/da…
Comment linking /dashboards/nyc-taxi-ridehailing-uber-lyft-data/
on “The gig economy is quietly undermining a century of worker protections”Submitted Analyzing 1.1B NYC Taxi and Uber Trips as a story · 140 points
HN discussioncheck out http://toddwschneider.com/posts/ballr-interactive-nba-shot-c...
Comment linking /posts/ballr-interactive-nba-shot-charts-with-r-and-shiny/
on “Every shot Kobe Bryant ever took”Submitted Taxi, Uber, and Lyft Usage in New York City as a story · 117 points
HN discussionYou can download data for over a billion taxi rides in NYC: http://toddwschneider.com/posts/analyzing-1-1-billion-nyc-ta... The linked blog post literally tracks employees of individual companies and sees where they live.
Comment linking /posts/analyzing-1-1-billion-nyc-taxi-and-uber-trips-with-a-vengeance/
on “Uber employees 'spied on ex-partners, politicians and Beyoncé' (2016)”Submitted The TechCrunch Bubble Index: Parsing Headlines to Quantify Startup Hype as a story · 114 points
HN discussionA while back someone posted a cool simulated annealing post of this[0]. The app seems to be down, but the code is there in case anyone wants to take a look. [0] http://toddwschneider.com/posts/traveling-salesman-with-simu...
Comment linking /posts/traveling-salesman-with-simulated-annealing-r-and-shiny/
on “The Traveling Salesperson Problem”Submitted Interactive NBA Shot Charts with R and Shiny as a story · 111 points
HN discussionSelect all and copy-paste from the webpage http://toddwschneider.com/stocks/ in chrome into Libreoffice Calc is parsed as expected.
Comment linking /stocks/
on “Show HN: A free, lightweight static page to get stock quotes using the IEX API”Submitted In Brooklyn, Uber is now bigger than taxis as a story · 98 points
HN discussion> Here in NYC Uber has pretty much entirely replaced yellow cabs Yes for ride hailing [1]. If I recall correctly, Uber gets about 60% of that. > their prices are a hell of a lot higher than they used to be Inflation adjusted? And relative to TLC fares? I remember when taking a cab was a deal compared to Uber, but that hasn’t been the case for years. [1] https://toddwschneider.com/dashboards/nyc-taxi-ridehailing-u...
Comment linking /dashboards/nyc-taxi-ridehailing-uber-lyft-data/
on “Uber to introduce fixed-route shuttles in major US cities”Submitted What is the Longest Disambiguation Page on Wikipedia? as a story · 97 points
HN discussionI'll just add to this thread that a large % of Citibike members in NYC are also owners of personal bicycles (like myself - unfortunately can't find source atm). My personal use case for Citibike are short/moderate length trips(1-4 mile) in the city core (Manhattan) where public transportation is unwieldy. Depending on your origin and destination, what is a 10/20 mins ride on a Citibike is easily a 30/40 mins ride on…
Comment linking /posts/a-tale-of-twenty-two-million-citi-bikes-analyzing-the-nyc-bike-share-system/
on “Lyft Follows Uber Into Bike-Sharing Lane, Buying Owner of CitiBike”Submitted Analysis of 100M Taxi Trips in Chicago Shows Usage Declining 35% per Year as a story · 96 points
HN discussionThis is kind of crazy but really interesting as a sort of extreme manifestation of data-centric applications. I say it's crazy, but startups like Supabase are essentially building the professional version of your idea. The share of discourse on HN about PostgreSQL, SQL, and Databases is growing noticeably. [0] I, for one, hope we are seeing the pendulum swing back from code-centric architectures and NoSQL to a new g…
Comment linking /dashboards/hacker-news-trends/?q=postgresql%2Csql%2Cdatabase&f=title&s=text&m=frac_items&t=year
on “Building single-page-apps with PostgREST”Submitted Trends in Show HN posts as a story · 93 points
HN discussion