Top all-time · #5842
Marc Garcia
Personal blog · datapythonista.me/blogdataprogramming
Marc Garcia writes datapythonista blog, a personal blog at datapythonista.me about data and programming. Since 2023, 14 different Hacker News readers have linked it 16 times, most often “Pandas 2.0 and the Arrow revolution (part I)”. It is still writing: the last post was on 2026-01-25, and you can follow it by feed.
Too few sampled comments (6) to say how often HN recommends it.?
Why HN links it
HN commenters link Marc Garcia's blog posts on pandas 2.0 and its move to the Apache Arrow backend, citing them for pandas performance and interoperability with Polars. The comments do not judge the writing.
Summarised by Claude from a sample of 6 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Most-linked posts?
- Pandas 2.0 and the Arrow revolution (part I)7 people · 9 mentions · first linked 2023-02-28
- How fast can we process a CSV file3 people · 3 mentions · first linked 2024-02-23
- Pandas 2.0 and the Arrow revolution (part I)2 people · 2 mentions · first linked 2023-02-23
What Hacker News says?
Pandas has also moved to Apache Arrow as a backend [1], so it’s likely performance will be similar when comparing recent versions. But it’s great to have some friendly competition. [1] https://datapythonista.me/blog/pandas-20-and-the-arrow-revol...
Comment linking /blog/pandas-20-and-the-arrow-revolution-part-i
on “Polars”Submitted Pandas 2.0 and the Arrow revolution (part I) as a story · 12 points
HN discussionThe submission link points to the blog instead of the specific post. It should be: https://datapythonista.me/blog/pandas-20-and-the-arrow-revol...
Comment linking /blog/pandas-20-and-the-arrow-revolution-part-i
on “Pandas 2.0 and the Arrow revolution (part I)”Submitted How fast can we process a CSV file as a story · 11 points
HN discussionBiggest performance games most people will see will be dealing with strings when using the pyarrow backend since those are now a native type and not wrapped in a python object. But for people who are looking for the performance polars gives with all the nice APIs of pandas, the big news is, since polars and pandas will now both use arrow for the underlying data, you can convert between the two kinds of dataframes wi…
Comment linking /blog/pandas-20-and-the-arrow-revolution-part-i
on “Pandas v2.0 Released”Submitted How fast can we process a CSV file as a story · 3 points
HN discussionI know arrow support is only part way their with this release - but this is a huge deal for Pandas, for standardisation as whole, but also speed ups. Benchmarking that was shared a while back here suggests 2x speed ups in some cases, 30x if you count strings since pandas uses python's in-built string data type[1] [1] https://datapythonista.me/blog/pandas-20-and-the-arrow-revol...
Comment linking /blog/pandas-20-and-the-arrow-revolution-part-i
on “Pandas v2.0 Released”Submitted How fast can we process a CSV file as a story · 3 points
HN discussionPre-release this was a reason [1]. Not sure if its still a compatibility reason: > There is also an option to let pandas know we want Arrow backed types by default. The option at the time of writing this article is partially implemented and has a confusing API. In particular, it's not yet working when creating data with pandas.Series or pandas.DataFrame. And for loading data from files it will only work when the par…
Comment linking /blog/pandas-20-and-the-arrow-revolution-part-i
on “Pandas v2.0 Released”Submitted What's New in Pandas 3 as a story · 1 points
HN discussion(This is more of a link-dump than a paper discussion --) For the line of inquiry w.r.t tensor compilers and MLIR/LLVM (linalg, polyhedral, [sparse_]tensor, etc), I personally found the following really helpful: https://news.ycombinator.com/item?id=25545373 (links to a survey), https://github.com/merrymercy/awesome-tensor-compilers I also have an interest in the community more widely associated with pandas/dataframes…
Comment linking /blog/pandas-20-and-the-arrow-revolution-part-i
on “The Distributed Tensor Algebra Compiler (2022)”Submitted Pandas with Rows (2022) as a story · 1 points
HN discussionSubmitted Pandas 2.0 and the Arrow revolution (part I) as a story · 1 points
HN discussionSubmitted Pandas 2.0 and the Arrow revolution (part I) as a story · 1 points
HN discussionSubmitted Pandas 2.0 and the Arrow revolution (part I) as a story · 1 points
HN discussionSubmitted Pandas 2.0 and the Arrow revolution (part I) as a story · 1 points
HN discussion
