Top all-time · #4957
Apify Blog
Company blog · blog.apify.comwebdataai
Apify Blog is the company blog at blog.apify.com, writing about web, data and ai. Since 2017, 16 different Hacker News readers have linked it 29 times, most often “Is Web Scraping Legal?”. It is still writing: the last post was on 2026-11-02, and you can follow it by feed.
Too few sampled comments (3) to say how often HN recommends it.?
Why HN links it
HN readers link Apify's blog for web scraping how-tos, such as a workaround for headless Chrome and Puppeteer and a guide to making an RSS feed from a site that has none.
Summarised by Claude from a sample of 3 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Learn how to use Apify Actors to get real-time web data, generate leads, monitor social media, and integrate your apps and agents.
Most-linked posts?
- Is Web Scraping Legal?3 people · 3 mentions · first linked 2021-09-06
What Hacker News says?
There are many legitimate and legal use cases where one might want to circumvent blocking of bots. We believe that everyone has the moral right to access and fairly use non-personal publicly available data on the web the way they want, not just the way the publishers want them to. This is the core founding principle of the open web, which allowed the web to become what it is today. BTW we continuously update this ex…
Comment linking /is-web-scraping-legal/
on “Show HN: Crawlee for Python – a web scraping and browser automation library”Submitted Is Web Scraping Legal? as a story · 33 points
HN discussionThere's a workaround - https://blog.apify.com/how-to-make-headless-chrome-and-puppe...
Comment linking /how-to-make-headless-chrome-and-puppeteer-use-a-proxy-server-with-authentication-249a21a79212
on “Show HN: Headless Chrome Crawler”Submitted The accidental click that changed everything: the Apify origin story as a story · 24 points
HN discussionCheck out my previous blogpost - how to easily create a RSS feed for websites that don't have it https://blog.apify.com/how-to-turn-any-website-into-an-rss-f...
Comment linking /how-to-turn-any-website-into-an-rss-feed-a8f9f216e1b0
on “How to never miss a beat on ever changing websites”Submitted Google Custom Search API is shutting down: migration guide and alternatives as a story · 15 points
HN discussionSubmitted IP session management and smart proxy rotation as a story · 7 points
HN discussionSubmitted How to get data from Hacker News with unofficial HN API as a story · 6 points
HN discussionSubmitted Show HN: Make regular passive income developing web automation actors as a story · 4 points
HN discussionSubmitted Using a man-in-the-middle proxy to scrape data from a mobile app API as a story · 4 points
HN discussionSubmitted Sponja found 897 companies running webinars (and who runs them) for under $20 as a story · 3 points
HN discussionSubmitted Get passive income building actors: Pays more than open source, easier than SaaS as a story · 3 points
HN discussionSubmitted Is Web Scraping Legal? as a story · 2 points
HN discussionSubmitted How to Scrape Paginated Websites as a story · 2 points
HN discussionSubmitted Are website terms of use enforced? as a story · 2 points
HN discussionSubmitted Who are your organization's GitHub champions? as a story · 2 points
HN discussionSubmitted Scrape Hotel Data from Booking.com as a story · 2 points
HN discussionSubmitted 10x more tools on x402 as a story · 1 points
HN discussionSubmitted Apify is launching MCP connectors to give Actors access to external apps as a story · 1 points
HN discussionSubmitted Combine web scraping with LLMs to create AI tools in 10 minutes (no clickbait) as a story · 1 points
HN discussionSubmitted Web Scraping Tutorial Using Crawlee as a story · 1 points
HN discussionSubmitted An easy way to scrape HTML tables with Pandas as a story · 1 points
HN discussionSubmitted Web scraping in 2024: breakthroughs and challenges ahead as a story · 1 points
HN discussionSubmitted Add custom actions to your GPTs using hundreds ready-made Actors as a story · 1 points
HN discussionSubmitted How to integrate Google search into your AI apps as a story · 1 points
HN discussionSubmitted Intercom uses Apify to feed web data to its AI chatbot for customer support as a story · 1 points
HN discussionSubmitted AI web scraping tools: do they work? as a story · 1 points
HN discussionSubmitted Crawlee: The web scraping and browser automation library as a story · 1 points
HN discussionSubmitted Tuning MongoDB Performance as a story · 1 points
HN discussion