Top all-time · #8665
NewsCatcher: Web & News Search API for AI Agents
Company blog · newscatcherapi.com/blog · on HN as artembugaradataaiprogramming
NewsCatcher: Web & News Search API for AI Agents is the company blog at newscatcherapi.com, writing about data, ai and programming. Since 2020, 9 different Hacker News readers have linked it 80 times, most often “Show HN: API-first news search engine”. No feed was found, so read it on the site itself.
Too few sampled comments (4) to say how often HN recommends it.?
Why HN links it
HN readers link NewsCatcher's blog and site, including a post on Python web scraping libraries and its news search API. Comments mostly concern related projects and the site's privacy popup.
Summarised by Claude from a sample of 4 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
NewsCatcher provides a recall-first Web Search API (CatchAll) and News API for AI agents and enterprise teams. 86% recall. 2B+ page index. Start free.
Most-linked posts?
- Show HN: API-first news search engine5 people · 23 mentions · first linked 2020-04-12
- Guide to Text Similarity with Python2 people · 3 mentions · first linked 2022-01-07
- How to Classify Text with Python, Transformers and Scikit-Learn2 people · 3 mentions · first linked 2022-02-24
- NewsCatcher2 people · 2 mentions · first linked 2024-06-12
- Annotate Company Name and Ticker with Spacy PhraseMacher2 people · 2 mentions · first linked 2022-01-27
- Python Web Scraping Libraries to Mine News Data2 people · 2 mentions · first linked 2021-11-22
What Hacker News says?
We’re ~17k MRR right now. Being doing it for almost 2 years. What made us take off is I and my cofounder running through our savings. I did it for ~15 months. One thing I had to start doing earlier is not trying to get everyone buy our product (we sell news articles published online as a source of data for insight mining) [0] I’ve lost so much time on people who’d never be able to use what we have unless we complete…
Comment linking /
on “Ask HN: What made your business take off that you wish you'd done much earlier?”Submitted We've been running a bootstrapped startup for a year as a story · 76 points
HN discussionI am building my business fully based on RSS. It is a news API. I got all my data solely form RSS. And I can confirm that the vast majority of news outlets still have it. https://newscatcherapi.com/ I probably should write a post with exact numbers: * how frequently it is updated * how many websites still support it * etc
Comment linking /
on “It’s Time to Get Back to RSS”Submitted Guide to Text Similarity with Python as a story · 6 points
HN discussionSo true, especially about RegEx. I love RegEx. You can do so many things with simple RegEx rules. For example, have you ever tried to autodetect a published datetime of a news article published online? In many cases, it will be in metadata, or in the time/datetime tag. However, there still many websites where published time is just written somewhere with no logic at all. Writing a RegEx script by hand can resolve a…
Comment linking /news-api
on “The First Rule of Machine Learning: Start Without Machine Learning”Submitted How to Classify Text with Python, Transformers and Scikit-Learn as a story · 5 points
HN discussionWrite libraries AND services, where it makes sense. I wrote a Python library to scrape google news [0] We also have it as a service [1] Want to know why? Because devs who can't pay won't pay. Businesses who can pay will rather pay for a service (API in our case), and not care about maintaining it. [0] https://github.com/kotartemiy/pygooglenews [1] https://newscatcherapi.com/google-news-api
Comment linking /google-news-api
on “Write libraries instead of services, where possible”Submitted Show HN: API-first news search engine as a story · 5 points
HN discussionHere's a real feedback on metadata tags from someone who's been building "online-published articles index" for ~13 months [0]. So, we talk about news websites for whom it is crucial to be well-indexed. Talking about non-US news websites: 1. Not so many news websites even have a sitemap 2. LD+JSON meta tags are not so common either 3. OG metadata can be simply wrong 4. For many websites it's impossible to detect whic…
Comment linking /
on “We were promised Strong AI, but instead we got metadata analysis”Submitted How to Present/Showcase Open-Source Projects [Practical Guide] as a story · 4 points
HN discussionI and my friend are building API to search for structured news articles [1]. It's a data-as-a-service. We've been working for ~1 year. Our full-time job now. ~3k MRR Our recent article about what we've learned [2] [1] https://newscatcherapi.com/ [2] https://newscatcherapi.com/blog/we-ve-been-running-a-bootstr...
Comment linking /blog/we-ve-been-running-a-bootstrapped-startup-for-1-year-our-top-15-takeaways
on “Ask HN: What are you working on?”Submitted Show HN: Newscatcher API Beta – JSON API to search for relevant news data as a story · 4 points
HN discussionFrancois, Adrien, that's a super nice demo. Stateless search engine is something new, for sure. I'd be super interested to see how it evolves over time. We're [1] indexing over 1,000,000 news articles per day. We're using ElasticSearch to index our data. Would be interested to see if there's a way to make a cross-demo? Let me know. [1] https://newscatcherapi.com/
Comment linking /
on “Searching the web for under $1000/month”Submitted Web Search API Types: Three Architectures, One Confusing Name as a story · 3 points
HN discussionI began my side-project [1] one year ago. I quit my very well-paid job 6 months ago to make my side-project my full-time job. It is going quite well (I am nowhere near making the same money). Just 2 of us at the moment. I've learnt so much over this period. Like what you would get over 10 years in a big tech company while jumping over all the hierarchy. Moreover, my very first side project turned me from a guy who k…
Comment linking /
on “Advice to my young self: forget side projects and focus on your job”Submitted Sentiment Analysis Using Python [Tutorial] as a story · 3 points
HN discussionCongrats! Very nice to see results being lightning fast, I am getting 100-120ms response with network overhead included and that is impressive. The payload size of only 10-20kb helps immensely, good job! I've built something similar called Teclis [1] and in my experience a new search engine should focus on a niche and try to be really, really good at it (I focused on non-commercial content for example). The reason i…
Comment linking /
on “Show HN: I'm building a non-profit search engine”Submitted Guide to Text Similarity with Python as a story · 3 points
HN discussionI totally agree with the first part where you say it's fine to scrape. It is just an automation. But you don't mention what you do with this data after. 1. You store it somewhere (not in your brain) 2. You extract value out of it (directly or indirectly) That's why I understand why it is a problem for those who publish this data. One thing I always try to say to everyone who argues about web scraping: web scraping i…
Comment linking /
on “Web Scraping Is Vital to Democracy”Submitted SpaCy vs. NLTK. Text Normalization Comparison [with Code Examples] as a story · 3 points
HN discussionI'm curious where the data get fetched from. The Author mentions that Mozilla Readability and SimplePie are used. Readability to parse the content. SimplePie to fetch the data (I assume). Dat from RSS feeds? In case you want to make something similar, I recently wrote a blog on where you could get news data for free [1] (self-promo) I'd recommend to take a look at my Python package to mine news data from Google News…
Comment linking /free-news-api
on “68k.news: A Netscape 1.1 makeover of Google News”Submitted Named Entity Recognition with SpaCy [with code example] as a story · 3 points
HN discussionThis article is incredible. I've been running a news search engine API [1] for about 18 months, and I found a lot of new things. The biggest takeaway (IMO) is to use existing SaaS at first. We've been using ElasticSearch Service for our v1, and it worked great. 0s downtime with no master nodes. And yes, ElasticsSearch itself is just a tool: you'd have to write your own search logic on top of it. Also, start with som…
Comment linking /news-api
on “What software engineers should know about search (2017)”Submitted Show HN: News parsing API with a built-in topic prediction as a story · 3 points
HN discussionYou might find useful this article about how to use google news RSS parameters: https://newscatcherapi.com/blog/google-news-rss-search-param... You can replace the original RSS with the "mirror" from Google News
Comment linking /blog/google-news-rss-search-parameters-the-missing-documentaiton
on ““We removed the RSS feed since this technology became obsolete””Submitted NewsCatcher as a story · 2 points
HN discussionWe realized how great Dynamo was only after we migrated off AWS. Dynamo was a key factor to us when we were releasing the MVP of our News API [0]. We used Dynamo, ElasticSearch, Lambda and could make it running in 60 days while being full-time employed. Also, the best tech talk I saw was given by Rick Houlihan on re:Invent [1] I highly recommend every engineer to watch it: it's a great overview of SQL vs NoSQL [0] h…
Comment linking /blog/how-we-built-a-news-api-beta-in-60-days
on “DynamoDB 10 years later”Submitted Custom Named Entity Recognition[NER] Model with SpaCy as a story · 2 points
HN discussionMy article where I briefly explain how I approach open-sourcing my code: https://newscatcherapi.com/blog/how-to-present-showcase-open...
Comment linking /blog/how-to-present-showcase-open-source-projects-practical-guide
on “Tips For Making a Popular Open Source Project in 2021”Submitted Annotate Company Name and Ticker with Spacy PhraseMacher as a story · 2 points
HN discussion
