Top all-time · #8333
Redirecting to https://scraperwiki.com/blog
Company blog · blog.scraperwiki.comdatastartupsbusiness
Redirecting to https://scraperwiki.com/blog is the company blog at blog.scraperwiki.com, writing about data, startups and business. Since 2011, 9 different Hacker News readers have linked it 24 times, most often “The story of getting Twitter data and its “missing middle” (2014)”. No feed was found, so read it on the site itself.
Too few sampled comments (4) to say how often HN recommends it.?
Why HN links it
HN readers link ScraperWiki's blog for its account of Twitter suspending ScraperWiki's API access in 2014, which one commenter cited as a source for a discussion of data democracy.
Summarised by Claude from a sample of 4 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Most-linked posts?
- The story of getting Twitter data and its “missing middle” (2014)4 people · 5 mentions · first linked 2014-08-21
What Hacker News says?
ScraperWiki ( https://scraperwiki.com , https://pdftables.com ) Technical Architect | Liverpool, Northwest UK | Full time | ONSITE (remote some days of the week OK) Right now we're building pdftables.com and growing rapidly! Knowledge of Go, Python and Linux a bonus. The average 3 bed house in Liverpool costs £141,000, five times cheaper than in London! We’ve got a generous 30 days holiday :) More detail can be foun…
Comment linking /jobs/technical-architect/
on “Ask HN: Who is hiring? (September 2015)”Submitted How to test shell scripts as a story · 25 points
HN discussionScraperWiki, Liverpool, UK - Data Scientists We're always looking for people interested in Python, Go, Data, visualisation and so on. At least get in touch to say "hi!" for a coffee! https://blog.scraperwiki.com/jobs/data-engineer-liverpool/
Comment linking /jobs/data-engineer-liverpool/
on “Ask HN: Who is hiring? (November 2014)”Submitted Why does Google Docs have so many ways of sharing? as a story · 3 points
HN discussionScraperWiki, Liverpool, UK. Software Engineer and Digital Marketer. We're that rare thing an open source startup in Liverpool, using things like Node.js, Python, Docker, Salt... We also do consultancy for clients like the Cabinet Office and the UN. https://blog.scraperwiki.com/jobs/data-engineer-liverpool/ We've a SaaS product with paying customers, which we're optimising the funnel for. It helps marketers get data.…
Comment linking /jobs/digital-marketer/
on “Ask HN: Who is hiring? (June 2014)”Submitted Twitter suspended ScraperWiki's API use as a story · 2 points
HN discussionYes, it is complicated. That said, this is partly just because there aren't enough cases - and partly because the law hasn't stabilised (took a century to stabilise after invention of printing press). It isn't clear what rights society should grant yet, for maximising business. My take on it, from ScraperWiki's point of view: http://blog.scraperwiki.com/2012/04/02/is-scraping-legal/
Comment linking /2012/04/02/is-scraping-legal/
on “I Don’t Need No Stinking API: Web Scraping For Fun and Profit”Submitted Book review: Mining the Social Web by Matthew A. Russell as a story · 2 points
HN discussionScraperWiki in Liverpool, UK We're hiring a data scientist! https://blog.scraperwiki.com/jobs/swjob10/ If you hear news of a new dataset on the web, the GP prescribing data, or the catalogue of the Science Museum, for example – what is your first instinct? If you answered “Download the data and play with it”, then we have just the role for you! ScraperWiki is a technology company based in Liverpool with clients arou…
Comment linking /jobs/swjob10/
on “Ask HN: Who is hiring? (November 2013)”Submitted The story of getting Twitter data and its “missing middle” (2014) as a story · 1 points
HN discussionAt ScraperWiki, we had our Twitter to spreadsheet tool cut off (at a much more modest size!). I wrote up an analysis of where you can get Twitter data from and why which is relevant: https://blog.scraperwiki.com/2014/08/the-story-of-getting-tw...
Comment linking /2014/08/the-story-of-getting-twitter-data-and-its-missing-middle/
on “Twitter Cuts Off DataSift To Step Up Its Own Big Data Business”Submitted ….and suddenly I could convert my bank statement from PDF to Excel… as a story · 1 points
HN discussionLegality of scraping is a subtle issue - I wrote up my take on it here: https://blog.scraperwiki.com/2012/04/is-scraping-legal/
Comment linking /2012/04/is-scraping-legal/
on “Ask HN: What info do you web scrape for?”Submitted ScraperWiki's values and how to brainstorm your organisation's values as a story · 1 points
HN discussionThe answer is complicated, because the law isn't shaken out yet. Doubt it will be for centuries. I've written "Is scraping legal?" here, with details, and my own view morally. https://blog.scraperwiki.com/2012/04/is-scraping-legal/
Comment linking /2012/04/is-scraping-legal/
on “Introducing the Priceonomics Business Model: Data Crawling Services”Submitted What's a CTO at a startup actually do? as a story · 1 points
HN discussionSee my blog post about this on the ScraperWiki blog https://blog.scraperwiki.com/2012/04/is-scraping-legal/
Comment linking /2012/04/is-scraping-legal/
on “Import.io – Structured Web Data Scraping”Submitted Why the World Got Stuck on Spreadsheets as a story · 1 points
HN discussionOther people's heads contain different information that yours! There are smarter people out there but they might not have your insights into the challenges and rewards of hydroponic banana farming. Two days ago you might not have known how to perform a particular task, and searching the internet was fruitless. You might not be the first person to have to work out how to do that from first principles -- but you can m…
Comment linking /2015/07/eusprig/
on “Ask HN: Can you give me some advice on writing essays?”Submitted Start Talking to Your Data – Literally as a story · 1 points
HN discussionHiya! Francis from ScraperWiki here. There are a couple of things going on: Firstly, it is about inconsistency between how developers are treated and how people-who-can-use-Excel are treated. Secondly, it is that vetting of "data use" is so hard, it means low end users just can't buy it at all (financial and red tape reasons). Even if they are happy with the per-Tweet cost. Speaking for ScraperWiki, we want Twitter…
Comment linking /2014/08/the-story-of-getting-twitter-data-and-its-missing-middle/
on “Why Twitter’s decision on Scraperwiki is bad for data democracy”Here is a link from ScraperWiki from the article: https://blog.scraperwiki.com/2014/08/the-story-of-getting-tw...
Comment linking /2014/08/the-story-of-getting-twitter-data-and-its-missing-middle/
on “Why Twitter’s decision on Scraperwiki is bad for data democracy”And it looks like the suspension is permanent per the update today at https://blog.scraperwiki.com/2014/08/the-story-of-getting-tw...
Comment linking /2014/08/the-story-of-getting-twitter-data-and-its-missing-middle/
on “Twitter suspended ScraperWiki's API use”