Top all-time · #13725
Jack Schultz
Personal blog · bigishdata.com · on HN as jackschultzdataprogramming
Jack Schultz writes bigishdata, a personal blog at bigishdata.com about data and programming. Since 2015, 5 different Hacker News readers have linked it 26 times, most often “Classifying Amazon Reviews with Scikit-Learn”. No feed was found, so read it on the site itself.
Jack Schultz's blog.
Most-linked posts?
- Classifying Amazon Reviews with Scikit-Learn2 people · 2 mentions · first linked 2016-12-19
- How to Build Your Own Blockchain Part 3 – Writing Nodes That Mine and Talk2 people · 2 mentions · first linked 2017-11-03
- Classifying Country Music Songs Is an Art – Getting Training Data – Big-Ish Data2 people · 2 mentions · first linked 2016-11-03
What Hacker News says?
I've actually wrote about this! General tips that I've found from doing more than a few projects [0], and then an overview of Python libraries I use [1]. If you don't want to clock on the links, requests and BeautifulSoup / lxml is all you need 90% of the time. Throw gevent in there and you can get a lot of scraping done in not as much time as you think it would take. And as long as we're talking about web scraping,…
Comment linking /2017/06/06/web-scraping-with-python-part-two-library-overview-of-requests-urllib2-beautifulsoup-lxml-scrapy-and-more/
on “Ask HN: What are best tools for web scraping?”Submitted How to Build Your Own Blockchain Part 3 – Writing Nodes That Mine and Talk as a story · 282 points
HN discussion1000% percent this. I write about Python web scraping a lot and the big one is that there's two parts. First is gathering the pages you need to scrape locally, and the second is scraping the pages you've saved. You need need to separate those two to avoid hitting their servers over and over when you're tying to debug the scraping code. My way is to write the first in a file called gather.py, and then the other in sc…
Comment linking /2017/05/11/general-tips-for-web-scraping-with-python/
on “Introduction to web scraping with Python”Submitted General Tips for Web Scraping with Python as a story · 4 points
HN discussionGood to see that data cleaning was #1 on that list. Whenever I do work on a side project, it takes way way more time to get and structure the data than it does running the algorithms. Granted, that's because I have to go out and get the data in the first place, and then make sure it's useable and in the correct format. Like the recent project I'm doing trying to classify country music songs based on their topic on t…
Comment linking /
on “Ways Data Projects Fail”Submitted A Practical Use for Python Decorators – Logging, Error Checks, and Timing as a story · 4 points
HN discussionYup for me, and since seems like everyone here is linking their own blogs as example, the one I'm talking about is Bigish Data [1]. As of now, I get about 50 views a day, but mostly because of google searching. I wrote an article about how to use Genius's API [2], posted it on Reddit, and at this point, searching "Genius API" on Google leads to that article. To me, that seems like the only way I've been able to get…
Comment linking /2016/09/27/getting-song-lyrics-from-geniuss-api-scraping
on “Ask HN: Has attracting a blog audience become harder?”Submitted The Special Relationship Between Noodles and Qdoba as a story · 3 points
HN discussionWell sure it's possible, I've done writeups on text classification with Scikit-Learn as well here: https://bigishdata.com/2016/12/05/classifying-amazon-reviews... But results and how well the classifier performs really just depends on the quality and amount of training data you have. So would be interesting to see how this does if you can get a bunch more data from each of the subreddits and have some more test exam…
Comment linking /2016/12/05/classifying-amazon-reviews-with-scikit-learn-more-data-is-better-turns-out/
on “Show HN: Subreddit classifier using scikit-learn and a high-performance Go proxy”Submitted Explaining Bitcoin Proof of Work Difficulty as a story · 2 points
HN discussionI actually had this issue recently when trying to get training data for a project of mine as well [0], so I built an app [1] as a way to more easily classify documents. Basically I have simpler interfaces and the ability for multiple people to quickly answer questions like this on a set of data. Easily exportable in the end as well. If you're interested in using that to get some more data on sentences, let me know.…
Comment linking /2016/11/01/classifying-country-music-songs-is-an-art-getting-training-data/
on “How Quid uses deep learning with small data”Submitted Build Your Own Blockchain – Writing Nodes That Mine and Talk as a story · 2 points
HN discussionSubmitted Classifying Amazon Reviews with Scikit-Learn as a story · 2 points
HN discussionSubmitted Practical Naive Bayes – Classification of Amazon Reviews as a story · 2 points
HN discussionSubmitted Classifying Country Music Songs Is an Art – Getting Training Data – Big-Ish Data as a story · 2 points
HN discussionSubmitted Country Song Lyrical Analysis with Python and Genius – Trucks, Beer, and Love as a story · 2 points
HN discussionSubmitted Optimizing a Daily Fantasy Sports NBA Lineup as a story · 1 points
HN discussionSubmitted Using Clustering Algorithms to Analyze Golf Shots from the U.S. Open as a story · 1 points
HN discussionSubmitted How to Write, Deploy, and Interact with Ethereum Smart Contracts as a story · 1 points
HN discussionSubmitted Practical Naive Bayes – Classifying Amazon Reviews as a story · 1 points
HN discussionSubmitted Predicting PGA Tour Scoring Average from Statistics Using Linear Regression as a story · 1 points
HN discussionSubmitted What's the average age of a Nobel Prize winner? as a story · 1 points
HN discussion