Top all-time · #13512
polydesmida.info
Personal blog · polydesmida.info/BASHingprogrammingdata
polydesmida.info is a personal blog at polydesmida.info about programming and data. Since 2018, 5 different Hacker News readers have linked it 18 times, most often “A data cleaner's cookbook – Gremlin characters”. No feed was found, so read it on the site itself.
Too few sampled comments (2) to say how often HN recommends it.?
Why HN links it
Linked for a Linux command-line data post (awk checks on tab-separated fields) and a cookbook page on a tool that scrubs bad symbols from data. One commenter criticises the awk approach.
Summarised by Claude from a sample of 2 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Most-linked posts?
- A data cleaner's cookbook – Gremlin characters2 people · 2 mentions · first linked 2018-11-16
- A Data Cleaner's Cookbook2 people · 2 mentions · first linked 2018-07-07
What Hacker News says?
There's also a great tool to scrub bad symbols from your data: https://www.polydesmida.info/cookbook/gremlins.html
Comment linking /cookbook/gremlins.html
on “Big List of Naughty Strings”Submitted SCI and the “62;c62;” attack as a story · 43 points
HN discussionOk so the title of the blog is 'Data ops in the Linux command line'. Sounds fun, but in the same way that 'paintball with blindfolds' would be fun. e.g. this is one of the examples - a kindof sanity check on two fields in a tab separated file to see if one is less than the other. The fields are identified by their position (31, 33 etc) awk -F"\t" 'NR>1 && $31!="" && $33!="" && $33>$31' fish | wc -l Surely much bette…
Comment linking /cookbook/index.html
on “Finding data items in one field that contradict data items in another field”Submitted Finding data items in one field that contradict data items in another field as a story · 32 points
HN discussionSubmitted A record pager built with YAD as a story · 14 points
HN discussionSubmitted BASHing data: Truncated data items as a story · 12 points
HN discussionSubmitted A Data Cleaner's Cookbook as a story · 4 points
HN discussionSubmitted A data cleaner's cookbook – Gremlin characters as a story · 3 points
HN discussionSubmitted Drugs on the command line as a story · 2 points
HN discussionSubmitted Changing the month format: a fairly general solution as a story · 2 points
HN discussionSubmitted How to find distances between lat/lons for geochecking as a story · 2 points
HN discussionSubmitted Mapping with gnuplot as a story · 2 points
HN discussionSubmitted Bird watching with AWK and grep as a story · 2 points
HN discussionSubmitted Fuzzy matching in practice as a story · 2 points
HN discussionSubmitted Horizontal sorting within a field as a story · 1 points
HN discussionSubmitted Horizontal sorting within a field as a story · 1 points
HN discussionSubmitted Finding changepoints in a list from command line as a story · 1 points
HN discussionSubmitted How to validate ISO 8601 dates without regex as a story · 1 points
HN discussion