Top all-time · #8391
Globus
Company blog · globus.org/blogsystemsdata
Globus is the company blog at globus.org, writing about systems and data. Since 2013, 9 different Hacker News readers have linked it 9 times, most often “Globus: open source data publication as a service”. No feed was found, so read it on the site itself.
Too few sampled comments (6) to say how often HN recommends it.?
Why HN links it
HN commenters link Globus, a research data transfer service run out of UChicago, as a free alternative to Aspera for moving large datasets. The links point to the service's site, not to written posts.
Summarised by Claude from a sample of 6 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Research data management simplified.
Most-linked posts?
- Globus: open source data publication as a service4 people · 4 mentions · first linked 2016-02-05
- /2 people · 2 mentions · first linked 2019-12-30
What Hacker News says?
See also https://www.globus.org/ .
Comment linking /
on “Academic Torrents: A distributed system for sharing enormous datasets”Submitted GridFTP: A Brief History of Fast File Transfer (2024) as a story · 17 points
HN discussionI don't know what your needs are, but Globus might be a good alternative. https://www.globus.org It's being run out of UChicago, and I know they have at least one large company using them. Feel free to reach out to the Globus team, or shoot me an email!
Comment linking /
on “A Desperate Plea for a Free Software Alternative to Aspera (2018)”Submitted Globus: open source data publication as a service as a story · 6 points
HN discussionGlobus is definitely not dead[1], it has an active community with strong uptake in the Materials Science world (where I work), among others. The Globus folks have a repo for many popular Linux distros, it's reasonably straightforward to get started. (I'm a user of it, not a developer or necessarily an advocate.) It's not free for "managed" (Enterprise) applications, though, which is what the OP seems to be looking f…
Comment linking /
on “A Desperate Plea for a Free Software Alternative to Aspera (2018)”Submitted Lawrence Berkeley National Laboratory and ESNet – Globus as a story · 2 points
HN discussionAt least on the experimental LHC side, we process/analyse each event independently from every other event, so it's an embarrassingly parallel workload. All we do is split our input dataset up into N files, run N jobs, combine the N outputs. Because we have so much data (of the order of 25+ PB of raw data per year; it actually balloons to much more than this due to copies in many slightly different formats) and so ma…
Comment linking /toolkit/docs/latest-stable/gridftp/
on “Ask HN: To everybody who uses MapReduce: what problems do you solve?”There's a free alternative I have to talk up any time Aspera gets mentioned, and that's GridFTP by way of Globus Connect.[1] It's pitched as a way to move massive quantities of research data around, but it's free for personal/academic use and dead simple to set up. There's a standalone command line client too [2], but it requires a bit more knowledge of how to tweak the settings, while Aspera and the Globus client d…
Comment linking /
on “When Movies Fly: How Modern Internet Experience Is Made Possible by Airplanes”https://www.globus.org/
Comment linking /
on “Ask HN: What libraries allow resilient distributed computing/network/storage?”