Top all-time · #5199
Ai2 Blog
Company blog · blog.allenai.orgaiscience
Ai2 Blog is the company blog at blog.allenai.org, writing about ai and science. Since 2022, 15 different Hacker News readers have linked it 28 times, most often “OLMo: An Open LLM and Framework”. It is still writing: the last post was on 2026-10-28, and you can follow it by feed.
Too few sampled comments (3) to say how often HN recommends it.?
Why HN links it
HN readers link blog.allenai.org to cite Allen Institute for AI posts on LLM ensembling (LLM-Blender) and early data-driven math discovery work. One commenter from the institute shared its upcoming research.
Summarised by Claude from a sample of 3 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Ai2, a non-profit research institute founded by Paul Allen, is committed to breakthrough AI to solve the world’s biggest problems.
Most-linked posts?
- OLMo: An Open LLM and Framework4 people · 6 mentions · first linked 2024-02-01
- Hello OLMo: a Truly Open LLM2 people · 7 mentions · first linked 2024-02-01
- 3T Token Open Corpus for Language Model Pretraining2 people · 3 mentions · first linked 2023-08-18
What Hacker News says?
AI2 has released training data in their OLMo model: https://blog.allenai.org/hello-olmo-a-truly-open-llm-43f7e73...
Comment linking /hello-olmo-a-truly-open-llm-43f7e7359222
on “Open source AI is the path forward”Submitted Hello OLMo: A truly open LLM as a story · 398 points
HN discussionNo open weights are the output of a proprietary and secretive process of training. It’s like sharing a pre compiled application instead of what you need to reproduce the compiled application. AI2’s OLMo is an example of what open source actually looks like for LLMs: https://blog.allenai.org/hello-olmo-a-truly-open-llm-43f7e73...
Comment linking /hello-olmo-a-truly-open-llm-43f7e7359222
on “Open source AI is the path forward”Submitted OLMo: An Open LLM and Framework as a story · 15 points
HN discussionWhat are some of the other ones? I am aware mainly of OLMo ( https://blog.allenai.org/olmo-open-language-model-87ccfc95f5... )
Comment linking /olmo-open-language-model-87ccfc95f580
on “Open source AI is the path forward”Submitted Hello OLMo: a Truly Open LLM as a story · 5 points
HN discussionHere’s one list of what is needed to be actually open source: https://blog.allenai.org/hello-olmo-a-truly-open-llm-43f7e73...
Comment linking /hello-olmo-a-truly-open-llm-43f7e7359222
on “Open source AI is the path forward”Submitted OLMo: Open Language Model as a story · 3 points
HN discussionOnly if it is truly open source (open data sets, transparent curation/moderation/censorship of data sets, open training source code, open evaluation suites, and an OSI approved open source license). Open weights (and open inference code) is NOT open source, but just some weak open washing marketing. The model that comes closest to being TRULY open is AI2’s OLMo. See their blog post on their approach: https://blog.al…
Comment linking /dolma-3-trillion-tokens-open-llm-corpus-9a0ff4b8da64
on “Open source AI is the path forward”Submitted AI2 OLMo, an open language model made by scientists, for scientists as a story · 3 points
HN discussionYes, there are several. See this blog post from Databricks describing the landscape of LLMs trained on AMD hardware for example: https://www.databricks.com/blog/training-llms-scale-amd-mi25... The most interesting one IMO is OLMo from AI2, which is truly open. You can read their blog post about it ( https://blog.allenai.org/hello-olmo-a-truly-open-llm-43f7e73... ) but basically it is open everything - they released…
Comment linking /hello-olmo-a-truly-open-llm-43f7e7359222
on “Llm.c – LLM training in simple, pure C/CUDA”Submitted OLMo: Open Language Model and Framework from Allen.ai as a story · 2 points
HN discussionAi2 | Senior Software Engineer | Seattle, WA | ONSITE / HYBRID | Ai2 ( https://allenai.org ) is a Seattle based non-profit AI research institute founded in 2014 by the late Paul Allen. We develop foundational AI research and innovation to deliver real-world impact through large-scale open models, data, robotics, conservation, and beyond. My team (ReOps) maintains the software and servers that allow research teams at…
Comment linking /beaker-ed617d5f4593
on “Ask HN: Who is hiring? (October 2024)”Submitted 3T Token Open Corpus for Language Model Pretraining as a story · 2 points
HN discussionThanks! Most of the current work is not yet out as press or blogs - we generally do that post code release/ publications/ arXiv submissions. Will share them as they are made public. Meanwhile, this is the blog of our earliest work from January that will be published in ICML24: https://blog.allenai.org/data-driven-discovery-with-large-ge... Also if you are interested - happy to correspond more by email. Lot more to s…
Comment linking /data-driven-discovery-with-large-generative-models-e1a062e99390
on “AI for math resources, and erdosproblems.com”Submitted Līla: A Unified Benchmark for Mathematical Reasoning as a story · 2 points
HN discussionIs this a surprise? Technology and news media companies have always abused their position to manipulate the public. This was true even when we just had plain old search and not generative AI. The fix is for people to once again recognize the wisdom of principles like free speech, and hold all of society accountable to classically liberal principles. Yes, private entities too, at least above a certain size (in revenu…
Comment linking /olmo-open-language-model-87ccfc95f580
on “Gemini Pro refuses to acknowledge yt-dlp”Submitted S2FOS, an open source academic field of study classifier as a story · 2 points
HN discussionOne issue with AI2 (who makes Olmo) is that some of their input data sets are filtered and curated, to remove things that they deem politically or ethically unacceptable like “toxic” content. This step obviously influences the LLM, but as far as I know it isn’t done transparently in an auditable way. I think being truly open would require a raw dataset to be available without this curation, along with a log of every…
Comment linking /dolma-3-trillion-tokens-open-llm-corpus-9a0ff4b8da64
on “Rethinking Open Source Generative AI: Open-Washing and the EU AI Act”Submitted OLMo 1.7–7B: A 24 point improvement on MMLU as a story · 1 points
HN discussionA reinforcement of definitions is needed. Open weights is NOT open source. But there are people like Meta that are rampantly open washing their work. The point of open source is that you can recreate the product yourself, for example by compiling the source code. Clearly the equivalent for an LLM is being able to retrain the model to produce the weights. Yes I realize this is impractical without access to the hardwa…
Comment linking /olmo-open-language-model-87ccfc95f580
on “The Open Source AI Definition RC1 Is Available for Comments”Submitted AI for Earth, 2023 in Review as a story · 1 points
HN discussionIt’s absolutely valuable. It lets you determine the biases of the model, by examining what it was trained on. It also lets you alter the curation, pre, and post processing to achieve a different model that may be more accurate or truthful (if you can train it). But the transparency is necessary to audit what they do. > If, somehow, Meta had also released their training data, I suspect the goalposts would immediately…
Comment linking /hello-olmo-a-truly-open-llm-43f7e7359222
on “Open-source AI must reveal its training data, per new OSI definition”Submitted Protecting Marine Life with AI as a story · 1 points
HN discussionThey claim several times to be “truly open” but I don’t see anything about open sourcing the training code. The inference code isn’t that interesting. What we need is total transparency on how the model weights are produced, since otherwise it’s hard to trust the biases of a model. The only actually truly open model is AI2’s OLMo as far as I know - and even they don’t get totally transparent about how they produced…
Comment linking /hello-olmo-a-truly-open-llm-43f7e7359222
on “Snowflake Arctic: LLM for Enterprise AI — Efficiently Intelligent, Truly Open”Submitted MultiDocument Approach to Generating Diverse Descriptions of Scientific Concepts as a story · 1 points
HN discussionThis is called ensembling . https://blog.allenai.org/llm-blender-a-simple-ensemble-learn...
Comment linking /llm-blender-a-simple-ensemble-learning-framework-for-llms-9e4bc57af23e
on “Run LLMs at home, BitTorrent‑style”