Top all-time · #1115
Together.ai
Company blog · together.ai/blogaisystems
Together.ai is the company blog at together.ai, writing about ai and systems. Since 2023, 62 different Hacker News readers have linked it 82 times, most often “Paving the way to efficient architectures: StripedHyena-7B”. It is still writing: the last post was on 2026-10-27, and you can follow it by feed.
Too few sampled comments (29) to say how often HN recommends it.?
Why HN links it
HN readers link Together.ai's pricing page and blog posts for LLM inference and fine-tuning costs, model comparisons, speedup research such as SpecExec, and open datasets like RedPajama v2. Comments cite them as sources, with no judgement of the writing.
Summarised by Claude from a sample of 29 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Build what's next on the AI Native Cloud. Full-stack AI platform for inference, fine-tuning, and GPU clusters — powered by cutting-edge research.
Most-linked posts?
- /pricing6 people · 6 mentions · first linked 2023-11-29
- Paving the way to efficient architectures: StripedHyena-7B4 people · 4 mentions · first linked 2023-12-08
- Together MoA–collective intelligence of open-source models pushing LLM frontier4 people · 4 mentions · first linked 2024-06-13
- /3 people · 3 mentions · first linked 2024-04-03
- Mamba-33 people · 3 mentions · first linked 2026-03-17
- Together API hosts open source models3 people · 3 mentions · first linked 2023-07-14
- FlashAttention-2: Faster attention with better parallelism and work partitioning2 people · 2 mentions · first linked 2023-07-17
- A practitioner's guide to testing and running GPU clusters2 people · 2 mentions · first linked 2024-08-13
- RedPajama-Data-v2: An open dataset with 30T tokens (2023)2 people · 2 mentions · first linked 2024-02-23
- Aurora2 people · 2 mentions · first linked 2026-03-31
What Hacker News says?
> What about alternatives? Custom models? Apart from the Big 3 (in no particular order): - https://together.ai/ - https://replicate.com/ - https://anyscale.com/ - https://baseten.co/ - https://modal.com/ - https://banana.dev/ - https://runpod.io/ - https://bentoml.com/ - https://brev.dev/ - https://octo.ai/ - https://cerebrium.ai/ ...
Comment linking /
on “Fly.io has GPUs now”Submitted FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-Precision as a story · 287 points
HN discussionThis is targeted towards GPU rental services like RunPod as well as API providers such as together AI. Together.ai is charging $0.90/1M tokens at 70B parameters. https://www.together.ai/pricing
Comment linking /pricing
on “Meta AI releases Code Llama 70B”Submitted AdapTive-LeArning Speculator System (ATLAS): Faster LLM inference as a story · 198 points
HN discussionIf you are running a local LLM already (which no one in the "general public is") then the bar is really not that much higher for fine-tuning (either for an individual or community member to do). And you don't need any additional equipment at all. When I say trivial, I really do mean it - you can go to https://www.together.ai/pricing and see for yourself - a 10M token 3 epoch fine tune on a 7B model will cost you abo…
Comment linking /pricing
on “Eagle 7B: Soaring past Transformers”Submitted Based: Simple linear attention language models as a story · 165 points
HN discussioni havent seen anyone mention this yet so i'll be the first - what is the comparison vs StripedHyena? https://www.together.ai/blog/stripedhyena-7b
Comment linking /blog/stripedhyena-7b
on “Jamba: Production-grade Mamba-based AI model”Submitted Dragonfly: A large vision-language model with multi-resolution zoom as a story · 143 points
HN discussionOrders of magnitude seems a bit ambitious. The implementation from the DeepMind paper achieved a 2-2.5X https://arxiv.org/pdf/2302.01318 and most of the tests I've seen [1][2] have been similar, but there are different variations (Medusa, Ouroboros, etc) that can do better/be combined. Recently Together.ai published SpecExec, a SD variant which did claim to get a 10-18X speedups: https://www.together.ai/blog/specexe…
Comment linking /blog/specexec
on “AMD Unveils Its First Small Language Model AMD-135M”Submitted A practitioner's guide to testing and running GPU clusters as a story · 80 points
HN discussionThanks, I need to spend some time digging into OpenRouter. The main requirement would be reliable function calling and JSON, since Plandex relies heavily on that. I'm also expecting to need some model-specific prompts, considering how much prompt iteration was needed to get things behaving how I wanted on OpenAI. I've also looked at Together ( https://www.together.ai/ ) for this purpose. Can anyone speak to the diff…
Comment linking /
on “Show HN: Plandex – an AI coding engine for complex tasks”Submitted Direct Preference Optimization vs. RLHF as a story · 37 points
HN discussionHere's one I've used: * https://www.together.ai/ Here are all the models: * https://docs.together.ai/docs/chat-models * https://docs.together.ai/docs/language-and-code-models
Comment linking /
on “Multi-agent chatbot murder mystery”Submitted DeepCoder: An Open-Source 14B Coder at O3-Mini Level as a story · 31 points
HN discussionLooks awesome! Been doing a lot of OCR recently, and love the addition to the space. The reigning champion in the PDF -> Markdown space (AFAIK) is Facebook's Nougat[1], and I'm excited to hook this up to DSPy and see which works better for philosophy books. This repo links the Zerox[2] project by some startup, which also looks awesome , and certainly more smoothly advertised than Nougat. Would love corrections/advic…
Comment linking /products
on “Llama-OCR: Document to Markdown”Submitted Consistency diffusion language models: Up to 14x faster, no quality loss as a story · 4 points
HN discussionMemory is part of compute. I have no idea why you've separated them. >How exactly are you going to find enough data to feed these monstrous petabyte scale models? You won't! Your models will stay small and become cheap over time! People have this idea that we're stretching the limit of tokens to feed to models. Not even close. This is a 30T token dataset https://www.together.ai/blog/redpajama-data-v2 It's just web s…
Comment linking /blog/redpajama-data-v2
on “Things I don't know about AI”Submitted The Mamba in the Llama: Distilling and Accelerating Hybrid Models as a story · 4 points
HN discussionhttps://www.together.ai/pricing
Comment linking /pricing
on “DeepSeek R1 Is Now Available on Azure AI Foundry and GitHub”Submitted Together AI acquires CodeSandbox to launch code interpreter for generative AI as a story · 3 points
HN discussion- nl · 2026-06-09
Their models are much smaller: 1T vs 5T for the frontier models. 1T is Sonnet/Google Flash size, not Opus size. The $0.87/M tokens price for Mimo Pro is probably subsidized. Mimo models aren't widely available on western providers, but Kimi and Deepseek are similar sizes and cost about the same to run. They are priced $3-$4/M tokens (which is right were Google's very confused range of Flash models are priced at: bet…
Comment linking /pricing
on “MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second” Submitted Fine-Tuning LLMs for Multi-Turn Conversations: A Technical Deep Dive as a story · 3 points
HN discussionIn HuggingChat ( https://huggingface.co/chat ) you can test open models for free and even test specific providers. From there I collected the following US providers currently serving GLM 5.2: - Together ( https://www.together.ai/models ) - Fireworks ( https://fireworks.ai/models ) - Featherless ( https://featherless.ai/models )
Comment linking /models
on “GLM 5.2 vs. Opus”Submitted Fine-tuning Llama-3 to get 90% of GPT-4's performance at a fraction of the cost as a story · 3 points
HN discussionPrevailing wisdom is that serving LLMs at a profit is achievable... it's when you factor in the cost of training them that prices get astronomical real fast. Open-source model inference providers (who do not have to bear the cost of training) seem able to do it at much lower prices. https://www.together.ai/pricing https://fireworks.ai/pricing#serverless-pricing (scroll down to headline models) Of course, it's possib…
Comment linking /pricing
on “Gemini 3.5: frontier intelligence with action”Submitted Together Inference Engine 2.0 with new Turbo and Lite endpoints as a story · 3 points
HN discussionPiece with less detail than the source linked from the article: https://www.together.ai/blog/stripedhyena-7b
Comment linking /blog/stripedhyena-7b
on “Generative AI and the big buzz about small language models”Submitted Llama 32K Context Released by Together AI as a story · 3 points
HN discussion(Not affiliated) https://together.ai/pricing
Comment linking /pricing
on “Introducing ChatGPT Enterprise”Submitted M3.1 Flash weights are now open as a story · 2 points
HN discussion
