Top all-time · #6696
lamini.ai
Company blog · lamini.ai/blogaiprogramming
lamini.ai is the company blog at lamini.ai, writing about ai and programming. Since 2023, 12 different Hacker News readers have linked it 26 times, most often “Lamini and AMD: Paving the Road to GPU-Rich Enterprise LLMs”. No feed was found, so read it on the site itself.
Too few sampled comments (4) to say how often HN recommends it.?
Why HN links it
HN readers link lamini.ai for its blog posts on running LLM training on AMD GPUs and a layperson's explainer on free, fast LLM finetuning. Comments cite these posts as references rather than judging them.
Summarised by Claude from a sample of 4 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Most-linked posts?
- Lamini and AMD: Paving the Road to GPU-Rich Enterprise LLMs4 people · 5 mentions · first linked 2023-09-26
- Lamini LLM Finetuning on AMD ROCm: A Technical Recipe3 people · 3 mentions · first linked 2023-10-25
- Lamini – LLM Engine – Connect Your Enterprise Data Warehouse2 people · 2 mentions · first linked 2023-04-29
What Hacker News says?
There's a number of scaled AMD deployments, including Lamini ( https://www.lamini.ai/blog/lamini-amd-paving-the-road-to-gpu... ) specifically for LLM's. There's also a number of HPC configurations, including the world's largest publicly disclosed supercomputer (Frontier) and Europe's largest supercomputer (LUMI) running on MI250x. Multiple teams have trained models on those HPC setups too. Do you have any more evide…
Comment linking /blog/lamini-amd-paving-the-road-to-gpu-rich-enterprise-llms
on “Intel Gaudi 3 AI Accelerator”Submitted Lamini Memory Tuning: 10x Fewer Hallucinations as a story · 128 points
HN discussionThat's not exactly the same thing as the LLM photographic memory that we launched at Lamini a month ago - https://www.lamini.ai/blog/lamini-llm-photographic-memory-ev... We focused on LLMs that can reason while still remembering key facts exactly. But I like that the concept is catching on in the AI community. Go Satya. LLMs are powerful, but unlike humans, their weights are fixed during inference and cannot be used…
Comment linking /blog/lamini-llm-photographic-memory-evaluation-suite
on “Microsoft's AI chatbot will 'recall' everything you do on its new PCs”Submitted How to evaluate performance of LLM inference frameworks as a story · 18 points
HN discussionWe can run llama 2 on an AWS vm if you have enough GPUs: https://lamini.ai/ Install in 10 minutes. Make sure you have enough GPU memory to fit your llama model if you want good perf
Comment linking /
on “Azure ChatGPT: Private and secure ChatGPT for internal enterprise use”Submitted Launch Lamini: The LLM Engine for Rapidly Customizing Models as Good as ChatGPT as a story · 8 points
HN discussionwe wrote a blog post about why companies do this here: https://www.lamini.ai/blog/specialize-llms-to-private-data-d... Here are a few: Data privacy Ownership of IP Control over ops The table in the blog lists the top 10 reasons why companies do this based on about 50 customer interviews.
Comment linking /blog/specialize-llms-to-private-data-databricks
on “Azure ChatGPT: Private and secure ChatGPT for internal enterprise use”Submitted LLMs hallucinate in critical enterprise scenarios as a story · 6 points
HN discussionThe MI300x aren't released yet, that's why it isn't popular. Azure is building a cloud [0]. I know someone else personally who's building a cloud too. As for training, it has been happening a bit on MI250's [1]. There is also A LOT that happens that doesn't make the larger news [2] and [3]. [0] https://techcommunity.microsoft.com/t5/azure-high-performanc... [1] https://www.databricks.com/blog/training-llms-scale-amd…
Comment linking /blog/lamini-llm-finetuning-on-amd-rocm-a-technical-recipe
on “Amazon's Trainium2 AI Accelerator Features 96 GB of HBM, 4x Training Performance”Submitted Training LLMs in the Wild Wild West – AMD multi-node as a story · 2 points
HN discussionHosted here (on our own AMD cluster): https://www.lamini.ai Docs here: https://lamini-ai.github.io We can run on any machine that can run docker in a dev mode. It won't be very fast for very big models, but you can test all of the functionality. Many customers start by allocating a cloud node, e.g. on Azure/AWS, we do an install onto it, and they develop applications on top of it. Then for scale or to run larger mod…
Comment linking /
on “AI startup Lamini bets future on AMD's Instinct GPUs”Submitted Lamini LLM Finetuning on AMD ROCm: A Technical Recipe as a story · 2 points
HN discussionhttps://www.lamini.ai/blog/lamini-amd-paving-the-road-to-gpu...
Comment linking /blog/lamini-amd-paving-the-road-to-gpu-rich-enterprise-llms
on “AI startup Lamini bets future on AMD's Instinct GPUs”Submitted LLM Inference at the Memory Wall as a story · 1 points
HN discussionHi HN! I’m super excited to announce Lamini, the LLM engine that gives every developer the superpowers that took the world from GPT-3 to ChatGPT! I’ve seen a lot of developers get stuck after prompt-tuning for a couple days or after fine-tuning an LLM and it just gets worse—there’s no good way to debug it. I have a PhD in AI from Stanford, and don’t think anyone should need one to build an LLM as good as ChatGPT. A…
Comment linking /contact
on “Launch Lamini: The LLM Engine for Rapidly Customizing Models as Good as ChatGPT”Submitted Faster LLM Inference: Lamini Inference with 52x more RPM than vLLM as a story · 1 points
HN discussionIf anyone wants access to mi250 or mi300 today, contact us here: https://www.lamini.ai/contact If you are a LLM startup blocked on compute, send me a dm
Comment linking /contact
on “AMD MI300X 30% higher performance than Nvidia H100, even with optimized stack”Submitted Lamini LLM Finetuning on AMD ROCm: A Technical Recipe as a story · 1 points
HN discussionOfficial repo for the finetuning pipeline, so you can train custom models on your data. It's free, on small LLMs It's fast, taking 10-15 minutes It's like working with an unlimited prompt size, with 1000x+ more space than the largest prompts It's learning new information, not just trying to make sense of it given what it already learned (retrieval-augmented generation) Layperson's blogpost: https://www.lamini.ai/blo…
Comment linking /blog/free-fast-and-furious-finetuning
on “Free and Fast LLM Finetuning”Submitted Lamini and AMD: Paving the Road to GPU-Rich Enterprise LLMs as a story · 1 points
HN discussionRelevant, we deployed Lamini on hundreds of MI200 GPUs. Lisa tweet: https://x.com/LisaSu/status/1706707561809105331?s=20 Lamini tweet: https://x.com/realSharonZhou/status/1706701693684154766?s=20 Blog: https://www.lamini.ai/blog/lamini-amd-paving-the-road-to-gpu... Register: https://www.theregister.com/2023/09/26/amd_instinct_ai_lamin... CRN: https://www.crn.com/news/components-peripherals/llm-startup-... The hard p…
Comment linking /blog/lamini-amd-paving-the-road-to-gpu-rich-enterprise-llms
on “ROCm Is AMD's #1 Priority, Executive Says”Submitted Lamini and AMD: Paving the Road to GPU-Rich Enterprise LLMs as a story · 1 points
HN discussionThis enables you to chain and switch between thousands of finetuned LLMs. A free notebook that lets you train a model using this optimization: https://colab.research.google.com/drive/1QMeGzR9FnhNJJFmcHtm... A walkthrough that shows how to finetune a Llama v2 model: https://lamini-ai.github.io/Examples/llama_v2_example A blog explaining how to support 10,000 fine tuned Llama 2 models one server, and reduce the time n…
Comment linking /blog/one-billion-times-faster-finetuning-with-lamini-peft
on “1.109B times faster serving of finetuned LLMs”Submitted 1.109B times faster serving of finetuned LLMs as a story · 1 points
HN discussionSubmitted Lamini – LLM Engine – Connect Your Enterprise Data Warehouse as a story · 1 points
HN discussion
