Top all-time · #18103
Klu
Company blog · klu.ai/blog · on HN as aethelyonai
Klu is the company blog at klu.ai, writing about ai. Since 2023, 4 different Hacker News readers have linked it 10 times, most often “GPT-4 Turbo and ft-3.5-turbo-1106 benchmarks”. No feed was found, so read it on the site itself.
Too few sampled comments (2) to say how often HN recommends it.?
Why HN links it
HN readers link Klu's AI glossary entry on the HumanEval benchmark, and mention Klu as a startup offering tooling for AI data management, evaluation and prompting. The comments don't judge the writing.
Summarised by Claude from a sample of 2 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Automatically evaluate frontier models for your use cases
Most-linked posts?
- GPT-4 Turbo and ft-3.5-turbo-1106 benchmarks2 people · 2 mentions · first linked 2023-11-10
- /2 people · 2 mentions · first linked 2023-11-04
What Hacker News says?
This sounds like 164 leetcode like questions. The correlation to actual capability is very tenuous in my opinion. https://klu.ai/glossary/humaneval-benchmark I'd love if I could 10X / 100X my productivity with AI, but as a heavy ChatGPT user, it's more like a 30% improvement. Awesome, obviously, but looking forward to improvement.
Comment linking /glossary/humaneval-benchmark
on “AutoDev: Automated AI-driven development by Microsoft”Submitted Evaluating Frontier Model Capabilities as a story · 4 points
HN discussionI think this is exactly the kind of issue that the startup Klu [0] is trying to solve. Not everybody should be building their own custom toolchains for finetuning/prompting AI models and there is really quite a lot of work involved in data management/evaluation. There's definitely a lot of value in adding some AI features into your applications, but if it's not your core business you shouldn't be spending a lot of y…
Comment linking /
on “Don't Build AI Products the Way Everyone Else Is Doing It”Submitted Gemini Pro vs. GPT3.5 as a story · 3 points
HN discussioncheck out https://klu.ai – we built it for this reason – sign up, book some time, and I'll help you however I can
Comment linking /
on “Ask HN: How are you using your datasets with LLMs?”Submitted Startup Guide to Azure OpenAI as a story · 3 points
HN discussionwe built https://klu.ai/ for this ====== outside of us, here's what I see happening 80% of folks aren't building in prod if you pull apart the 20% that are building, I've seen this from largest to smallest population: 1. most people are not monitoring, followed by 2. home-grown solutions logged into existing observe/analytics platforms, followed by 3. LLMOps tooling like Klu the 2 cents on the unfortunate truth: I t…
Comment linking /
on “How are generative AI companies monitoring their systems in production?”Submitted GPT-4 Turbo and ft-3.5-turbo-1106 benchmarks as a story · 2 points
HN discussionWe benchmarked retrieval, GPT-4 turbo vs GPT-4, and fine-tuned several models: https://klu.ai/blog/openai-devday-2023 You can use the result of one here https://huberman.klu.ai/
Comment linking /blog/openai-devday-2023
on a deleted threadSubmitted Ask HN: Compiling GPT-4 model card as a story · 1 points
HN discussion