Top all-time · #18787
Hamming AI
Company blog · hamming.ai/blogaiprogramming
Hamming AI is the company blog at hamming.ai, writing about ai and programming. Since 2024, 4 different Hacker News readers have linked it 6 times, most often “Hamming: Voice Agent Tooling”. No feed was found, so read it on the site itself.
Too few sampled comments (4) to say how often HN recommends it.?
Why HN links it
The linked posts cover LLM and voice-agent testing, including the BICS benchmark for finding bugs in large Python codebases. Commenters mention them as a competitor or a benchmark and do not judge the writing.
Summarised by Claude from a sample of 4 HN comments that link here. Each comment is marked recommending, critical or neutral (citing without judging); how this works.
Complete voice & chat agent QA platform. Auto-generate scenarios, replay production calls, 50+ metrics. SOC 2 certified. Start in under 10 minutes.
Most-linked posts?
- Hamming: Voice Agent Tooling2 people · 2 mentions · first linked 2024-10-11
What Hacker News says?
I've been keeping a rolling list of LLMOps/AI agent observability products funded by YC. What problems does Lucidic solve that the others do not? https://hegel-ai.com https://www.vellum.ai/ https://www.parea.ai http://baserun.ai https://www.traceloop.com https://www.trychatter.ai https://talc.ai https://langfuse.com https://humanloop.com https://uptrain.ai https://athina.ai https://relari.ai https://phospho.ai https…
Comment linking /
on “Launch HN: Lucidic (YC W25) – Debug, test, and evaluate AI agents in production”Submitted Can LLMs find bugs in large Python codebases? as a story · 5 points
HN discussionAs someone who's building a personal work assistant for voice - I see the merit in automating test case generation and validation. All products in this space by YC teams are targeted at scaled voice agent startups or teams. - Roark ( https://roark.ai/ ) - Hammin ( https://hamming.ai/ ) - Coval ( https://www.coval.dev/ ) - Vocera ( https://www.vocera.ai/ ) How do you differentiate - who is this for? Voice agent devs…
Comment linking /
on “Launch HN: Roark (YC W25) – Taking the pain out of voice AI testing”Submitted Hamming: Voice Agent Tooling as a story · 1 points
HN discussionHi HN - In collab with UWaterloo, we published a new code-focused needle in the haystack benchmark. TLDR - GPT-3.5-Turbo showed lower accuracy on the BICS benchmark than the BABILONG benchmark at the same context length and target depth, indicating that LLMs struggle more on code-based tasks than text-based tasks at long context length. - The hype is real. GPT-4o showed the best performance, closely followed by GPT-…
Comment linking /blog/bug-in-the-codestack
on “New code-focused LLM needle in the haystack benchmark”Hi HN - We built a new benchmark called "Bug In The Code Stack" (BICS) to test how well LLMs can find syntactic bugs in large Python codebases. (similar to a text-based needle-in-the-haystack test) GPT-3.5-Turbo showed lower accuracy on the BICS benchmark than the BABILONG benchmark at the same context length and target depth, indicating that LLMs struggle more on code-based tasks than text-based tasks at long conte…
Comment linking /blog/bug-in-the-codestack
on “Can LLMs find bugs in large Python codebases?”