The founders built the tool because they needed independent, comparative data on LLM performance vs. cost for their own legal AI startup. It only became a full-time company after its utility grew with the explosion of new models, demonstrating how solving a personal niche problem can address a wider market need.

Related Insights

Startups are increasingly using AI to handle legal and accounting tasks themselves, avoiding high professional fees. This signals a significant market need for tools that formalize and support this DIY approach, especially as startups scale and require more robust solutions for investors.

The rapid growth of AI products isn't due to a sudden market desire for AI technology itself. Rather, AI enables superior solutions for long-standing customer problems that were previously addressed with inadequate options. The demand existed long before the AI-powered supply arrived to meet it.

An app bundling various LLMs into one interface is making $300k/month. Replicate this success by targeting a specific professional niche like lawyers or teachers. Stitch together models and workflows to become the default AI assistant for that vertical.

Arena differentiates from competitors like Artificial Analysis by evaluating models on organic, user-generated prompts. This provides a level of real-world relevance and data diversity that platforms using pre-generated test cases or rerunning public benchmarks cannot replicate.

Most successful SaaS companies weren't built on new core tech, but by packaging existing tech (like databases or CRMs) into solutions for specific industries. AI is no different. The opportunity lies in unbundling a general tool like ChatGPT and rebundling its capabilities into vertical-specific products.

Resource-constrained startups are forgoing traditional hires like lawyers, instead using LLMs to analyze legal documents, identify unfavorable terms, and generate negotiation counter-arguments, saving significant legal fees in their first years.

Initially building a tool for ML teams, they discovered the true pain point was creating AI-powered workflows for business users. This insight came from observing how first customers struggled with the infrastructure *around* their tool, not the tool itself.

Instead of paying lawyers $50,000 for deal diligence, Union Square Ventures' Fred Wilson used Google's free AI tool, NotebookLM. He uploaded past deal documents and the new startup's data room into separate "notebooks" and used AI to interrogate the differences, collapsing weeks of expensive work into a few hours.

Founders can get objective performance feedback without waiting for a fundraising cycle. AI benchmarking tools can analyze routine documents like monthly investor updates or board packs, providing continuous, low-effort insight into how the company truly stacks up against the market.

The legal profession's core functions—researching case law, drafting contracts, and reviewing documents—are based on a large, structured corpus of text. This makes them ideal use cases for Large Language Models, fueling a massive wave of investment into legal AI companies.

Artificial Analysis Began as a Side Project to Solve the Founders' Own LLM Benchmarking Needs | RiffOn