To ensure accuracy in its legal AI, LexisNexis unexpectedly hired a large number of lawyers, not just data scientists. These legal experts are crucial for reviewing AI output, identifying errors, and training the models, highlighting the essential role of human domain expertise in specialized AI.

The legal system, despite its structure, is fundamentally non-deterministic and influenced by human factors. Applying new, equally non-deterministic AI systems to this already unpredictable human process poses a deep philosophical challenge to the notion of law as a computable, deterministic process.

Despite the potential for AI to create more efficient legal services, new tech-first law firms face significant hurdles. The established reputation of a major law firm ("the name on the letterhead") sends a powerful signal in litigation. Furthermore, incumbent firms carry malpractice insurance, meaning they assume liability for mistakes—a crucial function AI startups cannot easily replicate.

Current AI tools are empowering laypeople to generate a flood of low-quality legal filings. This 'sludge' overwhelms the courts and creates more work for skilled attorneys who must respond to the influx of meritless litigation, ironically boosting demand for the very profession AI is meant to disrupt.

Messy AI-generated code ("slop") can still result in a functional product, hiding imperfections from the end user. In knowledge work, a slightly "off" AI-generated contract or memo creates immediate legal or business risk, as there is no interface to abstract away the sloppiness.

While AI can identify legal technicalities to help individuals file lawsuits, the aggregate effect is a flood of litigation that bogs down the court system. This creates a negative second-order consequence that can outweigh the individual benefits.

When junior employees are encouraged to use AI from day one, they fail to develop foundational skills. This "deskilling" means they won't be able to spot AI hallucinations or errors, ironically making them less competent and more liable, particularly in fields like law.

While AI "hallucinations" grab headlines, the more systemic risk is lawyers becoming overly reliant on AI and failing to perform due diligence. The LexisNexis CEO predicts an attorney will eventually lose their license not because the AI failed, but because the human failed to properly review the work.

The once-critical problem of AI hallucinations has been dramatically reduced. Current frontier models are now more reliable in this regard than human junior associates, making them viable for professional legal work, contrary to popular belief.