The insurance industry acts as a powerful de facto regulator. As major insurers seek to exclude AI-related liabilities from policies, they could dramatically slow AI deployment because businesses will be unwilling to shoulder the unmitigated financial risk themselves.

Reid Hoffman argues AI models are so capable that patients with major medical issues are making a "huge mistake" if they don't use one for a second opinion. He suggests it's becoming "almost malpractice" for doctors not to use these tools to double-check themselves.

Contrary to its reputation for slow tech adoption, the legal industry is rapidly embracing advanced AI agents. The sheer volume of work and potential for efficiency gains are driving swift innovation, with firms even hiring lawyers specifically to help with AI product development.

Despite the potential for AI to create more efficient legal services, new tech-first law firms face significant hurdles. The established reputation of a major law firm ("the name on the letterhead") sends a powerful signal in litigation. Furthermore, incumbent firms carry malpractice insurance, meaning they assume liability for mistakes—a crucial function AI startups cannot easily replicate.

A new insurance category, separate from cyber insurance, is launching to cover enterprise risks specific to generative AI. Backed by Lloyd's of London, this product uses US lawsuit data to underwrite liabilities such as copyright infringement and personal injury caused by AI systems, addressing a critical gap for companies deploying the technology.

Within the last year, legal AI tools have evolved from unimpressive novelties to systems capable of performing tasks like due diligence—worth hundreds of thousands of dollars—in minutes. This dramatic capability leap signals that the legal industry's business model faces imminent disruption as clients demand the efficiency gains.

Insurers like AIG are seeking to exclude liabilities from AI use, such as deepfake scams or chatbot errors, from standard corporate policies. This forces businesses to either purchase expensive, capped add-ons or assume a significant new category of uninsurable risk.

While AI "hallucinations" grab headlines, the more systemic risk is lawyers becoming overly reliant on AI and failing to perform due diligence. The LexisNexis CEO predicts an attorney will eventually lose their license not because the AI failed, but because the human failed to properly review the work.

Without clear government standards for AI safety, there is no "safe harbor" from lawsuits. This makes it likely courts will apply strict liability, where a company is at fault even if not negligent. This legal uncertainty makes risk unquantifiable for insurers, forcing them to exit the market.