Observed AI mathematical breakthroughs operate largely within the convex hull of existing knowledge, recombining recognized results rather than creating novel frameworks. Generating genuinely surprising hypotheses or proposing the next foundational open question remains an unresolved challenge for automated systems.

Current AI models are powerful at applying a vast library of known mathematical techniques to solve problems. However, they fall short in the more abstract, "fuzzy" areas of developing new theories, intuitions, and non-rigorous philosophies that often drive major breakthroughs in the field.

Because models excel at mechanical theorem-proving within defined boundaries, the mathematician's core differentiator is shifting toward mathematical taste. Deciding which real-world problems to model, asking insightful questions, and framing theories will increasingly outweigh the routine mechanics of proof verification.

Unlike human mathematicians who give up on ideas after weeks of tedious work, AI models are relentlessly dogged. They will execute on a given approach without the human bias of judging it as unlikely or not worth the time, leading to breakthroughs in problems where the solution required immense, finicky detail work.

Future AI-driven mathematical discoveries will likely follow two paths. One is finding 'lightning bolt' connections between existing, disparate fields (e.g., number theory and physics). The other, more profound path, is 'mountain building'—constructing entirely new theoretical frameworks, a skill signifying a much higher level of general intelligence.

The core fear isn't just automation, but that AI will mechanistically solve existing problems without the creative leap that opens up entirely new fields of research. This could leave the discipline sterile, with a list of solved questions but no new avenues for human-led discovery.

Even if AI could instantly prove any mathematical claim, it wouldn't end the field. The truly creative and valuable work in mathematics lies in higher-level tasks AI can't do: asking interesting questions, identifying fruitful problems, and inventing entirely new branches of mathematics like calculus or information theory.

Moving beyond solving existing problems like the Millennium Prize problems, the true test of advanced AI in mathematics will be its ability to generate novel, interesting conjectures and create new, unifying definitions. This represents a higher tier of mathematical creativity, akin to the work of the greatest mathematicians who frame the questions for others to solve.

We have formal languages like Lean for deductive proofs, which AI can be trained on. The next frontier is developing a language to capture mathematical *strategy*—how to assess a conjecture's plausibility or choose a promising path. This would help automate the intuitive, creative part of mathematical discovery.