Get your free personalized podcast brief
We scan new podcasts and send you the top 5 insights daily.
Jerry Twerk suggests that large, successful AI labs like OpenAI are hampered by their own success. Their established, scaled-up methods for training models (e.g., transformers) create inertia that makes it difficult to explore fundamentally new approaches. This gives smaller, agile startups a key advantage in pursuing breakthrough research.
Related Insights
With industry dominating large-scale compute, academia's function is no longer to train the biggest models. Instead, its value lies in pursuing unconventional, high-risk research in areas like new algorithms, architectures, and theoretical underpinnings that commercial labs, focused on scaling, might overlook.
As large, commercially-focused AI labs shift resources from fundamental research to product development, a vacuum is created. This opens a critical window for universities, the open-source community, and independent researchers to pioneer the next generation of non-obvious AI breakthroughs.
With industry dominating large-scale model training, academia’s comparative advantage has shifted. Its focus should be on exploring high-risk, unconventional concepts like new algorithms and hardware-aligned architectures that commercial labs, focused on near-term ROI, cannot prioritize.
Intense market competition forces major AI labs to focus on scaling proven, profitable Transformer models for short-term gains. This creates a strategic blind spot, leaving a crucial gap for startups like Core Automation to explore fundamentally new, non-Transformer architectures that could redefine the field.
With industry dominating large-scale model training, academic labs can no longer compete on compute. Their new strategic advantage lies in pursuing unconventional, high-risk ideas, new algorithms, and theoretical underpinnings that large commercial labs might overlook.
Large AI labs must serve a vast portfolio of products, preventing them from focusing intensely on any single vertical. This creates a significant opportunity for startups. By concentrating all resources on a specific domain, startups can 'run laps around' even the best-resourced labs, leveraging focus as their primary competitive advantage.
Don't fear competition from large AI labs like Google or OpenAI. A startup's A-team, maniacally focused on a specific enterprise problem, will consistently beat the C-team of a tech giant assigned to a non-core project.
The founder, who left a $1.3M+ Google role, argues that major AI innovations (ChatGPT, Claude Code, OpenClaw) come from nimble teams. Large corporations' approval processes and guardrails stifle the rapid, experimental iteration necessary for true breakthroughs, making them poor environments for building the future of AI.
The mantra 'ideas are cheap' fails in the current AI paradigm. With 'scaling' as the dominant execution strategy, the industry has more companies than novel ideas. This makes truly new concepts, not just execution, the scarcest resource and the primary bottleneck for breakthrough progress.
Ilya Sutskever argues that the AI industry's "age of scaling" (2020-2025) is insufficient for achieving superintelligence. He posits that the next leap requires a return to the "age of research" to discover new paradigms, as simply making existing models 100x larger won't be enough for a breakthrough.
