While Figure's CEO criticizes competitors for using human operators in robot videos, this 'wizard of oz' technique is a critical data-gathering and development stage. Just as early Waymo cars had human operators, teleoperation is how companies collect the training data needed for true autonomy.
The integration of AI into human-led services will mirror Tesla's approach to self-driving. Humans will remain the primary interface (the "steering wheel"), while AI progressively automates backend tasks, enhancing capability rather than eliminating the human role entirely in the near term.
To overcome the data bottleneck in robotics, Sunday developed gloves that capture human hand movements. This allows them to train their robot's manipulation skills without needing a physical robot for teleoperation. By separating data gathering (gloves) from execution (robot), they can scale their training dataset far more efficiently than competitors who rely on robot-in-the-loop data collection methods.
The rapid progress of many LLMs was possible because they could leverage the same massive public dataset: the internet. In robotics, no such public corpus of robot interaction data exists. This “data void” means progress is tied to a company's ability to generate its own proprietary data.
Instead of creating bespoke self-driving kits for every car model, a humanoid robot can physically sit in any driver's seat and operate the controls. This concept, highlighted by George Hotz, bypasses proprietary vehicle systems and hardware lock-in, treating the car as a black box.
AI models lack access to the rich, contextual signals from physical, real-world interactions. Humans will remain essential because their job is to participate in this world, gather unique context from experiences like customer conversations, and feed it into AI systems, which cannot glean it on their own.
Physical Intelligence demonstrated an emergent capability where its robotics model, after reaching a certain performance threshold, significantly improved by training on egocentric human video. This solves a major bottleneck by leveraging vast, existing video datasets instead of expensive, limited teleoperated data.
The adoption of powerful AI architectures like transformers in robotics was bottlenecked by data quality, not algorithmic invention. Only after data collection methods improved to capture more dexterous, high-fidelity human actions did these advanced models become effective, reversing the typical 'algorithm-first' narrative of AI progress.
The evolution of Tesla's Full Self-Driving offers a clear parallel for enterprise AI adoption. Initially, human oversight and frequent "disengagements" (interventions) will be necessary. As AI agents learn, the rate of disengagement will drop, signaling a shift from a co-pilot tool to a fully autonomous worker in specific professional domains.
To achieve scalable autonomy, Flywheel AI avoids expensive, site-specific setups. Instead, they offer a valuable teleoperation service today. This service allows them to profitably collect the vast, diverse datasets required to train a generalizable autonomous system, mirroring Tesla's data collection strategy.
Self-driving cars, a 20-year journey so far, are relatively simple robots: metal boxes on 2D surfaces designed *not* to touch things. General-purpose robots operate in complex 3D environments with the primary goal of *touching* and manipulating objects. This highlights the immense, often underestimated, physical and algorithmic challenges facing robotics.