Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Josh Gao says Mecka was an early contributor to Egoverse, a consortium with researchers who believed in scaling human data for robotics. It shared action trajectories, computer vision post-processing, quality gates, and platform tooling to lift the whole industry because robotics is far behind.

Related Insights

Josh Gao says the industry is converging on roughly a million hours of human egocentric data, tens of thousands of hours of UMI data, and a few hours of last-mile teleoperation or in-domain demonstrations. He stresses that tactile and simulation data have not even entered the mix yet.

Pre-training on massive human egocentric video gives foundation models a broad prior across diverse physical manipulation tasks. Fine-tuning with small batches of robot-specific data bridges embodiment gaps and establishes low-level dexterity without expensive massive teleoperation collection.

Josh Gao expects Mecka to look different as robots deploy: not just egocentric data, but a platform that collects domain data, post-trains models, and white-gloves enterprises. He compares the future role to a modern robotics systems integrator whose installed bot keeps improving with data.

Josh Gao says LLM pre-training data was driven by labs through web crawlers and never became a large market. In robotics, he says pre-training is already a large market because there is no free internet corpus; Mecka must create, process, and license physical-world data.

Physical Intelligence demonstrated an emergent capability where its robotics model, after reaching a certain performance threshold, significantly improved by training on egocentric human video. This solves a major bottleneck by leveraging vast, existing video datasets instead of expensive, limited teleoperated data.

Runway’s robotics thesis is that pre-training on massive, easily available third-person video data (e.g., people performing tasks) is more scalable and effective than relying on expensive, limited teleoperation or first-person data. This general world knowledge can then be fine-tuned for specific robotic tasks.

At founding, Josh Gao says robot data was mostly teleoperation, which was hard to scale. He bet that first-person human video could close the vision gap and that humans and humanoids look alike, letting ordinary people contribute like a Tesla-style data fleet.

Josh Gao says large-scale robot factories doing repetitive warehouse tasks revealed a threshold of diversity. Beyond some point, adding more robot data of the same kind oversaturates the need, so Mecka tracks job and industry heat maps and adapts quality heuristics as edge cases emerge.

No single data collection method will solve robotics. Teleoperation provides high-precision ground truth for specific robots but scales poorly and degrades when hardware updates. Universal Manipulation Interface (UMI) data offers better scale and precision via sensors but requires hardware maintenance. Egocentric human video provides massive scale but lacks precise end-effector force signals and suffers from human-to-robot physical embodiment mismatch.

China is accelerating robot training by collecting two data types. It is building expensive, centralized "robot training centers" for high-quality machine data. Simultaneously, firms like JD.com are crowdsourcing "egocentric data" by equipping hundreds of thousands of workers with sensor gear to record their physical movements at scale.

Egoverse consortium shares egocentric data and tooling industry-wide | RiffOn