Instead of repeatedly performing tasks, knowledge workers will train AI agents by creating "evals"—data sets that teach the AI how to handle specific workflows. This fundamental shift means the economy will transition from paying for human execution to paying for human training data.
Related Insights
AI startup Mercore's valuation quintupled to $10B by connecting AI labs with domain experts to train models. This reveals that the most critical bottleneck for advanced AI is not just data or compute, but reinforcement learning from highly skilled human feedback, creating a new "RL economy."
As AI agents take over task execution, the primary role of human knowledge workers evolves. Instead of being the "doers," humans become the "architects" who design, model, and orchestrate the workflows that both human and AI teammates follow. This places a premium on systems thinking and process design skills.
As AI evolves from single-task tools to autonomous agents, the human role transforms. Instead of simply using AI, professionals will need to manage and oversee multiple AI agents, ensuring their actions are safe, ethical, and aligned with business goals, acting as a critical control layer.
Top-performing engineering teams are evolving from hands-on coding to a managerial role. Their primary job is to define tasks, kick off multiple AI agents in parallel, review plans, and approve the final output, rather than implementing the details themselves.
Companies like OpenAI and Anthropic are spending billions creating simulated enterprise apps (RL gyms) where human experts train AI models on complex tasks. This has created a new, rapidly growing "AI trainer" job category, but its ultimate purpose is to automate those same expert roles.
Instead of focusing on foundational models, software engineers should target the creation of AI "agents." These are automated workflows designed to handle specific, repetitive business chores within departments like customer support, sales, or HR. This is where companies see immediate value and are willing to invest.
As AI agents automate day-to-day e-commerce optimization, the primary role for humans evolves. Core competencies will shift from data analysis and execution to high-level decision-making and managing the complex, collaborative joint business planning process with retail partners.
Mercore's $500M revenue in 17 months highlights a shift in AI training. The focus is moving from low-paid data labelers to a marketplace of elite experts like doctors and lawyers providing high-quality, nuanced data. This creates a new, lucrative gig economy for top-tier professionals.
The job of an individual contributor is no longer about direct execution but about allocation. ICs now act like managers, directing AI agents to perform tasks and using their judgment to prioritize, review, and integrate the output. This represents a fundamental shift in the nature of knowledge work.
The paradigm shift with AI agents is from "tools to click buttons in" (like CRMs) to autonomous systems that work for you in the background. This is a new form of productivity, akin to delegating tasks to a team member rather than just using a better tool yourself.
