Early AI training involved simple preference tasks. Now, training frontier models requires PhDs and top professionals to perform complex, hours-long tasks like building entire websites or explaining nuanced cancer topics. The demand is for deep, specialized expertise, not just generalist labor.

A fascinating meta-learning loop emerged where an LLM provides real-time 'quality checks' to human subject-matter experts. This helps them learn the novel skill of how to effectively teach and 'stump' another AI, bridging the gap between their domain expertise and the mechanics of model training.

The 30-40% pay premium for AI PMs isn't just because "AI is hot." It's rooted in the scarcity of their specialized skillset, similar to how analytics PMs with statistics backgrounds are paid more. Companies are paying for demonstrated experience with AI tooling and technical fluency, which is rare.

Industry leaders from LinkedIn and Salesforce predict that AI will automate narrow, specialized tasks, fundamentally reshaping careers. The future workforce will favor 'professional generalists' who can move fluidly between projects and roles, replacing rigid departmental structures with dynamic 'work charts.'

Rather than just replacing jobs, AI is fostering the emergence of new, specialized roles. The "Content Automation Strategist," for example, is a position that merges creative oversight with the technical skill to use AI for scaling content production and personalization effectively.

In a group of 100 experts training an AI, the top 10% will often drive the majority of the model's improvement. This creates a power law dynamic where the ability to source and identify this elite talent becomes a key competitive moat for AI labs and data providers.

Companies like OpenAI and Anthropic are spending billions creating simulated enterprise apps (RL gyms) where human experts train AI models on complex tasks. This has created a new, rapidly growing "AI trainer" job category, but its ultimate purpose is to automate those same expert roles.

By paying over 100 former Wall Street bankers to train its models on complex financial tasks, OpenAI is creating a template for vertical AI dominance. This 'expert-as-a-contractor' model will be replicated across law, accounting, and consulting to systematically automate lucrative knowledge work sectors.

For cutting-edge AI problems, innate curiosity and learning speed ("velocity") are more important than existing domain knowledge. Echoing Karpathy, a candidate with a track record of diving deep into complex topics, regardless of field, will outperform a skilled but less-driven specialist.