Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Despite extensively using custom AI for interview analysis, Formation Bio finds that AI for candidate sourcing is still immature. Their talent team insists on a human reviewing every resume, highlighting that sourcing remains a significant automation challenge due to the need for nuance and confidence in evaluation.

Related Insights

Resource-constrained startups demonstrate the future of corporate functions by bypassing HR entirely. Founders now use LLMs to write job descriptions and build custom AI agents to screen and stack-rank resumes, automating the entire top of the hiring funnel.

The future of AI in talent acquisition is moving beyond on-demand analysis. Formation Bio is working towards "agentic AI" that proactively monitors the hiring pipeline, analyzes interviews in real-time, and provides suggestions for the next steps without being prompted, thus automating strategic insight.

Despite the hype, AI-moderated user interviews are not yet a reliable tool. Even Anthropic, creators of Claude, ran a study with their own AI moderation tool that produced unimpressive, low-quality questions, highlighting the immaturity of the technology.

Beyond model capabilities and process integration, a key challenge in deploying AI is the "verification bottleneck." This new layer of work requires humans to review edge cases and ensure final accuracy, creating a need for entirely new quality assurance processes that didn't exist before.

Countering the idea that AI sacrifices quality for speed, Honeybook's recruiting agent found four net-new, high-quality candidates the team had missed manually. The fifth candidate it found was one the team was already pursuing, validating the AI's quality and ability to augment human efforts.

At Formation Bio, the goal of implementing AI in recruitment isn't to automate decision-making. Instead, AI handles data synthesis and analysis, which allows the talent team to spend more time building deeper, more personal relationships with candidates, armed with better insights.

The company uses a custom AI tool that analyzes interview transcripts and scorecards. By providing the AI with context on company values and philosophy, it can identify thematic signals of alignment, moving beyond simple keyword matching to a more nuanced evaluation of a candidate.

When companies use black-box AI for hiring, it creates a no-win 'arms race.' Applicants use prompt injection and other tricks to game the system, while companies build countermeasures to detect them. This escalatory cycle is a 'war of attrition' where the underlying goal of finding the right candidate is lost.

Despite the hype, AI is unreliable, with error rates as high as 20-30%. This makes it a poor substitute for junior employees. Companies attempting to replace newcomers with current AI risk significant operational failures and undermine their talent pipeline.

AI agents have flooded job portals with applications, making the traditional resume drop useless. To break into competitive AI PM roles, candidates must bypass this noise by finding a human connection for a referral. Recruiters now primarily rely on direct outreach, making networking essential for getting noticed.