To familiarize engineers with agentic coding workflows, Brex created a new interview process that requires AI tool usage. They then had every current engineer and manager complete the interview, forcing hands-on experience and revealing skill gaps in a practical setting.

Theoretical knowledge is now just a prerequisite, not the key to getting hired in AI. Companies demand candidates who can demonstrate practical, day-one skills in building, deploying, and maintaining real, scalable AI systems. The ability to build is the new currency.

Rather than creating assessments that prohibit AI use, hiring managers should embrace it. A candidate's ability to leverage tools like ChatGPT to complete a project is a more accurate predictor of their future impact than their ability to perform tasks without them.

To evaluate candidates, run the same case study through an AI agent like Claude. This creates an objective performance floor; if a human candidate cannot outperform the AI's output, they fail to meet the minimum standard for the role, providing a practical filter in the hiring process.

To assess a product manager's AI skills, integrate AI into your standard hiring process rather than just asking theoretical questions. Expect candidates to use AI tools in take-home case studies and analytical interviews to test for practical application and raise the quality bar.

A common hiring mistake is prioritizing a conversational 'vibe check' over assessing actual skills. A much better approach is to give candidates a project that simulates the job's core responsibilities, providing a direct and clean signal of their capabilities.

To build an AI-native team, shift the hiring process from reviewing resumes to evaluating portfolios of work. Ask candidates to demonstrate what they've built with AI, their favorite prompt techniques, and apps they wish they could create. This reveals practical skill over credentialism.

To avoid wasting significant capital on an underperforming developer, vet candidates by hiring them for a small, isolated test project first. Use platforms like Upwork for this initial trial to confirm their skills and work ethic before committing to a larger, more expensive build.

Since AI assistants make it easy for candidates to complete take-home coding exercises, simply evaluating the final product is no longer an effective screening method. The new best practice is to require candidates to build with AI and then explain their thought process, revealing their true engineering and problem-solving skills.