We scan new podcasts and send you the top 5 insights daily.
To gauge a person's critical thinking beyond AI, use a three-part test. The key is asking them to write a piece on a topic AI couldn't possibly know, like a personal childhood memory. This reveals their ability to structure a narrative and think originally, separating their core skills from AI-augmented output.
To determine if an employee critically engaged with AI-generated content, bypass reading the lengthy document. Instead, directly question them on its substance. Their ability to confidently defend, elaborate on, and explain the material is the true test of their understanding and ownership of the work.
The purpose of quirky interview questions has evolved. Beyond just assessing personality, questions about non-work achievements or hypothetical scenarios are now used to jolt candidates out of scripted answers and expose those relying on mid-interview AI prompts for assistance.
To accurately assess candidates, interviews must be split. One part must be a "Zero AI" test to evaluate raw problem-solving ability and foundational knowledge, complete with cheat detection. The other part must be an "AI-Max" test to assess their skill in leveraging AI tools to be a "roboticist."
To gauge an expert's (human or AI) true depth, go beyond recall-based questions. Pose a complex problem with multiple constraints, like a skeptical audience, high anxiety, and a tight deadline. A genuine expert will synthesize concepts and address all layers of the problem, whereas a novice will give generic advice.
A simple chat thread in ChatGPT is not a workflow. To truly assess if a candidate is a systems thinker, ask how they automate processes in their personal life. A good answer involves feedback loops and self-improving systems, revealing a deeper, more innate ability to leverage AI beyond simple queries.
To assess a candidate's ability to use AI as a thinking partner, have them solve a problem with an LLM. The key is observing their follow-up prompts and their ability to guide the AI step-by-step, rather than just accepting the initial output.
To assess a candidate's authentic writing ability, compare their response to a short, single-sentence prompt with a longer, paragraph-based one. A flawless paragraph but a weak sentence suggests heavy reliance on editing tools or AI for the longer response.
To assess a candidate's true character and values, move beyond standard interview questions. Use unexpected, personal prompts like "What's something your parents taught you?" or "What was your first job?" These questions reveal foundational lessons, resilience, and personal drive, which are hard to gauge otherwise.
Traditional hiring methods are becoming obsolete. To hire PMs, Mercor uses a single test for AI fluency, then immediately shifts to whiteboarding. This assesses fundamental skills like judgment, experimental design, and statistics—capabilities that cannot be outsourced to AI and reveal a candidate's core thinking.
Traditional hiring assessments that ban modern tools are obsolete. A better approach is to give candidates access to AI tools and ask them to complete a complex task in an hour. This tests their ability to leverage technology for productivity, not their ability to memorize information.