Day 244 of the Daily · Talent Management

The Predictor Ranking

5 min read · 4 principles · apply it by lunch

Good morning. There’s a ranked list of every way to judge a candidate. Your process is built from the wrong end of it.

The question

Add up the hours your last hire’s process actually consumed — the CV sift, the coffee, the panel conversation about whether they’d fit — and then add up the hours that produced a written score against a stated outcome: which number is larger, and what does that ratio say about what you truly believe predicts performance?

The idea

In 1998 Frank Schmidt of the University of Iowa and John Hunter of Michigan State published a paper in Psychological Bulletin with an unusually literal title: the validity and utility of selection methods, drawn from eighty-five years of research findings. They’d brought the field’s meta-analyses together to answer one question — for each way of assessing a candidate, how well does the assessment predict how that person later performs? The output is a ranked list, and it remains the most useful single document in hiring. Work samples, tests of general mental ability and structured interviews sit at the top. Unstructured interviews sit well below them. Years of job experience and years of education sit lower still. Handwriting analysis scores roughly zero, which is the number an honest process should also give to a gut feel. Paul Sackett and colleagues revisited the arithmetic in the Journal of Applied Psychology in 2022, arguing the older figures had been over-corrected for range restriction; their revised list moves the numbers about — structured interviews come out on top, cognitive tests lower — but the shape holds. Samples and structure beat impressions and credentials. The trap is that the two instruments most hiring actually runs on, the CV and the chat, are the two the evidence ranks near the bottom, and they’re the two that feel most like knowing someone.

In the Daily · 4 principles and a template

The Predictor Ranking is Day 244 of 365.

In the Daily, each of its four principles is explained in full, with a one-page template to apply it the same day. A new framework arrives every morning at 7am for a year, across all fifteen courses of the FutureMBA curriculum.

$29 a month · cancel any time · 7-day money-back guarantee

More from Talent Management

The next four in the course.

All 19 Talent Management frameworks
Day 253 · Talent Management

The Blind Screen

Take the last twenty applications you turned down and ask what actually did the turning down: was it evidence weighed against the outcomes you wrote for the role, or was it the university, the unexplained gap in the dates, the company you’d never heard of, the name you couldn’t place? One of those you could defend to the candidate a year later. Which one were you reading?

See the framework →
Day 263 · Talent Management

The Interview Illusion

Think about the last person you interviewed and turned down — can you name the specific thing they said that changed your mind, or was it that the conversation never quite lifted, and if it’s the second, what exactly did you learn that morning about the candidate rather than about the room?

See the framework →
Day 276 · Talent Management

The Structured Interview

Pull up the last interview you ran: how many of the questions were written down before you walked in, how many were asked of every candidate in the same order, and how many answers did you score on paper before you heard what anyone else in the room thought? Whatever that count is, it’s the share of the decision that wasn’t really about the candidate.

See the framework →
Day 286 · Talent Management

The Work Sample

For the last role you filled, what did you actually watch that person produce before you signed the offer — a document, a call, a piece of code, a plan for something real — as opposed to hearing them describe having produced things like it? If the honest answer is nothing, you didn’t hire on evidence. You hired on a well-told story about evidence.

See the framework →