The Five-User Test
5 min read · 4 principles · apply it by lunch
Morning. The instruction that makes this work is the one nobody can follow: don’t help them.
Have you ever sat behind someone who’d never seen your product, handed them a real task and then stayed silent while they failed at it — or is everything you believe about how the thing gets used assembled entirely from your own hands on your own keyboard?
In 1993 Jakob Nielsen and Thomas Landauer presented a paper at the INTERCHI conference in Amsterdam under an unglamorous title — a mathematical model of the finding of usability problems — and it changed how software gets tested. Averaged across a large set of real projects, one person watched using an interface turns up roughly 31 per cent of its usability problems. Each extra person re-finds most of what the last one found, so the curve flattens fast: five people surface around 85 per cent of what’s there, and the sixth and seventh mainly hand you things you’ve already written down. Nielsen made the practical case in a 2000 essay, and the argument was economic as much as statistical — several small tests through a build beat one big one at the end, because you’re fixing while fixing is still cheap. Laura Faulkner stress-tested the claim in 2003, running sixty users on one interface and then drawing random sets of five from the pool: some sets found 99 per cent of the problems, others found 55. Five is a good average and a shaky single roll, which is an argument for running the test again rather than running it bigger. Sitting there while someone flounders feels like bad manners, so you explain what the button does — and destroy the only data the morning was going to produce. That is the trap, and it arrives dressed as politeness.
The Five-User Test is Day 293 of 365.
In the Daily, each of its four principles is explained in full, with a one-page template to apply it the same day. A new framework arrives every morning at 7am for a year, across all fifteen courses of the FutureMBA curriculum.
$29 a month · cancel any time · 7-day money-back guarantee