Survivorship Bias

During World War II, the Statistical Research Group at Columbia University was tasked with inspecting bombers returning from combat. Many aircraft were peppered with bullet holes across their wings and fuselages. As the popular story goes, military officers wanted to add thicker armor to the wings where the bullet holes clustered most heavily.

However, mathematician Abraham Wald reached the exact opposite conclusion. Planes hit in the wings managed to limp home, but planes shot in the engines or cockpit were much less likely to return. The very absence of bullet holes in those vital spots on returning bombers was the clue. The research team was observing only the planes that survived.

The bullet holes on returning bombers were actually proof of where a plane could take a hit and still fly. When missing data from those who perished is excluded, we are bound to make completely backward decisions.

Walk into any bookstore and you will easily spot titles like *The Secrets of Billionaire College Dropouts*. They focus on shared traits of iconic founders like Steve Jobs or Bill Gates. Reading them makes it feel as though dropping out of college is the secret formula for entrepreneurial success.

Yet we never hear from the tens of thousands who dropped out, launched a venture, and quietly went broke. Winners take the stage for flashy interviews and keynote speeches, while the stories of those who failed remain hidden in the shadows.

It is the same with beloved neighborhood restaurants. The secret recipe of a legendary diner thriving for thirty years seems foolproof. But the countless diners that used identical recipes and closed within a year are completely invisible. To truly understand success, you have to examine the data of those who failed too.

In statistics, survivorship bias is recognized as a classic form of selection bias—an error that happens during data sampling. It creates systematic distortions when only items that cleared a specific filter survive into your dataset instead of a truly random sample.

An anecdote about the ancient Greek philosopher Diagoras illustrates this perfectly. When shown votive paintings dedicated to the gods by sailors who survived shipwrecks, he asked: "Where are the portraits of those who prayed just as hard, yet drowned?" Consciously searching for missing data is the bedrock of critical thinking.

Whenever you learn something new or make an important decision, ask yourself: "Am I looking at the whole picture, or just the survivors?" The moment you search for the silent, eliminated data, you begin seeing the world with far greater clarity.