Bill James and the base-rate fallacy

I was recently rereading and enjoying Bill James’s Historical Baseball Abstract (the second edition, from 2001).

But even the Master is not perfect. Here he is, in the context of the all-time 20th-greatest shortstop (in his reckoning):

Are athletes special people? In general, no, but occasionally, yes. Johnny Pesky at 75 was trim, youthful, optimistic, and practically exploding with energy. You rarely meet anybody like that who isn’t an ex-athlete–and that makes athletes seem special. [italics in the original]

Hey, I’ve met 75-year-olds like that–and none of them are ex-athletes! That’s probably because I don’t know a lot of ex-athletes. But Bill James . . . he knows a lot of athletes. He went to the bathroom with Tim Raines once! The most I can say is that I saw Rickey Henderson steal a couple bases when he was playing against the Orioles once.

Cognitive psychologists talk about the base-rate fallacy, which is the mistake of estimating probabilities without accounting for underlying frequencies. Bill James knows a lot of ex-athletes, so it’s no surprise that the youthful, optimistic, 75-year-olds he meets are likely to be ex-athletes. The rest of us don’t know many ex-athletes, so it’s no suprrise that most of the youthful, optimistic, 75-year-olds we meet are not ex-athletes.

The mistake James made in the above quote was to write “You” when he really meant “I.” I’m not disputing his claim that athletes are disproportionately likely to become lively 75-year-olds; what I’m disagreeing with is his statement that almost all such people are ex-athletes.

Yeah, I know, I’m being picky. But the point is important, I think, because of the window it offers into the larger issue of people being trapped in their own environment (the “availability heuristic,” in the jargon of cognitive psychology). Athletes loom large in Bill James’s world–and I wouldn’t want it any other way–and sometimes he forgets that the rest of us live in a different world.

4 thoughts on “Bill James and the base-rate fallacy

  1. For you, they will someday be mostly emeritus professors.

    As for James: don't former football players tend to die young? They're ex-athletes, I would think.

    http://archive.newsmax.com/archives/articles/2006… notes " the average life expectancy for all pro football players, including all positions and backgrounds, is 55 years. Several insurance carriers say it is 51 years."

    Also this: "A 1994 study of 7,000 former players by the National Institute of Occupational Safety and Health found linemen had a 52 percent greater risk of dying from heart disease than the general population. While U.S. life expectancy is 77.6 years, recent studies suggest the average for NFL players is 55, 52 for linemen. " http://www.sptimes.com/2006/01/29/Sports/A_huge_p

  2. "I was recently rereading Bill James's Historical Baseball Abstract (the second edition, from 2001) and I really like how he"

    …?

Comments are closed.