The deterrent effect of the death penalty

John Donohue sent me this paper reviewing evidence about the deterrent effect of the death penalty. I recommend the Donohue and Wolfers paper highly–at least on the technical side, it’s the paper I would like to have written on this topic, if I had been able to go through all the details on the many recent papers on the topic. I can’t really comment on their policy recommendations but have some futher thoughts on the death-penalty studies from a statistical perspective.

I’ll first give the key paragraph of the conclusion of their paper, then give my comments:

We [Donohue and Wolfers] have surveyed data on the time series of executions and homicides in the United States, compared the United States with Canada, compared non-death penalty states with executing states, analyzed the effects of the judicial experiments provided by the Furman and Gregg decisions comparing affected states with unaffected states, surveyed the state panel data since 1934, assessed a range of instrumental variables approaches, and analyzed two recent state-specific execution moratoria. None of these approaches suggested that the death penalty has large effects on the murder rate. Year-to-year movements in homicide rates are large, and the effects of even major changes in execution policy are barely detectable. Inferences of substantial deterrent effects made by authors examining specific samples appear not to be robust in larger samples; inferences based on specific functional forms appear not to be robust to alternative functional forms; inferences made without reference to a comparison group appear only to reflect broader societal trends and do not hold up when compared with appropriate control groups; inferences based on specific sets of controls turn out not to be robust to alternative sets of controls; and inferences of robust effects based on either faulty instruments or underestimated standard errors are also found wanting.

My thoughts

My first comment is that death-penalty deterrence is a difficult topic to study. The treatment is observational, the data and the effect itself are aggregate, and changes in death-penalty policies are associated with other policy changes. (In contrast, my work with Jim Liebman and others on death-penalty reversals was much cleaner–our analysis was descriptive rather than causal, and the problem was much more clearly defined. This does not make our study any better, but it certainly made it easier.) Much of the discussion of the deterrence studies reminds me of a little-known statistical principle, which is that statisticians (or, more generally, data analysts) look best when they are studying large, clear effects. This is a messy problem, and nobody is going to come out of it looking so great.

My second comment is that a quick analysis of the data, at least since 1960, will find that homicide rates went up when the death penalty went away, and then homicide rates declined when the death penalty was re-instituted (see Figure 1 of the Donohue and Wolfers paper), and similar patterns have happened within states. So it’s not a surprise that regression analyses have found a deterrent effect. But, as noted, the difficulties arise because of the observational nature of the treatment, and the fact that other policies are changed along with the death penalty. There are also various technical issues that arise, which Donohue and Wolfers discussed.

Also some quick comments:

– Figure 1 should be two graphs, one for homicide rate and once for execution rate.

– Figure 2 should be 2 graphs, one on top of the other (so time line is clear), one for the U.S. and one for Canada. Actually, once Canada is in the picture, maybe consider breaking U.S. into regions, since the northern U.S. is perhaps a more reasonable comparison to Canada.

– Figure 8 qould be much clearer as 12 separate time series in a grid (with common x- and y-axes). It’s hopeless to try to read all these lines. With care, you could fit these 12 little plots in the exact same space as this single graph.

Another view

Here’s an article by Joanna Shepherd stating the position that the death penalty deters homicides in some states but not others. Their story is possible but it seems to me (basically, for the reasons discussed in the Donohue and Wolfers paper) not a credible extrapolation from the data.

The death penalty as a decision-analysis problem?

Policy questions about the death penalty have sometimes been expressed in terms of the number of lives lost or saved by a given sentencing policy. But I think this direction of thinking might be a dead end. First off, as noted above, it may very well be essentially impossible to statistically estimate the net deterrent effect of death sentencing–what seem like the “hard numbers” (in Richard Posner’s words, “careful econometric analysis”) aren’t so clear at all.

More generally, though, I’m not sure how you balance out the chance of deterring murders with the chance of executing an innocent person. What if each death sentence deterred 0.1 murder, and 5% of people executed were actually innocent? That’s still a 2:1 ratio (assuming that it’s OK to execute the guilty people). Then again, maybe these innocent people who were executed weren’t so innocent after all. But then again, not every murder victim is innocent either. Conversely, suppose that executing an innocent person were to deter 2 murders (or, conversely, that freeing an innocently-convicted man were to un-deter 2 murders). Then the utility calculus would suggest that it’s actually OK to do it. In general I’m a big fan of probabilistic cost-benefit analyses (see, for example, chapter 22 of my book), but here I don’t see it working out. The main concerns–on the one hand, worry about out-of-control crime, and on the other hand, worry about executing innocents–just seem difficult to put on the same scale.

Finally, regarding decision analysis, incentives, and so forth: much of the discussion (not in the Donohoe and Wolfers paper, but elsewhere) seems to go to the incentives of potential murderers. But the death penalty also affects the incentives of judges, juries, prosecutors, and so forth. One of the arguments in favor of the death penalty is that it sends a message that the justice system is serious about prosecuting murders. This message is sent to the population at large, I think, not just to deter potential murderers but to make clear that the system works. Conversely, one argument against the death penalty is that it motivates prosecutors to go after innocent people, and to hide or deny exculpatory evidence. Lots of incentives out there.

P.S. See also here and here for more comments on the topic.

5 thoughts on “The deterrent effect of the death penalty

  1. I think it was Deirdre McCloskey that noted that if there wasn't something very, very, sick and rotten at the heart of econometrics, there would be a lot more articles in the journals which concluded that it was impossible to answer a particular question one way or the other on the basis of the available evidence.

  2. Assume we can assess the number of lives saved/lost by pursuing a particular policy; in other words, the number of extra murders that would happen under a no-death-penalty policy minus the number of innocent people executed by mistake. Assume everyone agrees with the resulting number or distribution of this quantity. I have little idea how we would go about doing this, but assume it is done.

    In that case, we can't help balancing victims of murderers vs victims of mistaken executions; any policy we choose will implicitly choose a trade-off point between the two; it can't be helped. It might be hard, but all we can do is choose the balance point thoughtfully or unthoughtfully, explicitly or implicitly.

    Why might we think that a victim of a murderer and a victim of a mistaken execution wouldn't trade-off 1 for 1? As a starting point, I could ask "Which would I rather die from, if I had to choose?". I don't know enough to have a preference one way or the other right now, so I would be indifferent, but experts might enlighten me. I see arguments both ways.

    Execution: long time in jail, fear, etc.;
    Murder: fear, pain, and the "criminality" of murder (e.g. I prefer losing something to having it stolen; the consequences are the same, I know, but the feeling isn't. Same goes for dying through an accident or mistake vs being murdered)

    Note: I have been saying "mistaken execution" not to euphemize but to clarify; if an innocent is executed recklessly or fraudulently, then that would be a murder caused by the death penalty policy.

  3. hi we're doing a report. name ONE piece of evidence that death penalty doesn't deter crime, please. and no graphs, we already have that!! bye bye

  4. Clearly for the sake of man kind there is only one thing to do. The experimental units will be the 50 states. The treatment will be the death penalty. We will randomly assign states to the death penalty and no death penalty treatments. We will watch for 60 years.

    Normally you kill a bunch of people in an experiment and people go 'ohhhh unethical'. But hey death penalty is cool right? So just tell all the states to forget about all their 'right' this and 'wrong' that. We put their names into a hat and get this process started right.

    We will put people to death in one state and not another. Nothing unethical about that we do every day in this country.

    Though I bet you we would need an effect for whether or not they were a death penalty state before the experiment. Maybe we should control for that prior to the randomization? Hmmm

    On second, this isn't a good spot for science to go. We should just kick back and let legislators feel their way through the dark molasses of execution, while we cleanly evaluate the results as best we can. Worked for tobacco!

Comments are closed.