Here’s a useful response by Christakis to criticisms of the contagion-of-obesity claims

Yesterday I posted an update on citations of the influential paper from 2007 by sociologist Nicholas Christakis and political scientist James Fowler, “The Spread of Obesity in a Large Social Network over 32 Years,” which concluded, “Network phenomena appear to be relevant to the biologic and behavioral trait of obesity, and obesity appears to spread through social ties.”

As I wrote yesterday, several other researchers had criticized that paper on methodological grounds, and in my post I characterized it as being “many times debunked” and expressed distress that the original claim seems to be regularly cited without reference to the published criticisms by economists Jason Fletcher and Ethan Cohen-Cole, mathematician Russ Lyons, political scientists Hans Noel and Brendan Nyhan, and statisticians Cosma Shalizi and Andrew Thomas.

That said, I am not an expert in this field. I have read the articles linked in the above post but have not kept track of the later literature.

In comments, Christakis shares his perspective on all this:

I [Christakis] think this post is an incomplete summary of the very carefully expressed claims in the original 2007 paper, and also an inaccurate summary of the state of the literature. You also may want to look at our original exchanges on this blog from years ago, and to our published responses to prior critiques, including to some of the decades-old critiques (often inaccurate) that you mention.[1]

Many papers have replicated our findings of social contagion with respect to obesity (and the various other phenomena discussed in our original suite of papers), and many papers have evaluated the early methods we used (based on generalized estimating equations) and have supported that approach.

For instance, analyses by various scholars supported the GEE approach, e.g., by estimating how large the effect of unobserved factors would have to be to subvert confidence in the results.[2],[3],[4],[5] Other papers supported the findings in other ways.[6],[7],[8],[9],[10] This does not mean, of course, that this GEE approach does not require various assumptions or is perfectly able to capture causal effects. This is one reason the 2007 paper described exactly what models were implemented, was judicious in its claims, and also proposed certain innovations for causal identification, including the “edge-directionality test.” The strengths and limitations of the edge-directionality test for causal identification have subsequently been explored by computer scientists,[11] econometricians,[12] statisticians,[13] and sociologists.[14]

Work by other investigators with other datasets and approaches has generally confirmed the 2007 findings. Pertinent work regarding weight and related behaviors is quite diverse, including everything from observational studies to experiments.[15],[16],[17],[18],[19],[20],[21],[22],[23] Of course, as expected, work has also confirmed the existence of homophily with respect to weight. Still other studies have used experimental and observational methods to confirm that one mechanism of the interpersonal spread of obesity might indeed be a spread of norms, as speculated in the 2007 paper.[24],[25],[26],[27]

Of course, methods to estimate social contagion with observational data regarding complex networks continue to evolve, and continue to require various assumption, as ours did in 2007. As before, I would love to see someone offer a superior statistical method to observational data. And I should also clarify that the public-use version of the FHS-Net data (posted at dbGap) is not the same version as the one we based our 2007 analyses on (a constraint imposed by the FHS itself, in ways documented there); however, the original data is available via the FHS itself (or at least was). At times, this difference in datasets explains why other analyses have reached slightly different conclusions than us.

In our 2007 paper, we also documented an association of various ego and alter traits to a geodesic depth of three degrees of separation. We also did this with respect to public goods contributions in a network of hunter-gatherers in Tanzania[28] and smoking in the FHS-Net.[29] Other observational studies have also noted this empirical regularity with respect to information,[30],[31] concert attendance,[32] or even the risk of being murdered.[33] We summarized this topic in 2013.[34]

Moreover, we and others have observed actual contagion up to three degrees of separation in experiments which absolutely excludes homophily or context as an explanation for the clustering.[35],[36],[37] For instance, Moussaid et al documented hyper-dyadic contagion of risk perception experimentally.[38] Another experiment found that the reach of propagation in a subjective judgment task “rarely exceeded a social distance of three to four degrees of separation.”[39] A massive experiment with 61 million people on Facebook documented the spread of voting behavior to two degrees of separation.[40] A large field experiment with 24,702 villagers in Honduras showed that certain maternal and child health behaviors likewise spread to at least two degrees of separation.[41] And a 2023 study involved 2,491 women household heads in 50 poor urban residential units in Mumbai documented social contagion, too.[42]

In addition, my own lab, in the span from as early as 2010 to as recently as 2024 has published many demanding randomized controlled field trials and other experiments documenting social contagion, as noted above. For instance, my group published our first experiment with social contagion in 2010,[43] as well as many other experiments involving social contagion in economic games using online subjects[44],[45],[46] often stimulating still other work.[47],[48],[49]

Many other labs, in part stimulated by our work, have conducted many other experiments documenting social contagion. The idea of using a network-based approach to exploit social contagion to disseminate an intervention – so as to change knowledge, attitudes, or practices at both individual and population levels – has been evaluated in a range of settings.[50],[51],[52],[53],[54],[55],[56],[57],[58]

Finally, other rigorous observational and experimental studies involving large samples and mapped networks have explored diverse outcomes in recent years, beyond the examples reviewed so far. For instance, phenomena mediated by online interactions include phone viruses,[59] diverse kinds of information,[60],[61],[62] voting,[63] and emotions.[64] In face-to-face networks, phenomena as diverse as gun violence in Chicago,[65] microfinance uptake in India,[66] bullying in American schools,[67] chemotherapy use by physicians,[68] agricultural technology in Malawi,[69] and risk perception[70] have been shown to spread by social contagion.

The above, in my view, is a fairer and more complete summary of the impact, relevance, and accuracy of our claims about obesity in particular and social contagion in general. Work in the field of social contagion in complex networks, using observational and experimental studies has exploded since we published our 2007 paper.

The list of references is at the end of Christakis’s comment.

Back in 2010 I wrote that this area is ripe for statistical development and also ripe for development in experimental design and data collection. As of 2024, the area is not just “ripe for development” in experimental design, data collection, and statistical analysis; there have also been many developments in all these areas, by Christakis, his collaborators, and other research groups, and my earlier post was misleading: just because I was ignorant of that followup literature, that’s not an excuse for me to act as if it didn’t exist.

One question here is how to think about the original Christakis and Fowler (2007) paper. On one hand, I remain persuaded by the critics that it made strong claims that were not supported by the data at hand. On the other hand, it was studying an evidently real general phenomenon and it motivated tons of interesting and important research.

Whatever its methodological issues, Christakis and Fowler (2007) is not like the ESP paper or the himmicanes paper or the ovulation-and-voting papers, say, whose only useful contributions to science were to make people aware of the replication crisis and motivate some interesting methodological work. One way to say this is that the social contagion of behavior is both real and interesting. I don’t think that’s the most satisfying way to put this—the people who study ESP, social priming, evolutionary psychology, etc., would doubtless say that their subject areas are both real and interesting too!—so consider this paragraph as a placeholder for a fuller investigation of this point (ideally done by someone who can offer a clear perspective than I can here).

In summary:

1. I remain convinced by the critics that the original Christakis and Fowler paper did not have the evidence to back up its claims.

2. But . . . that doesn’t mean there’s nothing there! In their work, Christakis and Fowler (2007) were not just shooting in the dark. They were studying an interesting and important phenomenon, and the fact that their data were too sparse to answer the questions they were trying to answer, well, that’s what motivates future work.

3. This work does not seem to me to be like various notorious examples of p-hacked literature such as beauty-and-sex-ratio, ovulation-and-clothing, mind-body-healing, etc., and I think a key difference is that the scientific hypotheses involving contagion of behavior are more grounded in reality rather than being anything-goes theories that could be used to explain any pattern in the data.

4. I was wrong to refer to the claim of contagion of obesity as being debunked. That original paper had flaws, and I do think that when it is cited, the papers by its critics should be cited too. But that doesn’t mean the underlying claims are debunked. This one’s tricky—it relates to the distinction between evidence and truth—and that’s why followups such as Christakis’s comment (and the review article that it will be part of) are relevant.

I want to thank Christakis again for his thoughtful and informative response, and I apologize for the inappropriate word “debunked.” I’ve usually been so careful over the years to distinguish evidence and truth, but this time I was sloppy—perhaps in the interest of telling a better story. I’ll try to do better next time.

P.S. I think that one problem here is the common attitude that a single study should be definitive. Christakis and Fowler don’t have that attitude—they’ve done lots of work in this area, not just resting their conclusions on one study—and I don’t have that attitude either. I’m often saying this, that (a) one study is rarely convincing enough to believe on its own, and, conversely, (b) just because a particular study has fatal flaws in its data, that doesn’t mean that nothing is there. We usually criticize the single-study attitude when researchers or journalists take one provisional result and run with it. In this case, though, I fell into the single-study fallacy myself by inappropriately taking the well-documented flaws of that one paper as evidence that nothing was there.

That all said, I’m sure that different social scientists have different views on social contagion, and so I’m not trying to present Christakis’s review as the final word. Nor is he, I assume. It’s just appropriate for me to summarize his views on the matter based on all this followup research he discusses and not have the attitude that everything stopped in 2011.

8 thoughts on “Here’s a useful response by Christakis to criticisms of the contagion-of-obesity claims

  1. Andrew: I appreciate this further response. But I still think you are not correct in some of your characterizations — either in terms of the actual reality of our 2007 findings and the careful way it was executed and described, or in terms of the very large body of work validating both our methods and findings (as documented in my other response). Our claims were indeed “supported by the data.” It’s not for nothing that hundreds of good scientists cite our work, for instance.

    You could also more clearly acknowledge our early turn in my lab to doing many actual demanding experiments (in part because of our frustration with the challenges of causal inference in this setting). I think that would give a more fulsome picture of the field of social contagion in complex networks. We published experiments documenting social contagion in complex networks in 2010 in PNAS, in 2015 in The Lancet, in 2015 in Nature, in 2023 in PNAS, and in 2024 in Science. And we published still other experiments too.

    So, when you say the following, I just think it elides a lot (though I do appreciate the kind words too!): “I think that all of this is consistent with what I wrote that the claim of social contagion of obesity wasn’t supported by the data from the Framingham Health Study, but that doesn’t mean there’s nothing there. There are social effects on attitudes and behavior, and they’re hard to study. As Christakis and Fowler wrote, this area is ripe for statistical development and also ripe for development in experimental design and data collection.

    One question here is how to think about the original Christakis and Fowler (2007) paper. On one hand, it made strong claims that were not supported by the data, and these problems were noted by several published criticisms. On the other hand, it was studying an evidently real general phenomenon and it motivated tons of interesting and important research.”

    Respectfully,

    Nicholas

    • Nicholas:

      Fair enough. My statement, “this area is ripe for statistical development and also ripe for development in experimental design and data collection,” was from 2010. As of 2024, the area is not just “ripe for development” in experimental design, data collection, and statistical analysis; there have also been many developments in all these areas, by you, your collaborators, and other research groups. I am not current on all of this, but that’s my problem, not yours! Or, it shouldn’t be yours, but it was, because you had to waste time responding to my post, for which I again apologize. I will edit the post to clarify.

      Regarding the issue of whether the claims were supported by the data in the original paper, there I remain persuaded by the critics. As I wrote above, I can still see that it makes sense for good scientists to cite the work (and also cite the criticisms) as the ideas remain important, and that paper was such an important first crack at the problem.

      Thanks again for your patience, and I apologize again for the misrepresentations that came from my ignorance and sloppiness. On the plus side, perhaps this discussion will lead some people to read your review material who hadn’t otherwise seen it!

    • I know nothing about the issue at hand. But, I do know that the word, “fulsome” should be avoided:

      “I think that would give a more fulsome picture of the field of social contagion in complex networks.

      It has often been used “incorrectly” as another way of saying the word, “full.” From

      https://www.vocabulary.com/dictionary/fulsome:
      ———————————————————————————————-
      Compliments usually make you feel pretty good, but fulsome compliments, which are exaggerated and usually insincere, may have the opposite effect.

      Hundreds of years ago fulsome used to mean “abundant,” but now it’s more often used to describe an ingratiating manner or an excess of flattery that might provoke an onlooker to mime gagging. If you find fulsome to be a rather clunky word, there are several fun (if vaguely stomach-churning) synonyms, including buttery, oily, oleaginous, and smarmy.
      Definitions of fulsome

      adjective
      unpleasantly and excessively suave or ingratiating in manner or speech
      “gave him a fulsome introduction”
      synonyms: buttery, oily, oleaginous, smarmy, soapy, unctuous
      insincere
      lacking sincerity
      ——————————————————————————————————-
      Aubrey Clayton has made much of the problem which he calls the “transposed conditional” and how easy it is to calculate the wrong quantity. The word “fulsome” illustrates how easy it is to say the opposite of what is intended.

      Am I being pedantic? An old “fuddy duddy?” trying to hold back the inevitable tide of a changing and vibrant language? Or, should some social contagion be challenged? If so, which ones?

      • Paul –

        An old “fuddy duddy?”

        I think it matters if there is some likelihood of people misunderstanding the connotation he intended to convey. I think in this case that’s unlikely.

        Languages change. How do you measure when that’s for the better or for the worse?

        • Joshua: Language, as you suggest, does change but not necessarily for the better. Social climbing, as in “between you and I” and the ubiquitous all-purpose “like” as well as the gratuitous swear words, are ever present today.
          What to do when people use “penultimate” to mean beyond the ultimate? My measurement scale is personal and likely in the minority. But, what should be done when the lay public, for example, somehow believes that statistical significance is more important than (practical, clinical, political) significance?
          One answer is to give up and assume the fetal position. Another is to gently suggest things in this blog.

  2. For completeness, here also are citations to two prior published responses (from a decade ago) to some of the points raised by critics of the 2007 paper. To be clear, we agree with some of the points (e.g., the technical issue of how to account for tie dissolution) and disagree with others. I think the variety of models we brought to bear in the spate of initial papers of ours from 2007-2010, the methodological innovations (e.g., the directionality test for identification, the accounting for geographic location, etc.), the hard-to-obtain data, and the care with which we expressed our claims in the 2007 paper have stood the test of time. And our findings and methods have indeed been widely replicated (and not just cited).

    J.H. Fowler and N.A. Christakis, “Estimating Peer Effects on Health in Social Networks,” Journal of Health Economics 27(5): 1386-1391 (September 2008).

    N.A. Christakis and J.H. Fowler, “Social Contagion Theory: Examining Dynamic Social Networks and Human Behavior,” Statistics in Medicine 32(4): 556-577 (February 2013)

    Furthermore, the work we did using observational methods has motivated a large literature in actual experiments regarding social contagion in complex networks, including many further contributions by my own group, starting early from 2010 onward. In these experiments, we can be very certain about the causal effects of one person on others to whom they are directly or even indirectly connected within the social fabric. There are more citations elsewhere in the exchanges we are having here, but here (again for completeness in the archive that your wonderful blog has become) is a representative selection:

    J.H. Fowler, and N.A. Christakis, “Cooperative Behavior Cascades in Human Social Networks,” PNAS: Proceedings of the National Academy of Sciences 107(12): 5334-5338 (March 2010)

    D.A. Kim, A.R. Hwong, D. Stafford, D.A. Hughes, A.J. O’Malley, J.H. Fowler, and N.A. Christakis, “Social Network Targeting to Maximise Population Behaviour Change: A Cluster Randomised Controlled Trial,” The Lancet 386: 145-153 (July 2015)

    A. Nishi, H. Shirado, D. Rand, and N.A. Christakis, “Inequality and Visibility of Wealth in Experimental Social Networks,” Nature 526: 426-429 (October 2015)

    M.A. Alexander, L. Forastiere, S. Gupta, and N.A. Christakis, “Algorithms for Seeding Social Networks Can Enhance the Adoption of a Public Health Intervention in Urban India,” PNAS: Proceedings of the National Academy of Sciences 119 (30): e22120742119 (July 2022)

    E. Airoldi and N.A. Christakis, “Induction of Social Contagion for Diverse Outcomes in Structured Experiments in Isolated Honduras Villages” Science 384: eadi5147 (May 2024)

    Again, while I disagree with some of your assessments, Andrew, I really appreciate the openness with which you engage in such topics. :-)

  3. ChristaksChristakis is playing a different game. In some parts of social science, the answer has to be right and that is what we argue about. In sociology, the answer has to fit the “right” narrative, and if it does, then a lot of weakness is forgiven. NK made the mistake of getting into an area where a lot of the players are not sociologists.

Leave a Reply

Your email address will not be published. Required fields are marked *