The above-titled paper from two University of Michigan researchers is published in my new favorite journal, Advances in Methods and Practices in Psychological Science:
Although psychological research often relies on convenience samples, the most informative participants may be individuals who are reluctant to engage because of vulnerability, mistrust of the research process, and/or disagreement with a study’s goals. Although this concern is particularly urgent for certain research questions, it is relevant for all researchers because relying solely on easy-to-reach participants limits a study’s validity and generalizability and may substantially hollow out or even render unanswerable some research questions. We review a number of challenges for conducting research with “reluctant but informative” participants . . . engaging reluctant participants requires attention at every phase of the research process, including study design and planning, participant recruitment and testing, data analysis and interpretation, and reporting and broader impacts. We also illustrate with our own recent experiences conducting research on children’s gender concepts in rural, conservative U.S. communities that expressed skepticism about the value of this research. . . . we discuss the importance of transparency around sample composition and constraints to generalizability and the potential utility of collaborative research both across research institutions and between researchers and participant communities.
There’s a lot here that I like, in particular the focus on
– Measurement
– Generalization
– Treating the people involved in an experiment as collaborators or participants rather than “subjects.”
you forgot to add “from the sister blog”
Oh, stop it!
I came across this blog yonks ago whilst googeling for a social psychologist whose first name I couldn’t recall, and so I thunk to meself this guy sounds really interesting. And so he does. I don’t think he has any need for promoting any next-of-kin. Nor do they.
Olaf:
The point of this blog is not to promote anything. I write about what seems interesting and important (or some mix of interestingness and importance) to me. When I happen to learn about work of friends, colleagues, or relatives that seems interesting and important, I’ll write about it. That is, I follow no policy of avoiding such topics when they arise.
I read Mitzi’s comment as witticism not criticism.
Ah, well, there’s
Miller, J. B., & Gelman, A. (2020). Laplace’s theories of cognitive illusions, heuristics and biases. Statistical science, 35(2), 159-170.
cited in
Kahneman, D., & Bar-Hillel, M. (2020). Comment: Laplace and Cognitive Illusions. Statistical science, 35(2), 171-172.
as
Miller, J. and Gelman, S. (2020). Laplace’s theories of cognitive illusions, heuristics and biases. Statistical science, 35(2), 159-170.
Thanks Andrew. I thought this was great and, by chance, a great reference for a problem a friend was just working on this week.
> Treating the people involved in an experiment as collaborators or participants rather than “subjects.”
Yes. I was happy to see “member checking” called out. It’s also valuable towards the goal of making the research valuable for the population that was studied — particularly if this is a population without high social, economic, or cultural status.