Paul Alper writes: Some of your blog postings elicit many responses and some, rather few. Have you ever thought of displaying some sort of statistical graph illustrating the years of data? For example, sports vs. politics, or responses for one year vs. another (time series), winter vs. summer, highly technical vs. breezy. I’ve not done […]
Archive of posts filed under the Decision Theory category.
More on that credulity thing
I see five problems here that together form a feedback loop with bad consequences. Here are the problems: 1. Irrelevant or misunderstood statistical or econometric theory; 2. Poorly-executed research; 3. Other people in the field being loath to criticize, taking published or even preprinted claims as correct until proved otherwise; 4. Journalists taking published or […]
Rob Tibshirani, Yuling Yao, and Aki Vehtari on cross validation
Rob Tibshirani writes: About 9 years ago I emailed you about our new significance result for the lasso. You wrote about in your blog. For some reason I never saw that full blog until now. I do remember the Stanford-Berkeley Seminar in 1994 where I first presented the lasso and you asked that question. Anyway, […]
Relative vs. absolute risk reduction . . . 500 doctors want to know!
Some stranger writes: What are your thoughts on this paper? Especially the paragraph on page 6 “Similar to the critical appraisal ….. respectively”. There are many of us MD’s who are quite foxed. If you blog about it, please don’t mention my name and just say a doctor on a 500-member listserv asked you about […]
Understanding the value of bloc voting, using the Congressional Progressive Caucus as an example:
Daniel Stock writes: I’m a public policy PhD student, interested in economic policy and a bit of political science. I recently saw that the Congressional Progressive Caucus instituted bloc voting rules a few months ago: if at least two thirds of them agree on a bill or amendment, then all CPC members are bound to […]
Call for a moratorium on the use of the term “prisoner’s dilemma”
Palko writes: I’m not sure what the best way to get the ball rolling here would be (perhaps a kickstarter?) but we need to have a strictly enforced rule that no journalist or pundit is allowed to mention the prisoner’s dilemma for the next five or ten years, however long it takes to learn to […]
I have these great April Fools ideas but there’s no space for them in the margin of this blog
Not really. Actually I have no good April Fools ideas this year. Usually I write an April Fools post months in advance, but it’s been such an overwhelming year in so many ways with a pandemic, an attempted overthrow of the government, and lots more, that somehow the inspiration never came. Bu we should have […]
Many years ago, when he was a baby economist . . .
Jonathan Falk writes: Many years ago, when I was a baby economist, a fight broke out in my firm between two economists. There was a question as to whether a particular change in the telecommunications laws had spurred productivity improvements or not. There a trend of x% per year in productivity improvements that had gone […]
What is the landscape of uncertainty outside the clinical trial’s methods?
I live in the province of British Columbia in the country of Canada (right, this post is not by Andrew, it is by Lizzie). Recently one of our top provincial health officials, Dr. Bonnie Henry, has received extra scrutiny based on her decision to delay second doses of the vaccine. The general argument against this […]
Bayesian methods and what they offer compared to classical econometrics
A well-known economist who wishes to remain anonymous writes: Can you write about this agent? He’s getting exponentially big on Twitter. The link is to an econometrician, Jeffrey Wooldridge, who writes: Many useful procedures—shrinkage, for example—can be derived from a Bayesian perspective. But those estimators can be studied from a frequentist perspective, and no strong […]
A new approach to pandemic control by informing people of their social distance from exposure
Po-Shen Lo, a mathematician who works in graph theory, writes about a new approach he devised for pandemic control. He writes: The significance of this new approach is potentially very high, because it not only can improve the current situation, but it would permanently add a new orthogonal tool to the toolbox for pandemic control, […]
Here is how you should title the next book you write.
I was talking with someone about book titles. I liked the title Red State Blue State Rich State Poor State when I came up with it, but the book did not sell as well as I hoped (not that I thought it would sell enough to make me lots of money; I’m just using sales […]
The Mets are hiring
Des McGowan writes: We are looking to hire multiple full time analysts/senior analysts to join the Baseball Analytics department at the New York Mets. The roles will involve building, testing, and presenting statistical models that inform decision-making in all facets of Baseball Operations. These positions require a strong background in complex statistics and data analytics, […]
Statisticians don’t use statistical evidence to decide what statistical methods to use. Also, The Way of the Physicist.
David Bailey, a physicist at the University of Toronto, writes: I thought you’d be pleased to hear that a student in our Advanced Physics Lab spontaneously used Stan to analyze data with significant uncertainties in both x and y. We’d normally expect students to use python and orthogonal distance regression, and STAN is never mentioned […]
Is the right brain hemisphere more analog and Bayesian?
Oliver Schultheiss writes: I recently commented one of your posts (I forgot which one) with a reference to evidence suggesting that the right brain hemisphere may be in a better position to handle numbers and probabilistic predictions. Yesterday I came across the attached paper by Filipowicz, Anderson, & Danckert (2016) that may be of some […]
“Our underpowered trial provides no indication that X has a positive or negative effect on Y”
It’s rare to see researchers say flat-out that an experimental result leaves them uncertain. There seems to be such a temptation to either declare victory with statistical significance (setting the significance level to 0.1 if necessary to clear the bar) or to claim that weak and noisy results are “suggestive” or, conversely, to declare non-significance […]
Nudgelords: Given their past track record, why should I trust them this time? (Don’t call me Stasi)
An economist who wants to remain nameless sent me an email with subject line Hilarious and with the following text: https://www.amazon.com/Averting-Catastrophe-Decision-Potential-Disasters/dp/1479808482 The link is to a listing for a forthcoming book, Averting Catastrophe: Decision Theory for COVID-19, Climate Change, and Potential Disasters of All Kinds, by Cass R. Sunstein. The book “explores how governments ought […]
Bayesian inference completely solves the multiple comparisons problem
I’m rerunning this one from 2016 because it came up at work recently, and I think the general topic is as important as it’s ever been. flat priors consistently give bad inferences. Or, to put it another way, the routine use of flat priors results in poor frequency properties in realistic settings where studies are […]
“Small Steps to Accuracy: Incremental Updaters are Better Forecasters”
Pavel Atanasov writes: I noticed your 2016 post on belief updating. Here is the key bit: From the perspective of the judgment and decision making literature, the challenge is integrating new information at the appropriate rate: not so fast that your predictions jump up and down like a yo-yo (the fate of naive poll-watchers) and […]
Hierarchical stacking, part II: Voting and model averaging
(This post is by Yuling) Yesterday I have advertised our new preprint on hierarchical stacking. Apart from the methodology development, perhaps I could draw some of your attention to the analogy between model averaging/selection and voting systems, which is likely to be more entertaining. Model selection = we have multiple models to fit the data and […]