Skip to content
Archive of posts filed under the Causal Inference category.

Designing a study to see if “the 10x programmer” is a real thing

Lorin H. writes: One big question in the world of software engineering is: how much variation is there in productivity across programmers? (If you google for “10x programmer” you’ll see lots of hits). Let’s say I wanted to explore this research question with a simple study. Choose a set of participants at random from a […]

If observational studies are outlawed, then only outlaws will do observational studies

My article “Experimental reasoning in social science” begins as follows: As a statistician, I was trained to think of randomized experimentation as representing the gold standard of knowledge in the social sciences, and, despite having seen occasional arguments to the contrary, I still hold that view, expressed pithily by Box, Hunter, and Hunter (1978) that […]

Retrospective clinical trials?

Kelvin Leshabari writes: I am a young medical doctor in Africa who wondered if it is possible to have a retrospective designed randomised clinical trial and yet be sound valid in statistical sense. This is because to the best of my knowledge, the assumptions underlying RCT methodology include that data is obtained in a prospective […]

The history of MRP highlights some differences between political science and epidemiology

Responding to a comment from Thomas Lumley (who asked why MRP estimates often seem to appear without any standard errors), I wrote: In political science, MRP always seems accompanied by uncertainty estimates. However, when lots of things are being displayed at once, it’s not always easy to show uncertainty, and in many cases I simply […]

I love it when I can respond to a question with a single link

Shira writes: This came up from trying to help a colleague of mine at Human Rights Watch. He has several completely observed variables X, and a variable with 29% missing, Y. He wants a histogram (and other descriptive statistics) of a “filled in” Y. He can regress Y on X, and impute missing Y’s from […]

Why I’m still not persuaded by the claim that subliminal smiley-faces can have big effects on political attitudes

We had a discussion last month on the sister blog regarding the effects of subliminal messages on political attitudes.  It started with a Larry Bartels post entitled “Here’s how a cartoon smiley face punched a big hole in democratic theory,” with the subtitle, “Fleeting exposure to ‘irrelevant stimuli’ powerfully shapes our assessments of policy arguments,” discussing the […]

Estimating discontinuity in slope of a response function

Peter Ganong sends me a new paper (coauthored with Simon Jager) on the “regression kink design.” Ganong writes: The method is a close cousin of regression discontinuity and has gotten a lot of traction recently among economists, with over 20 papers in the past few years, though less among statisticians. We propose a simple placebo […]

Estimated effect of early childhood intervention downgraded from 42% to 25%

Last year I came across an article, “Labor Market Returns to Early Childhood Stimulation: a 20-year Followup to an Experimental Intervention in Jamaica,” by Paul Gertler, James Heckman, Rodrigo Pinto, Arianna Zanolini, Christel Vermeerch, Susan Walker, Susan M. Chang, and Sally Grantham-McGregor, that claimed that early childhood stimulation raised adult earnings by 42%. At the […]

The health policy innovation center: how best to move from pilot studies to large-scale practice?

A colleague pointed me to this news article regarding evaluation of new health plans: The Affordable Care Act would fund a new research outfit evocatively named the Innovation Center to discover how to most effectively deliver health care, with $10 billion to spend over a decade. But now that the center has gotten started, many […]

A linguist has a question about sampling when the goal is causal inference from observational data

Nate Delaney-Busch writes: I’m a PhD student of cognitive neuroscience at Tufts, and a question came recently with my colleagues about the difficulty of random sampling in cases of highly controlled stimulus sets, and I thought I would drop a line to see if you had any reading suggestions for us. Let’s say I wanted […]