Search Results for: reproducibility

Frictionless reproducibility; methods as proto-algorithms; division of labor as a characteristic of statistical methods; statistics as the science of defaults; statisticians well prepared to think about issues raised by AI; and robustness to adversarial attacks

Posted on by
13

Tian points us to this article by David Donoho, which argues that some of the rapid progress in data science and AI research in recent years has come from “frictionless reproducibility,” which he identifies with “data sharing, code sharing, and … Continue reading →

“The butterfly and the piranha: Understanding the generalizability and reproducibility crisis from statistical and political perspectives” (my talk at the University of Minnesota political science department on Monday)

Posted on by
4

The talk is Mon 13 Mar, 11:30am Minnesota time, and it will be remote: The butterfly and the piranha: Understanding the generalizability and reproducibility crisis from statistical and political perspectives Researchers often act as if causal identification + statistical significance … Continue reading →

The Brazilian Reproducibility Initiative wants your comments on their analysis plan!

Posted on by
Reply

Kleber Neves and Olavo Amaral write: We are the coordinators of the Brazilian Reproducibility Initiative, a multicenter systematic replication of experiments from Brazilian biomedical science (the project has been discussed in your blog before via Anna Dreber when we were … Continue reading →

Challenges to the Reproducibility of Machine Learning Models in Health Care; also a brief discussion about not overrating randomized clinical trials

Posted on by
32

Mark Tuttle pointed me to this article by Andrew Beam, Arjun Manrai, and Marzyeh Ghassemi, Challenges to the Reproducibility of Machine Learning Models in Health Care, which appeared in the Journal of the American Medical Association. Beam et al. write: … Continue reading →

Bayes, statistics, and reproducibility: “Many serious problems with statistics in practice arise from Bayesian inference that is not Bayesian enough, or frequentist evaluation that is not frequentist enough, in both cases using replication distributions that do not make scientific sense or do not reflect the actual procedures being performed on the data.”

Posted on by
26

This is an abstract I wrote for a talk I didn’t end up giving. (The conference conflicted with something else I had to do that week.) But I thought it might interest some of you, so here it is: Bayes, … Continue reading →

“No System is Perfect: Understanding How Registration-Based Editorial Processes Affect Reproducibility and Investment in Research Quality”

Posted on by
2

Robert Bloomfield, Kristina Rennekamp, Blake Steenhoven sent along this paper that compares “a registration-based Editorial Process (REP). Authors submitted proposals to gather and analyze data; successful proposals were guaranteed publication as long as the authors lived up to their commitments, … Continue reading →

Bayes, statistics, and reproducibility: My talk at Rutgers 5pm on Mon 29 Jan 2018

Posted on by
11

In the weekly seminar on the Foundations of Probability in the Philosophy Departmentat Rutgers University, New Brunswick Campus, Miller Hall, 2nd floor seminar room: Bayes, statistics, and reproducibility The two central ideas in the foundations of statistics—Bayesian inference and frequentist … Continue reading →

This Friday at noon, join this online colloquium on replication and reproducibility, featuring experts in economics, statistics, and psychology!

Posted on by
33

Justin Esarey writes: This Friday, October 27th at noon Eastern time, the International Methods Colloquium will host a roundtable discussion on the reproducibility crisis in social sciences and a recent proposal to impose a stricter threshold for statistical significance. The … Continue reading →

PhD student fellowship opportunity! in Belgium! to work with us! on the multiverse and other projects on improving the reproducibility of psychological research!!!

Posted on by
4

[image of Jip and Janneke dancing with a cat] Wolf Vanpaemel and Francis Tuerlinckx write: We at the Quantitative Psychology and Individual Differences, KU Leuven, Belgium are looking for a PhD candidate. The goal of the PhD research is to … Continue reading →