Skip to content
Archive of posts filed under the Miscellaneous Science category.

How to design future studies of systemic exercise intolerance disease (chronic fatigue syndrome)?

Someone named Ramsey writes on behalf of a self-managed support community of 100+ systemic exercise intolerance disease (SEID) patients. He read my recent article on the topic and had a question regarding the following excerpt: For conditions like S.E.I.D., then, the better approach may be to gather data from people suffering “in the wild,” combining […]

They want help designing a crowdsourcing data analysis project

Michael Feldman writes: My collaborators and myself are doing research where we try to understand the reasons for the variability in data analysis (“the garden of forking paths”). Our goal is to understand the reasons why scientists make different decisions regarding their analyses and in doing so reach different results. In a project called “Crowdsourcing […]

“The Null Hypothesis Screening Fallacy”?

[non-cat picture] Rick Gerkin writes: A few months ago you posted your list of blog posts in draft stage and I noticed that “Humans Can Discriminate More than 1 Trillion Olfactory Stimuli. Not.” was still on that list. It was about some concerns I had about a paper in Science (http://science.sciencemag.org/content/343/6177/1370). After talking it through […]

Capitalist science: The solution to the replication crisis?

Bruce Knuteson pointed me to this article, which begins: The solution to science’s replication crisis is a new ecosystem in which scientists sell what they learn from their research. In each pairwise transaction, the information seller makes (loses) money if he turns out to be correct (incorrect). Responsibility for the determination of correctness is delegated, […]

PhD student fellowship opportunity! in Belgium! to work with us! on the multiverse and other projects on improving the reproducibility of psychological research!!!

[image of Jip and Janneke dancing with a cat] Wolf Vanpaemel and Francis Tuerlinckx write: We at the Quantitative Psychology and Individual Differences, KU Leuven, Belgium are looking for a PhD candidate. The goal of the PhD research is to develop and apply novel methodologies to increase the reproducibility of psychological science. More information can […]

Why I’m not participating in the Transparent Psi Project

I received the following email from psychology researcher Zoltan Kekecs: I would like to ask you to participate in the establishment of the expert consensus design of a large scale fully transparent replication of Bem’s (2011) ‘Feeling the future’ Experiment 1. Our initiative is called the ‘Transparent Psi Project’. [https://osf.io/jk2zf/wiki/home/] Our aim is to develop […]

The (Lance) Armstrong Principle

If you push people to promise more than they can deliver, they’re motivated to cheat.

“Bombshell” statistical evidence for research misconduct, and what to do about it?

Someone pointed me to this post by Nick Brown discussing a recent article by John Carlisle regarding scientific misconduct. Here’s Brown: [Carlisle] claims that he has found statistical evidence that a surprisingly high proportion of randomised controlled trials (RCTs) contain data patterns that cannot have arisen by chance. . . . the implication is that […]

How has my advice to psychology researchers changed since 2013?

Four years ago, in a post entitled, “How can statisticians help psychologists do their research better?”, I gave the following recommendations to researchers: – Analyze all your data. – Present all your comparisons. – Make your data public. And, for journal editors, I wrote, “if a paper is nothing special, you don’t have to publish […]

Using external C++ functions with PyStan & radial velocity exoplanets

Dan Foreman-Mackey writes: I [Mackey] demonstrate how to use a custom C++ function in a Stan model using the Python interface PyStan. This was previously only possible using the R interface RStan (see an example here) so I hacked PyStan to make this possible in Python as well. . . . I have some existing […]

Theoretical Statistics is the Theory of Applied Statistics: How to Think About What We Do

Above is my talk at the 2017 New York R conference. Look, no slides! The talk went well. I think the video would be more appealing to listen to if they’d mixed in more of the crowd noise. Then you’d hear people laughing at all the right spots. P.S. Here’s my 2016 NYR talk, and […]

How is a politician different from a 4-year-old?

A few days ago I shared my reactions to an op-ed by developmental psychologist Alison Gopnik. Gopnik replied: As a regular reader of your blog, I thought you and your readers might be interested in a response to your very fair comments. In the original draft I had an extra few paragraphs (below) that speak […]

How to think scientifically about scientists’ proposals for fixing science

I wrote this article for a sociology journal: Science is in crisis. Any doubt about this status has surely been been dispelled by the loud assurances to the contrary by various authority figures who are deeply invested in the current system and have written things such as, “Psychology is not in crisis, contrary to popular […]

An obvious fact about constrained systems.

  This post is not by Andrew. This post is by Phil. This post is prompted by Andrew’s recent post about the book “Everything is obvious once you know the answer,” together with a recent discussion I’ve been involved in. I’m going to say something obvious. True story: earlier this year I was walking around […]

XXX

You gotta read this, including all the comments. It’s fascinating. (Link from Jkrideau.)

Honesty and transparency are not enough

[cat picture] From a recent article, Honesty and transparency are not enough: This point . . . is important for two reasons. First, consider the practical consequences for a researcher who eagerly accepts the message of ethical and practical values of sharing and openness, but does not learn about the importance of data quality. He […]

The statistical crisis in science: How is it relevant to clinical neuropsychology?

[cat picture] Hilde Geurts and I write: There is currently increased attention to the statistical (and replication) crisis in science. Biomedicine and social psychology have been at the heart of this crisis, but similar problems are evident in a wide range of fields. We discuss three examples of replication challenges from the field of social […]

Representists versus Propertyists: RabbitDucks – being good for what?

It is not that unusual in statistics to get the same statistical output (uncertainty interval, estimate, tail probability,etc.) for every sample, or some samples or the same distribution of outputs or the same expectations of outputs or just close enough expectations of outputs. Then, I would argue one has a variation on a DuckRabbit. In […]

Mmore from Ppnas

Kevin Lewis asks for my take on two new papers: Study 1: Honesty plays a key role in social and economic interactions and is crucial for societal functioning. However, breaches of honesty are pervasive and cause significant societal and economic problems that can affect entire nations. Despite its importance, remarkably little is known about the […]

Crack Shot

Raghu Parthasarathy writes: You might find this interesting, an article (and related essay) on the steadily declining percentage of NIH awards going to mid-career scientists and the steadily increasing percentage going to older researchers. The key figure is below. The part that may be of particular interest to you, since you’ve written about age-adjustment in demographic work: does […]