Skip to content
Archive of posts filed under the Zombies category.

Financial anomalies are contingent on being unknown

Jonathan Falk points us to this article by Kewei Hou, Chen Xue, and Lu Zhang, who write: In retrospect, the anomalies literature is a prime target for p-hacking. First, for decades, the literature is purely empirical in nature, with little theoretical guidance. Second, with trillions of dollars invested in anomalies-based strategies in the U.S.market alone, […]

The (Lance) Armstrong Principle

If you push people to promise more than they can deliver, they’re motivated to cheat.

Another serious error in my published work!

Uh oh, I’m starting to feel like that pizzagate guy . . . Here’s the background. When I talk about my serious published errors, I talk about my false theorem, I talk about my empirical analysis that was invalidated by miscoded data, I talk my election maps whose flaws were pointed out by an angry […]

All the things we have to do that we don’t really need to do: The social cost of junk science

I’ve been thinking a lot about junk science lately. Some people have said it’s counterproductive or rude of me to keep talking about the same few examples (actually I think we have about 15 or so examples that come up again and again), so let me just speak generically about the sort of scientific claim […]

Some natural solutions to the p-value communication problem—and why they won’t work.

John Carlin and I write: It is well known that even experienced scientists routinely misinterpret p-values in all sorts of ways, including confusion of statistical and practical significance, treating non-rejection as acceptance of the null hypothesis, and interpreting the p-value as some sort of replication probability or as the posterior probability that the null hypothesis […]

What is needed to do good research (hint: it’s not just the avoidance of “too much weight given to small samples, a tendency to publish positive results and not negative results, and perhaps an unconscious bias from the researchers themselves”)

[cat picture] In a news article entitled, “No, Wearing Red Doesn’t Make You Hotter,” Dalmeet Singh Chawla recounts the story of yet another Psychological Science / PPNAS-style study (this one actually appeared back in 2008 in Journal of Personality and Social Psychology, the same prestigious journal which published Daryl Bem’s ESP study a couple years […]

Mockery is the best medicine

[cat picture] I’m usually not such a fan of twitter, but Jeff sent me this, from Andy Hall, and it’s just hilarious: The background is here. But Hall is missing a few key determinants of elections and political attitudes: subliminal smiley faces, college football, fat arms, and, of course, That Time of the Month. You […]

“P-hacking” and the intention-to-cheat effect

I’m a big fan of the work of Uri Simonsohn and his collaborators, but I don’t like the term “p-hacking” because it can be taken to imply an intention to cheat. The image of p-hacking is of a researcher trying test after test on the data until reaching the magic “p less than .05.” But, […]

A whole fleet of Wansinks: is “evidence-based design” a pseudoscience that’s supporting a trillion-dollar industry?

Following a recent post that mentioned

I hate R, volume 38942

link R doesn’t allow block comments. You have to comment out each line, or you can encapsulate the block in if(0){} which is the world’s biggest hack. Grrrrr. P.S. Just to clarify: I want block commenting not because I want to add long explanatory blocks of text to annotate my scripts. I want block commenting […]

The meta-hype algorithm

[cat picture] Kevin Lewis pointed me to this article: There are several methods for building hype. The wealth of currently available public relations techniques usually forces the promoter to judge, a priori, what will likely be the best method. Meta-hype is a methodology that facilitates this decision by combining all identified hype algorithms pertinent for […]

Reputational incentives and post-publication review: two (partial) solutions to the misinformation problem

So. There are erroneous analyses published in scientific journals and in the news. Here I’m not talking not about outright propaganda, but about mistakes that happen to coincide with the preconceptions of their authors. We’ve seen lots of examples. Here are just a few: – Political scientist Larry Bartels is committed to a model of […]

“Do you think the research is sound or is it gimmicky pop science?”

image David Nguyen writes: I wanted to get your opinion on http://www.scienceofpeople.com/. Do you think the research is sound or is it gimmicky pop science? My reply: I have no idea. But since I see no evidence on the website, I’ll assume it’s pseudoscience until I hear otherwise. I won’t believe it until it has […]

Organizations that defend junk science are pitiful suckers get conned and conned again

[cat picture] So. Cornell stands behind Wansink, and Ohio State stands behind Croce. George Mason University bestows honors on Weggy. Penn State trustee disses “so-called victims.” Local religious leaders aggressively defend child abusers in their communities. And we all remember how long it took for Duke University to close the door on Dr. Anil Potti. […]

Air rage rage

[cat picture] Commenter David alerts us that Consumer Reports fell for the notorious air rage story. Background on air rage here and here. Or, if you want to read something by someone other than me, here. This last piece is particularly devastating as it addresses flaws in the underlying research article, hype in the news […]

Pizzagate update! Response from the Cornell University Media Relations Office

[cat picture] Hey! A few days ago I received an email from the Cornell University Media Relations Office. As I reported in this space, I responded as follows: Dear Cornell University Media Relations Office: Thank you for pointing me to these two statements. Unfortunately I fear that you are minimizing the problem. You write, “while […]

Mmore from Ppnas

Kevin Lewis asks for my take on two new papers: Study 1: Honesty plays a key role in social and economic interactions and is crucial for societal functioning. However, breaches of honesty are pervasive and cause significant societal and economic problems that can affect entire nations. Despite its importance, remarkably little is known about the […]

Molyneux expresses skepticism on hot hand

image Guy Molyneux writes: I saw your latest post on the hot hand too late to contribute to the discussion there. While I don’t disagree with your critique of Gilovich and his reluctance to acknowledge past errors, I do think you underestimate the power of the evidence against a meaningful hot hand effect in sports. […]

Cross Purposes

A correspondent writes: I thought you might enjoy this… I’m refereeing a paper which basically looks at whether survey responses on a particular topic vary when the question is asked in two different ways. In the main results table they split the sample along several relevant dimensions (education; marital status; religion; etc). I give them […]

PPPPPPPPPPNAS!

Jochen Weber writes: As I follow your blog (albeit loosely), I figured I’d point out an “early release” paper from PNAS I consider to be “garbage” (at least by title, and probably by content). The short version is, the authors claim to have found the neural correlate of a person being “cognizant of” the outcome […]