Intellectual humility: the importance of knowing you might be wrong

Knowledge Questions: What are the limitations in our abilities to reason? How do we produce knowledge in the sciences? What impact does knowledge have on the knower?

This article brings together so many interesting issues in TOK and the problems associated with knowledge and its production. There are connections in this article to memory, the scientific method, the replication crisis, reason, and the Dunning-Kruger Effect.

We need more intellectual humility for two reasons. One is that our culture promotes and rewards overconfidence and arrogance (think Trump and Theranos, or the advice your career counselor gave you when going into job interviews). At the same time, when we are wrong — out of ignorance or error — and realize it, our culture doesn’t make it easy to admit it. Humbling moments too easily can turn into moments of humiliation.

https://www.vox.com/science-and-health/2019/1/4/17989224/intellectual-humility-explained-psychology-replication

JOHN ARNOLD MADE A FORTUNE AT ENRON. NOW HE’S DECLARED WAR ON BAD SCIENCE

Nosek was so taken with the importance of redoing old experiments that he had also rallied more than 50 like-minded researchers across the country to participate in something he called the Reproducibility Project. The aim was to redo about 50 studies from three prominent psychology journals, to establish an estimate of how often modern psychology turns up false positive results.

It was little wonder, then, that funders didn’t come running to support Nosek: He wasn’t promising novel findings, he was promising to question them. So he ran his projects on a shoestring budget, self-­financing them with his own earnings from corporate speaking engagements on his research about bias.

https://www.wired.com/2017/01/john-arnold-waging-war-on-bad-science/?mbid=social_fb

Thomas Bayes and the crisis in science

Science is currently said to be suffering a “replicability crisis”. Over the last few years a worrying number of widely accepted findings in psychology, medicine and other disciplines have failed to be confirmed by repetitions of the original experiments. Well-known psychological results that have proved hard to reproduce include the claim that new-born babies imitate their mothers’ facial expressions and that will power is a limited resource that becomes depleted through use. In medicine, the drug companies Bayer and Amgen, frustrated by the slow progress of drug development, discovered that more than three-quarters of the basic science studies they were relying on didn’t stand up when repeated. When the journal Naturepolled 1,500 scientists in 2016, 70 per cent said they had failed to reproduce another scientist’s results.

This crisis of reproducibility has occasioned much wringing of hands. The finger has been pointed at badly designed experiments, not to mention occasional mutterings about rigged data. But the only real surprise is that the problem has taken so long to emerge. The statistical establishment has been reluctant to concede the point, but failures of replication are nothing but the pigeons of significance testing coming home to roost.

https://www.the-tls.co.uk/articles/public/thomas-bayes-science-crisis/

The Stanford Prison Experiment was massively influential. We just learned it was a fraud.

The most famous psychological studies are often wrong, fraudulent, or outdated. Textbooks need to catch up.

The findings have long been subject to scrutiny — many think of them as more of a dramatic demonstration, a sort-of academic reality show, than a serious bit of science. But these new revelations incited an immediate response. “We must stop celebrating this work,” personality psychologist Simine Vazire tweeted, in response to the article. “It’s anti-scientific. Get it out of textbooks.” Many other psychologists have expressed similar sentiments.

https://www.vox.com/2018/6/13/17449118/stanford-prison-experiment-fraud-psychology-replication

The Lifespan of a Lie

The most famous psychology study of all time was a sham. Why can’t we escape the Stanford Prison Experiment?

Medium Article that goes into greater detail.

View this collection on Medium.com

View this collection on Medium.com

View this collection on Medium.com

Replication in the Human Sciences. Radiolab Podcast: Sterothreat

“Back in 1995, Claude Steele published a study that showed that negative stereotypes could have a detrimental effect on students’ academic performance. But the big surprise was that he could make that effect disappear with just a few simple changes in language. We were completely enamored with this research when we first heard about it, but in the current roil of replications and self-examination in the field of social psychology, we have to wonder whether we can still cling to the hopes of our earlier selves, or if we might have to grow up just a little bit.”

http://www.radiolab.org/story/stereothreat/

 

The Inquiry Podcast: Is the Knowledge Factory Broken?

This podcast examines the nature of scientific knowledge and how it is produced. What is “good science” and how is it undermined by incentives and the process itself?

“Academic research stands accused of turning a blind eye to dodgy data, failing to reconcile contradictory findings and valuing money over knowledge. We examine the criticisms, which go the very heart of our pursuit of knowledge.”

http://www.bbc.co.uk/programmes/w3csvsy8

“Everything Is Crumbling” The Replication Crisis in the Social Sciences

“An influential psychological theory, borne out in hundreds of experiments, may have just been debunked. How can so many scientists have been so wrong?”

“And yet, it now appears that ego depletion could be completely bogus, that its foundation might be made of rotted-out materials. That means an entire field of study—and significant portions of certain scientists’ careers—could be resting on a false premise. If something this well-established could fall apart, then what’s next? That’s not just worrying. It’s terrifying.”

http://www.slate.com/articles/health_and_science/cover_story/2016/03/ego_depletion_an_influential_theory_in_psychology_may_have_just_been_debunked.html

Podcast: “The Replication Crisis” on You are Not So Smart

“Nosek recently lead a project in which 270 scientists sought to replicate 100 different studies in psychology, all published in 2008 — 97 of which claimed to have found significant results — and in the end, two-thirds failed to replicate. Clearly, some sort of course correction is in order.”

https://youarenotsosmart.com/2017/07/19/yanss-100-the-replication-crisis/

Hidden Brain Podcast: The Scientific Process

This is a great podcast that gets into some of the issues and challenges with constructing knowledge in the human sciences. Though we differentiate between the human and natural sciences, both use similar processes to construct experiments and rely on similar reasoning processes to construct knowledge. One key idea in both types of science is the idea that experiments can be reproduced and results can be replicated in order to validate a study’s findings. What happens when you can’t reproduce a prior finding? Were the original results fraudulent? Poorly constructed experiments? Was the new experiment faulty? The answer to these questions is complicated but this podcast delves into some of those issues.

“Lots of psychology studies fail to produce the same results when they are repeated. How do scientists know what’s true?”

Listen· 28:17Queue
Toggle more options

http://www.npr.org/player/embed/479201596/479202167