This is why you shouldn’t believe that exciting new medical study

“It’s a fact that all studies are biased and flawed in their own unique ways. The truth usually lies somewhere in a flurry of research on the same question. This means real insights don’t come by way of miraculous, one-off findings or divinely ordained eureka moments; they happen after a long, plodding process of vetting and repeating tests, and peer-to-peer discussion. The aim is to make sure findings are accurate and not the result of a quirk in one experiment or the biased crusade of a lone researcher.”

http://www.vox.com/2015/3/23/8264355/research-study-hype

I turned this into a handout for students to work with:

This is why you shouldn’t believe that new medical study

Medical Study WS

TED Talk: Naomi Oreskes: Why Should We Believe In Science?

“Many of the world’s biggest problems require asking questions of scientists — but why should we believe what they say? Historian of science Naomi Oreskes thinks deeply about our relationship to belief and draws out three problems with common attitudes toward scientific inquiry — and gives her own reasoning for why we ought to trust science.”

Human Gene Editing Receives Science Panel’s Support

“In a report laden with caveats and notes of caution, the group endorsed the alteration of human eggs, sperm and embryos — but only to prevent babies from being born with genes known to cause serious diseases and disability, only when no “reasonable alternative” exists, and only when a plan is in place to track the effects of the procedure through multiple generations.

“Human genetic engineering for any reason has long been seen as an ethical minefield. Many scientists fear that the techniques used to prevent genetic diseases might also be used to enhance intelligence or create humans physically suited to particular tasks, like soldiers.”

Getting a scientific message across means taking human nature into account

“We humans have collectively accumulated a lot of science knowledge. We’ve developed vaccines that can eradicate some of the most devastating diseases. We’ve engineered bridges and cities and the internet. We’ve created massive metal vehicles that rise tens of thousands of feet and then safely set down on the other side of the globe. And this is just the tip of the iceberg (which, by the way, we’ve discovered is melting). While this shared knowledge is impressive, it’s not distributed evenly. Not even close. There are too many important issues that science has reached a consensus on that the public has not.”

https://theconversation.com/getting-a-scientific-message-across-means-taking-human-nature-into-account-70634

TED Talk: Paul Knoepfler: The ethical dilemma of designer babies

 

“Creating genetically modified people is no longer a science fiction fantasy; it’s a likely future scenario. Biologist Paul Knoepfler estimates that within fifteen years, scientists could use the gene editing technology CRISPR to make certain “upgrades” to human embryos — from altering physical appearances to eliminating the risk of auto-immune diseases. In this thought-provoking talk, Knoepfler readies us for the coming designer baby revolution and its very personal, and unforeseeable, consequences.”

Forensic evidence largely not supported by sound science – now what?

“A groundbreaking 2009 report from the National Academy of Sciences finally drew the curtain back to reveal that the wizardry of forensics was more art than science. The report assessed forensic science’s methods and developed recommendations to increase validity and reliability among many of its disciplines.”

http://theconversation.com/forensic-evidence-largely-not-supported-by-sound-science-now-what-67413

Freakonomics Podcast: Bad Medicine, Parts 1, 2, and 3: The Story of 98.6, Drug Trials, and Death Diagnosis

Part I:

“We tend to think of medicine as a science, but for most of human history it has been scientific-ish at best. In the first episode of a three-part series, we look at the grotesque mistakes produced by centuries of trial-and-error, and ask whether the new era of evidence-based medicine is the solution.”

http://freakonomics.com/podcast/bad-medicine-part-1-story-98-6/

Part II:

“How do so many ineffective and even dangerous drugs make it to market? One reason is that clinical trials are often run on “dream patients” who aren’t representative of a larger population. On the other hand, sometimes the only thing worse than being excluded from a drug trial is being included.”

http://freakonomics.com/podcast/bad-medicine-part-2-drug-trials-and-tribulations/

Part III:

“By some estimates, medical error is the third-leading cause of death in the U.S. How can that be? And what’s to be done? Our third and final episode in this series offers some encouraging answers.”

http://freakonomics.com/podcast/bad-medicine-part-3-death-diagnosis/

Climate Change in Trump’s Age of Ignorance

“Now we know that many other industries have learned from Big Tobacco’s playbook. Physicians hired by the National Football League have questioned the evidence that concussions can cause brain disease, and soda sellers have financed research to deny that sugar causes obesity. And climate deniers have conducted a kind of scavenger hunt for oddities that appear to challenge the overwhelming consensus of climate scientists.”

http://www.nytimes.com/2016/11/20/opinion/climate-change-in-trumps-age-of-ignorance.html

Testing Treatments: Better Research for Better Healthcare

Book about medical reaseach, common fallacies and problems, and what makes good science when it comes to medicine. Worth reading just for the introduction.

“Medicine shouldn’t be about authority, and the most important question anyone can ask on any claim is simple: ‘how do you know?’ This book is about the answer to that question. There has been a huge shift in the way that people who work in medicine relate to patients. In the distant past, ‘communications skills training’, such as it was, consisted of how not to tell your patient they were dying of cancer. Today we teach students – and this is a direct quote from the hand-outs – how to ‘work collaboratively with the patient towards an optimum health outcome’. Today, if they wish, at medicine’s best, patients are involved in discussing and choosing their own treatments. For this to happen, it’s vital that everyone understands how we know if a treatment works, how we know if it has harms, and how we weigh benefits against harms to determine the risk. Sadly doctors can fall short on this, as much as anybody else. Even more sadly, there is a vast army out there, queuing up to mislead us”

http://www.testingtreatments.org/wp-content/uploads/2012/09/TT_2ndEd_English_17oct2011.pdf

Our world is awash in bullshit health claims. These scientists want to train kids to spot them.

Screen Shot 2016-09-28 at 10.07.44 AM.png

“We are trying to teach children that stories are usually an unreliable basis for assessing the effect of treatments,” Nsangi explained, adding that stories amount to anecdotal evidence. The kids are also learning to watch out for the perverting effects of conflicts of interest, and to recognize that all treatments carry both harms and benefits and that large, dramatic effects from a treatment are really, really rare.

https://www.vox.com/2016/10/6/13079754/teaching-critical-thinking-schools-health-claims