MENU

Fun & Interesting

The Reproducibility Crisis in Science: How do Expectations Influence Experimental Results?

Rupert Sheldrake 11,436 1 year ago
Video Not Working? Fix It Now

Episode 4 of the online course How To Transform the Sciences: Six Potential Breakthroughs https://www.sheldrake.org/online-courses Around 2015, scientists were shocked to find that most papers in high-prestige peer-reviewed scientific journals are not reproducible. In one study of papers in prestigious biomedical journals, 90% could not be replicated, and in experimental psychology more than 60%. This crisis partly arises from systematic biases that Rupert discusses in his chapter on ‘Illusions of Objectivity’ in The Science Delusion (2012, new edition 2020; in the US this book is called Science Set Free), including the selective observation and reporting of results, and perverse incentives for scientists and journals to publish striking positive findings. The crisis continues to roll on, as shown, for example, by an editorial in Nature, December 2021, about un-reproducible results in cancer biology. All this is relatively straightforward, but Rupert suggests that some experiments may also involve direct mind-over-matter effects. It has long been known that experimenters can influence their experimental results through their expectations, in so-called ‘experimenter expectancy effects’, which is why many clinical trials, psychological and parapsychological experiments are carried out under blind or double-blind conditions. In most other fields of science, experimenter effects are ignored and blind methodologies are rarely employed. Rupert suggests that in addition to the usual sources of bias, experimenters may also influence experiments psychokinetically, through direct mind-over-matter effects. Scientists may be particularly prone to this source of error because most scientists believe psychokinesis is impossible, and hence take no precautions against it. They practise unprotected science. Rupert proposes experiments on experiments to test for the effects of experimenters’ hopes and expectations. References ____ A Dream, or the Astronomy of the Moon Johann Kepler, published posthumously in 1634 by his son https://sheldrake.org/somnium ____ Rupert's essay The Replicability Crisis in Science https://sheldrake.org/replicability ____ Bad Pharma Ben GoldacreFourth Estate, 2012 https://sheldrake.org/badpharma ____ Artifacts in Behavioral Research Robert Rosenthal and Ralph L. Rosnow, Oxford University Press, 2009 https://sheldrake.org/rosenthal ____ Over half of psychology studies fail reproducibility test https://www.nature.com/articles/nature.2015.18248 ____ Differential indoctrination of examiners and Rorschach responses https://psycnet.apa.org/record/1965-12396-001 ____ A longitudinal study of the effects of experimenter bias on the operant learning of laboratory rats https://psycnet.apa.org/record/1965-01547-001 ____ Could Experimenter Effects Occur in the Physical and Biological Sciences? Skeptical Inquirer 22(3), 57-58 May / June 1998 https://sheldrake.org/skepticalinquirer98 ____ Quantum‐Mechanical Random‐Number Generator https://aip.scitation.org/doi/abs/10.1063/1.1658698 ------ Dr Rupert Sheldrake, PhD, is a biologist and author best known for his hypothesis of morphic resonance. At Cambridge University, as a Fellow of Clare College, he was Director of Studies in biochemistry and cell biology. As the Rosenheim Research Fellow of the Royal Society, he carried out research on the development of plants and the ageing of cells, and together with Philip Rubery discovered the mechanism of polar auxin transport. In India, he was Principal Plant Physiologist at the International Crops Research Institute for the Semi-Arid Tropics, where he helped develop new cropping systems now widely used by farmers. He is the author of more than 100 papers in peer-reviewed journals and his research contributions have been widely recognized by the academic community, earning him a notable h-index for numerous citations. On ResearchGate his Research Interest Score puts him among the top 4% of scientists. #ScienceCrisis #Reproducibility #ScientificMethod #ExperimenterEffect #PublicationBias #PsychokineticResearch

Comment