Psychology’s Replication Crisis

April 13, 2024 Health & Healing No Comments

Since 2010, an effort (Many Labs 2) to replicate 28 of the most renowned and highly cited studies in behavioral psychology (with peer-reviewed protocols) has led to +/- half of them showing drastically different results in comparison to the originals.

This should not be denied. It potentially calls into question substantial parts of scientific knowledge, yet it is no reason to discard science. On the contrary, it should lead us to take science even more seriously, primarily when it influences general policy-making in mind-related matters.

What causes this conundrum.

Several hypotheses have been forwarded:

  • sloppy research practices, with small and statistically weak studies
  • fuzziness in data handling, turning them around until something interesting comes out (posthoc ‘cherry picking’ of hypotheses)
  • publication bias: only publishing the ones with positive results
  • unfortunately, also: financial and other interests and prejudices.

I would personally add to this what may be most crucial after all:

  • a huge cultural bias against the influence of the deeper layers of the mind in anything human-related.

The above same arguments have then been ushered toward initial replicating scientists, which is why the massive Many Labs 2 project took place, with 60 times more study subjects than in the studies in question, repeating experiments many times over in many countries (different cultures), checking every possible detail. The results are clear, as shown above.

An interesting cultural sidekick

Those studies that showed positive replication did so in different cultures. Those that diverged also did so in various cultures.

This shows – if we didn’t know yet – that people all over the world are pretty similar. Well, doesn’t it make one happy to see this transcendent result, at least, being replicated? Of course, people behave culturally differently, but to the core, we are the same.

Not only psychology

Failed replication also happens in other natural and social sciences, including in medicine. The probably most interesting article in the latter domain is written by John Ioannidis (*), an extraordinarily courageous and brilliant researcher whom I had the privilege of personally encountering in 2016. I remember we also talked about my investigations into the lack of blinding (as well as blindness proof) of many medical studies, and the implications of this on the concept itself of ‘double-blind studies’ (see <science> in the above green menu).

Unfortunately, Ioannidis has also shown that the quality of the evidence in even very renowned scientific papers/journals does not seem to improve over time.

Again, this is no argument to discard science ― on the contrary!

However, rethinking my own added critique, we should at least acknowledge that the known gaps in our knowledge about what causes illness and healing are not only huge but will also probably grow in anything related to the complexity of the human mind.

Isn’t it high time for the Lisa Revolution, emphasizing the integration of deep respect for the human mind in both personal growth and scientific inquiry?

__

(*)  Ioannidis JP. Why most published research findings are false. PLoS Med. 2005 Aug;2(8):e124. doi: 10.1371/journal.pmed.0020124. Epub 2005 Aug 30.

Leave a Reply

Related Posts

‘Mind = Body’ Breakthrough

It’s time we learn to know who we are. ‘Seeing the thinking’ of some simple animals Here are some interesting videos from recent lectures by T. Sejnowski ― one of the most important researchers in the field, and whom I am following for thirty years as an inspiration to AURELIS. The videos are entirely fascinating. Read the full article…

Schizophrenia (and Other Psychotic States)

Schizophrenia is not an AURELIS-indication. However, I personally think it would be a good one, helpful to schizophrenics. The absence of this indication has legal reasons: Suppose someone with an upcoming psychosis uses the indication and gets a psychotic episode… Is AURELIS to blame? At the same time I think this is (as I write Read the full article…

Compassion over Addiction

Addiction and Compassion (with capital C) are subconceptual happenings. Thus, they belong to the same domain and which is different from the merely conceptual one. This opens specific perspectives. Please make sure to read first: [see: “Essence of Compassion”] [see: “Addiction: in Search of Deeper Meaning”] [see: “About ‘Subconceptual’”] Also, please follow the other links Read the full article…

Translate »