Skip to content
Psych Dictionary

Replication crisis

  • Concept · Research methods and meta-science
  • Mixed or contested
  • Published October 20, 2026
  • 19 sources
  • 4 min read

In short

The replication crisis is the recognition, through large replication projects in the 2010s, that many published findings in psychology could not be reproduced or shrank sharply on repetition. Its causes, its size and the reforms it prompted, such as preregistration and registered reports, remain debated.

Key facts

Field
Research methods and meta-science
Also known as
Replicability crisis; Reproducibility crisis; Replication crisis in psychology

State of the evidence

Mixed or contested

In a coordinated attempt to replicate 100 psychology studies, 36% of replications were statistically significant and effects were about half the original size[1]; later projects found 62% and 54% success rates with similarly reduced effects[2][3]. What these figures mean is disputed[4][5]. Registered reports report far fewer positive results than standard articles[6], and clinical psychology has been slower to join the discussion[7].

Evidence labels summarise the research literature; they are not recommendations. How labels are assigned

The replication crisis is the period of concern, in psychology and other sciences, that followed evidence that many published findings could not be reproduced when the studies were repeated, or produced much smaller effects. Replication, the repetition of a study with new data to see whether its result holds, is a defining feature of science; the crisis concerns how often published psychological findings pass that test[1]. The discussion began with high-profile failures to replicate in experimental psychology and was at first concentrated in social and cognitive psychology[7].

Large-scale replication projects

The best-known project was coordinated by the Open Science Collaboration and published in 2015. Its members replicated 100 experimental and correlational studies from three psychology journals, using high-powered designs and the original materials where available. Although 97% of the original studies had reported statistically significant results, 36% of the replications did; replication effects were on average half the size of the originals; 47% of original effect sizes fell within the replication’s 95% confidence interval; and 39% of effects were judged subjectively to have replicated. Replication success was better predicted by the strength of the original evidence than by characteristics of the original or replication teams[1].

Later projects used different designs and reached similar conclusions. A replication of 21 social science experiments published in Nature and Science between 2010 and 2015, with analysis plans reviewed by the original authors and preregistered, and samples about five times larger than the originals, found a significant effect in the original direction for 13 studies (62%), with replication effects averaging about half the original size[2]. Many Labs 2 replicated 28 classic and contemporary findings across 125 samples with 15,305 participants in 36 countries and territories. Fifteen (54%) produced a significant effect in the original direction; the median effect size fell from 0.60 in the originals to 0.15; and variation in results was attributable more to the effect being studied than to the sample or setting[3].

Debate over the reproducibility estimates

The 2015 estimate was immediately contested. Gilbert, King, Pettigrew and Wilson argued that the project contained three statistical errors and that its data were consistent with the opposite conclusion, that the reproducibility of psychological science is quite high[4]. Members of the collaboration replied that this optimistic assessment rested on statistical misconceptions and on causal inferences from selectively interpreted correlational data, and that the data allowed both optimistic and pessimistic conclusions, neither of which was yet warranted[5].

Part of the disagreement concerns what counts as a successful replication: the 2015 project itself reported several criteria that gave different rates, from 36% to 47% to 68% when original and replication results were combined on the assumption that the originals were unbiased[1]. Many Labs 2 later found that variation in results was attributable more to the effect being studied than to the sample or setting[3], which bears on the question of whether failed replications reflect differences between the populations or contexts of original and replication studies.

Proposed causes

Several mechanisms have been proposed, and they are not mutually exclusive. Ioannidis argued that a research claim is less likely to be true when studies in a field are small, when effects are small, when many relationships are tested with little preselection, and when there is greater flexibility in designs, definitions and analyses[8]. Simmons, Nelson and Simonsohn showed with simulations and two experiments that flexibility in data collection, analysis and reporting dramatically increases the actual rate of false-positive findings above the nominal 5%, so that it is easy to accumulate statistically significant evidence for a false hypothesis[9]. Selective publication of positive results compounds these problems, as described under publication bias.

Reforms

The main reforms aim to fix decisions before results are known. Preregistration means specifying research questions and analysis plans before observing outcomes, so that tests of predictions can be distinguished from analyses generated after the fact[10]. Registered reports extend this to publication: study proposals are peer reviewed and accepted before the research is carried out, so that the decision to publish rests on the question and methods rather than the results[11]. In a comparison with the standard literature, 96% of standard psychology articles reported a positive result for their first hypothesis, against 44% of registered reports[6]. Chambers and Tzavella, reviewing early evidence that registered reports work as intended, also acknowledge that they are not a universal solution to irreproducibility[11].

Clinical psychology and replication

Clinical psychology was at first insulated from the discussion. Tackett and colleagues examined why clinical, counseling and school psychology had not been central participants, and which concerns and recommendations from experimental psychology apply more or less well to clinical research[7]. The issues overlap with problems documented in psychotherapy research, including publication bias[12], selective outcome reporting in trials[13] and the dependence of results on the choice of control condition discussed under placebo effect[14] .

Several failed or contested replications relevant to clinical psychology are covered elsewhere on this site. Replications of behavioral priming studies, an influential line of evidence that behavior is driven by unconscious determinants, failed to reproduce the original effects, as described under unconscious mind[16] . The think/no-think task, proposed as a laboratory model of repression, produced failed replications including a pre-registered online study that found effects close to zero[17][18]. A typology of men who batter based on heart rate reactivity did not replicate in a sample of 58 maritally violent men, as described under John Gottman . Experiments on visceral learning in paralyzed rats, part of the history described under biofeedback, could not be replicated after more than 2,500 animals were studied[19].

Sources19

Numbered in order of first citation.

  1. 1.Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716
  2. 2.Camerer, C. F., Dreber, A., Holzmeister, F., Ho, T. H., Huber, J., Johannesson, M., Kirchler, M., Nave, G., Nosek, B. A., Pfeiffer, T., Altmejd, A., Buttrick, N., Chan, T., Chen, Y., Forsell, E., Gampa, A., Heikensten, E., Hummer, L., Imai, T., … Wu, H. (2018). Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015. Nature Human Behaviour, 2(9), 637–644. https://doi.org/10.1038/s41562-018-0399-z
  3. 3.Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams, R. B., Alper, S., Aveyard, M., Axt, J. R., Babalola, M. T., Bahník, Š., Batra, R., Berkics, M., Bernstein, M. J., Berry, D. R., Bialobrzeska, O., Binan, E. D., Bocian, K., Brandt, M. J., Busching, R., … Nosek, B. A. (2018). Many Labs 2: Investigating variation in replicability across samples and settings. Advances in Methods and Practices in Psychological Science, 1(4), 443–490. https://doi.org/10.1177/2515245918810225
  4. 4.Gilbert, D. T., King, G., Pettigrew, S., & Wilson, T. D. (2016). Comment on “Estimating the reproducibility of psychological science”. Science, 351(6277), 1037. https://doi.org/10.1126/science.aad7243
  5. 5.Anderson, C. J., Bahník, Š., Barnett-Cowan, M., Bosco, F. A., Chandler, J., Chartier, C. R., Cheung, F., Christopherson, C. D., Cordes, A., Cremata, E. J., Della Penna, N., Estel, V., Fedor, A., Fitneva, S. A., Frank, M. C., Grange, J. A., Hartshorne, J. K., Hasselman, F., Henninger, F., … Zuni, K. (2016). Response to Comment on “Estimating the reproducibility of psychological science”. Science, 351(6277), 1037. https://doi.org/10.1126/science.aad9163
  6. 6.Scheel, A. M., Schijen, M. R. M. J., & Lakens, D. (2021). An excess of positive results: Comparing the standard psychology literature with registered reports. Advances in Methods and Practices in Psychological Science, 4(2). https://doi.org/10.1177/25152459211007467
  7. 7.Tackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2017). It’s time to broaden the replicability conversation: Thoughts for and from clinical psychological science. Perspectives on Psychological Science, 12(5), 742–756. https://doi.org/10.1177/1745691617690042
  8. 8.Ioannidis, J. P. (2005). Why most published research findings are false. PLoS Medicine, 2(8), e124. https://doi.org/10.1371/journal.pmed.0020124
  9. 9.Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11), 1359–1366. https://doi.org/10.1177/0956797611417632
  10. 10.Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018). The preregistration revolution. Proceedings of the National Academy of Sciences, 115(11), 2600–2606. https://doi.org/10.1073/pnas.1708274114
  11. 11.Chambers, C. D., & Tzavella, L. (2022). The past, present and future of Registered Reports. Nature Human Behaviour, 6(1), 29–42. https://doi.org/10.1038/s41562-021-01193-7
  12. 12.Cuijpers, P., Smit, F., Bohlmeijer, E., Hollon, S. D., & Andersson, G. (2010). Efficacy of cognitive–behavioural therapy and other psychological treatments for adult depression: meta-analytic study of publication bias. British Journal of Psychiatry, 196(3), 173–178. https://doi.org/10.1192/bjp.bp.109.066001
  13. 13.Bradley, H. A., Rucklidge, J. J., & Mulder, R. T. (2017). A systematic review of trial registration and selective outcome reporting in psychotherapy randomized controlled trials. Acta Psychiatrica Scandinavica, 135(1), 65–77. https://doi.org/10.1111/acps.12647
  14. 14.Mohr, D. C., Spring, B., Freedland, K. E., Beckner, V., Arean, P., Hollon, S. D., Ockene, J., & Kaplan, R. (2009). The selection and design of control conditions for randomized controlled trials of psychological interventions. Psychotherapy and Psychosomatics, 78(5), 275–284. https://doi.org/10.1159/000228248
  15. 15.Meehan, J. C., Holtzworth-Munroe, A., & Herron, K. (2001). Maritally violent men's heart rate reactivity to marital interactions: A failure to replicate the Gottman et al. (1995) typology. Journal of Family Psychology, 15(3), 394–408. https://doi.org/10.1037/0893-3200.15.3.394
  16. 16.Shanks, D. R., Newell, B. R., Lee, E. H., Balakrishnan, D., Ekelund, L., Cenac, Z., Kavvadia, F., & Moore, C. (2013). Priming intelligent behavior: An elusive phenomenon. PLoS ONE, 8(4), e56515. https://doi.org/10.1371/journal.pone.0056515
  17. 17.Bulevich, J. B., Roediger HL 3rd, Balota, D. A., & Butler, A. C. (2006). Failures to find suppression of episodic memories in the think/no-think paradigm. Memory & Cognition, 34(8), 1569–1577. https://doi.org/10.3758/BF03195920
  18. 18.Wiechert, S., Loewy, L., Wessel, I., Fawcett, J. M., Ben-Shakhar, G., Pertzov, Y., & Verschuere, B. (2023). Suppression-induced forgetting: a pre-registered replication of the think/no-think paradigm. Memory, 31(7), 989–1002. https://doi.org/10.1080/09658211.2023.2208791
  19. 19.Dworkin, B. R., & Miller, N. E. (1986). Failure to replicate visceral learning in the acute curarized rat preparation. Behavioral Neuroscience, 100(3), 299–314. https://doi.org/10.1037/0735-7044.100.3.299

Further reading

  • Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716
  • Tackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2017). It’s time to broaden the replicability conversation: Thoughts for and from clinical psychological science. Perspectives on Psychological Science, 12(5), 742–756. https://doi.org/10.1177/1745691617690042

Cite this entry

  • APA 7

    Psych Dictionary. (2026, October 20). Replication crisis. In Psych Dictionary. https://www.psychdictionary.com/concepts/replication-crisis

  • MLA 9

    “Replication Crisis.” Psych Dictionary, 20 Oct. 2026, www.psychdictionary.com/concepts/replication-crisis.

Written by Editorial team. First published October 20, 2026. Editorial standards

Educational reference material. Nothing on this site is a diagnosis, a treatment recommendation or a substitute for care from a qualified clinician.