Investigating the replicability of the social and behavioural sciences

Andrew H. Tyner, Anna Lou Abatayo, Mason Daley, Samuel Field, Nicholas Fox, Noah A. Haber, Krystal M. Hahn, Melissa Kline Struhl, Brinna Mawhinney, Olivia Miske, Priya Silverstein, Courtney K. Soderberg, Theresa Stankov, Ahmed Abbasi, Christopher L. Aberson, Balazs Aczel, Matúš Adamkovič, Nihan Albayrak, Peter J. Allen, Michael Andreychik, Eli Awtrey, Erick Axxe, Flavio Azevedo, Miles D. Bader, Bence Bago, James Bailey, Marjan Bakker, Gabriel Banik, George C. Banks, Ernest Baskin, Anatolia Batruch, Annika Beatteay, Sophie M. Behr, Nicholas Berente, Zachariah Berry, Jędrzej Białkowski, Bojana Bodroža, Laura Boeschoten, Miklos Bognar, Christian Bokhove, Diane Bonfiglio, Robin Bouwman, Timothy F. Brady, Scott R. Braithwaite, Gabriel Briceño Jiménez, Cameron Brick, Traci Bricka, Roman Briker, Annette Brown, Gordon D. A. Brown, Robbie C. M. van Aert, Kathryn Caldwell, Sara Capitan, Tabaré Capitán, Jesse Chandler, Tessa Charles, Christopher R. Chartier, Rahul Chawdhary, Kent Jason Cheng, William J. Chopik, Bruce Clark, Victoria E. Colvin, C. Cozette Comer, Giulio Costantini, Tom Coupé, Jamie Cummins, Aneta Czernatowicz-Kukuczka, Joshua de Leeuw, David Dobolyi, James N. Druckman, Jianhua Duan, Marin Dujmović, Daniel J. Dunleavy, Patrick K. Durkee, Cécile Emery, Kevin M. Esterling, Thomas R. Evans, Anna Fedor, Belén Fernández-Castilla, Nathan Fiala, James G. Field, Nathan Fong, Miguel A. Fonseca, Alexandra L. J. Freeman, Jeremy Freese, Sandra J. Geiger, Jing Geng, Laura M. Getz, Linda Marjoleine Geven, Ilka Helene Gleibs, Donna Pamella Gonzales, Janaki Gooty, Amélie Gourdon-Kanhukamwe, Cristina Greculescu, Siobhán M. Griffin, Lusine Grigoryan, Martina Grunow, Nicholas Gunby, Braeden Hall, Paul H. P. Hanel, Erin E. Hannon, Sam Harper, Marco Jürgen Held, Louis Hickman, Nathan C. Higgins, Svenja Hippel, Sven Hoeppner, Sanghyun Hong, Thomas J. Hostler, Michael Inzlicht, Kamil Izydorczak, Bastian Jaeger, Kristin Jankowsky, Johannes Jarke-Neuert, Matthew Jensen, Biljana Jokić, Daniel Jolles, Phillip Jolly, Angela M. Jones, Marie Juanchich, Pavol Kačmár, Hansika Kapoor, Andjela Keljanovic, Samjhana Koirala, Marta Kołczyńska, Dimitra Kouroupaki, Ulrich Kühnen, Michelangelo Landgrave, Michael J. Larson, Lyonel Laulié, Alice C. E. Lawrence, Joel M. Le Forestier, Katelin E. Leahy, Sungmok Lee, Jared Leslie, Savannah C. Lewis, Christopher Limnios, Hause Lin, An-Chiao Liu, John Wills Lloyd, Elliot A. Ludvig, Dermot Lynott, Jordan MacDonald, Peter Mallik, Daniel J. Mallinson, Daniele Marinazzo, Corinna S. Martarelli, Joshua Matacotta, Andrew McBride, Cillian McHugh, Gail McMillan, Esteban Méndez, Mitchell Metzger, Michalis P. Michaelides, Johannes Michalak, Leticia Micheli, Jeremy K. Miller, Marina Milyavskaya, Daniel C. Molden, Ambar G. Monjaras, David Moreau, Audrey Morrow, Cristóbal Moya, Liad Mudrik, Laetitia B. Mulder, Katie A. Munt, Arijit Nandi, Kathryn Nason, Carolin Nast, Gideon Nave, Heinrich H. Nax, Florian Neubauer, Phuong Linh L. Nguyen, Austin Lee Nichols, Gustav Nilsonne, Ernest O’Boyle, Jule Oettinghaus, Jeewon Oh, Adoril Oshana, Thomas Ostermann, Rachel P. Ostrowski, Abiola Oyebanjo, Radoslaw Panczak, Jamie Patrianakos, Ignacio Pavez, Yuri G. Pavlov, Sofia Persson, Marco Perugini, Kim Peters, Constant Pieters, Vladimir Ponizovskiy, Nathaniel D. Porter, Jason M. Prenoveau, Danka Purić, Mariah F. Purol, Arathy Puthillam, Kimberly A. Quinn, Marco Ramljak, W. Reed (), Michaela Ritchie, Margaret Ritzau, Sean Patrick Roche, Romina Rodela, Jan Philipp Röer, Ivan Ropovik, Jacob Rothschild, Justine Saal, Hani Safadi, Jason Samaha, Mary Sanchez, Soorya Sankaran, David Santos, Amanda C. Sargent, Marian Sauter, Kathleen Schmidt, Landon Schnabel, Amber N. Schroeder, Sebastian W. Schuetz, Brendan A. Schuetze, Michael Schulte-Mecklenbeck, Astrid Schütz, Eric L. Sevigny, Ellie Shackleton, Richard M. Shafranek, Samuel Shaki, Shishir Shakya, Miroslav Sirota, Matthew Ryan Sisco, Maksim M. Sitnikov, L. Robert Slevc, Laura Smalarz, Colin Tucker Smith, Joel S. Snyder, Nicolas Sommet, Fatih Sonmez, Barbara A. Spellman, Natalia Stanulewicz-Buckley, George Stock, Chris N. H. Street, Eirik Strømland, Tina Sundelin, Moin Syed, Anna Szabelska, Barnabas Szaszi, Ewa Szumowska, Anirudh Tagat (), Susanne Täuber, Louis Tay, Stuti Thapa, Jason Thatcher, Domna Tsaklakidou, Lars Tummers, Elise Turkovich, Melba Verra Tutor, Karolina Urbanska, Anna Elisabeth van ’t Veer, Marcel van Assen, Niels van de Ven, Ruben van den Goorbergh, Elisabeth Julie Vargo, Leigh Ann Vaughn, Simine Vazire, Jentien M. Vermeulen, Diem Thi Hong Vo, Victor Volkman, Eric-Jan Wagenmakers, Deliah Wagner, Lukasz Walasek, Frank Walter, Lara Warmelink, Liuqing Wei, Marie Isabelle Weißflog, Nicholas Weller, Aaron L. Wichman, Jonathan Wilbiks, Jamal R. Williams, Kelly Wolfe, Finnian Wort, Ryan Wright, Jesper N. Wulff, Xindong Xue, Veronica X. Yan, Yuzhi Yang, Sangsuk Yoon, Iris Žeželj, Yinxian Zhang, Ignazio Ziano, Cristina Zogmaister, Zorana Zupan, Rolf A. Zwaan, Brian A. Nosek () and Timothy M. Errington
Additional contact information
Andrew H. Tyner: Center for Open Science
Mason Daley: Center for Open Science
Samuel Field: SAS Institute
Nicholas Fox: Center for Open Science
Noah A. Haber: Center for Open Science
Krystal M. Hahn: Center for Open Science
Melissa Kline Struhl: Massachusetts Institute of Technology
Brinna Mawhinney: Center for Open Science
Olivia Miske: Center for Open Science
Priya Silverstein: University of Coimbra
Courtney K. Soderberg: Center for Open Science
Theresa Stankov: Center for Open Science
Ahmed Abbasi: University of Notre Dame
Christopher L. Aberson: The Dissertation Coach
Balazs Aczel: ELTE Eötvös Loránd University, Institute of Psychology
Matúš Adamkovič: Slovak Academy of Sciences
Nihan Albayrak: Boğaziçi University
Peter J. Allen: University of Bristol
Michael Andreychik: Fairfield University
Eli Awtrey: University of Cincinnati
Erick Axxe: Hendrix College
Flavio Azevedo: University of Cambridge
Miles D. Bader: Vassar College
Bence Bago: Tilburg University
Marjan Bakker: Tilburg University
Gabriel Banik: Pavol Jozef Šafárik University in Košice
George C. Banks: University of North Carolina at Charlotte
Ernest Baskin: Saint Joseph’s University
Anatolia Batruch: University of Lausanne
Annika Beatteay: University of New Brunswick
Sophie M. Behr: DIW Berlin
Nicholas Berente: University of Notre Dame
Zachariah Berry: University of Southern California
Jędrzej Białkowski: University of Canterbury
Bojana Bodroža: University of Novi Sad, Faculty of Philosophy
Laura Boeschoten: Utrecht University
Miklos Bognar: ELTE Eötvös Loránd University, Institute of Psychology
Christian Bokhove: University of Southampton
Diane Bonfiglio: Ashland University
Robin Bouwman: Erasmus University Rotterdam
Timothy F. Brady: University of California San Diego
Scott R. Braithwaite: Brigham Young University
Gabriel Briceño Jiménez: Universidad de Chile, Facultad de Economía y Negocios
Cameron Brick: University of Amsterdam
Traci Bricka: University of Texas at Arlington
Roman Briker: WHU – Otto Beisheim School of Management
Gordon D. A. Brown: University of Warwick
Robbie C. M. van Aert: Tilburg University
Kathryn Caldwell: Ithaca College
Sara Capitan: Swedish University of Agricultural Sciences
Jesse Chandler: University of Michigan
Tessa Charles: Vassar College
Christopher R. Chartier: Ashland University
Rahul Chawdhary: Kingston University
Kent Jason Cheng: University of Massachusetts Boston
William J. Chopik: Michigan State University
Bruce Clark: Southern Illinois University
Victoria E. Colvin: University of Florida
C. Cozette Comer: Virginia Tech
Giulio Costantini: Università degli Studi di Milano-Bicocca
Tom Coupé: University of Canterbury
Jamie Cummins: University of Bern
Aneta Czernatowicz-Kukuczka: Jagiellonian University
Joshua de Leeuw: Vassar College
David Dobolyi: University of Colorado Boulder
James N. Druckman: University of Rochester
Jianhua Duan: University of Canterbury
Marin Dujmović: University of Bristol
Daniel J. Dunleavy: Office of Program Policy Analysis and Government Accountability
Patrick K. Durkee: University of Texas at Austin
Cécile Emery: University of Exeter
Kevin M. Esterling: University of California Riverside
Thomas R. Evans: University of Greenwich
Anna Fedor: Independent Researcher
Belén Fernández-Castilla: Universidad Nacional de Educación a Distancia
Nathan Fiala: University of Connecticut
James G. Field: West Virginia University
Nathan Fong: Rutgers University
Miguel A. Fonseca: University of Exeter
Alexandra L. J. Freeman: University of Cambridge
Jeremy Freese: Stanford University
Sandra J. Geiger: University of Vienna
Jing Geng: Virginia Tech
Laura M. Getz: University of San Diego
Linda Marjoleine Geven: Leiden University
Ilka Helene Gleibs: London School of Economics
Donna Pamella Gonzales: Independent Researcher
Janaki Gooty: University of North Carolina at Charlotte
Amélie Gourdon-Kanhukamwe: Kingston University
Cristina Greculescu: Bremen International Graduate School of Social Sciences
Siobhán M. Griffin: University of Limerick
Lusine Grigoryan: University of York
Nicholas Gunby: UCMeta
Braeden Hall: Southern Illinois University
Paul H. P. Hanel: University of Essex
Erin E. Hannon: University of Nevada Las Vegas
Sam Harper: McGill University
Marco Jürgen Held: University of Bamberg
Louis Hickman: Virginia Tech
Nathan C. Higgins: University of Nevada Las Vegas
Svenja Hippel: University of Bonn
Sven Hoeppner: Charles University
Sanghyun Hong: University of Canterbury
Thomas J. Hostler: Manchester Metropolitan University
Michael Inzlicht: University of Toronto
Kamil Izydorczak: SWPS University
Bastian Jaeger: Tilburg University
Kristin Jankowsky: University of Kassel
Johannes Jarke-Neuert: Forschungszentrum Jülich
Matthew Jensen: University of Oklahoma
Biljana Jokić: University of Belgrade
Daniel Jolles: London School of Economics and Political Science
Phillip Jolly: Pennsylvania State University
Angela M. Jones: Texas State University
Marie Juanchich: University of Essex
Pavol Kačmár: Pavol Jozef Šafárik University in Košice
Hansika Kapoor: University of Connecticut
Andjela Keljanovic: University of Novi Sad, Faculty of Philosophy
Samjhana Koirala: University of Connecticut
Marta Kołczyńska: Institute of Political Studies of the Polish Academy of Sciences
Dimitra Kouroupaki: Atticon University General Hospital, 2nd Psychiatric Clinic
Ulrich Kühnen: Constructor University
Michelangelo Landgrave: University of Colorado Boulder
Michael J. Larson: Brigham Young University
Lyonel Laulié: Universidad de Chile, Facultad de Economía y Negocios
Alice C. E. Lawrence: University of Cambridge
Joel M. Le Forestier: University of Pittsburgh
Katelin E. Leahy: Michigan State University
Sungmok Lee: University of New Brunswick
Jared Leslie: University of Nevada Las Vegas
Savannah C. Lewis: Ashland University
Christopher Limnios: Providence College
Hause Lin: Massachusetts Institute of Technology
An-Chiao Liu: Utrecht University
John Wills Lloyd: University of Virginia
Elliot A. Ludvig: University of Warwick
Dermot Lynott: Maynooth University
Jordan MacDonald: University of New Brunswick
Peter Mallik: Hubbard Decision Research
Daniel J. Mallinson: Penn State Harrisburg
Daniele Marinazzo: Ghent University
Corinna S. Martarelli: UniDistance Suisse
Joshua Matacotta: Western University of Health Sciences
Andrew McBride: Santa Clara University
Cillian McHugh: University of Limerick
Gail McMillan: Carleton University
Esteban Méndez: Central Bank of Costa Rica
Mitchell Metzger: Ashland University
Michalis P. Michaelides: University of Cyprus
Johannes Michalak: Witten/Herdecke University
Leticia Micheli: Leiden University
Jeremy K. Miller: Willamette University
Marina Milyavskaya: Carleton University
Daniel C. Molden: Northwestern University
Ambar G. Monjaras: University of Nevada Las Vegas
David Moreau: University of Auckland
Audrey Morrow: Univeristy of California, Santa Cruz
Cristóbal Moya: DIW Berlin
Liad Mudrik: Tel Aviv University
Laetitia B. Mulder: University of Groningen
Katie A. Munt: University of Queensland
Arijit Nandi: McGill University
Kathryn Nason: University of New Brunswick
Carolin Nast: UiS Business School
Gideon Nave: University of Pennsylvania, Wharton School of Business
Heinrich H. Nax: University of Zurich
Florian Neubauer: University of Connecticut
Phuong Linh L. Nguyen: University of Minnesota
Austin Lee Nichols: Central European University
Gustav Nilsonne: Karolinska Institutet
Ernest O’Boyle: Indiana University
Jule Oettinghaus: Ruhr University
Jeewon Oh: Syracuse University
Adoril Oshana: University of North Carolina at Charlotte
Thomas Ostermann: Witten/Herdecke University
Rachel P. Ostrowski: Vassar College
Abiola Oyebanjo: Policy Innovation Center
Radoslaw Panczak: University of Bern
Jamie Patrianakos: Loyola University Chicago
Ignacio Pavez: Universidad de Chile, Facultad de Economía y Negocios
Yuri G. Pavlov: University of Tuebingen
Sofia Persson: Leeds Beckett University
Marco Perugini: University of Milan-Bicocca
Kim Peters: University of Exeter
Constant Pieters: Copenhagen Business School
Vladimir Ponizovskiy: Ruhr University
Nathaniel D. Porter: Virginia Tech
Jason M. Prenoveau: Loyola University Maryland
Danka Purić: University of Belgrade
Mariah F. Purol: Union College
Arathy Puthillam: University of California San Diego
Kimberly A. Quinn: DePaul University
Marco Ramljak: Utrecht University
Michaela Ritchie: University of New Brunswick
Margaret Ritzau: Vassar College
Sean Patrick Roche: Texas State University
Romina Rodela: Södertörn University
Jan Philipp Röer: Witten/Herdecke University
Ivan Ropovik: Charles University
Jacob Rothschild: Verasight
Justine Saal: Ruhr University
Hani Safadi: University of Georgia
Jason Samaha: Univeristy of California, Santa Cruz
Mary Sanchez: University of Nevada Las Vegas
Soorya Sankaran: Univeristy of California, Santa Cruz
David Santos: Universidad Autónoma de Madrid
Amanda C. Sargent: Bentley University
Marian Sauter: Universität Ulm
Kathleen Schmidt: Ashland University
Landon Schnabel: Cornell University
Amber N. Schroeder: University of Texas at Arlington
Sebastian W. Schuetz: University of Colorado Boulder
Brendan A. Schuetze: University of Texas at Austin
Michael Schulte-Mecklenbeck: University of Bern
Astrid Schütz: University of Bamberg
Eric L. Sevigny: Georgia State University
Ellie Shackleton: University of Limerick
Richard M. Shafranek: Northwestern University
Samuel Shaki: Ariel University
Shishir Shakya: Appalachian State University
Miroslav Sirota: University of Essex
Matthew Ryan Sisco: Columbia University
Maksim M. Sitnikov: Tilburg University
L. Robert Slevc: University of Maryland, College Park
Laura Smalarz: Arizona State University
Colin Tucker Smith: University of Florida
Joel S. Snyder: University of Nevada Las Vegas
Nicolas Sommet: University of Lausanne
Fatih Sonmez: Muş Alparslan University
Barbara A. Spellman: University of Virginia
Natalia Stanulewicz-Buckley: Aston University
George Stock: University of North Carolina at Charlotte
Chris N. H. Street: Keele University
Eirik Strømland: Western Norway University of Applied Sciences
Tina Sundelin: Karolinska Institutet
Moin Syed: University of Minnesota
Anna Szabelska: Psychological Science Accelerator
Barnabas Szaszi: ELTE Eötvös Loránd University, Institute of Psychology
Ewa Szumowska: Jagiellonian University
Susanne Täuber: University of Amsterdam
Louis Tay: Purdue University
Stuti Thapa: University of Tulsa
Jason Thatcher: University of Colorado Boulder
Domna Tsaklakidou: Atticon University General Hospital, 2nd Psychiatric Clinic
Lars Tummers: Utrecht University
Elise Turkovich: Univeristy of California, Santa Cruz
Melba Verra Tutor: Independent Researcher
Karolina Urbanska: Independent Researcher
Anna Elisabeth van ’t Veer: Leiden University, Institute of Psychology
Marcel van Assen: Utrecht University
Niels van de Ven: Tilburg University
Ruben van den Goorbergh: Utrecht University
Elisabeth Julie Vargo: Institute for Globally Distributed Open Research and Education
Leigh Ann Vaughn: Ithaca College
Simine Vazire: University of Melbourne
Jentien M. Vermeulen: Amsterdam UMC
Diem Thi Hong Vo: UCMeta
Victor Volkman: University of Connecticut
Eric-Jan Wagenmakers: University of Amsterdam
Deliah Wagner: Center for Criminological Research Saxony (ZKFS)
Lukasz Walasek: University of Warwick
Frank Walter: Justus-Liebig-University Giessen
Lara Warmelink: Lancaster University
Liuqing Wei: Hubei University
Marie Isabelle Weißflog: University of York
Nicholas Weller: University of California Riverside
Aaron L. Wichman: Western Kentucky University
Jonathan Wilbiks: University of New Brunswick
Jamal R. Williams: University of California San Diego
Kelly Wolfe: Heriot-Watt University
Finnian Wort: University of Warwick
Ryan Wright: University of Virginia
Jesper N. Wulff: Aarhus University
Xindong Xue: Zhongnan University of Economics & Law
Veronica X. Yan: University of Texas at Austin
Yuzhi Yang: University of New Brunswick
Sangsuk Yoon: University of Dayton
Iris Žeželj: University of Belgrade
Yinxian Zhang: CUNY, Queens College
Ignazio Ziano: University of Geneva
Cristina Zogmaister: Università degli Studi di Milano-Bicocca
Zorana Zupan: University of Belgrade
Rolf A. Zwaan: Erasmus University Rotterdam
Brian A. Nosek: Center for Open Science
Timothy M. Errington: Center for Open Science

Nature, 2026, vol. 652, issue 8108, 143-150

Abstract: Abstract Pursuing replicability — independent evidence for previous claims — is important for creating generalizable knowledge1,2. Here we attempted replications of 274 claims of positive results from 164 quantitative papers published from 2009 to 2018 in 54 journals in the social and behavioural sciences. Replications were high powered on average to detect the original effect size (median of 99.6%), used original materials when relevant and available, and were peer reviewed in advance through a standardized internal protocol. Replications showed statistically significant results in the original pattern for 151 of 274 claims (55.1% (95% confidence interval (CI) 49.2–60.9%)) and for 80.8 of 164 papers (49.3% (95% CI 43.8–54.7%)), weighed for replicating multiple claims per paper. We observed modest variation in replication rates across disciplines (42.5–63.1%), although some estimates had high uncertainty. The median Pearson’s r effect size was 0.25 (95% CI 0.21–0.27) for original studies and 0.10 (95% CI 0.09–0.13) for replication studies, an 82.4% (95% CI 67.8–88.2%) reduction in shared variance. Thirteen methods for evaluating replication success provided estimates ranging from 28.6% to 74.8% (median of 49.3%). Some decline in effect size and significance is expected based on power to detect original effects and regression to the mean because we replicated only positive results. We observe that challenges for replicability extend across social–behavioural sciences, illustrating the importance of identifying conditions that promote or inhibit replicability3,4.

Date: 2026
References: Add references at CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://www.nature.com/articles/s41586-025-10078-y Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:nature:v:652:y:2026:i:8108:d:10.1038_s41586-025-10078-y

Ordering information: This journal article can be ordered from
https://www.nature.com/

DOI: 10.1038/s41586-025-10078-y

Access Statistics for this article

Nature is currently edited by Magdalena Skipper

More articles in Nature from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().