IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v114y2025ics2214804324001642.html
   My bibliography  Save this article

Incentives and the replication crisis in social sciences: A critical review of open science practices

Author

Listed:
  • Balafoutas, Loukas
  • Celse, Jeremy
  • Karakostas, Alexandros
  • Umashev, Nicholas

Abstract

The replication crisis in the social sciences has revealed systemic issues undermining the credibility of research findings, primarily driven by misaligned incentives that encourage questionable research practices (QRPs). This paper offers a comprehensive and critical review of recent empirical evidence on the effectiveness of Open Science initiatives—such as replication studies, reproducibility efforts, pre-registrations, and registered reports—in addressing the root causes of the replication crisis. Building upon and extending prior reviews, we integrate recent theoretical models from economics with empirical findings across several social science disciplines to assess how these practices impact research integrity. Our review demonstrates that while measures like pre-registration and data sharing have advanced transparency, they often fall short in mitigating QRPs due to persistent incentive misalignments. In contrast, registered reports and megastudies show greater promise by fundamentally reshaping the incentive structure, shifting the focus from producing statistically significant results to emphasizing methodological rigor and meaningful research questions. We argue that realigning incentives is crucial for fostering a culture of integrity and offer policy recommendations involving key stakeholders—including authors, journals, editors, reviewers, and institutions—to promote practices that enhance research reliability and credibility across the social sciences.

Suggested Citation

  • Balafoutas, Loukas & Celse, Jeremy & Karakostas, Alexandros & Umashev, Nicholas, 2025. "Incentives and the replication crisis in social sciences: A critical review of open science practices," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
    • Handle: RePEc:eee:soceco:v:114:y:2025:i:c:s2214804324001642
    DOI: 10.1016/j.socec.2024.102327
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2214804324001642
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socec.2024.102327?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    --->

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Richard A. Bettis & Constance E. Helfat & J. Myles Shaver & Richard A. Bettis & Constance E. Helfat & J. Myles Shaver, 2016. "The necessity, logic, and forms of replication," Strategic Management Journal, Wiley Blackwell, vol. 37(11), pages 2193-2203, November.
    2. John Protzko & Jon Krosnick & Leif Nelson & Brian A. Nosek & Jordan Axt & Matt Berent & Nicholas Buttrick & Matthew DeBell & Charles R. Ebersole & Sebastian Lundmark & Bo MacInnis & Michael O’Donnell , 2024. "RETRACTED ARTICLE: High replicability of newly discovered social-behavioural findings is achievable," Nature Human Behaviour, Nature, vol. 8(2), pages 311-319, February.
    3. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
    4. Alfredo Di Tillio & Marco Ottaviani & Peter Norman Sørensen, 2017. "Persuasion Bias in Science: Can Economics Help?," Economic Journal, Royal Economic Society, vol. 127(605), pages 266-304, October.
    5. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    6. Brodeur, Abel & Mikola, Derek & Cook, Nikolai & Brailey, Thomas & Briggs, Ryan & de Gendre, Alexandra & Dupraz, Yannick & Fiala, Lenka & Gabani, Jacopo & Gauriot, Romain & Haddad, Joanne & McWay, Ryan, 2024. "Mass Reproducibility and Replicability: A New Hope," I4R Discussion Paper Series 107, The Institute for Replication (I4R).
    7. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 48(1), pages 62-83.
    8. Miloš Fišar & Ben Greiner & Christoph Huber & Elena Katok & Ali I. Ozkes, 2024. "Reproducibility in Management Science," Management Science, INFORMS, vol. 70(3), pages 1343-1356, March.
    9. Anna Dreber & Magnus Johannesson, 2025. "A framework for evaluating reproducibility and replicability in economics," Economic Inquiry, Western Economic Association International, vol. 63(2), pages 338-356, April.
    10. Abel Brodeur & Nikolai Cook & Carina Neisser, 2024. "p-Hacking, Data type and Data-Sharing Policy," The Economic Journal, Royal Economic Society, vol. 134(659), pages 985-1018.
    11. Katherine L. Milkman & Dena Gromet & Hung Ho & Joseph S. Kay & Timothy W. Lee & Pepi Pandiloski & Yeji Park & Aneesh Rai & Max Bazerman & John Beshears & Lauri Bonacorsi & Colin Camerer & Edward Chang, 2021. "Megastudies improve the impact of applied behavioural science," Nature, Nature, vol. 600(7889), pages 478-483, December.
    12. Christophe Pérignon & Olivier Akmansoy & Christophe Hurlin & Anna Dreber & Felix Holzmeister & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Albert J Menkveld & Michael Razen & Utz Weitzel, 2024. "Computational Reproducibility in Finance: Evidence from 1,000 Tests," The Review of Financial Studies, Society for Financial Studies, vol. 37(11), pages 3558-3593.
    13. Benjamin A. Olken, 2015. "Promises and Perils of Pre-analysis Plans," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 61-80, Summer.
    14. Rubin, Mark, 2020. "Does preregistration improve the credibility of research findings?," MetaArXiv vgr89, Center for Open Science.
    15. Abhijit Banerjee & Esther Duflo & Amy Finkelstein & Lawrence F. Katz & Benjamin A. Olken & Anja Sautmann, 2020. "In Praise of Moderation: Suggestions for the Scope and Use of Pre-Analysis Plans for RCTs in Economics," NBER Working Papers 26993, National Bureau of Economic Research, Inc.
    16. Brodeur, Abel & Cook, Nikolai & Hartley, Jonathan & Heyes, Anthony, 2022. "Do Pre-Registration and Pre-analysis Plans Reduce p-Hacking and Publication Bias?," MetaArXiv uxf39, Center for Open Science.
    17. Nicola Lacetera & Lorenzo Zirulia, 2011. "The Economics of Scientific Misconduct," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 27(3), pages 568-603.
    18. Mike Felgenhauer & Fangya Xu, 2021. "The Face Value Of Arguments With And Without Manipulation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 62(1), pages 277-293, February.
    19. Nasser Lubega & Abigail Anderson & Nicole C Nelson, 2023. "Experience of irreproducibility as a risk factor for poor mental health in biomedical science doctoral students: A survey and interview-based study," PLOS ONE, Public Library of Science, vol. 18(11), pages 1-19, November.
    20. Justin McCrary & Garret Christensen & Daniele Fanelli, 2016. "Conservative Tests under Satisficing Models of Publication Bias," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-10, February.
    21. Necker, Sarah, 2014. "Scientific misbehavior in economics," Research Policy, Elsevier, vol. 43(10), pages 1747-1759.
    22. Dena M. Gromet & Sean F. Ellis & Joseph S. Kay & Heather N. Graci, 2023. "The Megastudy Approach for Changing Behavior at Scale," Springer Books, in: Michael Sanders & Syon Bhanot & Shibeal O' Flaherty (ed.), Behavioral Public Policy in a Global Context, pages 345-360, Springer.
    23. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    24. Joseph Bak-Coleman & Berna Devezer, 2024. "Claims about scientific rigour require rigour," Nature Human Behaviour, Nature, vol. 8(10), pages 1890-1891, October.
    25. Gall, Thomas & Maniadis, Zacharias, 2019. "Evaluating solutions to the problem of false positives," Research Policy, Elsevier, vol. 48(2), pages 506-515.
    26. Eliot Abrams & Jonathan Libgober & John List, 2020. "Research Registries: Facts, Myths, and Possible Improvements," Artefactual Field Experiments 00703, The Field Experiments Website.
    27. Logg, Jennifer M. & Dorison, Charles A., 2021. "Pre-registration: Weighing costs and benefits for researchers," Organizational Behavior and Human Decision Processes, Elsevier, vol. 167(C), pages 18-27.
    28. Tom E. Hardwicke & Eric-Jan Wagenmakers, 2023. "Reducing bias, increasing transparency and calibrating confidence with preregistration," Nature Human Behaviour, Nature, vol. 7(1), pages 15-26, January.
    29. Jan G. Voelkel & James Y. Chu & Michael N. Stagnaro & James N. Druckman & Robb Willer, 2024. "How to design and conduct a megastudy," Nature Human Behaviour, Nature, vol. 8(12), pages 2257-2260, December.
    30. Alexander Brüggen & Victor S. Maas & Alexandra Van den Abbeele, 2021. "Replication in experimental management accounting research - an editorial," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 32(2), pages 155-160, June.
    31. Nick Huntington‐Klein & Andreu Arenas & Emily Beam & Marco Bertoni & Jeffrey R. Bloem & Pralhad Burli & Naibin Chen & Paul Grieco & Godwin Ekpe & Todd Pugatch & Martin Saavedra & Yaniv Stopnitzky, 2021. "The influence of hidden researcher decisions in applied microeconomics," Economic Inquiry, Western Economic Association International, vol. 59(3), pages 944-960, July.
    32. McCullough, B. D. & McGeary, Kerry Anne & Harrison, Teresa D., 2006. "Lessons from the JMCB Archive," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(4), pages 1093-1107, June.
    33. Anderson, Richard G., 2013. "Registration and Replication: A Comment," Political Analysis, Cambridge University Press, vol. 21(1), pages 38-39, January.
    34. repec:osf:socarx:4hmb6_v1 is not listed on IDEAS
    35. repec:osf:osfxxx:mydzv_v1 is not listed on IDEAS
    36. Zacharias Maniadis & Fabio Tufano & John A. List, 2017. "To Replicate or Not To Replicate? Exploring Reproducibility in Economics through the Lens of a Model and a Pilot Study," Economic Journal, Royal Economic Society, vol. 127(605), pages 209-235, October.
    37. Lucas C. Coffman & Muriel Niederle, 2015. "Pre-analysis Plans Have Limited Upside, Especially Where Replications Are Feasible," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 81-98, Summer.
    38. repec:osf:metaar:uxf39_v1 is not listed on IDEAS
    39. Thibaut Arpinon & Romain Espinosa, 2023. "A practical guide to Registered Reports for economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 9(1), pages 90-122, June.
    40. Nicholas Swanson & Garret Christensen & Rebecca Littman & David Birke & Edward Miguel & Elizabeth Levy Paluck & Zenan Wang, 2020. "Research Transparency Is on the Rise in Economics," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 61-65, May.
    41. Trafimow, David & Hyman, Michael R. & Kostyk, Alena, 2020. "The (im)precision of scholarly consumer behavior research," Journal of Business Research, Elsevier, vol. 114(C), pages 93-101.
    42. Edward Miguel, 2021. "Evidence on Research Transparency in Economics," Journal of Economic Perspectives, American Economic Association, vol. 35(3), pages 193-214, Summer.
    43. repec:osf:osfxxx:2dxu5_v1 is not listed on IDEAS
    44. Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do economists replicate?," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
    45. Andrew C. Chang & Phillip Li, 2017. "A Preanalysis Plan to Replicate Sixty Economics Research Papers That Worked Half of the Time," American Economic Review, American Economic Association, vol. 107(5), pages 60-64, May.
    46. repec:osf:metaar:vgr89_v1 is not listed on IDEAS
    47. John Protzko & Jon Krosnick & Leif Nelson & Brian A. Nosek & Jordan Axt & Matt Berent & Nicholas Buttrick & Matthew DeBell & Charles R. Ebersole & Sebastian Lundmark & Bo MacInnis & Michael O’Donnell , 2024. "Retraction Note: High replicability of newly discovered social-behavioural findings is achievable," Nature Human Behaviour, Nature, vol. 8(10), pages 2067-2067, October.
    48. Cohn, Jonathan B. & Liu, Zack & Wardlaw, Malcolm I., 2022. "Count (and count-like) data in finance," Journal of Financial Economics, Elsevier, vol. 146(2), pages 529-551.
    49. Joel Ferguson & Rebecca Littman & Garret Christensen & Elizabeth Levy Paluck & Nicholas Swanson & Zenan Wang & Edward Miguel & David Birke & John-Henry Pezzuto, 2023. "Survey of open science practices and attitudes in the social sciences," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    50. George K. Ofosu & Daniel N. Posner, 2020. "Do Pre-analysis Plans Hamper Publication?," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 70-74, May.
    51. Martin Dufwenberg & Peter Martinsson, 2019. "Sealed Envelope Submissions Foster Research Integrity," Revue économique, Presses de Sciences-Po, vol. 70(6), pages 919-926.
    52. Brodeur, Abel & Esterling, Kevin & Ankel-Peters, Jörg & Bueno, Natália S & Desposato, Scott & Dreber, Anna & Genovese, Federica & Green, Donald P & Hepplewhite, Matthew & de la Guardia, Fernando Hoces, 2024. "Promoting Reproducibility and Replicability in Political Science," Department of Economics, Working Paper Series qt23n3n3dg, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    53. B.D. McCullough & Kerry Anne McGeary & Teresa D. Harrison, 2008. "Do economics journal archives promote replicable research?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 41(4), pages 1406-1420, November.
    54. Colin F. Camerer & Anna Dreber & Felix Holzmeister & Teck-Hua Ho & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Gideon Nave & Brian A. Nosek & Thomas Pfeiffer & Adam Altmejd & Nick Buttrick , 2018. "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015," Nature Human Behaviour, Nature, vol. 2(9), pages 637-644, September.
    55. Paul Gertler & Sebastian Galiani & Mauricio Romero, 2018. "How to make replication the norm," Nature, Nature, vol. 554(7693), pages 417-419, February.
    56. Arel-Bundock, Vincent & Briggs, Ryan C. & Doucouliagos, Hristos & Mendoza Aviña, Marco & Stanley, Tom D., 2022. "Quantitative Political Science Research is Greatly Underpowered," I4R Discussion Paper Series 6, The Institute for Replication (I4R).
    57. Paul J. Ferraro & Pallavi Shukla, 2020. "Feature—Is a Replicability Crisis on the Horizon for Environmental and Resource Economics?," Review of Environmental Economics and Policy, University of Chicago Press, vol. 14(2), pages 339-351.
    58. Gelman, Andrew, 2013. "Preregistration of Studies and Mock Reports," Political Analysis, Cambridge University Press, vol. 21(1), pages 40-41, January.
    59. Christopher D. Chambers & Loukia Tzavella, 2022. "The past, present and future of Registered Reports," Nature Human Behaviour, Nature, vol. 6(1), pages 29-42, January.
    60. Christopher Allen & David M A Mehler, 2019. "Open science challenges, benefits and tips in early career and beyond," PLOS Biology, Public Library of Science, vol. 17(5), pages 1-14, May.
    61. Anna Dreber & Magnus Johannesson & Yifan Yang, 2024. "Selective reporting of placebo tests in top economics journals," Economic Inquiry, Western Economic Association International, vol. 62(3), pages 921-932, July.
    62. repec:plo:pbio00:3000587 is not listed on IDEAS
    63. Nosek, BA & Alter, G & Banks, GC & Borsboom, D & Bowman, SD & Breckler, SJ & Buck, S & Chambers, CD & Chin, G & Christensen, G & Contestabile, M & Dafoe, A & Eich, E & Freese, J & Glennerster, R & Gor, 2015. "Promoting an open research culture," Department of Economics, Working Paper Series qt7wh1000s, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    64. Christopher J. Bryan & Elizabeth Tipton & David S. Yeager, 2021. "Behavioural science is unlikely to change the world without a heterogeneity revolution," Nature Human Behaviour, Nature, vol. 5(8), pages 980-989, August.
    65. Todd Mitton, 2022. "Methodological Variation in Empirical Corporate Finance," The Review of Financial Studies, Society for Financial Studies, vol. 35(2), pages 527-575.
    66. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    67. Courtney K. Soderberg & Timothy M. Errington & Sarah R. Schiavone & Julia Bottesini & Felix Singleton Thorn & Simine Vazire & Kevin M. Esterling & Brian A. Nosek, 2021. "Initial evidence of research quality of registered reports compared with the standard publishing model," Nature Human Behaviour, Nature, vol. 5(8), pages 990-997, August.
    68. Daniele Fanelli, 2009. "How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data," PLOS ONE, Public Library of Science, vol. 4(5), pages 1-11, May.
    69. Sylvérie Herbert & Hautahi Kingi & Flavio Stanchi & Lars Vilhubern, 2021. "The Reproducibility of Economics Research: A Case Study," Working papers 853, Banque de France.
    70. Michal Krawczyk & Ernesto Reuben, 2012. "(Un)Available upon Request: Field Experiment on Researchers' Willingness to Share Supplementary Materials," Natural Field Experiments 00689, The Field Experiments Website.
    71. Joshua M. Ackerman, 2018. "Best practices for interpreting large-scale replications," Nature Human Behaviour, Nature, vol. 2(10), pages 712-712, October.
    72. Campbell, Douglas & Brodeur, Abel & Dreber, Anna & Johannesson, Magnus & Kopecky, Joseph & Lusher, Lester & Tsoy, Nikita, 2024. "The Robustness Reproducibility of the American Economic Review," I4R Discussion Paper Series 124, The Institute for Replication (I4R).
    73. Robert A. Moffitt, 2011. "Report of the Editor: American Economic Review (with Appendix by Philip J. Glandon)," American Economic Review, American Economic Association, vol. 101(3), pages 684-693, May.
    74. Zacharias Maniadis & Fabio Tufano & John A. List, 2017. "To Replicate or Not To Replicate? Exploring Reproducibility in Economics through the Lens of a Model and a Pilot Study," Economic Journal, Royal Economic Society, vol. 127(605), pages 209-235, October.
    75. Andrew M. Davis & Blair Flicker & Kyle Hyndman & Elena Katok & Samantha Keppler & Stephen Leider & Xiaoyang Long & Jordan D. Tong, 2023. "A Replication Study of Operations Management Experiments in Management Science," Management Science, INFORMS, vol. 69(9), pages 4977-4991, September.
    76. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    77. Alfredo Di Tillio & Marco Ottaviani & Peter Norman Sørensen, 2017. "Persuasion Bias in Science: Can Economics Help?," Economic Journal, Royal Economic Society, vol. 127(605), pages 266-304, October.
    78. Ting-Yu Lin & Hao-Chien Cheng & Li-Fu Cheng & Tsung-Min Hung, 2024. "Registered report adoption in academic journals: assessing rates in different research domains," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(4), pages 2123-2130, April.
    79. Ofosu, George K. & Posner, Daniel N., 2020. "Do pre-analysis plans hamper publication?," LSE Research Online Documents on Economics 112748, London School of Economics and Political Science, LSE Library.
    80. Nosek, Brian A. & Ebersole, Charles R. & DeHaven, Alexander Carl & Mellor, David Thomas, 2018. "The Preregistration Revolution," OSF Preprints 2dxu5, Center for Open Science.
    81. Thibaut Arpinon & Romain Espinosa, 2023. "A Practical Guide to Registered Reports for Economists," Post-Print halshs-03897719, HAL.
    82. Marjan Bakker & Coosje L S Veldkamp & Marcel A L M van Assen & Elise A V Crompvoets & How Hwee Ong & Brian A Nosek & Courtney K Soderberg & David Mellor & Jelte M Wicherts, 2020. "Ensuring the quality and specificity of preregistrations," PLOS Biology, Public Library of Science, vol. 18(12), pages 1-18, December.
    83. Tourish, Dennis, 2019. "Making a difference: Doing leadership research that matters," Journal of Management & Organization, Cambridge University Press, vol. 25(3), pages 364-369, May.
    84. David Card & Stefano DellaVigna, 2020. "What Do Editors Maximize? Evidence from Four Economics Journals," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 195-217, March.
    85. Leonid Tiokhin & Karthik Panchanathan & Daniel Lakens & Simine Vazire & Thomas Morgan & Kevin Zollman, 2021. "Honest signaling in academic publishing," PLOS ONE, Public Library of Science, vol. 16(2), pages 1-19, February.
    86. Felgenhauer, Mike, 2021. "Experimentation and manipulation with preregistration," Games and Economic Behavior, Elsevier, vol. 130(C), pages 400-408.
    87. Paul J. Ferraro & Pallavi Shukla, 2023. "Credibility crisis in agricultural economics," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 45(3), pages 1275-1291, September.
    88. Monya Baker, 2016. "1,500 scientists lift the lid on reproducibility," Nature, Nature, vol. 533(7604), pages 452-454, May.
    89. Sandip Sukhtankar, 2017. "Replications in Development Economics," American Economic Review, American Economic Association, vol. 107(5), pages 32-36, May.
    90. Jonathan Libgober, 2022. "False Positives and Transparency," American Economic Journal: Microeconomics, American Economic Association, vol. 14(2), pages 478-505, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    2. Thibaut Arpinon & Romain Espinosa, 2023. "A practical guide to Registered Reports for economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 9(1), pages 90-122, June.
    3. Thibaut Arpinon & Romain Espinosa, 2023. "A Practical Guide to Registered Reports for Economists," Post-Print halshs-03897719, HAL.
    4. Deer, Lachlan & Adler, Susanne J. & Datta, Hannes & Mizik, Natalie & Sarstedt, Marko, 2025. "Toward open science in marketing research," International Journal of Research in Marketing, Elsevier, vol. 42(1), pages 212-233.
    5. Thibaut Arpinon & Marianne Lefebvre, 2024. "Registered Reports and Associated Benefits for Agricultural Economics," Post-Print hal-04635986, HAL.
    6. Miloš Fišar & Ben Greiner & Christoph Huber & Elena Katok & Ali I. Ozkes, 2024. "Reproducibility in Management Science," Management Science, INFORMS, vol. 70(3), pages 1343-1356, March.
    7. Anna Dreber & Magnus Johannesson & Yifan Yang, 2024. "Selective reporting of placebo tests in top economics journals," Economic Inquiry, Western Economic Association International, vol. 62(3), pages 921-932, July.
    8. So, Tony, 2020. "Classroom experiments as a replication device," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 86(C).
    9. Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do economists replicate?," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
    10. Anna Dreber & Magnus Johannesson, 2025. "A framework for evaluating reproducibility and replicability in economics," Economic Inquiry, Western Economic Association International, vol. 63(2), pages 338-356, April.
    11. repec:osf:osfxxx:mydzv_v1 is not listed on IDEAS
    12. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    13. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    14. Christophe Pérignon & Olivier Akmansoy & Christophe Hurlin & Anna Dreber & Felix Holzmeister & Juergen Huber & Magnus Johanneson & Michael Kirchler & Albert Menkveld & Michael Razen & Utz Weitzel, 2022. "Reproducibility of Empirical Results: Evidence from 1,000 Tests in Finance," Working Papers hal-03810013, HAL.
    15. Brinkerink, Jasper & De Massis, Alfredo & Kellermanns, Franz, 2022. "One finding is no finding: Toward a replication culture in family business research," Journal of Family Business Strategy, Elsevier, vol. 13(4).
    16. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," Research Policy, Elsevier, vol. 48(1), pages 62-83.
    17. Abel Brodeur & Nikolai Cook & Carina Neisser, 2024. "p-Hacking, Data type and Data-Sharing Policy," The Economic Journal, Royal Economic Society, vol. 134(659), pages 985-1018.
    18. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
    19. Strømland, Eirik, 2019. "Preregistration and reproducibility," Journal of Economic Psychology, Elsevier, vol. 75(PA).
    20. Horton, Joanne & Krishna Kumar, Dhanya & Wood, Anthony, 2020. "Detecting academic fraud using Benford law: The case of Professor James Hunton," Research Policy, Elsevier, vol. 49(8).
    21. Mueller-Langer, Frank & Andreoli-Versbach, Patrick, 2018. "Open access to research data: Strategic delay and the ambiguous welfare effects of mandatory data disclosure," Information Economics and Policy, Elsevier, vol. 42(C), pages 20-34.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • B49 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Other
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:114:y:2025:i:c:s2214804324001642. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.