EconPapers    
Economics at your fingertips  
 

Non-Standard Errors

Albert Menkveld, Anna Dreber, Felix Holzmeister, Jürgen Huber (), Magnus Johannesson, Michael Kirchler (), Sebastian Neusüss (), Michael Razen (), Utz Weitzel (), David Abad-Dí­az, Menachem Abudy, Tobias Adrian, Yacine Ait-Sahalia, Olivier Akmansoy, Jamie T. Alcock, Vitali Alexeev, Arash Aloosh, Livia Amato, Diego Amaya, James J. Angel, Alejandro T. Avetikian, Amadeus Bach, Edwin Baidoo, Gaetan Bakalli, Li Bao, Andrea Barbon, Oksana Bashchenko, Parampreet C. Bindra, Geir Bjønnes, Jeffrey R. Black, Bernard S. Black, Dimitar Bogoev, Santiago Bohorquez Correa, Oleg Bondarenko, Charles Bos (), Ciril Bosch-Rosa, Elie Bouri (), Christian Brownlees, Anna Calamia, Viet Nga Cao, Gunther Capelle-Blancard, Laura M. Capera Romero, Massimiliano Caporin, Allen Carrion, Tolga Caskurlu, Bidisha Chakrabarty, Jian Chen, Mikhail Chernov, William Cheung, Ludwig B. Chincarini, Tarun Chordia, Nikolai Sheung-Chi Chow, Benjamin Clapham, Jean-Edouard Colliard, Carole Comerton-Forde, Edward Curran, Thong Dao, Wale Dare, Ryan Davies, Riccardo De Blasis, Gianluca F. De Nard, Fany Declerck, Oleg Deev, Hans Degryse, Solomon Deku, Christophe Desagre, Mathijs A. van Dijk, Chukwuma Dim, Thomas Dimpfl, Yun Jiang Dong, Philip A. Drummond, Tom Dudda, Teodor Duevski, Ariadna Dumitrescu (), Teodor Dyakov, Anne Haubo Dyhrberg, Michal Dzielinski, Asli Eksi, Izidin El Kalak, Saskia ter Ellen, Nicolas Eugster, Martin D. D. Evans, Michael Farrell, Ester Felez-Vinas, Gerardo Ferrara (), El Mehdi Ferrouhi, Andrea Flori, Jonathan T. Fluharty, Sean D. V. Foley, Kingsley Y. L. Fong, Thierry Foucault, Tatiana Franus, Francesco Franzoni, Bart Frijns, Michael Frömmel, Servanna M. Fu, Sascha Füllbrunn, Baoqing Gan, Ge Gao, Thomas Gehrig, Roland Gemayel, Dirk Gerritsen, Javier Gil-Bazo, Dudley Gilder, Lawrence R. Glosten, Thomas Gomez, Arseny Gorbenko (), Joachim Grammig, Vincent Grégoire, Ufuk Güçbilmez, Björn Hagströmer, Julien Hambuckers, Erik Hapnes, Jeffrey Harris, Lawrence Harris, Simon Hartmann, Jean-Baptiste Hasse, Nikolaus Hautsch (), Xuezhong (Tony) He, Davidson Heath, Simon Hediger, Terrence Hendershott, Ann Marie Hibbert, Erik Hjalmarsson, Seth Hoelscher, Peter Hoffmann, Craig W. Holden, Alex Horenstein, Wenqian Huang, Da Huang, Christophe Hurlin, Konrad Ilczuk, Alexey Ivashchenko, Subramanian R. Iyer, Hossein Jahanshahloo, Naji Jalkh, Charles Jones, Simon Jurkatis, Petri Jylhä, Andreas T. Kaeck, Gabriel Kaiser, Arzé Karam, Egle Karmaziene, Bernhard Kassner, Markku Kaustia, Ekaterina Kazak, Fearghal Kearney, Vincent van Kervel, Saad A. Khan, Marta K. Khomyn, Tony Klein, Olga Klein, Alexander Klos, Michael Koetter, Aleksey Kolokolov, Robert Korajczyk, Roman Kozhan, Jan P. Krahnen, Paul Kuhle, Amy Kwan, Quentin Lajaunie (), F. Y. Eric C. Lam, Marie Lambert, Hugues Langlois, Jens Lausen, Tobias Lauter, Markus Leippold, Vladimir Levin, Yijie Li, Hui Li, Chee Liew, Thomas Lindner, Oliver Linton (), Jiacheng Liu, Anqi Liu, Guillermo Llorente, Matthijs Lof, Ariel Lohr, Francis Longstaff, Alejandro Lopez-Lira, Shawn Mankad, Nicola Mano, Alexis Marchal, Charles Martineau, Francesco Mazzola, Debrah Meloso, Michael G. Mi, Roxana Mihet, Vijay Mohan, Sophie Moinas, David Moore, Liangyi Mu, Dmitriy Muravyev, Dermot Murphy, Gabor Neszveda, Christian Neumeier, Ulf Nielsson, Mahendrarajah Nimalendran, Sven Nolte, Lars L. Norden, Peter W. O'Neill, Khaled Obaid, Bernt Ødegaard, Per Östberg, Emiliano Pagnotta, Marcus Painter, Stefan Palan, Imon J. Palit, Andreas Park, Roberto Pascual, Paolo Pasquariello, Lubos Pastor, Vinay Patel (), Andrew Patton, Neil D. Pearson, Loriana Pelizzon (), Michele Pelli, Matthias Pelster, Christophe Perignon (), Cameron Pfiffer, Richard Philip, Tomás Plí­hal, Puneet Prakash, Oliver-Alexander Press, Tina Prodromou, Marcel Prokopczuk (), Talis Putnins, Ya Qian, Gaurav Raizada, David Rakowski (), Angelo Ranaldo, Luca Regis (), Stefan Reitz, Thomas Renault, Rex W. Renjie, Roberto Reno, Steven J. Riddiough, Kalle Rinne, Paul J. Rintamäki, Ryan Riordan, Thomas Rittmannsberger, Iñaki Rodrí­guez Longarela, Dominik Roesch, Lavinia Rognone, Brian Roseman, Ioanid Rosu, Saurabh Roy, Nicolas Rudolf, Stephen R. Rush, Khaladdin Rzayev, Aleksandra A. Rzeznik, Anthony Sanford, Harikumar Sankaran, Asani Sarkar, Lucio Sarno, Olivier Scaillet, Stefan Scharnowski, Klaus Schenk-Hoppé, Andrea Schertler, Michael Schneider, Florian Schroeder, Norman Schürhoff, Philipp Schuster, Marco Schwarz, Mark S. Seasholes, Norman J. Seeger, Or Shachar, Andriy Shkilko, Jessica Shui, Mario Sikic, Giorgia Simion, Lee Smales, Paul Söderlind, Elvira Sojli, Konstantin Sokolov, Jantje Sönksen (), Laima Spokeviciute, Denitsa Stefanova, Marti G. Subrahmanyam, Barnabas Szaszi, Oleksandr Talavera (), Yuehua Tang, Nick Taylor, Wing Wah Tham, Erik Theissen, Julian Thimme, Ian Tonks, Hai Tran, Luca Trapin, Anders B. Trolle, M. Andreea Vaduva, Giorgio Valente, Robert A. Van Ness, Aurelio Vasquez, Thanos Verousis (), Patrick Verwijmeren, Anders Vilhelmsson, Grigory Vilkov, Vladimir Vladimirov, Sebastian Vogel, Stefan Voigt, Wolf Wagner, Thomas Walther, Patrick Weiss, Michel van der Wel, Ingrid M. Werner, Joakim Westerholm, Christian Westheide, Hans C. Wika, Evert Wipplinger, Michael Wolf, Christian Wolff, Leonard Wolk, Wing-Keung Wong, Jan Wrampelmeyer, Zhen-Xing Wu, Shuo Xia, Dacheng Xiu, Ke Xu (), Caihong Xu, Pradeep K. Yadav, José Yagüe, Cheng Yan, Antti Yang, Woongsun Yoo, Wenjia Yu, Yihe Yu, Shihao Yu, Bart Z. Yueshen, Darya Yuferova, Marcin Zamojski, Abalfazl Zareei, Stefan M. Zeisberger, Lu Zhang, S. Sarah Zhang, Xiaoyu Zhang, Lu Zhao, Zhuo Zhong, Zeyang (Ivy) Zhou, Chen Zhou (), Xingyu S. Zhu, Marius Zoican and Remco Zwinkels
Authors registered in the RePEc Author Service: Tomáš Plíhal, Norman Schuerhoff and Anders Wilhelmsson ()

Working Papers from Faculty of Economics and Statistics, Universität Innsbruck

Abstract: In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in sample estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence-generating process (EGP). We claim that EGP variation across researchers adds uncertainty: non-standard errors. To study them, we let 164 teams test six hypotheses on the same sample. We find that non-standard errors are sizeable, on par with standard errors. Their size (i) co-varies only weakly with team merits, reproducibility, or peer rating, (ii) declines significantly after peer-feedback, and (iii) is underestimated by participants.

Keywords: non-standard errors; multi-analyst approach; liquidity (search for similar items in EconPapers)
JEL-codes: C12 C18 G1 G14 (search for similar items in EconPapers)
Pages: 63
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
https://www2.uibk.ac.at/downloads/c9821000/wpaper/2021-31.pdf (application/pdf)

Related works:
Working Paper: Nonstandard errors (2024) Downloads
Working Paper: Non-Standard Errors (2023)
Working Paper: Non-Standard Errors* (2023) Downloads
Working Paper: Non-Standard Errors (2023) Downloads
Working Paper: Non-Standard Errors (2022) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-Standard Errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
Working Paper: Non-standard errors (2021) Downloads
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inn:wpaper:2021-31

Access Statistics for this paper

More papers in Working Papers from Faculty of Economics and Statistics, Universität Innsbruck Contact information at EDIRC.
Bibliographic data for series maintained by Janette Walde ( this e-mail address is bad, please contact ).

 
Page updated 2024-05-17
Handle: RePEc:inn:wpaper:2021-31