Publication Type

Journal Article

Version

publishedVersion

Publication Date

6-2024

Abstract

In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence-generating process (EGP). We claim that EGP variation across researchers adds uncertainty—nonstandard errors (NSEs). We study NSEs by letting 164 teams test the same hypotheses on the same data. NSEs turn out to be sizable, but smaller for more reproducible or higher rated research. Adding peer-review stages reduces NSEs. We further find that this type of uncertainty is underestimated by participants.

Discipline

Finance and Financial Management | Management Sciences and Quantitative Methods

Research Areas

Finance

Publication

Journal of Finance

Volume

79

Issue

3

First Page

1715

Last Page

2393

ISSN

0022-1082

Identifier

10.1111/jofi.13337

Publisher

Wiley

Copyright Owner and License

Authors-CC-BY

Comments

Menkveld, Albert J., Dreber, Anna, Holzmeister, Felix, Huber, Juergen, Johanneson, Magnus, Kirchler, Michael, Razen, Michael, Weitzel, Utz, Abad, David, Abudy, Menachem (Meni), Adrian, Tobias, Ait-Sahalia, Yacine, Akmansoy, Olivier, Alcock, Jamie, Alexeev, Vitali, Aloosh, Arash, Amato, Livia, Amaya, Diego, Angel, James J., Bach, Amadeus, Baidoo, Edwin, Bakalli, Gaetan, Barbon, Andrea, Bashchenko, Oksana, Bindra, Parampreet Christopher, Bjonnes, Geir Hoidal, Black, Jeffrey R., Black, Bernard S., Bohorquez, Santiago, Bondarenko, Oleg, Bos, Charles S., Bosch-Rosa, Ciril, Bouri, Elie, Brownlees, Christian T., Calamia, Anna, Cao, Viet Nga, Capelle-Blancard, Gunther, Capera, Laura, Caporin, Massimiliano, Carrion, Allen, Caskurlu, Tolga, Chakrabarty, Bidisha, Chernov, Mikhail, Cheung, William Ming Yan, Chincarini, Ludwig B., Chordia, Tarun, Chow, Sheung Chi, Clapham, Benjamin, Colliard, Jean-Edouard, Comerton-Forde, Carole, Curran, Edward, Dao, Thong, Dare, Wale, Davies, Ryan J., De Blasis, Riccardo, De Nard, Gianluca, Declerck, Fany, Deev, Oleg, Degryse, Hans, Deku, Solomon, Desagre, Christophe, van Dijk, Mathijs A., Dim, Chukwuma, Dimpfl, Thomas, Dong, Yun Jiang, Drummond, Philip, Dudda, Tom L., Dumitrescu, Ariadna, Dyakov, Teodor, Dyhrberg, Anne Haubo, Dzieliński, Michał, Eksi, Asli, El Kalak, Izidin, ter Ellen, Saskia, Eugster, Nicolas, Evans, Martin D.D., Farrell, Michael, Félez-Viñas, Ester, Ferrara, Gerardo, FERROUHI, El Mehdi, Flori, Andrea, Fluharty-Jaidee, Jonathan, Foley, Sean, Fong, Kingsley Y. L., Foucault, Thierry, Franus, Tatiana, Franzoni, Francesco A., Frijns, Bart, Frömmel, Michael, Fu, Servanna Mianjun, Füllbrunn, Sascha, Gan, Baoqing, Gehrig, Thomas, Gerritsen, Dirk, Gil-Bazo, Javier, Glosten, Lawrence R., Gomez, Thomas, Gorbenko, Arseny, Güçbilmez, Ufuk, Grammig, Joachim, Gregoire, Vincent, Hagströmer, Björn, Hambuckers, Julien, Hapnes, Erik, Harris, Jeffrey H., Harris, Lawrence, Hartmann, Simon, Hasse, Jean-Baptiste, Hautsch, Nikolaus, He, Xue-Zhong 'Tony', Heath, Davidson, Hediger, Simon, Hendershott, Terrence J., Hibbert, Ann Marie, Hjalmarsson, Erik, Hoelscher, Seth, Hoffmann, Peter, Holden, Craig W., Horenstein, Alex R., Huang, Wenqian, Huang, Da, Hurlin, Christophe, Ivashchenko, Alexey, Iyer, Subramanian R., Jahanshahloo, Hossein, Jalkh, Naji, Jones, Charles M., Jurkatis, Simon, Jylha, Petri, Kaeck, Andreas, Kaiser, Gabriel, Karam, Arzé, Karmaziene, Egle, Kassner, Bernhard, Kaustia, Markku, Kazak, Ekaterina, Kearney, Fearghal, van Kervel, Vincent, Khan, Saad, Khomyn, Marta, Klein, Tony, Klein, Olga, Klos, Alexander, Koetter, Michael, Krahnen, Jan Pieter, Kolokolov, Aleksey, Korajczyk, Robert A., Kozhan, Roman, Kwan, Amy, Lajaunie, Quentin, Lam, Full Yet Eric Campbell, Lambert, Marie, Langlois, Hugues, Lausen, Jens, Lauter, Tobias, Leippold, Markus, Levin, Vladimir, Li, Yijie, Li, (Michael) Hui, Liew, Chee Yoong, Lindner, Thomas, Linton, Oliver B., Liu, Jiacheng, Liu, Anqi, Llorente-Alvarez, Jesus-Guillermo, Lof, Matthijs, Lohr, Ariel, Longstaff, Francis A., Lopez-Lira, Alejandro, Mankad, Shawn, Mano, Nicola, Marchal, Alexis, Martineau, Charles, Mazzola, Francesco, Meloso, Debrah C, Mihet, Roxana, Mohan, Vijay, Moinas, Sophie, Moore, David, Mu, Liangyi, Muravyev, Dmitriy, Murphy, Dermot, Neszveda, Gabor, Neumeier, Christian, Nielsson, Ulf, Nimalendran, Mahendrarajah, Nolte, Sven, Nordén, Lars L., O'Neill, Peter, Obaid, Khaled, Ødegaard, Bernt Arne, Östberg, Per, Painter, Marcus, Palan, Stefan, Palit, Imon, Park, Andreas, Pascual Gascó, Roberto, Pasquariello, Paolo, Pastor, Lubos, Patel, Vinay, Patton, Andrew J., Pearson, Neil D., Pelizzon, Loriana, Pelster, Matthias, Pérignon, Christophe, Pfiffer, Cameron, Philip, Richard, Plíhal, Tomáš, Prakash, Puneet, Press, Oliver-Alexander, Prodromou, Tina, Putnins, Talis J., Raizada, Gaurav, Rakowski, David A., Ranaldo, Angelo, Regis, Luca, Reitz, Stefan, Renault, Thomas, Wang, Renjie, Renò, Roberto, Riddiough, Steven, Rinne, Kalle, Rintamäki, Paul, Riordan, Ryan, Rittmannsberger, Thomas, Rodríguez Longarela, Iñaki, Rösch, Dominik, Rognone, Lavinia, Roseman, Brian, Rosu, Ioanid, Roy, Saurabh, Rudolf, Nicolas, Rush, Stephen, Rzayev, Khaladdin, Rzeźnik, Aleksandra, Sanford, Anthony, Sankaran, Harikumar, Sarkar, Asani, Sarno, Lucio, Scaillet, Olivier, Scharnowski, Stefan, Schenk-Hoppé, Klaus Reiner, Schertler, Andrea, Schneider, Michael, Schroeder, Florian, Schuerhoff, Norman, Schuster, Philipp, Schwarz, Marco A., Seasholes, Mark S., Seeger, Norman, Shachar, Or, Shkilko, Andriy, Shui, Jessica, Sikic, Mario, Simion, Giorgia, Smales, Lee A., Söderlind, Paul, Sojli, Elvira, Sokolov, Konstantin, Spokeviciute, Laima, Stefanova, Denitsa, Subrahmanyam, Marti G., Neusüss, Sebastian, Szaszi, Barnabas, Talavera, Oleksandr, Tang, Yuehua, Taylor, Nicholas, Tham, Wing Wah, Theissen, Erik, Thimme, Julian, Tonks, Ian, Tran, Hai, Trapin, Luca, Trolle, Anders B., Valente, Giorgio, Van Ness, Robert A., Vasquez, Aurelio, Verousis, Thanos, Verwijmeren, Patrick, Vilhelmsson, Anders, Vilkov, Grigory, Vladimirov, Vladimir, Vogel, Sebastian, Voigt, Stefan, Wagner, Wolf, Walther, Thomas, Weiss, Patrick, van der Wel, Michel, Werner, Ingrid M., Westerholm, P. Joakim, Westheide, Christian, Wipplinger, Evert, Wolf, Michael, Wolff, Christian C. P., Wolk, Leonard, Wong, Wing-Keung, Wrampelmeyer, Jan, Xia, Shuo, Xiu, Dacheng, Xu, Ke, Xu, Caihong, Yadav, Pradeep K., Yagüe, José, Yan, Cheng, Yang, Antti, Yoo, Woongsun, Yu, Wenjia, Yu, Shihao, Yueshen, Bart Zhou, Yuferova, Darya, Zamojski, Marcin, Zareei, Abalfazl, Zeisberger, Stefan, Zhang, Sarah, Zhang, Xiaoyu, Zhong, Zhuo, Zhou, Z. Ivy, Zhou, Chen, Zhu, Xingyu Sonya, Zoican, Marius, Zwinkels, Remco C.J., Chen, Jian, Duevski, Teodor, Gao, Ge, Gemayel, Roland, Gilder, Dudley, Kuhle, Paul, Pagnotta, Emiliano, Pelli, Michele, Sönksen, Jantje, Zhang, Lu, Ilczuk, Konrad, Bogoev, Dimitar, Qian, Ya, Wika, Hans C., Yu, Yihe, Zhao, Lu, Mi, Michael, Bao, Li, Vaduva, Andreea, Prokopczuk, Marcel, Avetikian, Alejandro, Wu, Zhen-Xing,

Additional URL

https://doi.org/10.1111/jofi.13337

Download

Share

COinS