Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability

Charles R. Ebersole; Maya B. Mathur; Erica Baranski; Diane Jo Bart-Plange; Nicholas R. Buttrick; Christopher R. Chartier; Katherine S. Corker; Martin Corley; Joshua K. Hartshorne; Hans IJzerman; Ljiljana B. Lazarević; Hugh Rabagliati; Ivan Ropovik; Balazs Aczel; Lena F. Aeschbach; Luca Andrighetto; Jack D. Arnal; Holly Arrow; Peter Babincak; Bence E. Bakos; Gabriel Baník; Ernest Baskin; Radomir Belopavlović; Michael H. Bernstein; Michał Białek; Nicholas G. Bloxsom; Bojana Bodroža; Diane B.V. Bonfiglio; Leanne Boucher; Florian Brühlmann; Claudia C. Brumbaugh; Erica Casini; Yiling Chen; Carlo Chiorri; William J. Chopik; Oliver Christ; Antonia M. Ciunci; Heather M. Claypool; Sean Coary; Marija V. Čolić; W. Matthew Collins; Paul G. Curran; Chris R. Day; Benjamin Dering; Anna Dreber; John E. Edlund; Filipe Falcão; Anna Fedor; Lily Feinberg; Ian R. Ferguson; Máire Ford; Michael C. Frank; Emily Fryberger; Alexander Garinther; Katarzyna Gawryluk; Kayla Ashbaugh; Mauro Giacomantonio; Steffen R. Giessner; Jon E. Grahe; Rosanna E. Guadagno; Ewa Hałasa; Peter J.B. Hancock; Rias A. Hilliard; Joachim Hüffmeier; Sean Hughes; Katarzyna Idzikowska; Michael Inzlicht; Alan Jern; William Jiménez-Leal; Magnus Johannesson; Jennifer A. Joy-Gaba; Mathias Kauff; Danielle J. Kellier; Grecia Kessinger; Mallory C. Kidwell; Amanda M. Kimbrough; Josiah P.J. King; Vanessa S. Kolb; Sabina Kołodziej; Marton Kovacs; Karolina Krasuska; Sue Kraus; Lacy E. Krueger; Katarzyna Kuchno; Caio Ambrosio Lage; Eleanor V. Langford; Carmel A. Levitan; Tiago Jessé Souza de Lima; Hause Lin; Samuel Lins; Jia E. Loy; Dylan Manfredi; Łukasz Markiewicz; Madhavi Menon; Brett Mercier; Mitchell Metzger; Venus Meyet; Ailsa E. Millen; Jeremy K. Miller; Andres Montealegre; Don A. Moore; Rafał Muda; Gideon Nave; Austin Lee Nichols; Sarah A. Novak; Christian Nunnally; Ana Orlić; Anna Palinkas; Angelo Panno; Kimberly P. Parks; Ivana Pedović; Emilian Pękala; Matthew R. Penner; Sebastiaan Pessers; Boban Petrović; Thomas Pfeiffer; Damian Pieńkosz; Emanuele Preti; Danka Purić; Tiago Ramos; Jonathan Ravid; Timothy S. Razza; Katrin Rentzsch; Juliette Richetin; Sean C. Rife; Anna Dalla Rosa; Kaylis Hase Rudy; Janos Salamon; Blair Saunders; Przemysław Sawicki; Kathleen Schmidt; Kurt Schuepfer; Thomas Schultze; Stefan Schulz-Hardt; Astrid Schütz; Ani N. Shabazian; Rachel L. Shubella; Adam Siegel; Rúben Silva; Barbara Sioma; Lauren Skorb; Luana Elayne Cunha de Souza; Sara Steegen; L. A.R. Stein; R. Weylin Sternglanz; Darko Stojilović; Daniel Storage; Gavin Brent Sullivan; Barnabas Szaszi; Peter Szecsi; Orsolya Szöke; Attila Szuts; Manuela Thomae; Natasha D. Tidwell; Carly Tocco; Ann Kathrin Torka; Francis Tuerlinckx; Wolf Vanpaemel; Leigh Ann Vaughn; Michelangelo Vianello; Domenico Viganola; Maria Vlachou; Ryan J. Walker; Sophia C. Weissgerber; Aaron L. Wichman; Bradford J. Wiggins; Daniel Wolf; Michael J. Wood; David Zealley; Iris Žeželj; Mark Zrubka; Brian A. Nosek

doi:10.1177/2515245920958687

Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability

Charles R. Ebersole
, Maya B. Mathur
, Erica Baranski
, Diane Jo Bart-Plange
, Nicholas R. Buttrick
, Christopher R. Chartier
, Katherine S. Corker
, Martin Corley
, Joshua K. Hartshorne
, Hans IJzerman
, Ljiljana B. Lazarević
, Hugh Rabagliati
, Ivan Ropovik
, Balazs Aczel
, Lena F. Aeschbach
, Luca Andrighetto
, Jack D. Arnal
, Holly Arrow
, Peter Babincak
, Bence E. Bakos

Gabriel Baník, Ernest Baskin, Radomir Belopavlović, Michael H. Bernstein, Michał Białek, Nicholas G. Bloxsom, Bojana Bodroža, Diane B.V. Bonfiglio, Leanne Boucher, Florian Brühlmann, Claudia C. Brumbaugh, Erica Casini, Yiling Chen, Carlo Chiorri, William J. Chopik, Oliver Christ, Antonia M. Ciunci, Heather M. Claypool, Sean Coary, Marija V. Čolić, W. Matthew Collins, Paul G. Curran, Chris R. Day, Benjamin Dering, Anna Dreber, John E. Edlund, Filipe Falcão, Anna Fedor, Lily Feinberg, Ian R. Ferguson, Máire Ford, Michael C. Frank, Emily Fryberger, Alexander Garinther, Katarzyna Gawryluk, Kayla Ashbaugh, Mauro Giacomantonio, Steffen R. Giessner, Jon E. Grahe, Rosanna E. Guadagno, Ewa Hałasa, Peter J.B. Hancock, Rias A. Hilliard, Joachim Hüffmeier, Sean Hughes, Katarzyna Idzikowska, Michael Inzlicht, Alan Jern, William Jiménez-Leal, Magnus Johannesson, Jennifer A. Joy-Gaba, Mathias Kauff, Danielle J. Kellier, Grecia Kessinger, Mallory C. Kidwell, Amanda M. Kimbrough, Josiah P.J. King, Vanessa S. Kolb, Sabina Kołodziej, Marton Kovacs, Karolina Krasuska, Sue Kraus, Lacy E. Krueger, Katarzyna Kuchno, Caio Ambrosio Lage, Eleanor V. Langford, Carmel A. Levitan, Tiago Jessé Souza de Lima, Hause Lin, Samuel Lins, Jia E. Loy, Dylan Manfredi, Łukasz Markiewicz, Madhavi Menon, Brett Mercier, Mitchell Metzger, Venus Meyet, Ailsa E. Millen, Jeremy K. Miller, Andres Montealegre, Don A. Moore, Rafał Muda, Gideon Nave, Austin Lee Nichols, Sarah A. Novak, Christian Nunnally, Ana Orlić, Anna Palinkas, Angelo Panno, Kimberly P. Parks, Ivana Pedović, Emilian Pękala, Matthew R. Penner, Sebastiaan Pessers, Boban Petrović, Thomas Pfeiffer, Damian Pieńkosz, Emanuele Preti, Danka Purić, Tiago Ramos, Jonathan Ravid, Timothy S. Razza, Katrin Rentzsch, Juliette Richetin, Sean C. Rife, Anna Dalla Rosa, Kaylis Hase Rudy, Janos Salamon, Blair Saunders, Przemysław Sawicki, Kathleen Schmidt, Kurt Schuepfer, Thomas Schultze, Stefan Schulz-Hardt, Astrid Schütz, Ani N. Shabazian, Rachel L. Shubella, Adam Siegel, Rúben Silva, Barbara Sioma, Lauren Skorb, Luana Elayne Cunha de Souza, Sara Steegen, L. A.R. Stein, R. Weylin Sternglanz, Darko Stojilović, Daniel Storage, Gavin Brent Sullivan, Barnabas Szaszi, Peter Szecsi, Orsolya Szöke, Attila Szuts, Manuela Thomae, Natasha D. Tidwell, Carly Tocco, Ann Kathrin Torka, Francis Tuerlinckx, Wolf Vanpaemel, Leigh Ann Vaughn, Michelangelo Vianello, Domenico Viganola, Maria Vlachou, Ryan J. Walker, Sophia C. Weissgerber, Aaron L. Wichman, Bradford J. Wiggins, Daniel Wolf, Michael J. Wood, David Zealley, Iris Žeželj, Mark Zrubka, Brian A. Nosek

University of Virginia
Stanford University
The University of Houston
Ashland University
Grand Valley State University
University of Edinburgh
Boston College
Université Grenoble Alpes
Institut Universitaire de France
University of Belgrade
Charles University
University of Prešov
ELTE Eötvös Loránd University
University of Basel
University of Genova
McDaniel College
University of Oregon
Saint Joseph's University
University of Novi Sad
Brown University
University of Rhode Island
University of Wroclaw
Nova Southeastern University
Queens College
Università degli Studi di Milano Bicocca
Harvard University
Michigan State University
FernUniversität Campus Hagen
Miami University
Loyola University Chicago
Coventry University
University of Stirling
Stockholm School of Economics
University of Innsbruck
Rochester Institute of Technology
University of Porto
Centre for Ecological Research
Virginia Commonwealth University
NYU, Manhattan Community College and Marymount Manhattan College
Pacific Lutheran University
Kozminski University
Rose-Hulman Institute of Technology
Sapienza University of Rome
Rotterdam School of Management
Maria Curie-Skłodowska University
TU Dortmund University
Ghent University
University of Toronto
Universidad de Los Andes, Colombia
Medical School Hamburg
University of Pennsylvania Perelman School of Medicine
Brigham Young University–Idaho
Social & Behavioral Science
The University of Texas at Dallas
Fort Lewis College
East Texas A&M University
Pontifical Catholic University of Rio de Janeiro
Occidental College
University of Brasilia
The Wharton School of the University of Pennsylvania
University of California - Irvine
Willamette University
Cornell University
Haas School of Business
Duy Tan University
Hofstra University
European University of Rome
University of Niš
Western Kentucky University
University of Leuven
Institute of Criminological and Sociological Research
Massey University
Psychologische Hochschule Berlin (PHB)
Murray State University
University of Padova
University of Dundee
Southern Illinois University Carbondale
University of Göttingen
Leibniz Science Campus Primate Cognition
University of Bamberg
Cultivate Labs
University of Fortaleza
Rhode Island Training School
University of Denver
MEU - Die Multiversität
Diploma University of Applied Sciences
Ithaca College
University of Kassel
University of Winchester
University of Amsterdam
Center for Open Science

Research output: Contribution to journal › Article › peer-review

Original language	English
Pages (from-to)	309-331
Number of pages	23
Journal	Advances in Methods and Practices in Psychological Science
Volume	3
Issue number	3
DOIs	https://doi.org/10.1177/2515245920958687
State	Published - Nov 13 2020

ASJC Scopus Subject Areas

General Psychology

Keywords

metascience
open data
peer review
preregistered
Registered Reports
replication
reproducibility

Access to Document

10.1177/2515245920958687

Cite this

Ebersole, C. R., Mathur, M. B., Baranski, E., Bart-Plange, D. J., Buttrick, N. R., Chartier, C. R., Corker, K. S., Corley, M., Hartshorne, J. K., IJzerman, H., Lazarević, L. B., Rabagliati, H., Ropovik, I., Aczel, B., Aeschbach, L. F., Andrighetto, L., Arnal, J. D., Arrow, H., Babincak, P., ... Nosek, B. A. (2020). Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability. Advances in Methods and Practices in Psychological Science, 3(3), 309-331. https://doi.org/10.1177/2515245920958687

Ebersole, CR, Mathur, MB, Baranski, E, Bart-Plange, DJ, Buttrick, NR, Chartier, CR, Corker, KS, Corley, M, Hartshorne, JK, IJzerman, H, Lazarević, LB, Rabagliati, H, Ropovik, I, Aczel, B, Aeschbach, LF, Andrighetto, L, Arnal, JD, Arrow, H, Babincak, P, Bakos, BE, Baník, G, Baskin, E, Belopavlović, R, Bernstein, MH, Białek, M, Bloxsom, NG, Bodroža, B, Bonfiglio, DBV, Boucher, L, Brühlmann, F, Brumbaugh, CC, Casini, E, Chen, Y, Chiorri, C, Chopik, WJ, Christ, O, Ciunci, AM, Claypool, HM, Coary, S, Čolić, MV, Collins, WM, Curran, PG, Day, CR, Dering, B, Dreber, A, Edlund, JE, Falcão, F, Fedor, A, Feinberg, L, Ferguson, IR, Ford, M, Frank, MC, Fryberger, E, Garinther, A, Gawryluk, K, Ashbaugh, K, Giacomantonio, M, Giessner, SR, Grahe, JE, Guadagno, RE, Hałasa, E, Hancock, PJB, Hilliard, RA, Hüffmeier, J, Hughes, S, Idzikowska, K, Inzlicht, M, Jern, A, Jiménez-Leal, W, Johannesson, M, Joy-Gaba, JA, Kauff, M, Kellier, DJ, Kessinger, G, Kidwell, MC, Kimbrough, AM, King, JPJ, Kolb, VS, Kołodziej, S, Kovacs, M, Krasuska, K, Kraus, S, Krueger, LE, Kuchno, K, Lage, CA, Langford, EV, Levitan, CA, de Lima, TJS, Lin, H, Lins, S, Loy, JE, Manfredi, D, Markiewicz, Ł, Menon, M, Mercier, B, Metzger, M, Meyet, V, Millen, AE, Miller, JK, Montealegre, A, Moore, DA, Muda, R, Nave, G, Nichols, AL, Novak, SA, Nunnally, C, Orlić, A, Palinkas, A, Panno, A, Parks, KP, Pedović, I, Pękala, E, Penner, MR, Pessers, S, Petrović, B, Pfeiffer, T, Pieńkosz, D, Preti, E, Purić, D, Ramos, T, Ravid, J, Razza, TS, Rentzsch, K, Richetin, J, Rife, SC, Rosa, AD, Rudy, KH, Salamon, J, Saunders, B, Sawicki, P, Schmidt, K, Schuepfer, K, Schultze, T, Schulz-Hardt, S, Schütz, A, Shabazian, AN, Shubella, RL, Siegel, A, Silva, R, Sioma, B, Skorb, L, de Souza, LEC, Steegen, S, Stein, LAR, Sternglanz, RW, Stojilović, D, Storage, D, Sullivan, GB, Szaszi, B, Szecsi, P, Szöke, O, Szuts, A, Thomae, M, Tidwell, ND, Tocco, C, Torka, AK, Tuerlinckx, F, Vanpaemel, W, Vaughn, LA, Vianello, M, Viganola, D, Vlachou, M, Walker, RJ, Weissgerber, SC, Wichman, AL, Wiggins, BJ, Wolf, D, Wood, MJ, Zealley, D, Žeželj, I, Zrubka, M & Nosek, BA 2020, 'Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability', Advances in Methods and Practices in Psychological Science, vol. 3, no. 3, pp. 309-331. https://doi.org/10.1177/2515245920958687

@article{9b352817b3494bb8a7b20b5b7ae0597e,

title = "Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability",

keywords = "metascience, open data, peer review, preregistered, Registered Reports, replication, reproducibility",

author = "Ebersole, \{Charles R.\} and Mathur, \{Maya B.\} and Erica Baranski and Bart-Plange, \{Diane Jo\} and Buttrick, \{Nicholas R.\} and Chartier, \{Christopher R.\} and Corker, \{Katherine S.\} and Martin Corley and Hartshorne, \{Joshua K.\} and Hans IJzerman and Lazarevi{\'c}, \{Ljiljana B.\} and Hugh Rabagliati and Ivan Ropovik and Balazs Aczel and Aeschbach, \{Lena F.\} and Luca Andrighetto and Arnal, \{Jack D.\} and Holly Arrow and Peter Babincak and Bakos, \{Bence E.\} and Gabriel Ban{\'i}k and Ernest Baskin and Radomir Belopavlovi{\'c} and Bernstein, \{Michael H.\} and Micha{\l} Bia{\l}ek and Bloxsom, \{Nicholas G.\} and Bojana Bodro{\v z}a and Bonfiglio, \{Diane B.V.\} and Leanne Boucher and Florian Br{\"u}hlmann and Brumbaugh, \{Claudia C.\} and Erica Casini and Yiling Chen and Carlo Chiorri and Chopik, \{William J.\} and Oliver Christ and Ciunci, \{Antonia M.\} and Claypool, \{Heather M.\} and Sean Coary and {\v C}oli{\'c}, \{Marija V.\} and Collins, \{W. Matthew\} and Curran, \{Paul G.\} and Day, \{Chris R.\} and Benjamin Dering and Anna Dreber and Edlund, \{John E.\} and Filipe Falc{\~a}o and Anna Fedor and Lily Feinberg and Ferguson, \{Ian R.\} and M{\'a}ire Ford and Frank, \{Michael C.\} and Emily Fryberger and Alexander Garinther and Katarzyna Gawryluk and Kayla Ashbaugh and Mauro Giacomantonio and Giessner, \{Steffen R.\} and Grahe, \{Jon E.\} and Guadagno, \{Rosanna E.\} and Ewa Ha{\l}asa and Hancock, \{Peter J.B.\} and Hilliard, \{Rias A.\} and Joachim H{\"u}ffmeier and Sean Hughes and Katarzyna Idzikowska and Michael Inzlicht and Alan Jern and William Jim{\'e}nez-Leal and Magnus Johannesson and Joy-Gaba, \{Jennifer A.\} and Mathias Kauff and Kellier, \{Danielle J.\} and Grecia Kessinger and Kidwell, \{Mallory C.\} and Kimbrough, \{Amanda M.\} and King, \{Josiah P.J.\} and Kolb, \{Vanessa S.\} and Sabina Ko{\l}odziej and Marton Kovacs and Karolina Krasuska and Sue Kraus and Krueger, \{Lacy E.\} and Katarzyna Kuchno and Lage, \{Caio Ambrosio\} and Langford, \{Eleanor V.\} and Levitan, \{Carmel A.\} and \{de Lima\}, \{Tiago Jess{\'e} Souza\} and Hause Lin and Samuel Lins and Loy, \{Jia E.\} and Dylan Manfredi and {\L}ukasz Markiewicz and Madhavi Menon and Brett Mercier and Mitchell Metzger and Venus Meyet and Millen, \{Ailsa E.\} and Miller, \{Jeremy K.\} and Andres Montealegre and Moore, \{Don A.\} and Rafa{\l} Muda and Gideon Nave and Nichols, \{Austin Lee\} and Novak, \{Sarah A.\} and Christian Nunnally and Ana Orli{\'c} and Anna Palinkas and Angelo Panno and Parks, \{Kimberly P.\} and Ivana Pedovi{\'c} and Emilian P{\c e}kala and Penner, \{Matthew R.\} and Sebastiaan Pessers and Boban Petrovi{\'c} and Thomas Pfeiffer and Damian Pie{\'n}kosz and Emanuele Preti and Danka Puri{\'c} and Tiago Ramos and Jonathan Ravid and Razza, \{Timothy S.\} and Katrin Rentzsch and Juliette Richetin and Rife, \{Sean C.\} and Rosa, \{Anna Dalla\} and Rudy, \{Kaylis Hase\} and Janos Salamon and Blair Saunders and Przemys{\l}aw Sawicki and Kathleen Schmidt and Kurt Schuepfer and Thomas Schultze and Stefan Schulz-Hardt and Astrid Sch{\"u}tz and Shabazian, \{Ani N.\} and Shubella, \{Rachel L.\} and Adam Siegel and R{\'u}ben Silva and Barbara Sioma and Lauren Skorb and \{de Souza\}, \{Luana Elayne Cunha\} and Sara Steegen and Stein, \{L. A.R.\} and Sternglanz, \{R. Weylin\} and Darko Stojilovi{\'c} and Daniel Storage and Sullivan, \{Gavin Brent\} and Barnabas Szaszi and Peter Szecsi and Orsolya Sz{\"o}ke and Attila Szuts and Manuela Thomae and Tidwell, \{Natasha D.\} and Carly Tocco and Torka, \{Ann Kathrin\} and Francis Tuerlinckx and Wolf Vanpaemel and Vaughn, \{Leigh Ann\} and Michelangelo Vianello and Domenico Viganola and Maria Vlachou and Walker, \{Ryan J.\} and Weissgerber, \{Sophia C.\} and Wichman, \{Aaron L.\} and Wiggins, \{Bradford J.\} and Daniel Wolf and Wood, \{Michael J.\} and David Zealley and Iris {\v Z}e{\v z}elj and Mark Zrubka and Nosek, \{Brian A.\}",

note = "Publisher Copyright: {\textcopyright} The Author(s) 2020.",

year = "2020",

month = nov,

day = "13",

doi = "10.1177/2515245920958687",

language = "English",

volume = "3",

pages = "309--331",

journal = "Advances in Methods and Practices in Psychological Science",

issn = "2515-2459",

publisher = "Sage Publications",

number = "3",

}

TY - JOUR

T1 - Many Labs 5

T2 - Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability

AU - Ebersole, Charles R.

AU - Mathur, Maya B.

AU - Baranski, Erica

AU - Bart-Plange, Diane Jo

AU - Buttrick, Nicholas R.

AU - Chartier, Christopher R.

AU - Corker, Katherine S.

AU - Corley, Martin

AU - Hartshorne, Joshua K.

AU - IJzerman, Hans

AU - Lazarević, Ljiljana B.

AU - Rabagliati, Hugh

AU - Ropovik, Ivan

AU - Aczel, Balazs

AU - Aeschbach, Lena F.

AU - Andrighetto, Luca

AU - Arnal, Jack D.

AU - Arrow, Holly

AU - Babincak, Peter

AU - Bakos, Bence E.

AU - Baník, Gabriel

AU - Baskin, Ernest

AU - Belopavlović, Radomir

AU - Bernstein, Michael H.

AU - Białek, Michał

AU - Bloxsom, Nicholas G.

AU - Bodroža, Bojana

AU - Bonfiglio, Diane B.V.

AU - Boucher, Leanne

AU - Brühlmann, Florian

AU - Brumbaugh, Claudia C.

AU - Casini, Erica

AU - Chen, Yiling

AU - Chiorri, Carlo

AU - Chopik, William J.

AU - Christ, Oliver

AU - Ciunci, Antonia M.

AU - Claypool, Heather M.

AU - Coary, Sean

AU - Čolić, Marija V.

AU - Collins, W. Matthew

AU - Curran, Paul G.

AU - Day, Chris R.

AU - Dering, Benjamin

AU - Dreber, Anna

AU - Edlund, John E.

AU - Falcão, Filipe

AU - Fedor, Anna

AU - Feinberg, Lily

AU - Ferguson, Ian R.

AU - Ford, Máire

AU - Frank, Michael C.

AU - Fryberger, Emily

AU - Garinther, Alexander

AU - Gawryluk, Katarzyna

AU - Ashbaugh, Kayla

AU - Giacomantonio, Mauro

AU - Giessner, Steffen R.

AU - Grahe, Jon E.

AU - Guadagno, Rosanna E.

AU - Hałasa, Ewa

AU - Hancock, Peter J.B.

AU - Hilliard, Rias A.

AU - Hüffmeier, Joachim

AU - Hughes, Sean

AU - Idzikowska, Katarzyna

AU - Inzlicht, Michael

AU - Jern, Alan

AU - Jiménez-Leal, William

AU - Johannesson, Magnus

AU - Joy-Gaba, Jennifer A.

AU - Kauff, Mathias

AU - Kellier, Danielle J.

AU - Kessinger, Grecia

AU - Kidwell, Mallory C.

AU - Kimbrough, Amanda M.

AU - King, Josiah P.J.

AU - Kolb, Vanessa S.

AU - Kołodziej, Sabina

AU - Kovacs, Marton

AU - Krasuska, Karolina

AU - Kraus, Sue

AU - Krueger, Lacy E.

AU - Kuchno, Katarzyna

AU - Lage, Caio Ambrosio

AU - Langford, Eleanor V.

AU - Levitan, Carmel A.

AU - de Lima, Tiago Jessé Souza

AU - Lin, Hause

AU - Lins, Samuel

AU - Loy, Jia E.

AU - Manfredi, Dylan

AU - Markiewicz, Łukasz

AU - Menon, Madhavi

AU - Mercier, Brett

AU - Metzger, Mitchell

AU - Meyet, Venus

AU - Millen, Ailsa E.

AU - Miller, Jeremy K.

AU - Montealegre, Andres

AU - Moore, Don A.

AU - Muda, Rafał

AU - Nave, Gideon

AU - Nichols, Austin Lee

AU - Novak, Sarah A.

AU - Nunnally, Christian

AU - Orlić, Ana

AU - Palinkas, Anna

AU - Panno, Angelo

AU - Parks, Kimberly P.

AU - Pedović, Ivana

AU - Pękala, Emilian

AU - Penner, Matthew R.

AU - Pessers, Sebastiaan

AU - Petrović, Boban

AU - Pfeiffer, Thomas

AU - Pieńkosz, Damian

AU - Preti, Emanuele

AU - Purić, Danka

AU - Ramos, Tiago

AU - Ravid, Jonathan

AU - Razza, Timothy S.

AU - Rentzsch, Katrin

AU - Richetin, Juliette

AU - Rife, Sean C.

AU - Rosa, Anna Dalla

AU - Rudy, Kaylis Hase

AU - Salamon, Janos

AU - Saunders, Blair

AU - Sawicki, Przemysław

AU - Schmidt, Kathleen

AU - Schuepfer, Kurt

AU - Schultze, Thomas

AU - Schulz-Hardt, Stefan

AU - Schütz, Astrid

AU - Shabazian, Ani N.

AU - Shubella, Rachel L.

AU - Siegel, Adam

AU - Silva, Rúben

AU - Sioma, Barbara

AU - Skorb, Lauren

AU - de Souza, Luana Elayne Cunha

AU - Steegen, Sara

AU - Stein, L. A.R.

AU - Sternglanz, R. Weylin

AU - Stojilović, Darko

AU - Storage, Daniel

AU - Sullivan, Gavin Brent

AU - Szaszi, Barnabas

AU - Szecsi, Peter

AU - Szöke, Orsolya

AU - Szuts, Attila

AU - Thomae, Manuela

AU - Tidwell, Natasha D.

AU - Tocco, Carly

AU - Torka, Ann Kathrin

AU - Tuerlinckx, Francis

AU - Vanpaemel, Wolf

AU - Vaughn, Leigh Ann

AU - Vianello, Michelangelo

AU - Viganola, Domenico

AU - Vlachou, Maria

AU - Walker, Ryan J.

AU - Weissgerber, Sophia C.

AU - Wichman, Aaron L.

AU - Wiggins, Bradford J.

AU - Wolf, Daniel

AU - Wood, Michael J.

AU - Zealley, David

AU - Žeželj, Iris

AU - Zrubka, Mark

AU - Nosek, Brian A.

PY - 2020/11/13

Y1 - 2020/11/13

KW - metascience

KW - open data

KW - peer review

KW - preregistered

KW - Registered Reports

KW - replication

KW - reproducibility

UR - https://www.scopus.com/pages/publications/85096661669

UR - https://www.scopus.com/pages/publications/85096661669#tab=citedBy

U2 - 10.1177/2515245920958687

DO - 10.1177/2515245920958687

M3 - Article

AN - SCOPUS:85096661669

SN - 2515-2459

VL - 3

SP - 309

EP - 331

JO - Advances in Methods and Practices in Psychological Science

JF - Advances in Methods and Practices in Psychological Science

IS - 3

ER -

Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability

ASJC Scopus Subject Areas

Keywords

Access to Document

Other files and links

Cite this