Theory building through replication response to commentaries on the "Many labs" replication project

Richard A. Klein; Kate A. Ratliff; Michelangelo Vianello; Reginald B., Jr. Adams; Stepan Bahnik; Michael J. Bernstein; Konrad Bocian; Mark J. Brandt; Beach Brooks; Claudia Chloe Brumbaugh; Zeynep Cemalcilar; Jesse Chandler; Winnee Cheong; William E. Davis; Thierry Devos; Matthew Eisner; Natalia Frankowska; David Furrow; Elisa Maria Galliani; Fred Hasselman; Joshua A. Hicks; James F. Hovermale; S. Jane Hunt; Jeffrey R. Huntsinger; Hans Ijzerman; Melissa-Sue John; Jennifer A. Joy-Gaba; Heather Barry Kappes; Lacy E. Krueger; Jaime Kurtz; Carmel A. Levitan; Robyn K. Mallett; Wendy L. Morris; Anthony J. Nelson; Jason A. Nier; Grant Packard; Ronaldo Pilati; Abraham M. Rutchick; Kathleen Schmidt; Jeanine L. Skorinko; Robert Smith; Troy G. Steiner; Justin Storbeck; Lyn M. Van Swol; Donna Thompson; A. E. van 't Veer; Leigh Ann Vaughn; Marek Vranka; Aaron L. Wichman; Julie A. Woodzicka; Brian A. Nosek

doi:10.1027/1864-9335/a000202

Theory building through replication response to commentaries on the "Many labs" replication project

Richard A. Klein, Kate A. Ratliff, Michelangelo Vianello, Reginald B., Jr. Adams, Stepan Bahnik, Michael J. Bernstein, Konrad Bocian, Mark J. Brandt, Beach Brooks, Claudia Chloe Brumbaugh, Zeynep Cemalcilar, Jesse Chandler, Winnee Cheong, William E. Davis, Thierry Devos, Matthew Eisner, Natalia Frankowska, David Furrow, Elisa Maria Galliani, Fred HasselmanJoshua A. Hicks, James F. Hovermale, S. Jane Hunt, Jeffrey R. Huntsinger, Hans Ijzerman, Melissa-Sue John, Jennifer A. Joy-Gaba, Heather Barry Kappes, Lacy E. Krueger, Jaime Kurtz, Carmel A. Levitan, Robyn K. Mallett, Wendy L. Morris, Anthony J. Nelson, Jason A. Nier, Grant Packard, Ronaldo Pilati, Abraham M. Rutchick, Kathleen Schmidt, Jeanine L. Skorinko, Robert Smith, Troy G. Steiner, Justin Storbeck, Lyn M. Van Swol, Donna Thompson, A. E. van 't Veer, Leigh Ann Vaughn, Marek Vranka, Aaron L. Wichman, Julie A. Woodzicka, Brian A. Nosek

Department of Social Psychology

Research output: Contribution to journal › Article › Scientific › peer-review

Abstract

Responds to the comments made by Monin and Oppenheimer (see record 2014-37961-001), Ferguson et al. (see record 2014-38072-001), Crisp et al. (see record 2014-38072-002), and Schwarz & Strack (see record 2014-38072-003) on the current authors original article (see record 2014-20922-002). The current authors thank the commentators for their productive discussion of the Many Labs project. They entirely agree with the main theme across the commentaries: direct replication does not guarantee that the same effect was tested. As noted by Nosek and Lakens (2014, p. 137), ‘‘direct replication is the attempt to duplicate the conditions and procedure that existing theory and evidence anticipate as necessary for obtaining the effect.’’ Attempting to do so does not guarantee success, but it does provide substantial opportunity for theoretical development building on empirical evidence.

Original language	English
Pages (from-to)	307-310
Journal	Social Psychology
Volume	45
Issue number	4
DOIs	https://doi.org/10.1027/1864-9335/a000202
Publication status	Published - 2014

Cite this

Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B. . J., Bahnik, S., Bernstein, M. J., ... Nosek, B. A. (2014). Theory building through replication response to commentaries on the "Many labs" replication project. Social Psychology, 45(4), 307-310. https://doi.org/10.1027/1864-9335/a000202

Klein, Richard A. ; Ratliff, Kate A. ; Vianello, Michelangelo ; Adams, Reginald B., Jr. ; Bahnik, Stepan ; Bernstein, Michael J. ; Bocian, Konrad ; Brandt, Mark J. ; Brooks, Beach ; Brumbaugh, Claudia Chloe ; Cemalcilar, Zeynep ; Chandler, Jesse ; Cheong, Winnee ; Davis, William E. ; Devos, Thierry ; Eisner, Matthew ; Frankowska, Natalia ; Furrow, David ; Galliani, Elisa Maria ; Hasselman, Fred ; Hicks, Joshua A. ; Hovermale, James F. ; Hunt, S. Jane ; Huntsinger, Jeffrey R. ; Ijzerman, Hans ; John, Melissa-Sue ; Joy-Gaba, Jennifer A. ; Kappes, Heather Barry ; Krueger, Lacy E. ; Kurtz, Jaime ; Levitan, Carmel A. ; Mallett, Robyn K. ; Morris, Wendy L. ; Nelson, Anthony J. ; Nier, Jason A. ; Packard, Grant ; Pilati, Ronaldo ; Rutchick, Abraham M. ; Schmidt, Kathleen ; Skorinko, Jeanine L. ; Smith, Robert ; Steiner, Troy G. ; Storbeck, Justin ; Van Swol, Lyn M. ; Thompson, Donna ; van 't Veer, A. E. ; Vaughn, Leigh Ann ; Vranka, Marek ; Wichman, Aaron L. ; Woodzicka, Julie A. ; Nosek, Brian A. / Theory building through replication response to commentaries on the "Many labs" replication project. In: Social Psychology. 2014 ; Vol. 45, No. 4. pp. 307-310.

@article{6f94a2ed102943508b208255084ab715,

title = "Theory building through replication response to commentaries on the {"}Many labs{"} replication project",

abstract = "Responds to the comments made by Monin and Oppenheimer (see record 2014-37961-001), Ferguson et al. (see record 2014-38072-001), Crisp et al. (see record 2014-38072-002), and Schwarz & Strack (see record 2014-38072-003) on the current authors original article (see record 2014-20922-002). The current authors thank the commentators for their productive discussion of the Many Labs project. They entirely agree with the main theme across the commentaries: direct replication does not guarantee that the same effect was tested. As noted by Nosek and Lakens (2014, p. 137), ‘‘direct replication is the attempt to duplicate the conditions and procedure that existing theory and evidence anticipate as necessary for obtaining the effect.’’ Attempting to do so does not guarantee success, but it does provide substantial opportunity for theoretical development building on empirical evidence.",

author = "Klein, {Richard A.} and Ratliff, {Kate A.} and Michelangelo Vianello and Adams, {Reginald B., Jr.} and Stepan Bahnik and Bernstein, {Michael J.} and Konrad Bocian and Brandt, {Mark J.} and Beach Brooks and Brumbaugh, {Claudia Chloe} and Zeynep Cemalcilar and Jesse Chandler and Winnee Cheong and Davis, {William E.} and Thierry Devos and Matthew Eisner and Natalia Frankowska and David Furrow and Galliani, {Elisa Maria} and Fred Hasselman and Hicks, {Joshua A.} and Hovermale, {James F.} and Hunt, {S. Jane} and Huntsinger, {Jeffrey R.} and Hans Ijzerman and Melissa-Sue John and Joy-Gaba, {Jennifer A.} and Kappes, {Heather Barry} and Krueger, {Lacy E.} and Jaime Kurtz and Levitan, {Carmel A.} and Mallett, {Robyn K.} and Morris, {Wendy L.} and Nelson, {Anthony J.} and Nier, {Jason A.} and Grant Packard and Ronaldo Pilati and Rutchick, {Abraham M.} and Kathleen Schmidt and Skorinko, {Jeanine L.} and Robert Smith and Steiner, {Troy G.} and Justin Storbeck and {Van Swol}, {Lyn M.} and Donna Thompson and {van 't Veer}, {A. E.} and Vaughn, {Leigh Ann} and Marek Vranka and Wichman, {Aaron L.} and Woodzicka, {Julie A.} and Nosek, {Brian A.}",

year = "2014",

doi = "10.1027/1864-9335/a000202",

language = "English",

volume = "45",

pages = "307--310",

journal = "Social Psychology",

issn = "1864-9335",

publisher = "Hogrefe & Huber Publishers",

number = "4",

}

Klein, RA, Ratliff, KA, Vianello, M, Adams, RBJ, Bahnik, S, Bernstein, MJ, Bocian, K, Brandt, MJ, Brooks, B, Brumbaugh, CC, Cemalcilar, Z, Chandler, J, Cheong, W, Davis, WE, Devos, T, Eisner, M, Frankowska, N, Furrow, D, Galliani, EM, Hasselman, F, Hicks, JA, Hovermale, JF, Hunt, SJ, Huntsinger, JR, Ijzerman, H, John, M-S, Joy-Gaba, JA, Kappes, HB, Krueger, LE, Kurtz, J, Levitan, CA, Mallett, RK, Morris, WL, Nelson, AJ, Nier, JA, Packard, G, Pilati, R, Rutchick, AM, Schmidt, K, Skorinko, JL, Smith, R, Steiner, TG, Storbeck, J, Van Swol, LM, Thompson, D, van 't Veer, AE, Vaughn, LA, Vranka, M, Wichman, AL, Woodzicka, JA & Nosek, BA 2014, 'Theory building through replication response to commentaries on the "Many labs" replication project', Social Psychology, vol. 45, no. 4, pp. 307-310. https://doi.org/10.1027/1864-9335/a000202

Theory building through replication response to commentaries on the "Many labs" replication project. / Klein, Richard A.; Ratliff, Kate A.; Vianello, Michelangelo; Adams, Reginald B., Jr.; Bahnik, Stepan; Bernstein, Michael J.; Bocian, Konrad; Brandt, Mark J.; Brooks, Beach; Brumbaugh, Claudia Chloe; Cemalcilar, Zeynep; Chandler, Jesse; Cheong, Winnee; Davis, William E.; Devos, Thierry; Eisner, Matthew; Frankowska, Natalia; Furrow, David; Galliani, Elisa Maria; Hasselman, Fred; Hicks, Joshua A.; Hovermale, James F.; Hunt, S. Jane; Huntsinger, Jeffrey R.; Ijzerman, Hans; John, Melissa-Sue; Joy-Gaba, Jennifer A.; Kappes, Heather Barry; Krueger, Lacy E.; Kurtz, Jaime; Levitan, Carmel A.; Mallett, Robyn K.; Morris, Wendy L.; Nelson, Anthony J.; Nier, Jason A.; Packard, Grant; Pilati, Ronaldo; Rutchick, Abraham M.; Schmidt, Kathleen; Skorinko, Jeanine L.; Smith, Robert; Steiner, Troy G.; Storbeck, Justin; Van Swol, Lyn M.; Thompson, Donna; van 't Veer, A. E.; Vaughn, Leigh Ann; Vranka, Marek; Wichman, Aaron L.; Woodzicka, Julie A.; Nosek, Brian A.

In: Social Psychology, Vol. 45, No. 4, 2014, p. 307-310.

Research output: Contribution to journal › Article › Scientific › peer-review

TY - JOUR

T1 - Theory building through replication response to commentaries on the "Many labs" replication project

AU - Klein, Richard A.

AU - Ratliff, Kate A.

AU - Vianello, Michelangelo

AU - Adams, Reginald B., Jr.

AU - Bahnik, Stepan

AU - Bernstein, Michael J.

AU - Bocian, Konrad

AU - Brandt, Mark J.

AU - Brooks, Beach

AU - Brumbaugh, Claudia Chloe

AU - Cemalcilar, Zeynep

AU - Chandler, Jesse

AU - Cheong, Winnee

AU - Davis, William E.

AU - Devos, Thierry

AU - Eisner, Matthew

AU - Frankowska, Natalia

AU - Furrow, David

AU - Galliani, Elisa Maria

AU - Hasselman, Fred

AU - Hicks, Joshua A.

AU - Hovermale, James F.

AU - Hunt, S. Jane

AU - Huntsinger, Jeffrey R.

AU - Ijzerman, Hans

AU - John, Melissa-Sue

AU - Joy-Gaba, Jennifer A.

AU - Kappes, Heather Barry

AU - Krueger, Lacy E.

AU - Kurtz, Jaime

AU - Levitan, Carmel A.

AU - Mallett, Robyn K.

AU - Morris, Wendy L.

AU - Nelson, Anthony J.

AU - Nier, Jason A.

AU - Packard, Grant

AU - Pilati, Ronaldo

AU - Rutchick, Abraham M.

AU - Schmidt, Kathleen

AU - Skorinko, Jeanine L.

AU - Smith, Robert

AU - Steiner, Troy G.

AU - Storbeck, Justin

AU - Van Swol, Lyn M.

AU - Thompson, Donna

AU - van 't Veer, A. E.

AU - Vaughn, Leigh Ann

AU - Vranka, Marek

AU - Wichman, Aaron L.

AU - Woodzicka, Julie A.

AU - Nosek, Brian A.

PY - 2014

Y1 - 2014

N2 - Responds to the comments made by Monin and Oppenheimer (see record 2014-37961-001), Ferguson et al. (see record 2014-38072-001), Crisp et al. (see record 2014-38072-002), and Schwarz & Strack (see record 2014-38072-003) on the current authors original article (see record 2014-20922-002). The current authors thank the commentators for their productive discussion of the Many Labs project. They entirely agree with the main theme across the commentaries: direct replication does not guarantee that the same effect was tested. As noted by Nosek and Lakens (2014, p. 137), ‘‘direct replication is the attempt to duplicate the conditions and procedure that existing theory and evidence anticipate as necessary for obtaining the effect.’’ Attempting to do so does not guarantee success, but it does provide substantial opportunity for theoretical development building on empirical evidence.

AB - Responds to the comments made by Monin and Oppenheimer (see record 2014-37961-001), Ferguson et al. (see record 2014-38072-001), Crisp et al. (see record 2014-38072-002), and Schwarz & Strack (see record 2014-38072-003) on the current authors original article (see record 2014-20922-002). The current authors thank the commentators for their productive discussion of the Many Labs project. They entirely agree with the main theme across the commentaries: direct replication does not guarantee that the same effect was tested. As noted by Nosek and Lakens (2014, p. 137), ‘‘direct replication is the attempt to duplicate the conditions and procedure that existing theory and evidence anticipate as necessary for obtaining the effect.’’ Attempting to do so does not guarantee success, but it does provide substantial opportunity for theoretical development building on empirical evidence.

U2 - 10.1027/1864-9335/a000202

DO - 10.1027/1864-9335/a000202

M3 - Article

VL - 45

SP - 307

EP - 310

JO - Social Psychology

JF - Social Psychology

SN - 1864-9335

IS - 4

ER -

Access to Document

10.1027/1864-9335/a000202