Registered replication report: Rand, Greene, and Nowak (2012)

S. Bouwmeester, P. P. J. L. Verkoeijen, B. Aczel, F. Barbosa, L. Bègue, P. Brañas-garza, T. G. H. Chmura, G. Cornelissen, F. S. Døssing, A. M. Espín, A.M. Evans, F. Ferreira-santos, S. Fiedler, J. Flegr, M. Ghaffari, A. Glöckner, T. Goeschl, L. Guo, O. P. Hauser, R. Hernan-gonzalez & 36 others A. Herrero, Z. Horne, P. Houdek, M. Johannesson, L. Koppel, P. Kujal, T. Laine, J. Lohse, E. C. Martins, C. Mauro, D. Mischkowski, S. Mukherjee, K. O. R. Myrseth, D. Navarro-martínez, T. M. S. Neal, J. Novakova, R. Pagà, T. O. Paiva, B. Palfi, M. Piovesan, R.M. Rahal, E. Salomon, N. Srinivasan, A. Srivastava, B. Szaszi, A. Szollosi, K. Ø. Thor, G. Tinghög, J. S. Trueblood, J. J. Van Bavel, A. E. Van ‘t Veer, D. Västfjäll, M. Warner, E. Wengström, J. Wills, C. E. Wollbrant

Research output: Contribution to journalArticleScientificpeer-review

Abstract

In an anonymous 4-person economic game, participants contributed more money to a common project (i.e., cooperated) when required to decide quickly than when forced to delay their decision (Rand, Greene & Nowak, 2012), a pattern consistent with the social heuristics hypothesis proposed by Rand and colleagues. The results of studies using time pressure have been mixed, with some replication attempts observing similar patterns (e.g., Rand et al., 2014) and others observing null effects (e.g., Tinghög et al., 2013; Verkoeijen & Bouwmeester, 2014). This Registered Replication Report (RRR) assessed the size and variability of the effect of time pressure on cooperative decisions by combining 21 separate, preregistered replications of the critical conditions from Study 7 of the original article (Rand et al., 2012). The primary planned analysis used data from all participants who were randomly assigned to conditions and who met the protocol inclusion criteria (an intent-to-treat approach that included the 65.9% of participants in the time-pressure condition and 7.5% in the forced-delay condition who did not adhere to the time constraints), and we observed a difference in contributions of −0.37 percentage points compared with an 8.6 percentage point difference calculated from the original data. Analyzing the data as the original article did, including data only for participants who complied with the time constraints, the RRR observed a 10.37 percentage point difference in contributions compared with a 15.31 percentage point difference in the original study. In combination, the results of the intent-to-treat analysis and the compliant-only analysis are consistent with the presence of selection biases and the absence of a causal effect of time pressure on cooperation.
Original languageEnglish
Pages (from-to)527-542
JournalPerspectives on Psychological Science
Volume12
Issue number3
DOIs
Publication statusPublished - 2017

Fingerprint

Selection Bias

Cite this

Bouwmeester, S., Verkoeijen, P. P. J. L., Aczel, B., Barbosa, F., Bègue, L., Brañas-garza, P., ... Wollbrant, C. E. (2017). Registered replication report: Rand, Greene, and Nowak (2012). Perspectives on Psychological Science, 12(3), 527-542. https://doi.org/10.1177/1745691617693624
Bouwmeester, S. ; Verkoeijen, P. P. J. L. ; Aczel, B. ; Barbosa, F. ; Bègue, L. ; Brañas-garza, P. ; Chmura, T. G. H. ; Cornelissen, G. ; Døssing, F. S. ; Espín, A. M. ; Evans, A.M. ; Ferreira-santos, F. ; Fiedler, S. ; Flegr, J. ; Ghaffari, M. ; Glöckner, A. ; Goeschl, T. ; Guo, L. ; Hauser, O. P. ; Hernan-gonzalez, R. ; Herrero, A. ; Horne, Z. ; Houdek, P. ; Johannesson, M. ; Koppel, L. ; Kujal, P. ; Laine, T. ; Lohse, J. ; Martins, E. C. ; Mauro, C. ; Mischkowski, D. ; Mukherjee, S. ; Myrseth, K. O. R. ; Navarro-martínez, D. ; Neal, T. M. S. ; Novakova, J. ; Pagà, R. ; Paiva, T. O. ; Palfi, B. ; Piovesan, M. ; Rahal, R.M. ; Salomon, E. ; Srinivasan, N. ; Srivastava, A. ; Szaszi, B. ; Szollosi, A. ; Thor, K. Ø. ; Tinghög, G. ; Trueblood, J. S. ; Van Bavel, J. J. ; Van ‘t Veer, A. E. ; Västfjäll, D. ; Warner, M. ; Wengström, E. ; Wills, J. ; Wollbrant, C. E. / Registered replication report : Rand, Greene, and Nowak (2012). In: Perspectives on Psychological Science. 2017 ; Vol. 12, No. 3. pp. 527-542.
@article{83ab317f54ff45749fbe8dc3dd8ccc8c,
title = "Registered replication report: Rand, Greene, and Nowak (2012)",
abstract = "In an anonymous 4-person economic game, participants contributed more money to a common project (i.e., cooperated) when required to decide quickly than when forced to delay their decision (Rand, Greene & Nowak, 2012), a pattern consistent with the social heuristics hypothesis proposed by Rand and colleagues. The results of studies using time pressure have been mixed, with some replication attempts observing similar patterns (e.g., Rand et al., 2014) and others observing null effects (e.g., Tingh{\"o}g et al., 2013; Verkoeijen & Bouwmeester, 2014). This Registered Replication Report (RRR) assessed the size and variability of the effect of time pressure on cooperative decisions by combining 21 separate, preregistered replications of the critical conditions from Study 7 of the original article (Rand et al., 2012). The primary planned analysis used data from all participants who were randomly assigned to conditions and who met the protocol inclusion criteria (an intent-to-treat approach that included the 65.9{\%} of participants in the time-pressure condition and 7.5{\%} in the forced-delay condition who did not adhere to the time constraints), and we observed a difference in contributions of −0.37 percentage points compared with an 8.6 percentage point difference calculated from the original data. Analyzing the data as the original article did, including data only for participants who complied with the time constraints, the RRR observed a 10.37 percentage point difference in contributions compared with a 15.31 percentage point difference in the original study. In combination, the results of the intent-to-treat analysis and the compliant-only analysis are consistent with the presence of selection biases and the absence of a causal effect of time pressure on cooperation.",
author = "S. Bouwmeester and Verkoeijen, {P. P. J. L.} and B. Aczel and F. Barbosa and L. B{\`e}gue and P. Bra{\~n}as-garza and Chmura, {T. G. H.} and G. Cornelissen and D{\o}ssing, {F. S.} and Esp{\'i}n, {A. M.} and A.M. Evans and F. Ferreira-santos and S. Fiedler and J. Flegr and M. Ghaffari and A. Gl{\"o}ckner and T. Goeschl and L. Guo and Hauser, {O. P.} and R. Hernan-gonzalez and A. Herrero and Z. Horne and P. Houdek and M. Johannesson and L. Koppel and P. Kujal and T. Laine and J. Lohse and Martins, {E. C.} and C. Mauro and D. Mischkowski and S. Mukherjee and Myrseth, {K. O. R.} and D. Navarro-mart{\'i}nez and Neal, {T. M. S.} and J. Novakova and R. Pag{\`a} and Paiva, {T. O.} and B. Palfi and M. Piovesan and R.M. Rahal and E. Salomon and N. Srinivasan and A. Srivastava and B. Szaszi and A. Szollosi and Thor, {K. {\O}.} and G. Tingh{\"o}g and Trueblood, {J. S.} and {Van Bavel}, {J. J.} and {Van ‘t Veer}, {A. E.} and D. V{\"a}stfj{\"a}ll and M. Warner and E. Wengstr{\"o}m and J. Wills and Wollbrant, {C. E.}",
year = "2017",
doi = "10.1177/1745691617693624",
language = "English",
volume = "12",
pages = "527--542",
journal = "Perspectives on Psychological Science",
issn = "1745-6916",
publisher = "SAGE Publications Inc.",
number = "3",

}

Bouwmeester, S, Verkoeijen, PPJL, Aczel, B, Barbosa, F, Bègue, L, Brañas-garza, P, Chmura, TGH, Cornelissen, G, Døssing, FS, Espín, AM, Evans, AM, Ferreira-santos, F, Fiedler, S, Flegr, J, Ghaffari, M, Glöckner, A, Goeschl, T, Guo, L, Hauser, OP, Hernan-gonzalez, R, Herrero, A, Horne, Z, Houdek, P, Johannesson, M, Koppel, L, Kujal, P, Laine, T, Lohse, J, Martins, EC, Mauro, C, Mischkowski, D, Mukherjee, S, Myrseth, KOR, Navarro-martínez, D, Neal, TMS, Novakova, J, Pagà, R, Paiva, TO, Palfi, B, Piovesan, M, Rahal, RM, Salomon, E, Srinivasan, N, Srivastava, A, Szaszi, B, Szollosi, A, Thor, KØ, Tinghög, G, Trueblood, JS, Van Bavel, JJ, Van ‘t Veer, AE, Västfjäll, D, Warner, M, Wengström, E, Wills, J & Wollbrant, CE 2017, 'Registered replication report: Rand, Greene, and Nowak (2012)' Perspectives on Psychological Science, vol. 12, no. 3, pp. 527-542. https://doi.org/10.1177/1745691617693624

Registered replication report : Rand, Greene, and Nowak (2012). / Bouwmeester, S.; Verkoeijen, P. P. J. L.; Aczel, B.; Barbosa, F.; Bègue, L.; Brañas-garza, P.; Chmura, T. G. H.; Cornelissen, G.; Døssing, F. S.; Espín, A. M.; Evans, A.M.; Ferreira-santos, F.; Fiedler, S.; Flegr, J.; Ghaffari, M.; Glöckner, A.; Goeschl, T.; Guo, L.; Hauser, O. P.; Hernan-gonzalez, R.; Herrero, A.; Horne, Z.; Houdek, P.; Johannesson, M.; Koppel, L.; Kujal, P.; Laine, T.; Lohse, J.; Martins, E. C.; Mauro, C.; Mischkowski, D.; Mukherjee, S.; Myrseth, K. O. R.; Navarro-martínez, D.; Neal, T. M. S.; Novakova, J.; Pagà, R.; Paiva, T. O.; Palfi, B.; Piovesan, M.; Rahal, R.M.; Salomon, E.; Srinivasan, N.; Srivastava, A.; Szaszi, B.; Szollosi, A.; Thor, K. Ø.; Tinghög, G.; Trueblood, J. S.; Van Bavel, J. J.; Van ‘t Veer, A. E.; Västfjäll, D.; Warner, M.; Wengström, E.; Wills, J.; Wollbrant, C. E.

In: Perspectives on Psychological Science, Vol. 12, No. 3, 2017, p. 527-542.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Registered replication report

T2 - Rand, Greene, and Nowak (2012)

AU - Bouwmeester, S.

AU - Verkoeijen, P. P. J. L.

AU - Aczel, B.

AU - Barbosa, F.

AU - Bègue, L.

AU - Brañas-garza, P.

AU - Chmura, T. G. H.

AU - Cornelissen, G.

AU - Døssing, F. S.

AU - Espín, A. M.

AU - Evans, A.M.

AU - Ferreira-santos, F.

AU - Fiedler, S.

AU - Flegr, J.

AU - Ghaffari, M.

AU - Glöckner, A.

AU - Goeschl, T.

AU - Guo, L.

AU - Hauser, O. P.

AU - Hernan-gonzalez, R.

AU - Herrero, A.

AU - Horne, Z.

AU - Houdek, P.

AU - Johannesson, M.

AU - Koppel, L.

AU - Kujal, P.

AU - Laine, T.

AU - Lohse, J.

AU - Martins, E. C.

AU - Mauro, C.

AU - Mischkowski, D.

AU - Mukherjee, S.

AU - Myrseth, K. O. R.

AU - Navarro-martínez, D.

AU - Neal, T. M. S.

AU - Novakova, J.

AU - Pagà, R.

AU - Paiva, T. O.

AU - Palfi, B.

AU - Piovesan, M.

AU - Rahal, R.M.

AU - Salomon, E.

AU - Srinivasan, N.

AU - Srivastava, A.

AU - Szaszi, B.

AU - Szollosi, A.

AU - Thor, K. Ø.

AU - Tinghög, G.

AU - Trueblood, J. S.

AU - Van Bavel, J. J.

AU - Van ‘t Veer, A. E.

AU - Västfjäll, D.

AU - Warner, M.

AU - Wengström, E.

AU - Wills, J.

AU - Wollbrant, C. E.

PY - 2017

Y1 - 2017

N2 - In an anonymous 4-person economic game, participants contributed more money to a common project (i.e., cooperated) when required to decide quickly than when forced to delay their decision (Rand, Greene & Nowak, 2012), a pattern consistent with the social heuristics hypothesis proposed by Rand and colleagues. The results of studies using time pressure have been mixed, with some replication attempts observing similar patterns (e.g., Rand et al., 2014) and others observing null effects (e.g., Tinghög et al., 2013; Verkoeijen & Bouwmeester, 2014). This Registered Replication Report (RRR) assessed the size and variability of the effect of time pressure on cooperative decisions by combining 21 separate, preregistered replications of the critical conditions from Study 7 of the original article (Rand et al., 2012). The primary planned analysis used data from all participants who were randomly assigned to conditions and who met the protocol inclusion criteria (an intent-to-treat approach that included the 65.9% of participants in the time-pressure condition and 7.5% in the forced-delay condition who did not adhere to the time constraints), and we observed a difference in contributions of −0.37 percentage points compared with an 8.6 percentage point difference calculated from the original data. Analyzing the data as the original article did, including data only for participants who complied with the time constraints, the RRR observed a 10.37 percentage point difference in contributions compared with a 15.31 percentage point difference in the original study. In combination, the results of the intent-to-treat analysis and the compliant-only analysis are consistent with the presence of selection biases and the absence of a causal effect of time pressure on cooperation.

AB - In an anonymous 4-person economic game, participants contributed more money to a common project (i.e., cooperated) when required to decide quickly than when forced to delay their decision (Rand, Greene & Nowak, 2012), a pattern consistent with the social heuristics hypothesis proposed by Rand and colleagues. The results of studies using time pressure have been mixed, with some replication attempts observing similar patterns (e.g., Rand et al., 2014) and others observing null effects (e.g., Tinghög et al., 2013; Verkoeijen & Bouwmeester, 2014). This Registered Replication Report (RRR) assessed the size and variability of the effect of time pressure on cooperative decisions by combining 21 separate, preregistered replications of the critical conditions from Study 7 of the original article (Rand et al., 2012). The primary planned analysis used data from all participants who were randomly assigned to conditions and who met the protocol inclusion criteria (an intent-to-treat approach that included the 65.9% of participants in the time-pressure condition and 7.5% in the forced-delay condition who did not adhere to the time constraints), and we observed a difference in contributions of −0.37 percentage points compared with an 8.6 percentage point difference calculated from the original data. Analyzing the data as the original article did, including data only for participants who complied with the time constraints, the RRR observed a 10.37 percentage point difference in contributions compared with a 15.31 percentage point difference in the original study. In combination, the results of the intent-to-treat analysis and the compliant-only analysis are consistent with the presence of selection biases and the absence of a causal effect of time pressure on cooperation.

U2 - 10.1177/1745691617693624

DO - 10.1177/1745691617693624

M3 - Article

VL - 12

SP - 527

EP - 542

JO - Perspectives on Psychological Science

JF - Perspectives on Psychological Science

SN - 1745-6916

IS - 3

ER -

Bouwmeester S, Verkoeijen PPJL, Aczel B, Barbosa F, Bègue L, Brañas-garza P et al. Registered replication report: Rand, Greene, and Nowak (2012). Perspectives on Psychological Science. 2017;12(3):527-542. https://doi.org/10.1177/1745691617693624