The Psychological Science Accelerator: Advancing psychology through a distributed collaborative network

Hannah Moshontz, Lorne Campbell, Charles R. Ebersole, Hans Ijzerman, Heather L. Urry, Patrick S. Forscher, Jon E. Grahe, Randy J. Mccarthy, Erica D. Musser, Jan Antfolk, Christopher M. Castille, Thomas Rhys Evans, Susann Fiedler, Jessica Kay Flake, Diego A. Forero, Steve M. J. Janssen, Justin Robert Keene, John Protzko, Balazs Aczel, Sara Álvarez Solas & 77 others Daniel Ansari, Dana Awlia, Ernest Baskin, Carlota Batres, Martha Lucia Borras-guevara, Cameron Brick, Priyanka Chandel, Armand Chatard, William J. Chopik, David Clarance, Nicholas A. Coles, Katherine S. Corker, Barnaby James Wyld Dixson, Vilius Dranseika, Yarrow Dunham, Nicholas W. Fox, Gwendolyn Gardiner, S. Mason Garrison, Tripat Gill, Amanda C. Hahn, Bastian Jaeger, Pavol Kačmár, Gwenaël Kaminski, Philipp Kanske, Zoltan Kekecs, Melissa Kline, Monica A. Koehn, Pratibha Kujur, Carmel A. Levitan, Jeremy K. Miller, Ceylan Okan, Jerome Olsen, Oscar Oviedo-trespalacios, Asil Ali Özdoğru, Babita Pande, Arti Parganiha, Noorshama Parveen, Gerit Pfuhl, Sraddha Pradhan, Ivan Ropovik, Nicholas O. Rule, Blair Saunders, Vidar Schei, Kathleen Schmidt, Margaret Messiah Singh, Miroslav Sirota, Crystal N. Steltenpohl, Stefan Stieger, Daniel Storage, Gavin Brent Sullivan, Anna Szabelska, Christian K. Tamnes, Miguel A. Vadillo, Jaroslava V. Valentova, Wolf Vanpaemel, Marco A. C. Varella, Evie Vergauwe, Mark Verschoor, Michelangelo Vianello, Martin Voracek, Glenn P. Williams, John Paul Wilson, Janis H. Zickfeld, Jack D. Arnal, Burak Aydin, Sau-chin Chen, Lisa M. Debruine, Ana Maria Fernandez, Kai T. Horstmann, Peder M. Isager, Benedict Jones, Aycan Kapucu, Hause Lin, Michael C. Mensink, Gorka Navarrete, Miguel A. Silan, Christopher R. Chartier

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Concerns about the veracity of psychological research have been growing. Many findings in psychological science are based on studies with insufficient statistical power and nonrepresentative samples, or may otherwise be limited to specific, ungeneralizable settings or populations. Crowdsourced research, a type of large-scale collaboration in which one or more research projects are conducted across multiple lab sites, offers a pragmatic solution to these and other
current methodological challenges. The Psychological Science Accelerator (PSA) is a distributed network of laboratories designed to enable and support crowdsourced research projects. These projects can focus on novel research questions or replicate prior research in large, diverse samples. The PSA’s mission is to accelerate the accumulation of reliable and generalizable evidence in psychological science. Here, we describe the background, structure, principles, procedures, benefits, and challenges of the PSA. In contrast to other crowdsourced research networks, the PSA is ongoing (as opposed to time limited), efficient (in that structures and principles are reused for different projects), decentralized, diverse (in both subjects and researchers), and inclusive (of proposals, contributions, and other relevant input from anyone inside or outside the network). The PSA and other approaches to crowdsourced psychological science will advance understanding of mental processes and behaviors by enabling rigorous research and systematic examination of its generalizability.
Original languageEnglish
Pages (from-to)501–515
JournalAdvances in Methods and Practices in Psychological Science
Volume1
Issue number4
DOIs
Publication statusPublished - 2018

Cite this

Moshontz, H., Campbell, L., Ebersole, C. R., Ijzerman, H., Urry, H. L., Forscher, P. S., ... Chartier, C. R. (2018). The Psychological Science Accelerator: Advancing psychology through a distributed collaborative network. Advances in Methods and Practices in Psychological Science, 1(4), 501–515. https://doi.org/10.1177/2515245918797607
Moshontz, Hannah ; Campbell, Lorne ; Ebersole, Charles R. ; Ijzerman, Hans ; Urry, Heather L. ; Forscher, Patrick S. ; Grahe, Jon E. ; Mccarthy, Randy J. ; Musser, Erica D. ; Antfolk, Jan ; Castille, Christopher M. ; Evans, Thomas Rhys ; Fiedler, Susann ; Flake, Jessica Kay ; Forero, Diego A. ; Janssen, Steve M. J. ; Keene, Justin Robert ; Protzko, John ; Aczel, Balazs ; Álvarez Solas, Sara ; Ansari, Daniel ; Awlia, Dana ; Baskin, Ernest ; Batres, Carlota ; Borras-guevara, Martha Lucia ; Brick, Cameron ; Chandel, Priyanka ; Chatard, Armand ; Chopik, William J. ; Clarance, David ; Coles, Nicholas A. ; Corker, Katherine S. ; Dixson, Barnaby James Wyld ; Dranseika, Vilius ; Dunham, Yarrow ; Fox, Nicholas W. ; Gardiner, Gwendolyn ; Garrison, S. Mason ; Gill, Tripat ; Hahn, Amanda C. ; Jaeger, Bastian ; Kačmár, Pavol ; Kaminski, Gwenaël ; Kanske, Philipp ; Kekecs, Zoltan ; Kline, Melissa ; Koehn, Monica A. ; Kujur, Pratibha ; Levitan, Carmel A. ; Miller, Jeremy K. ; Okan, Ceylan ; Olsen, Jerome ; Oviedo-trespalacios, Oscar ; Özdoğru, Asil Ali ; Pande, Babita ; Parganiha, Arti ; Parveen, Noorshama ; Pfuhl, Gerit ; Pradhan, Sraddha ; Ropovik, Ivan ; Rule, Nicholas O. ; Saunders, Blair ; Schei, Vidar ; Schmidt, Kathleen ; Singh, Margaret Messiah ; Sirota, Miroslav ; Steltenpohl, Crystal N. ; Stieger, Stefan ; Storage, Daniel ; Sullivan, Gavin Brent ; Szabelska, Anna ; Tamnes, Christian K. ; Vadillo, Miguel A. ; Valentova, Jaroslava V. ; Vanpaemel, Wolf ; Varella, Marco A. C. ; Vergauwe, Evie ; Verschoor, Mark ; Vianello, Michelangelo ; Voracek, Martin ; Williams, Glenn P. ; Wilson, John Paul ; Zickfeld, Janis H. ; Arnal, Jack D. ; Aydin, Burak ; Chen, Sau-chin ; Debruine, Lisa M. ; Fernandez, Ana Maria ; Horstmann, Kai T. ; Isager, Peder M. ; Jones, Benedict ; Kapucu, Aycan ; Lin, Hause ; Mensink, Michael C. ; Navarrete, Gorka ; Silan, Miguel A. ; Chartier, Christopher R. / The Psychological Science Accelerator : Advancing psychology through a distributed collaborative network. In: Advances in Methods and Practices in Psychological Science. 2018 ; Vol. 1, No. 4. pp. 501–515.
@article{de7bf4d3fa2f4b729c1b6d757a79c88e,
title = "The Psychological Science Accelerator: Advancing psychology through a distributed collaborative network",
abstract = "Concerns about the veracity of psychological research have been growing. Many findings in psychological science are based on studies with insufficient statistical power and nonrepresentative samples, or may otherwise be limited to specific, ungeneralizable settings or populations. Crowdsourced research, a type of large-scale collaboration in which one or more research projects are conducted across multiple lab sites, offers a pragmatic solution to these and othercurrent methodological challenges. The Psychological Science Accelerator (PSA) is a distributed network of laboratories designed to enable and support crowdsourced research projects. These projects can focus on novel research questions or replicate prior research in large, diverse samples. The PSA’s mission is to accelerate the accumulation of reliable and generalizable evidence in psychological science. Here, we describe the background, structure, principles, procedures, benefits, and challenges of the PSA. In contrast to other crowdsourced research networks, the PSA is ongoing (as opposed to time limited), efficient (in that structures and principles are reused for different projects), decentralized, diverse (in both subjects and researchers), and inclusive (of proposals, contributions, and other relevant input from anyone inside or outside the network). The PSA and other approaches to crowdsourced psychological science will advance understanding of mental processes and behaviors by enabling rigorous research and systematic examination of its generalizability.",
author = "Hannah Moshontz and Lorne Campbell and Ebersole, {Charles R.} and Hans Ijzerman and Urry, {Heather L.} and Forscher, {Patrick S.} and Grahe, {Jon E.} and Mccarthy, {Randy J.} and Musser, {Erica D.} and Jan Antfolk and Castille, {Christopher M.} and Evans, {Thomas Rhys} and Susann Fiedler and Flake, {Jessica Kay} and Forero, {Diego A.} and Janssen, {Steve M. J.} and Keene, {Justin Robert} and John Protzko and Balazs Aczel and {{\'A}lvarez Solas}, Sara and Daniel Ansari and Dana Awlia and Ernest Baskin and Carlota Batres and Borras-guevara, {Martha Lucia} and Cameron Brick and Priyanka Chandel and Armand Chatard and Chopik, {William J.} and David Clarance and Coles, {Nicholas A.} and Corker, {Katherine S.} and Dixson, {Barnaby James Wyld} and Vilius Dranseika and Yarrow Dunham and Fox, {Nicholas W.} and Gwendolyn Gardiner and Garrison, {S. Mason} and Tripat Gill and Hahn, {Amanda C.} and Bastian Jaeger and Pavol Kačm{\'a}r and Gwena{\"e}l Kaminski and Philipp Kanske and Zoltan Kekecs and Melissa Kline and Koehn, {Monica A.} and Pratibha Kujur and Levitan, {Carmel A.} and Miller, {Jeremy K.} and Ceylan Okan and Jerome Olsen and Oscar Oviedo-trespalacios and {\"O}zdoğru, {Asil Ali} and Babita Pande and Arti Parganiha and Noorshama Parveen and Gerit Pfuhl and Sraddha Pradhan and Ivan Ropovik and Rule, {Nicholas O.} and Blair Saunders and Vidar Schei and Kathleen Schmidt and Singh, {Margaret Messiah} and Miroslav Sirota and Steltenpohl, {Crystal N.} and Stefan Stieger and Daniel Storage and Sullivan, {Gavin Brent} and Anna Szabelska and Tamnes, {Christian K.} and Vadillo, {Miguel A.} and Valentova, {Jaroslava V.} and Wolf Vanpaemel and Varella, {Marco A. C.} and Evie Vergauwe and Mark Verschoor and Michelangelo Vianello and Martin Voracek and Williams, {Glenn P.} and Wilson, {John Paul} and Zickfeld, {Janis H.} and Arnal, {Jack D.} and Burak Aydin and Sau-chin Chen and Debruine, {Lisa M.} and Fernandez, {Ana Maria} and Horstmann, {Kai T.} and Isager, {Peder M.} and Benedict Jones and Aycan Kapucu and Hause Lin and Mensink, {Michael C.} and Gorka Navarrete and Silan, {Miguel A.} and Chartier, {Christopher R.}",
year = "2018",
doi = "10.1177/2515245918797607",
language = "English",
volume = "1",
pages = "501–515",
journal = "Advances in Methods and Practices in Psychological Science",
issn = "2515-2459",
number = "4",

}

Moshontz, H, Campbell, L, Ebersole, CR, Ijzerman, H, Urry, HL, Forscher, PS, Grahe, JE, Mccarthy, RJ, Musser, ED, Antfolk, J, Castille, CM, Evans, TR, Fiedler, S, Flake, JK, Forero, DA, Janssen, SMJ, Keene, JR, Protzko, J, Aczel, B, Álvarez Solas, S, Ansari, D, Awlia, D, Baskin, E, Batres, C, Borras-guevara, ML, Brick, C, Chandel, P, Chatard, A, Chopik, WJ, Clarance, D, Coles, NA, Corker, KS, Dixson, BJW, Dranseika, V, Dunham, Y, Fox, NW, Gardiner, G, Garrison, SM, Gill, T, Hahn, AC, Jaeger, B, Kačmár, P, Kaminski, G, Kanske, P, Kekecs, Z, Kline, M, Koehn, MA, Kujur, P, Levitan, CA, Miller, JK, Okan, C, Olsen, J, Oviedo-trespalacios, O, Özdoğru, AA, Pande, B, Parganiha, A, Parveen, N, Pfuhl, G, Pradhan, S, Ropovik, I, Rule, NO, Saunders, B, Schei, V, Schmidt, K, Singh, MM, Sirota, M, Steltenpohl, CN, Stieger, S, Storage, D, Sullivan, GB, Szabelska, A, Tamnes, CK, Vadillo, MA, Valentova, JV, Vanpaemel, W, Varella, MAC, Vergauwe, E, Verschoor, M, Vianello, M, Voracek, M, Williams, GP, Wilson, JP, Zickfeld, JH, Arnal, JD, Aydin, B, Chen, S, Debruine, LM, Fernandez, AM, Horstmann, KT, Isager, PM, Jones, B, Kapucu, A, Lin, H, Mensink, MC, Navarrete, G, Silan, MA & Chartier, CR 2018, 'The Psychological Science Accelerator: Advancing psychology through a distributed collaborative network' Advances in Methods and Practices in Psychological Science, vol. 1, no. 4, pp. 501–515. https://doi.org/10.1177/2515245918797607

The Psychological Science Accelerator : Advancing psychology through a distributed collaborative network. / Moshontz, Hannah; Campbell, Lorne; Ebersole, Charles R.; Ijzerman, Hans; Urry, Heather L.; Forscher, Patrick S.; Grahe, Jon E.; Mccarthy, Randy J.; Musser, Erica D.; Antfolk, Jan; Castille, Christopher M.; Evans, Thomas Rhys; Fiedler, Susann; Flake, Jessica Kay; Forero, Diego A.; Janssen, Steve M. J.; Keene, Justin Robert; Protzko, John; Aczel, Balazs; Álvarez Solas, Sara; Ansari, Daniel; Awlia, Dana; Baskin, Ernest; Batres, Carlota; Borras-guevara, Martha Lucia; Brick, Cameron; Chandel, Priyanka; Chatard, Armand; Chopik, William J.; Clarance, David; Coles, Nicholas A.; Corker, Katherine S.; Dixson, Barnaby James Wyld; Dranseika, Vilius; Dunham, Yarrow; Fox, Nicholas W.; Gardiner, Gwendolyn; Garrison, S. Mason; Gill, Tripat; Hahn, Amanda C.; Jaeger, Bastian; Kačmár, Pavol; Kaminski, Gwenaël; Kanske, Philipp; Kekecs, Zoltan; Kline, Melissa; Koehn, Monica A.; Kujur, Pratibha; Levitan, Carmel A.; Miller, Jeremy K.; Okan, Ceylan; Olsen, Jerome; Oviedo-trespalacios, Oscar; Özdoğru, Asil Ali; Pande, Babita; Parganiha, Arti; Parveen, Noorshama; Pfuhl, Gerit; Pradhan, Sraddha; Ropovik, Ivan; Rule, Nicholas O.; Saunders, Blair; Schei, Vidar; Schmidt, Kathleen; Singh, Margaret Messiah; Sirota, Miroslav; Steltenpohl, Crystal N.; Stieger, Stefan; Storage, Daniel; Sullivan, Gavin Brent; Szabelska, Anna; Tamnes, Christian K.; Vadillo, Miguel A.; Valentova, Jaroslava V.; Vanpaemel, Wolf; Varella, Marco A. C.; Vergauwe, Evie; Verschoor, Mark; Vianello, Michelangelo; Voracek, Martin; Williams, Glenn P.; Wilson, John Paul; Zickfeld, Janis H.; Arnal, Jack D.; Aydin, Burak; Chen, Sau-chin; Debruine, Lisa M.; Fernandez, Ana Maria; Horstmann, Kai T.; Isager, Peder M.; Jones, Benedict; Kapucu, Aycan; Lin, Hause; Mensink, Michael C.; Navarrete, Gorka; Silan, Miguel A.; Chartier, Christopher R.

In: Advances in Methods and Practices in Psychological Science, Vol. 1, No. 4, 2018, p. 501–515.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - The Psychological Science Accelerator

T2 - Advancing psychology through a distributed collaborative network

AU - Moshontz, Hannah

AU - Campbell, Lorne

AU - Ebersole, Charles R.

AU - Ijzerman, Hans

AU - Urry, Heather L.

AU - Forscher, Patrick S.

AU - Grahe, Jon E.

AU - Mccarthy, Randy J.

AU - Musser, Erica D.

AU - Antfolk, Jan

AU - Castille, Christopher M.

AU - Evans, Thomas Rhys

AU - Fiedler, Susann

AU - Flake, Jessica Kay

AU - Forero, Diego A.

AU - Janssen, Steve M. J.

AU - Keene, Justin Robert

AU - Protzko, John

AU - Aczel, Balazs

AU - Álvarez Solas, Sara

AU - Ansari, Daniel

AU - Awlia, Dana

AU - Baskin, Ernest

AU - Batres, Carlota

AU - Borras-guevara, Martha Lucia

AU - Brick, Cameron

AU - Chandel, Priyanka

AU - Chatard, Armand

AU - Chopik, William J.

AU - Clarance, David

AU - Coles, Nicholas A.

AU - Corker, Katherine S.

AU - Dixson, Barnaby James Wyld

AU - Dranseika, Vilius

AU - Dunham, Yarrow

AU - Fox, Nicholas W.

AU - Gardiner, Gwendolyn

AU - Garrison, S. Mason

AU - Gill, Tripat

AU - Hahn, Amanda C.

AU - Jaeger, Bastian

AU - Kačmár, Pavol

AU - Kaminski, Gwenaël

AU - Kanske, Philipp

AU - Kekecs, Zoltan

AU - Kline, Melissa

AU - Koehn, Monica A.

AU - Kujur, Pratibha

AU - Levitan, Carmel A.

AU - Miller, Jeremy K.

AU - Okan, Ceylan

AU - Olsen, Jerome

AU - Oviedo-trespalacios, Oscar

AU - Özdoğru, Asil Ali

AU - Pande, Babita

AU - Parganiha, Arti

AU - Parveen, Noorshama

AU - Pfuhl, Gerit

AU - Pradhan, Sraddha

AU - Ropovik, Ivan

AU - Rule, Nicholas O.

AU - Saunders, Blair

AU - Schei, Vidar

AU - Schmidt, Kathleen

AU - Singh, Margaret Messiah

AU - Sirota, Miroslav

AU - Steltenpohl, Crystal N.

AU - Stieger, Stefan

AU - Storage, Daniel

AU - Sullivan, Gavin Brent

AU - Szabelska, Anna

AU - Tamnes, Christian K.

AU - Vadillo, Miguel A.

AU - Valentova, Jaroslava V.

AU - Vanpaemel, Wolf

AU - Varella, Marco A. C.

AU - Vergauwe, Evie

AU - Verschoor, Mark

AU - Vianello, Michelangelo

AU - Voracek, Martin

AU - Williams, Glenn P.

AU - Wilson, John Paul

AU - Zickfeld, Janis H.

AU - Arnal, Jack D.

AU - Aydin, Burak

AU - Chen, Sau-chin

AU - Debruine, Lisa M.

AU - Fernandez, Ana Maria

AU - Horstmann, Kai T.

AU - Isager, Peder M.

AU - Jones, Benedict

AU - Kapucu, Aycan

AU - Lin, Hause

AU - Mensink, Michael C.

AU - Navarrete, Gorka

AU - Silan, Miguel A.

AU - Chartier, Christopher R.

PY - 2018

Y1 - 2018

N2 - Concerns about the veracity of psychological research have been growing. Many findings in psychological science are based on studies with insufficient statistical power and nonrepresentative samples, or may otherwise be limited to specific, ungeneralizable settings or populations. Crowdsourced research, a type of large-scale collaboration in which one or more research projects are conducted across multiple lab sites, offers a pragmatic solution to these and othercurrent methodological challenges. The Psychological Science Accelerator (PSA) is a distributed network of laboratories designed to enable and support crowdsourced research projects. These projects can focus on novel research questions or replicate prior research in large, diverse samples. The PSA’s mission is to accelerate the accumulation of reliable and generalizable evidence in psychological science. Here, we describe the background, structure, principles, procedures, benefits, and challenges of the PSA. In contrast to other crowdsourced research networks, the PSA is ongoing (as opposed to time limited), efficient (in that structures and principles are reused for different projects), decentralized, diverse (in both subjects and researchers), and inclusive (of proposals, contributions, and other relevant input from anyone inside or outside the network). The PSA and other approaches to crowdsourced psychological science will advance understanding of mental processes and behaviors by enabling rigorous research and systematic examination of its generalizability.

AB - Concerns about the veracity of psychological research have been growing. Many findings in psychological science are based on studies with insufficient statistical power and nonrepresentative samples, or may otherwise be limited to specific, ungeneralizable settings or populations. Crowdsourced research, a type of large-scale collaboration in which one or more research projects are conducted across multiple lab sites, offers a pragmatic solution to these and othercurrent methodological challenges. The Psychological Science Accelerator (PSA) is a distributed network of laboratories designed to enable and support crowdsourced research projects. These projects can focus on novel research questions or replicate prior research in large, diverse samples. The PSA’s mission is to accelerate the accumulation of reliable and generalizable evidence in psychological science. Here, we describe the background, structure, principles, procedures, benefits, and challenges of the PSA. In contrast to other crowdsourced research networks, the PSA is ongoing (as opposed to time limited), efficient (in that structures and principles are reused for different projects), decentralized, diverse (in both subjects and researchers), and inclusive (of proposals, contributions, and other relevant input from anyone inside or outside the network). The PSA and other approaches to crowdsourced psychological science will advance understanding of mental processes and behaviors by enabling rigorous research and systematic examination of its generalizability.

U2 - 10.1177/2515245918797607

DO - 10.1177/2515245918797607

M3 - Article

VL - 1

SP - 501

EP - 515

JO - Advances in Methods and Practices in Psychological Science

JF - Advances in Methods and Practices in Psychological Science

SN - 2515-2459

IS - 4

ER -