Estimating the Reproducibility of Experimental Philosophy

Florian Cova*, Brent Strickland, Angela Abatista, Aurélien Allard, James Andow, Mario Attie, James Beebe, Renatas Berniūnas, Jordane Boudesseul, Matteo Colombo, Fiery Cushman, Rodrigo Diaz, Noah N’Djaye Nikolai van Dongen, Vilius Dranseika, Brian D. Earp, Antonio Gaitán Torres, Ivar Hannikainen, José V. Hernández-Conde, Wenjia Hu, François JaquetKareem Khalifa, Hanna Kim, Markus Kneer, Joshua Knobe, Miklos Kurthy, Anthony Lantian, Shen yi Liao, Edouard Machery, Tania Moerenhout, Christian Mott, Mark Phelan, Jonathan Phillips, Navin Rambharose, Kevin Reuter, Felipe Romero, Paulo Sousa, Emile Thalabard, Kevin Tobia, Hugo Viciana, Daniel Wilkenfeld, Xiang Zhou

*Corresponding author for this work

    Research output: Contribution to journalArticleScientificpeer-review

    89 Citations (Scopus)

    Abstract

    Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project (XRP) to estimate the reproducibility of experimental philosophy (osf.io/dvkpr). Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, we enlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward.

    Original languageEnglish
    Pages (from-to)9-44
    Number of pages36
    JournalReview of Philosophy and Psychology
    Volume12
    Issue number1
    DOIs
    Publication statusPublished - Mar 2021

    Keywords

    • Experimental philosophy.

    Fingerprint

    Dive into the research topics of 'Estimating the Reproducibility of Experimental Philosophy'. Together they form a unique fingerprint.

    Cite this