Statistical reporting inconsistencies in experimental philosophy

Matteo Colombo, Georgi Duev, M.B. Nuijten, Jan Sprenger*

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

12 Downloads (Pure)

Abstract

Experimental philosophy (x-phi) is a young field of research in the intersection of philosophy and psychology. It aims to make progress on philosophical questions by using experimental methods traditionally associated with the psychological and behavioral sciences, such as null hypothesis significance testing (NHST). Motivated by recent discussions about a methodological crisis in the behavioral sciences, questions have been raised about the methodological standards of x-phi. Here, we focus on one aspect of this question, namely the rate of inconsistencies in statistical reporting. Previous research has examined the extent to which published articles in psychology and other behavioral sciences present statistical inconsistencies in reporting the results of NHST. In this study, we used the R package statcheck to detect statistical inconsistencies in x-phi, and compared rates of inconsistencies in psychology and philosophy. We found that rates of inconsistencies in x-phi are lower than in the psychological and behavioral sciences. From the point of view of statistical reporting consistency, x-phi seems to do no worse, and perhaps even better, than psychological science.

Original languageEnglish
Article numbere0194360
JournalPLoS ONE
Volume13
Issue number4
DOIs
Publication statusPublished - 2018

Keywords

  • Behavioral Sciences
  • Humans
  • Models, Statistical
  • Motivation
  • Philosophy
  • Psychology/methods
  • Reference Standards
  • Reproducibility of Results
  • Research Design
  • Social Sciences
  • Software
  • Statistics as Topic

Cite this

@article{075f5696ae1a4aae9e17c0a5f8f99061,
title = "Statistical reporting inconsistencies in experimental philosophy",
abstract = "Experimental philosophy (x-phi) is a young field of research in the intersection of philosophy and psychology. It aims to make progress on philosophical questions by using experimental methods traditionally associated with the psychological and behavioral sciences, such as null hypothesis significance testing (NHST). Motivated by recent discussions about a methodological crisis in the behavioral sciences, questions have been raised about the methodological standards of x-phi. Here, we focus on one aspect of this question, namely the rate of inconsistencies in statistical reporting. Previous research has examined the extent to which published articles in psychology and other behavioral sciences present statistical inconsistencies in reporting the results of NHST. In this study, we used the R package statcheck to detect statistical inconsistencies in x-phi, and compared rates of inconsistencies in psychology and philosophy. We found that rates of inconsistencies in x-phi are lower than in the psychological and behavioral sciences. From the point of view of statistical reporting consistency, x-phi seems to do no worse, and perhaps even better, than psychological science.",
keywords = "Behavioral Sciences, Humans, Models, Statistical, Motivation, Philosophy, Psychology/methods, Reference Standards, Reproducibility of Results, Research Design, Social Sciences, Software, Statistics as Topic",
author = "Matteo Colombo and Georgi Duev and M.B. Nuijten and Jan Sprenger",
year = "2018",
doi = "10.1371/journal.pone.0194360",
language = "English",
volume = "13",
journal = "PLoS ONE",
issn = "1932-6203",
publisher = "PUBLIC LIBRARY SCIENCE",
number = "4",

}

Statistical reporting inconsistencies in experimental philosophy. / Colombo, Matteo; Duev, Georgi; Nuijten, M.B.; Sprenger, Jan.

In: PLoS ONE, Vol. 13, No. 4, e0194360, 2018.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Statistical reporting inconsistencies in experimental philosophy

AU - Colombo, Matteo

AU - Duev, Georgi

AU - Nuijten, M.B.

AU - Sprenger, Jan

PY - 2018

Y1 - 2018

N2 - Experimental philosophy (x-phi) is a young field of research in the intersection of philosophy and psychology. It aims to make progress on philosophical questions by using experimental methods traditionally associated with the psychological and behavioral sciences, such as null hypothesis significance testing (NHST). Motivated by recent discussions about a methodological crisis in the behavioral sciences, questions have been raised about the methodological standards of x-phi. Here, we focus on one aspect of this question, namely the rate of inconsistencies in statistical reporting. Previous research has examined the extent to which published articles in psychology and other behavioral sciences present statistical inconsistencies in reporting the results of NHST. In this study, we used the R package statcheck to detect statistical inconsistencies in x-phi, and compared rates of inconsistencies in psychology and philosophy. We found that rates of inconsistencies in x-phi are lower than in the psychological and behavioral sciences. From the point of view of statistical reporting consistency, x-phi seems to do no worse, and perhaps even better, than psychological science.

AB - Experimental philosophy (x-phi) is a young field of research in the intersection of philosophy and psychology. It aims to make progress on philosophical questions by using experimental methods traditionally associated with the psychological and behavioral sciences, such as null hypothesis significance testing (NHST). Motivated by recent discussions about a methodological crisis in the behavioral sciences, questions have been raised about the methodological standards of x-phi. Here, we focus on one aspect of this question, namely the rate of inconsistencies in statistical reporting. Previous research has examined the extent to which published articles in psychology and other behavioral sciences present statistical inconsistencies in reporting the results of NHST. In this study, we used the R package statcheck to detect statistical inconsistencies in x-phi, and compared rates of inconsistencies in psychology and philosophy. We found that rates of inconsistencies in x-phi are lower than in the psychological and behavioral sciences. From the point of view of statistical reporting consistency, x-phi seems to do no worse, and perhaps even better, than psychological science.

KW - Behavioral Sciences

KW - Humans

KW - Models, Statistical

KW - Motivation

KW - Philosophy

KW - Psychology/methods

KW - Reference Standards

KW - Reproducibility of Results

KW - Research Design

KW - Social Sciences

KW - Software

KW - Statistics as Topic

U2 - 10.1371/journal.pone.0194360

DO - 10.1371/journal.pone.0194360

M3 - Article

VL - 13

JO - PLoS ONE

JF - PLoS ONE

SN - 1932-6203

IS - 4

M1 - e0194360

ER -