Uncovering noisy social signals

Using optimization methods from experimental physics to study social phenomena

M.C. Kaptein, Robin Van Emden, Davide Iannuzzi

Research output: Contribution to journalArticleScientificpeer-review

22 Downloads (Pure)

Abstract

Due to the ubiquitous presence of treatment heterogeneity, measurement error, and contextual confounders, numerous social phenomena are hard to study. Precise control of treatment variables and possible confounders is often key to the success of studies in the social sciences, yet often proves out of the realm of control of the experimenter. To amend this situation we propose a novel approach coined "lock-in feedback" which is based on a method that is routinely used in high-precision physics experiments to extract small signals out of a noisy environment. Here, we adapt the method to noisy social signals in multiple dimensions and evaluate it by studying an inherently noisy topic: the perception of (subjective) beauty. We show that the lock-in feedback approach allows one to select optimal treatment levels despite the presence of considerable noise. Furthermore, through the introduction of an external contextual shock we demonstrate that we can find relationships between noisy variables that were hitherto unknown. We therefore argue that lock-in methods may provide a valuable addition to the social scientist's experimental toolbox and we explicitly discuss a number of future applications.

Original languageEnglish
Article numbere0174182
JournalPLoS ONE
Volume12
Issue number3
DOIs
Publication statusPublished - 17 Mar 2017

Keywords

  • OPTIMAL EXPERIMENTAL-DESIGN
  • DISCRIMINATION
  • HYPOTHESIS

Cite this

@article{04d20d4a51684c9cafe3ecf49356225b,
title = "Uncovering noisy social signals: Using optimization methods from experimental physics to study social phenomena",
abstract = "Due to the ubiquitous presence of treatment heterogeneity, measurement error, and contextual confounders, numerous social phenomena are hard to study. Precise control of treatment variables and possible confounders is often key to the success of studies in the social sciences, yet often proves out of the realm of control of the experimenter. To amend this situation we propose a novel approach coined {"}lock-in feedback{"} which is based on a method that is routinely used in high-precision physics experiments to extract small signals out of a noisy environment. Here, we adapt the method to noisy social signals in multiple dimensions and evaluate it by studying an inherently noisy topic: the perception of (subjective) beauty. We show that the lock-in feedback approach allows one to select optimal treatment levels despite the presence of considerable noise. Furthermore, through the introduction of an external contextual shock we demonstrate that we can find relationships between noisy variables that were hitherto unknown. We therefore argue that lock-in methods may provide a valuable addition to the social scientist's experimental toolbox and we explicitly discuss a number of future applications.",
keywords = "OPTIMAL EXPERIMENTAL-DESIGN, DISCRIMINATION, HYPOTHESIS",
author = "M.C. Kaptein and {Van Emden}, Robin and Davide Iannuzzi",
year = "2017",
month = "3",
day = "17",
doi = "10.1371/journal.pone.0174182",
language = "English",
volume = "12",
journal = "PLoS ONE",
issn = "1932-6203",
publisher = "PUBLIC LIBRARY SCIENCE",
number = "3",

}

Uncovering noisy social signals : Using optimization methods from experimental physics to study social phenomena. / Kaptein, M.C.; Van Emden, Robin; Iannuzzi, Davide.

In: PLoS ONE, Vol. 12, No. 3, e0174182, 17.03.2017.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Uncovering noisy social signals

T2 - Using optimization methods from experimental physics to study social phenomena

AU - Kaptein, M.C.

AU - Van Emden, Robin

AU - Iannuzzi, Davide

PY - 2017/3/17

Y1 - 2017/3/17

N2 - Due to the ubiquitous presence of treatment heterogeneity, measurement error, and contextual confounders, numerous social phenomena are hard to study. Precise control of treatment variables and possible confounders is often key to the success of studies in the social sciences, yet often proves out of the realm of control of the experimenter. To amend this situation we propose a novel approach coined "lock-in feedback" which is based on a method that is routinely used in high-precision physics experiments to extract small signals out of a noisy environment. Here, we adapt the method to noisy social signals in multiple dimensions and evaluate it by studying an inherently noisy topic: the perception of (subjective) beauty. We show that the lock-in feedback approach allows one to select optimal treatment levels despite the presence of considerable noise. Furthermore, through the introduction of an external contextual shock we demonstrate that we can find relationships between noisy variables that were hitherto unknown. We therefore argue that lock-in methods may provide a valuable addition to the social scientist's experimental toolbox and we explicitly discuss a number of future applications.

AB - Due to the ubiquitous presence of treatment heterogeneity, measurement error, and contextual confounders, numerous social phenomena are hard to study. Precise control of treatment variables and possible confounders is often key to the success of studies in the social sciences, yet often proves out of the realm of control of the experimenter. To amend this situation we propose a novel approach coined "lock-in feedback" which is based on a method that is routinely used in high-precision physics experiments to extract small signals out of a noisy environment. Here, we adapt the method to noisy social signals in multiple dimensions and evaluate it by studying an inherently noisy topic: the perception of (subjective) beauty. We show that the lock-in feedback approach allows one to select optimal treatment levels despite the presence of considerable noise. Furthermore, through the introduction of an external contextual shock we demonstrate that we can find relationships between noisy variables that were hitherto unknown. We therefore argue that lock-in methods may provide a valuable addition to the social scientist's experimental toolbox and we explicitly discuss a number of future applications.

KW - OPTIMAL EXPERIMENTAL-DESIGN

KW - DISCRIMINATION

KW - HYPOTHESIS

U2 - 10.1371/journal.pone.0174182

DO - 10.1371/journal.pone.0174182

M3 - Article

VL - 12

JO - PLoS ONE

JF - PLoS ONE

SN - 1932-6203

IS - 3

M1 - e0174182

ER -