A computational feedforward model predicts categorization of masked emotional body language for longer, but not for shorter, latencies

B.M.C. Stienen, K. Schindler, B. de Gelder

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Given the presence of massive feedback loops in brain networks, it is difficult to disentangle the contribution of feedforward and feedback processing to the recognition of visual stimuli, in this case, of emotional body expressions. The aim of the work presented in this letter is to shed light on how well feedforward processing explains rapid categorization of this important class of stimuli. By means of parametric masking, it may be possible to control the contribution of feedback activity in human participants. A close comparison is presented between human recognition performance and the performance of a computational neural model that exclusively modeled feedforward processing and was engineered to fulfill the computational requirements of recognition. Results show that the longer the stimulus onset asynchrony (SOA), the closer the performance of the human participants was to the values predicted by the model, with an optimum at an SOA of 100 ms. At short SOA latencies, human performance deteriorated, but the categorization of the emotional expressions was still above baseline. The data suggest that, although theoretically, feedback arising from inferotemporal cortex is likely to be blocked when the SOA is 100 ms, human participants still seem to rely on more local visual feedback processing to equal the model's performance.
Original languageEnglish
Pages (from-to)1806-1821
JournalNeural Computation
Volume24
Issue number7
DOIs
Publication statusPublished - 2012

Fingerprint

Kinesics
Sensory Feedback
Human Activities
Body Language
Computational Model
Stimulus
Emotion
Latency
Onset

Cite this

@article{52d13b0ef8314aaf9fdeb381a4abf345,
title = "A computational feedforward model predicts categorization of masked emotional body language for longer, but not for shorter, latencies",
abstract = "Given the presence of massive feedback loops in brain networks, it is difficult to disentangle the contribution of feedforward and feedback processing to the recognition of visual stimuli, in this case, of emotional body expressions. The aim of the work presented in this letter is to shed light on how well feedforward processing explains rapid categorization of this important class of stimuli. By means of parametric masking, it may be possible to control the contribution of feedback activity in human participants. A close comparison is presented between human recognition performance and the performance of a computational neural model that exclusively modeled feedforward processing and was engineered to fulfill the computational requirements of recognition. Results show that the longer the stimulus onset asynchrony (SOA), the closer the performance of the human participants was to the values predicted by the model, with an optimum at an SOA of 100 ms. At short SOA latencies, human performance deteriorated, but the categorization of the emotional expressions was still above baseline. The data suggest that, although theoretically, feedback arising from inferotemporal cortex is likely to be blocked when the SOA is 100 ms, human participants still seem to rely on more local visual feedback processing to equal the model's performance.",
author = "B.M.C. Stienen and K. Schindler and {de Gelder}, B.",
year = "2012",
doi = "10.1162/NECO_a_00305",
language = "English",
volume = "24",
pages = "1806--1821",
journal = "Neural Computation",
issn = "0899-7667",
publisher = "MIT Press Journals",
number = "7",

}

A computational feedforward model predicts categorization of masked emotional body language for longer, but not for shorter, latencies. / Stienen, B.M.C.; Schindler, K.; de Gelder, B.

In: Neural Computation, Vol. 24, No. 7, 2012, p. 1806-1821.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - A computational feedforward model predicts categorization of masked emotional body language for longer, but not for shorter, latencies

AU - Stienen, B.M.C.

AU - Schindler, K.

AU - de Gelder, B.

PY - 2012

Y1 - 2012

N2 - Given the presence of massive feedback loops in brain networks, it is difficult to disentangle the contribution of feedforward and feedback processing to the recognition of visual stimuli, in this case, of emotional body expressions. The aim of the work presented in this letter is to shed light on how well feedforward processing explains rapid categorization of this important class of stimuli. By means of parametric masking, it may be possible to control the contribution of feedback activity in human participants. A close comparison is presented between human recognition performance and the performance of a computational neural model that exclusively modeled feedforward processing and was engineered to fulfill the computational requirements of recognition. Results show that the longer the stimulus onset asynchrony (SOA), the closer the performance of the human participants was to the values predicted by the model, with an optimum at an SOA of 100 ms. At short SOA latencies, human performance deteriorated, but the categorization of the emotional expressions was still above baseline. The data suggest that, although theoretically, feedback arising from inferotemporal cortex is likely to be blocked when the SOA is 100 ms, human participants still seem to rely on more local visual feedback processing to equal the model's performance.

AB - Given the presence of massive feedback loops in brain networks, it is difficult to disentangle the contribution of feedforward and feedback processing to the recognition of visual stimuli, in this case, of emotional body expressions. The aim of the work presented in this letter is to shed light on how well feedforward processing explains rapid categorization of this important class of stimuli. By means of parametric masking, it may be possible to control the contribution of feedback activity in human participants. A close comparison is presented between human recognition performance and the performance of a computational neural model that exclusively modeled feedforward processing and was engineered to fulfill the computational requirements of recognition. Results show that the longer the stimulus onset asynchrony (SOA), the closer the performance of the human participants was to the values predicted by the model, with an optimum at an SOA of 100 ms. At short SOA latencies, human performance deteriorated, but the categorization of the emotional expressions was still above baseline. The data suggest that, although theoretically, feedback arising from inferotemporal cortex is likely to be blocked when the SOA is 100 ms, human participants still seem to rely on more local visual feedback processing to equal the model's performance.

U2 - 10.1162/NECO_a_00305

DO - 10.1162/NECO_a_00305

M3 - Article

VL - 24

SP - 1806

EP - 1821

JO - Neural Computation

JF - Neural Computation

SN - 0899-7667

IS - 7

ER -