Neural overlap of L1 and L2 semantic representations across visual and auditory modalities

A decoding approach

Eowyn Van De Putte, W. De Baene, Cathy J Price, Wouter Duyck

Research output: Contribution to journalArticleScientificpeer-review

Abstract

This study investigated whether brain activity in Dutch-French bilinguals during semantic access to concepts from one language could be used to predict neural activation during access to the same concepts from another language, in different language modalities/tasks. This was tested using multi-voxel pattern analysis (MVPA), within and across language comprehension (word listening and word reading) and production (picture naming). It was possible to identify the picture or word named, read or heard in one language (e.g. maan, meaning moon) based on the brain activity in a distributed bilateral brain network while, respectively, naming, reading or listening to the picture or word in the other language (e.g. lune). The brain regions identified differed across tasks. During picture naming, brain activation in the occipital and temporal regions allowed concepts to be predicted across languages. During word listening and word reading, across-language predictions were observed in the rolandic operculum and several motor-related areas (pre- and postcentral, the cerebellum). In addition, across-language predictions during reading were identified in regions typically associated with semantic processing (left inferior frontal, middle temporal cortex, right cerebellum and precuneus) and visual processing (inferior and middle occipital regions and calcarine sulcus). Furthermore, across modalities and languages, the left lingual gyrus showed semantic overlap across production and word reading. These findings support the idea of at least partially language- and modality-independent semantic neural representations.
Original languageEnglish
Pages (from-to)68-77
JournalNeuropsychologia
Volume113
DOIs
Publication statusPublished - 2018

Fingerprint

Language
Motor Cortex

Keywords

  • ANGULAR GYRUS
  • CONCEPTUAL KNOWLEDGE
  • ENGLISH BILINGUALS
  • FMRI
  • FUNCTIONAL MRI
  • HUMAN BRAIN
  • MENTAL-IMAGERY
  • TEMPORAL CORTEX
  • VOXEL PATTERN-ANALYSIS
  • WORDS
  • bilingualism
  • comprehension
  • fMRI
  • mvpa
  • neural overlap
  • production
  • semantic
  • word listening
  • word reading

Cite this

@article{74266a20a86e4f798001dc3a5ce6ce19,
title = "Neural overlap of L1 and L2 semantic representations across visual and auditory modalities: A decoding approach",
abstract = "This study investigated whether brain activity in Dutch-French bilinguals during semantic access to concepts from one language could be used to predict neural activation during access to the same concepts from another language, in different language modalities/tasks. This was tested using multi-voxel pattern analysis (MVPA), within and across language comprehension (word listening and word reading) and production (picture naming). It was possible to identify the picture or word named, read or heard in one language (e.g. maan, meaning moon) based on the brain activity in a distributed bilateral brain network while, respectively, naming, reading or listening to the picture or word in the other language (e.g. lune). The brain regions identified differed across tasks. During picture naming, brain activation in the occipital and temporal regions allowed concepts to be predicted across languages. During word listening and word reading, across-language predictions were observed in the rolandic operculum and several motor-related areas (pre- and postcentral, the cerebellum). In addition, across-language predictions during reading were identified in regions typically associated with semantic processing (left inferior frontal, middle temporal cortex, right cerebellum and precuneus) and visual processing (inferior and middle occipital regions and calcarine sulcus). Furthermore, across modalities and languages, the left lingual gyrus showed semantic overlap across production and word reading. These findings support the idea of at least partially language- and modality-independent semantic neural representations.",
keywords = "ANGULAR GYRUS, CONCEPTUAL KNOWLEDGE, ENGLISH BILINGUALS, FMRI, FUNCTIONAL MRI, HUMAN BRAIN, MENTAL-IMAGERY, TEMPORAL CORTEX, VOXEL PATTERN-ANALYSIS, WORDS, bilingualism, comprehension, fMRI, mvpa, neural overlap, production, semantic, word listening, word reading",
author = "{Van De Putte}, Eowyn and {De Baene}, W. and Price, {Cathy J} and Wouter Duyck",
year = "2018",
doi = "10.1016/j.neuropsychologia.2018.03.037",
language = "English",
volume = "113",
pages = "68--77",
journal = "Neuropsychologia",
issn = "0028-3932",
publisher = "PERGAMON-ELSEVIER SCIENCE LTD",

}

Neural overlap of L1 and L2 semantic representations across visual and auditory modalities : A decoding approach. / Van De Putte, Eowyn ; De Baene, W.; Price, Cathy J; Duyck, Wouter.

In: Neuropsychologia, Vol. 113, 2018, p. 68-77.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Neural overlap of L1 and L2 semantic representations across visual and auditory modalities

T2 - A decoding approach

AU - Van De Putte, Eowyn

AU - De Baene, W.

AU - Price, Cathy J

AU - Duyck, Wouter

PY - 2018

Y1 - 2018

N2 - This study investigated whether brain activity in Dutch-French bilinguals during semantic access to concepts from one language could be used to predict neural activation during access to the same concepts from another language, in different language modalities/tasks. This was tested using multi-voxel pattern analysis (MVPA), within and across language comprehension (word listening and word reading) and production (picture naming). It was possible to identify the picture or word named, read or heard in one language (e.g. maan, meaning moon) based on the brain activity in a distributed bilateral brain network while, respectively, naming, reading or listening to the picture or word in the other language (e.g. lune). The brain regions identified differed across tasks. During picture naming, brain activation in the occipital and temporal regions allowed concepts to be predicted across languages. During word listening and word reading, across-language predictions were observed in the rolandic operculum and several motor-related areas (pre- and postcentral, the cerebellum). In addition, across-language predictions during reading were identified in regions typically associated with semantic processing (left inferior frontal, middle temporal cortex, right cerebellum and precuneus) and visual processing (inferior and middle occipital regions and calcarine sulcus). Furthermore, across modalities and languages, the left lingual gyrus showed semantic overlap across production and word reading. These findings support the idea of at least partially language- and modality-independent semantic neural representations.

AB - This study investigated whether brain activity in Dutch-French bilinguals during semantic access to concepts from one language could be used to predict neural activation during access to the same concepts from another language, in different language modalities/tasks. This was tested using multi-voxel pattern analysis (MVPA), within and across language comprehension (word listening and word reading) and production (picture naming). It was possible to identify the picture or word named, read or heard in one language (e.g. maan, meaning moon) based on the brain activity in a distributed bilateral brain network while, respectively, naming, reading or listening to the picture or word in the other language (e.g. lune). The brain regions identified differed across tasks. During picture naming, brain activation in the occipital and temporal regions allowed concepts to be predicted across languages. During word listening and word reading, across-language predictions were observed in the rolandic operculum and several motor-related areas (pre- and postcentral, the cerebellum). In addition, across-language predictions during reading were identified in regions typically associated with semantic processing (left inferior frontal, middle temporal cortex, right cerebellum and precuneus) and visual processing (inferior and middle occipital regions and calcarine sulcus). Furthermore, across modalities and languages, the left lingual gyrus showed semantic overlap across production and word reading. These findings support the idea of at least partially language- and modality-independent semantic neural representations.

KW - ANGULAR GYRUS

KW - CONCEPTUAL KNOWLEDGE

KW - ENGLISH BILINGUALS

KW - FMRI

KW - FUNCTIONAL MRI

KW - HUMAN BRAIN

KW - MENTAL-IMAGERY

KW - TEMPORAL CORTEX

KW - VOXEL PATTERN-ANALYSIS

KW - WORDS

KW - bilingualism

KW - comprehension

KW - fMRI

KW - mvpa

KW - neural overlap

KW - production

KW - semantic

KW - word listening

KW - word reading

U2 - 10.1016/j.neuropsychologia.2018.03.037

DO - 10.1016/j.neuropsychologia.2018.03.037

M3 - Article

VL - 113

SP - 68

EP - 77

JO - Neuropsychologia

JF - Neuropsychologia

SN - 0028-3932

ER -