The grammar of emoji? Constraints on communicative pictorial sequencing

Neil Cohn*, Jan Engelen, Joost Schilperoord

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Emoji have become a prominent part of interactive digital communication. Here, we ask the questions: does a grammatical system govern the way people use emoji; and how do emoji interact with the grammar of written text? We conducted two experiments that asked participants to have a digital conversation with each other using only emoji (Experiment 1) or to substitute at least one emoji for a word in the sentences (Experiment 2). First, we found that the emoji-only utterances of participants remained at simplistic levels of patterning, primarily appearing as one-unit utterances (as formulaic expressions or responsive emotions) or as linear sequencing (for example, repeating the same emoji or providing an unordered list of semantically related emoji). Emoji playing grammatical roles (i.e., 'parts-of-speech') were minimal, and showed little consistency in 'word order'. Second, emoji were substituted more for nouns and adjectives than verbs, while also typically conveying nonredundant information to the sentences. These findings suggest that, while emoji may follow tendencies in their interactions with grammatical structure in multimodal text-emoji productions, they lack grammatical structure on their own.

Original languageEnglish
Article number33
Number of pages18
JournalCognitive research: principles and implications
Volume4
Issue number1
DOIs
Publication statusPublished - 30 Aug 2019

Keywords

  • Visual language
  • Emoji
  • Pictorial communication
  • Multimodality
  • Gesture
  • Grammar
  • SEMANTIC ROLES
  • PICTURES
  • LANGUAGE
  • EVENTS
  • AGENTS

Cite this

@article{c052798acc3f4bb19e02cfcc98acdc8c,
title = "The grammar of emoji? Constraints on communicative pictorial sequencing",
abstract = "Emoji have become a prominent part of interactive digital communication. Here, we ask the questions: does a grammatical system govern the way people use emoji; and how do emoji interact with the grammar of written text? We conducted two experiments that asked participants to have a digital conversation with each other using only emoji (Experiment 1) or to substitute at least one emoji for a word in the sentences (Experiment 2). First, we found that the emoji-only utterances of participants remained at simplistic levels of patterning, primarily appearing as one-unit utterances (as formulaic expressions or responsive emotions) or as linear sequencing (for example, repeating the same emoji or providing an unordered list of semantically related emoji). Emoji playing grammatical roles (i.e., 'parts-of-speech') were minimal, and showed little consistency in 'word order'. Second, emoji were substituted more for nouns and adjectives than verbs, while also typically conveying nonredundant information to the sentences. These findings suggest that, while emoji may follow tendencies in their interactions with grammatical structure in multimodal text-emoji productions, they lack grammatical structure on their own.",
keywords = "Visual language, Emoji, Pictorial communication, Multimodality, Gesture, Grammar, SEMANTIC ROLES, PICTURES, LANGUAGE, EVENTS, AGENTS",
author = "Neil Cohn and Jan Engelen and Joost Schilperoord",
year = "2019",
month = "8",
day = "30",
doi = "10.1186/s41235-019-0177-0",
language = "English",
volume = "4",
journal = "Cognitive research: principles and implications",
issn = "2365-7464",
publisher = "SpringerOpen",
number = "1",

}

The grammar of emoji? Constraints on communicative pictorial sequencing. / Cohn, Neil; Engelen, Jan; Schilperoord, Joost.

In: Cognitive research: principles and implications, Vol. 4, No. 1, 33, 30.08.2019.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - The grammar of emoji? Constraints on communicative pictorial sequencing

AU - Cohn, Neil

AU - Engelen, Jan

AU - Schilperoord, Joost

PY - 2019/8/30

Y1 - 2019/8/30

N2 - Emoji have become a prominent part of interactive digital communication. Here, we ask the questions: does a grammatical system govern the way people use emoji; and how do emoji interact with the grammar of written text? We conducted two experiments that asked participants to have a digital conversation with each other using only emoji (Experiment 1) or to substitute at least one emoji for a word in the sentences (Experiment 2). First, we found that the emoji-only utterances of participants remained at simplistic levels of patterning, primarily appearing as one-unit utterances (as formulaic expressions or responsive emotions) or as linear sequencing (for example, repeating the same emoji or providing an unordered list of semantically related emoji). Emoji playing grammatical roles (i.e., 'parts-of-speech') were minimal, and showed little consistency in 'word order'. Second, emoji were substituted more for nouns and adjectives than verbs, while also typically conveying nonredundant information to the sentences. These findings suggest that, while emoji may follow tendencies in their interactions with grammatical structure in multimodal text-emoji productions, they lack grammatical structure on their own.

AB - Emoji have become a prominent part of interactive digital communication. Here, we ask the questions: does a grammatical system govern the way people use emoji; and how do emoji interact with the grammar of written text? We conducted two experiments that asked participants to have a digital conversation with each other using only emoji (Experiment 1) or to substitute at least one emoji for a word in the sentences (Experiment 2). First, we found that the emoji-only utterances of participants remained at simplistic levels of patterning, primarily appearing as one-unit utterances (as formulaic expressions or responsive emotions) or as linear sequencing (for example, repeating the same emoji or providing an unordered list of semantically related emoji). Emoji playing grammatical roles (i.e., 'parts-of-speech') were minimal, and showed little consistency in 'word order'. Second, emoji were substituted more for nouns and adjectives than verbs, while also typically conveying nonredundant information to the sentences. These findings suggest that, while emoji may follow tendencies in their interactions with grammatical structure in multimodal text-emoji productions, they lack grammatical structure on their own.

KW - Visual language

KW - Emoji

KW - Pictorial communication

KW - Multimodality

KW - Gesture

KW - Grammar

KW - SEMANTIC ROLES

KW - PICTURES

KW - LANGUAGE

KW - EVENTS

KW - AGENTS

U2 - 10.1186/s41235-019-0177-0

DO - 10.1186/s41235-019-0177-0

M3 - Article

VL - 4

JO - Cognitive research: principles and implications

JF - Cognitive research: principles and implications

SN - 2365-7464

IS - 1

M1 - 33

ER -