Words, Numbers and Visual Heuristics in Web Surveys: Is there a Hierarchy of Importance?

V. Toepoel, D.A. Dillman

    Research output: Working paperDiscussion paperOther research output

    312 Downloads (Pure)

    Abstract

    In interpreting questions, respondents extract meaning from how the information in a questionnaire is shaped, spaced, and shaded. This makes it important to pay close attention to the arrangement of visual information on a questionnaire. Respondents follow simple heuristics in interpreting the visual features of questions. We carried out five experiments to investigate how the effect of visual heuristics affected the answers to survey questions. We varied verbal, numerical, and other visual cues such as color. In some instances the use of words helps overcome visual layout effects. In at least one instance, a fundamental difference in visual layout (violating the 'left and top means first' heuristic) influenced answers on top of word labels. This suggests that both visual and verbal languages are important. Yet sometimes one can override the other. To reduce the effect of visual cues, it is better to use fully labeled scales in survey questions.
    Original languageEnglish
    Place of PublicationTilburg
    PublisherCentER, Center for Economic Research
    Number of pages45
    Volume2008-92
    Publication statusPublished - 2008

    Publication series

    NameCentER Discussion Paper
    Volume2008-92

    Fingerprint

    Labels
    Color
    Experiments

    Keywords

    • questionnaire design
    • layout
    • visual language
    • response effects
    • visual cues

    Cite this

    Toepoel, V., & Dillman, D. A. (2008). Words, Numbers and Visual Heuristics in Web Surveys: Is there a Hierarchy of Importance? (CentER Discussion Paper; Vol. 2008-92). Tilburg: CentER, Center for Economic Research.
    Toepoel, V. ; Dillman, D.A. / Words, Numbers and Visual Heuristics in Web Surveys : Is there a Hierarchy of Importance?. Tilburg : CentER, Center for Economic Research, 2008. (CentER Discussion Paper).
    @techreport{21fbcc013c5d4942b41c72964e15ffe0,
    title = "Words, Numbers and Visual Heuristics in Web Surveys: Is there a Hierarchy of Importance?",
    abstract = "In interpreting questions, respondents extract meaning from how the information in a questionnaire is shaped, spaced, and shaded. This makes it important to pay close attention to the arrangement of visual information on a questionnaire. Respondents follow simple heuristics in interpreting the visual features of questions. We carried out five experiments to investigate how the effect of visual heuristics affected the answers to survey questions. We varied verbal, numerical, and other visual cues such as color. In some instances the use of words helps overcome visual layout effects. In at least one instance, a fundamental difference in visual layout (violating the 'left and top means first' heuristic) influenced answers on top of word labels. This suggests that both visual and verbal languages are important. Yet sometimes one can override the other. To reduce the effect of visual cues, it is better to use fully labeled scales in survey questions.",
    keywords = "questionnaire design, layout, visual language, response effects, visual cues",
    author = "V. Toepoel and D.A. Dillman",
    note = "Pagination: 45",
    year = "2008",
    language = "English",
    volume = "2008-92",
    series = "CentER Discussion Paper",
    publisher = "CentER, Center for Economic Research",
    type = "WorkingPaper",
    institution = "CentER, Center for Economic Research",

    }

    Toepoel, V & Dillman, DA 2008 'Words, Numbers and Visual Heuristics in Web Surveys: Is there a Hierarchy of Importance?' CentER Discussion Paper, vol. 2008-92, CentER, Center for Economic Research, Tilburg.

    Words, Numbers and Visual Heuristics in Web Surveys : Is there a Hierarchy of Importance? / Toepoel, V.; Dillman, D.A.

    Tilburg : CentER, Center for Economic Research, 2008. (CentER Discussion Paper; Vol. 2008-92).

    Research output: Working paperDiscussion paperOther research output

    TY - UNPB

    T1 - Words, Numbers and Visual Heuristics in Web Surveys

    T2 - Is there a Hierarchy of Importance?

    AU - Toepoel, V.

    AU - Dillman, D.A.

    N1 - Pagination: 45

    PY - 2008

    Y1 - 2008

    N2 - In interpreting questions, respondents extract meaning from how the information in a questionnaire is shaped, spaced, and shaded. This makes it important to pay close attention to the arrangement of visual information on a questionnaire. Respondents follow simple heuristics in interpreting the visual features of questions. We carried out five experiments to investigate how the effect of visual heuristics affected the answers to survey questions. We varied verbal, numerical, and other visual cues such as color. In some instances the use of words helps overcome visual layout effects. In at least one instance, a fundamental difference in visual layout (violating the 'left and top means first' heuristic) influenced answers on top of word labels. This suggests that both visual and verbal languages are important. Yet sometimes one can override the other. To reduce the effect of visual cues, it is better to use fully labeled scales in survey questions.

    AB - In interpreting questions, respondents extract meaning from how the information in a questionnaire is shaped, spaced, and shaded. This makes it important to pay close attention to the arrangement of visual information on a questionnaire. Respondents follow simple heuristics in interpreting the visual features of questions. We carried out five experiments to investigate how the effect of visual heuristics affected the answers to survey questions. We varied verbal, numerical, and other visual cues such as color. In some instances the use of words helps overcome visual layout effects. In at least one instance, a fundamental difference in visual layout (violating the 'left and top means first' heuristic) influenced answers on top of word labels. This suggests that both visual and verbal languages are important. Yet sometimes one can override the other. To reduce the effect of visual cues, it is better to use fully labeled scales in survey questions.

    KW - questionnaire design

    KW - layout

    KW - visual language

    KW - response effects

    KW - visual cues

    M3 - Discussion paper

    VL - 2008-92

    T3 - CentER Discussion Paper

    BT - Words, Numbers and Visual Heuristics in Web Surveys

    PB - CentER, Center for Economic Research

    CY - Tilburg

    ER -

    Toepoel V, Dillman DA. Words, Numbers and Visual Heuristics in Web Surveys: Is there a Hierarchy of Importance? Tilburg: CentER, Center for Economic Research. 2008. (CentER Discussion Paper).