Context-based Language Generation in Multi-modal Human-Computer Interaction

    Project: Research project

    Project Details

    Description

    This project deals with language generation as a part of the development of multimodal human-computer dialogue systems based on a combination of natural language and direct manipulation. Such a system should be able to generate utterances using linguistic and visual modalities. Especially two questions are considered here: 1) in what way is the generation of utterances directed by the cognitive-semantic context and the multimodal environment and 2) which aspects determine the use of a linguistic versus, or in combination with the visual modality.
    StatusFinished
    Effective start/end date15/01/0015/01/04

    Research Output

    • 4 Conference contribution
    • 1 Doctoral Thesis

    Multimodal Reference

    van der Sluis, I. F., 2005, Groningen: Uitgevershuis BuG.

    Research output: ThesisDoctoral Thesis

    File

    Towards the generation of overspecified multimodal referring expressions

    van der Sluis, I. F. & Krahmer, E. J., 2005, Proceedings of the Symposium on Dialogue Modelling and Generation at the 15th Annual Meeting of the Society for Text and Discourse. Amsterdam: STD

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

    File

    Evaluating Multimodal NLG using Production Experiments

    van der Sluis, I. F. & Krahmer, E. J., 2004, Proceedings of the 4th International Language Resources and Evaluation Conference (LREC 2004).. Lisbon: Unknown Publisher, p. 209-212 4 p.

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

    File