Publication

Cross-cultural assessment of automatically generated multimodal referring expressions in a virtual world

van der Sluis, I., Luz, S., Breitfuss, W., Ishizuka, M. & Prendinger, H., Sep-2012, In : International journal of human-Computer studies. 70, 9, p. 611-629 19 p.

Research output: Contribution to journalArticleAcademicpeer-review

APA

van der Sluis, I., Luz, S., Breitfuss, W., Ishizuka, M., & Prendinger, H. (2012). Cross-cultural assessment of automatically generated multimodal referring expressions in a virtual world. International journal of human-Computer studies, 70(9), 611-629. https://doi.org/10.1016/j.ijhcs.2012.05.002

Author

van der Sluis, Ielka ; Luz, Saturnino ; Breitfuss, Werner ; Ishizuka, Mitsuru ; Prendinger, Helmut. / Cross-cultural assessment of automatically generated multimodal referring expressions in a virtual world. In: International journal of human-Computer studies. 2012 ; Vol. 70, No. 9. pp. 611-629.

Harvard

van der Sluis, I, Luz, S, Breitfuss, W, Ishizuka, M & Prendinger, H 2012, 'Cross-cultural assessment of automatically generated multimodal referring expressions in a virtual world', International journal of human-Computer studies, vol. 70, no. 9, pp. 611-629. https://doi.org/10.1016/j.ijhcs.2012.05.002

Standard

Cross-cultural assessment of automatically generated multimodal referring expressions in a virtual world. / van der Sluis, Ielka; Luz, Saturnino; Breitfuss, Werner; Ishizuka, Mitsuru; Prendinger, Helmut.

In: International journal of human-Computer studies, Vol. 70, No. 9, 09.2012, p. 611-629.

Research output: Contribution to journalArticleAcademicpeer-review

Vancouver

van der Sluis I, Luz S, Breitfuss W, Ishizuka M, Prendinger H. Cross-cultural assessment of automatically generated multimodal referring expressions in a virtual world. International journal of human-Computer studies. 2012 Sep;70(9):611-629. https://doi.org/10.1016/j.ijhcs.2012.05.002


BibTeX

@article{4c574046bd1b42d5bd005d0ce2c050db,
title = "Cross-cultural assessment of automatically generated multimodal referring expressions in a virtual world",
abstract = "This paper presents an assessment of automatically generated multimodal referring expressions as produced by embodied conversational agents in a virtual world. The algorithm used for this purpose employs general principles of human motor control and cooperativity in dialogues that can be parameterised so as to vary the precision of the pointing gestures and the amount of linguistic information included in the referring expressions. The study assessed how native speakers of English and Japanese perceived three different algorithmic outputs for multimodal referring behaviour in terms of understandability, human-likeness and a social practice (selling). Results show that users generally prefer mobile agents that are economical in their linguistic descriptions to stationary verbose agents. They also show the need for further calibration of the algorithm to accommodate the differences between the two groups. In addition to the detailed description of the set up and results of the study, the paper discusses implications for the design and use of agents, methodological issues that arose while conducting the cross-cultural study and directions for future work. (C) 2012 Elsevier Ltd. All rights reserved.",
keywords = "Perception of multimodal referring expressions, Virtual worlds, Dialogue, Translation, Cross-cultural differences, CONVERSATIONAL AGENTS, SPEECH, GESTURE, USABILITY, JAPANESE, CONTEXT, OBJECT",
author = "{van der Sluis}, Ielka and Saturnino Luz and Werner Breitfuss and Mitsuru Ishizuka and Helmut Prendinger",
year = "2012",
month = "9",
doi = "10.1016/j.ijhcs.2012.05.002",
language = "English",
volume = "70",
pages = "611--629",
journal = "International journal of human-Computer studies",
issn = "1071-5819",
number = "9",

}

RIS

TY - JOUR

T1 - Cross-cultural assessment of automatically generated multimodal referring expressions in a virtual world

AU - van der Sluis, Ielka

AU - Luz, Saturnino

AU - Breitfuss, Werner

AU - Ishizuka, Mitsuru

AU - Prendinger, Helmut

PY - 2012/9

Y1 - 2012/9

N2 - This paper presents an assessment of automatically generated multimodal referring expressions as produced by embodied conversational agents in a virtual world. The algorithm used for this purpose employs general principles of human motor control and cooperativity in dialogues that can be parameterised so as to vary the precision of the pointing gestures and the amount of linguistic information included in the referring expressions. The study assessed how native speakers of English and Japanese perceived three different algorithmic outputs for multimodal referring behaviour in terms of understandability, human-likeness and a social practice (selling). Results show that users generally prefer mobile agents that are economical in their linguistic descriptions to stationary verbose agents. They also show the need for further calibration of the algorithm to accommodate the differences between the two groups. In addition to the detailed description of the set up and results of the study, the paper discusses implications for the design and use of agents, methodological issues that arose while conducting the cross-cultural study and directions for future work. (C) 2012 Elsevier Ltd. All rights reserved.

AB - This paper presents an assessment of automatically generated multimodal referring expressions as produced by embodied conversational agents in a virtual world. The algorithm used for this purpose employs general principles of human motor control and cooperativity in dialogues that can be parameterised so as to vary the precision of the pointing gestures and the amount of linguistic information included in the referring expressions. The study assessed how native speakers of English and Japanese perceived three different algorithmic outputs for multimodal referring behaviour in terms of understandability, human-likeness and a social practice (selling). Results show that users generally prefer mobile agents that are economical in their linguistic descriptions to stationary verbose agents. They also show the need for further calibration of the algorithm to accommodate the differences between the two groups. In addition to the detailed description of the set up and results of the study, the paper discusses implications for the design and use of agents, methodological issues that arose while conducting the cross-cultural study and directions for future work. (C) 2012 Elsevier Ltd. All rights reserved.

KW - Perception of multimodal referring expressions

KW - Virtual worlds

KW - Dialogue

KW - Translation

KW - Cross-cultural differences

KW - CONVERSATIONAL AGENTS

KW - SPEECH

KW - GESTURE

KW - USABILITY

KW - JAPANESE

KW - CONTEXT

KW - OBJECT

U2 - 10.1016/j.ijhcs.2012.05.002

DO - 10.1016/j.ijhcs.2012.05.002

M3 - Article

VL - 70

SP - 611

EP - 629

JO - International journal of human-Computer studies

JF - International journal of human-Computer studies

SN - 1071-5819

IS - 9

ER -

ID: 5628172