Multimodal character viewpoint in quoted dialogue sequences

Stec, K., Huiskes, M., Wieling, M. & Redeker, G., 5-May-2017, In : Glossa: a journal of general linguistics. 2, 1, 19 p., 39.

Research output: Contribution to journalArticleAcademicpeer-review

We investigate the multimodal production of character viewpoint in spoken American English narratives by performing complementary qualitative and quantitative analyses of two quoted dialogues, focusing on the storyteller’s use of character viewpoint gestures, character intonation, character facial expression, spatial orientation and gaze. A micro-analysis revealed that the extent of multimodal articulation depends on (i) the quoted speaker, with different multimodal articulatory patterns found for quotes by the speaker’s past self vs. a third-person character, and (ii) the position of the quoted utterance within the quoted dialogue, with mid-dialogue utterances garnering less co-articulation than initial or final utterances within the quoted dialogue. We further investigated these observations using a quantitative approach, which was based on generalized additive modeling (GAM). The GAM analysis revealed different multimodal patterns for each quoted character, as indicated by the number of co-produced multimodal articulators. These patterns were found to hold regardless of the quote’s position within the narrative. We discuss these findings with respect to previous work on multimodal quotation.
Original languageEnglish
Article number39
Number of pages19
JournalGlossa: a journal of general linguistics
Issue number1
Publication statusPublished - 5-May-2017


  • multimodality, co-speech gesture, viewpoint, direct speech, quotation , CO-SPEECH GESTURE, SIGN, HAND

Download statistics

No data available

ID: 23254997