Title: What you see is what you do: On the relation between gaze and gesture in multimodal alignment
Authors: Oben, Bert ×
BrĂ´ne, Geert #
Issue Date: 2-Nov-2015
Publisher: De Gruyter Mouton
Series Title: Language and Cognition vol:7 issue:4 pages:546-562
Abstract: Interactive language use inherently involves a process of coordination, which often leads to matching behaviour between interlocutors at different semiotic channels. We study this process of interactive alignment from a multimodal perspective: using data from head-mounted eye-trackers in a corpus of face-to-face conversations, we measure which effect gaze fixations by speakers (on their own gestures, condition 1) and fixations by interlocutors (on the gestures by those speakers, condition 2) have on subsequent gesture production by those interlocutors. The results show there is a significant effect of interlocutor gaze (condition 2), but not of speaker gaze (condition 1) on the amount of gestural alignment, with an interaction between the conditions.
ISSN: 1866-9808
Publication status: published
KU Leuven publication type: IT
Appears in Collections:Formal and Computational Linguistics (ComForT), Leuven
Faculty of Arts - miscellaneous
Multimodality, Interaction and Discourse, Campus Sint-Andries Antwerp
Linguistics Research Unit - miscellaneous
× corresponding author
# (joint) last author

Files in This Item:
File Description Status SizeFormat
Oben_Brone_gaze_alignment_revision.pdf Published 846KbAdobe PDFView/Open Request a copy

These files are only available to some KU Leuven Association staff members


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science