Please use this identifier to cite or link to this item:
https://www.um.edu.mt/library/oar/handle/123456789/104343
Title: | Head movements, facial expressions and feedback in conversations : empirical evidence from Danish multimodal data |
Authors: | Paggio, Patrizia Navarretta, Costanza |
Keywords: | Modality (Linguistics) Corpora (Linguistics) Body language -- Research Facial expression -- Data processing Machine learning Linguistics -- Methodology Human-computer interaction Speech and gesture Conversation analysis Danish language -- Discourse analysis |
Issue Date: | 2013 |
Publisher: | Springer |
Citation: | Paggio, P., & Navarretta, C. (2013). Head movements, facial expressions and feedback in conversations: Empirical evidence from Danish multimodal data. Journal on Multimodal User Interfaces, 7(1-2), 29-37. |
Abstract: | This article deals with multimodal feedback in two Danish multimodal corpora, i.e., a collection of map-task dialogues and a corpus of free conversations in first encounters between pairs of subjects. Machine learning techniques are applied to both sets of data to investigate various relations between the non-verbal behaviour—more specifically head movements and facial expressions—and speech with regard to the expression of feedback. In the map-task data, we study the extent to which the dialogue act type of linguistic feedback expressions can be classified automatically based on the non-verbal features. In the conversational data, on the other hand, non-verbal and speech features are used together to distinguish feedback from other multimodal behaviours. The results of the two sets of experiments indicate in general that head movements, and to a lesser extent facial expressions, are important indicators of feedback, and that gestures and speech disambiguate each other in the machine learning process. |
URI: | https://www.um.edu.mt/library/oar/handle/123456789/104343 |
ISBN: | 17838738 |
Appears in Collections: | Scholarly Works - InsLin |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Head_movements,_facial_expressions_and_feedback_in_conversations_Empirical_evidence_from_Danish_multimodal_data(2013).pdf Restricted Access | 315.49 kB | Adobe PDF | View/Open Request a copy |
Items in OAR@UM are protected by copyright, with all rights reserved, unless otherwise indicated.