Inproceedings,

What You See is What You Get: Channel Dominance in the Decoding of Affective Nonverbal Behavior Displayed by Avatars

, , , , , and .
Presentation at the 66th Annual Conference of the International Communication Association (ICA), June 9-13 2016, Fukuoka, Japan, (2016)

Abstract

Nonverbal expressions of emotions play an important role in social interactions. Regarding virtual environments (VEs) and the transmission of nonverbal cues in avatar-mediated communication, knowledge of the contribution of nonverbal channels to emotion recognition is essential. This study analyzed the impact of emotional expressions in faces and body motion on emotion recognition. Motion capture data of expressive body movements from actors portraying either anger or happiness were animated using avatars with congruent and incongruent facial expressions. Participants viewed the resulting animations and rated the perceived emotion. During stimulus presentation, gaze behavior was recorded. The analysis of the rating results and visual attention patterns indicates that humans predominantly judge emotions based on the facial expression and pay higher attention to the head region as an information source to recognize emotions. This implicates that the transmission of facial expression is of importance for the design of social VEs.

Tags

Users

  • @rothnroll
  • @hci-uwb

Comments and Reviews