Virtual character facial expressions influence human brain and facial EMG activity in a decision-making game

Show full item record



Permalink

http://hdl.handle.net/10138/232744

Citation

Ravaja , N , Bente , G , Kätsyri , J , Salminen , M & Takala , T 2018 , ' Virtual character facial expressions influence human brain and facial EMG activity in a decision-making game ' , IEEE Transactions on Affective Computing , vol. 9 , no. 2 , pp. 285-298 . https://doi.org/10.1109/TAFFC.2016.2601101

Title: Virtual character facial expressions influence human brain and facial EMG activity in a decision-making game
Author: Ravaja, Niklas; Bente, Gary; Kätsyri, Jari; Salminen, Mikko; Takala, Tapio
Contributor: University of Helsinki, Helsinki Institute for Information Technology
University of Helsinki, Aalto University
Date: 2018-04
Language: eng
Number of pages: 14
Belongs to series: IEEE Transactions on Affective Computing
ISSN: 1949-3045
URI: http://hdl.handle.net/10138/232744
Abstract: We examined the effects of the emotional facial expressions of a virtual character (VC) on human frontal electroencephalographic (EEG) asymmetry (putatively indexing approach/withdrawal motivation), facial electromyographic (EMG) activity (emotional expressions), and social decision making (cooperation/defection). In a within-subjects design, the participants played the Iterated Prisoner's Dilemma game with VCs with different dynamic facial expressions (predefined or dependent on the participant's electrodermal and facial EMG activity). In general, VC facial expressions elicited congruent facial muscle activity. However, both frontal EEG asymmetry and facial EMG activity elicited by an angry VC facial expression varied as a function of preceding interactional events (human collaboration/defection). Pre-decision inner emotional-motivational processes and emotional facial expressions were dissociated, suggesting that human goals influence pre-decision frontal asymmetry, whereas display rules may affect (pre-decision) emotional expressions in human-VC interaction. An angry VC facial expression, high pre-decision corrugator EMG activity, and relatively greater left frontal activation predicted the participant's decision to defect. Both post-decision frontal asymmetry and facial EMG activity were related to reciprocal cooperation. The results suggest that the justifiability of VC emotional expressions and the perceived fairness of VC actions influence human emotional responses.
Subject: 515 Psychology
Virtual characters
emotions
neurophysiology
decision making
FRONTAL EEG ASYMMETRY
EMOTIONAL-REACTIONS
PREFRONTAL CORTEX
CORTICAL ACTIVITY
SOCIAL MOTIVES
BEHAVIOR
PSYCHOPHYSIOLOGY
RESPONSES
COGNITION
TRUST
Rights:


Files in this item

Total number of downloads: Loading...

Files Size Format View
TAFFC2601101.pdf 1.010Mb PDF View/Open

This item appears in the following Collection(s)

Show full item record