Manipulating Bodily Presence Affects Cross-Modal Spatial Attention : A Virtual-Reality-Based ERP Study

Show full item record



Harjunen , V J , Ahmed , I , Jacucci , G , Ravaja , N & Spape , M 2017 , ' Manipulating Bodily Presence Affects Cross-Modal Spatial Attention : A Virtual-Reality-Based ERP Study ' , Frontiers in Human Neuroscience , vol. 11 , 79 .

Title: Manipulating Bodily Presence Affects Cross-Modal Spatial Attention : A Virtual-Reality-Based ERP Study
Author: Harjunen, Ville J.; Ahmed, Imtiaj; Jacucci, Giulio; Ravaja, Niklas; Spape, Michiel
Contributor organization: Department of Social Research (2010-2017)
Helsinki Institute for Information Technology
Department of Computer Science
Ubiquitous Interaction research group / Giulio Jacucci
Helsinki Collegium for Advanced Studies
Date: 2017-02-22
Language: eng
Number of pages: 12
Belongs to series: Frontiers in Human Neuroscience
ISSN: 1662-5161
Abstract: Earlier studies have revealed cross-modal visuo-tactile interactions in endogenous spatial attention. The current research used event-related potentials (ERPs) and virtual reality (VR) to identify how the visual cues of the perceiver’s body affect visuo-tactile interaction in endogenous spatial attention and at what point in time the effect takes place. A bimodal oddball task with lateralized tactile and visual stimuli was presented in two VR conditions, one with and one without visible hands, and one VR-free control with hands in view. Participants were required to silently count one type of stimulus and ignore all other stimuli presented in irrelevant modality or location. The presence of hands was found to modulate early and late components of somatosensory and visual evoked potentials. For sensory-perceptual stages, the presence of virtual or real hands was found to amplify attention-related negativity on the somatosensory N140 and cross-modal interaction in somatosensory and visual P200. For postperceptual stages, an amplified N200 component was obtained in somatosensory and visual evoked potentials, indicating increased response inhibition in response to non-target stimuli. The effect of somatosensory, but not visual, N200 enhanced when the virtual hands were present. The findings suggest that bodily presence affects sustained cross-modal spatial attention between vision and touch and that this effect is specifically present in ERPs related to early- and late-sensory processing, as well as response inhibition, but do not affect later attention and memory-related P3 activity. Finally, the experiments provide commeasurable scenarios for the estimation of the signal and noise ratio to quantify effects related to the use of a head mounted display (HMD). However, despite valid a-priori reasons for fearing signal interference due to a HMD, we observed no significant drop in the robustness of our ERP measurements.
Subject: 515 Psychology
cross-modal spatial attention
virtual reality
bodily presence
Event-related potentials (ERP)
Peer reviewed: Yes
Rights: cc_by
Usage restriction: openAccess
Self-archived version: publishedVersion

Files in this item

Total number of downloads: Loading...

Files Size Format View
Harjunen_el_al.2017_Fhns.pdf 1.424Mb PDF View/Open

This item appears in the following Collection(s)

Show full item record