DocumentCode :
71974
Title :
Simultaneous Neural and Movement Recording in Large-Scale Immersive Virtual Environments
Author :
Snider, Joseph ; Plank, Markus ; Dongpyo Lee ; Poizner, Howard
Author_Institution :
Inst. for Neural Comput., Univ. of California, San Diego, La Jolla, CA, USA
Volume :
7
Issue :
5
fYear :
2013
fDate :
Oct. 2013
Firstpage :
713
Lastpage :
721
Abstract :
Virtual reality (VR) allows precise control and manipulation of rich, dynamic stimuli that, when coupled with on-line motion capture and neural monitoring, can provide a powerful means both of understanding brain behavioral relations in the high dimensional world and of assessing and treating a variety of neural disorders. Here we present a system that combines state-of-the-art, fully immersive, 3D, multi-modal VR with temporally aligned electroencephalographic (EEG) recordings. The VR system is dynamic and interactive across visual, auditory, and haptic interactions, providing sight, sound, touch, and force. Crucially, it does so with simultaneous EEG recordings while subjects actively move about a 20×20 ft2 space. The overall end-to-end latency between real movement and its simulated movement in the VR is approximately 40 ms. Spatial precision of the various devices is on the order of millimeters. The temporal alignment with the neural recordings is accurate to within approximately 1 ms. This powerful combination of systems opens up a new window into brain-behavioral relations and a new means of assessment and rehabilitation of individuals with motor and other disorders.
Keywords :
electroencephalography; medical disorders; medical signal processing; neurophysiology; patient rehabilitation; virtual reality; VR system; auditory interactions; brain behavioral relations; brain-behavioral relations; haptic interactions; large-scale immersive virtual environments; motor disorders; multimodal VR system; neural disorders; neural monitoring; neural recordings; on-line motion capture; rehabilitation; simultaneous EEG recordings; simultaneous neural-movement recording; state-of-the-art; temporally aligned electroencephalographic recordings; virtual reality; visual interactions; Electroencephalography; Haptic interfaces; Robots; Timing; Tracking; Virtual environments; Visualization; Brain computer interfaces; interactive systems; robot control; virtual reality; Behavior; Brain; Electroencephalography; Environment; Humans; Monitoring, Physiologic; Movement; Neurons; User-Computer Interface;
fLanguage :
English
Journal_Title :
Biomedical Circuits and Systems, IEEE Transactions on
Publisher :
ieee
ISSN :
1932-4545
Type :
jour
DOI :
10.1109/TBCAS.2012.2236089
Filename :
6471260
Link To Document :
بازگشت