The quest for single trial correlations in multimodal EEG-fMRI data

In the past decade, technological advances have made it possible to reliably measure brain activity using simultaneous EEG-fMRI recordings inside an MR scanner. The main challenge then became to investigate the coupling between the EEG and fMRI signals in order to benefit from the simultaneously integrated temporal and spatial resolution. Although it is crucial to know when features in EEG and fMRI are expected to correlate with each other before the identification of common sources from multimodal data is possible, it is still a matter of debate. In this study, we address this question by analysing EEG and fMRI data separately from a face processing task. We show that we are able to reliably estimate single trial (ST) dynamics of face processing in EEG and fMRI data separately in four subjects. However, no correlation is found between the modalities. This implies that in this task modality-specific information is larger than the information that is shared by the modalities.