Title :
Tensor Analysis and Fusion of Multimodal Brain Images
Author :
Karahan, Esin ; Rojas-Lopez, Pedro A. ; Bringas-Vega, Maria L. ; Valdes-Hernandez, Pedro A. ; Valdes-Sosa, Pedro A.
Author_Institution :
Inst. of Biomed. Eng., Bogazici Univ., Istanbul, Turkey
Abstract :
Current high-throughput data acquisition technologies probe dynamical systems with different imaging modalities, generating massive data sets at different spatial and temporal resolutions-posing challenging problems in multimodal data fusion. A case in point is the attempt to parse out the brain structures and networks that underpin human cognitive processes by analysis of different neuroimaging modalities (functional MRI, EEG, NIRS, etc.). We emphasize that the multimodal, multiscale nature of neuroimaging data is well reflected by a multiway (tensor) structure where the underlying processes can be summarized by a relatively small number of components or “atoms.” We introduce Markov-Penrose diagrams-an integration of Bayesian DAG and tensor network notation in order to analyze these models. These diagrams not only clarify matrix and tensor EEG and fMRI time/frequency analysis and inverse problems, but also help understand multimodal fusion via multiway partial least squares and coupled matrix-tensor factorization. We show here, for the first time, that Granger causal analysis of brain networks is a tensor regression problem, thus allowing the atomic decomposition of brain networks. Analysis of EEG and fMRI recordings shows the potential of the methods and suggests their use in other scientific domains.
Keywords :
Bayes methods; biomedical MRI; causality; cognition; electroencephalography; image fusion; image resolution; inverse problems; least squares approximations; matrix decomposition; medical image processing; neurophysiology; regression analysis; spatiotemporal phenomena; tensors; time-frequency analysis; Bayesian DAG; Granger causal analysis; Markov-Penrose diagram; NIRS; brain network atomic decomposition; brain structure parsing; coupled matrix-tensor factorization; dynamical system; fMRI time-frequency analysis; functional MRI; high-throughput data acquisition technology; human cognitive process; inverse problem; matrix-tensor EEG; multimodal brain image fusion; multimodal data fusion; multimodal multiscale neuroimaging data; multiway partial least squares; multiway structure; neuroimaging modality analysis; spatial resolution; temporal resolution; tensor analysis; tensor network notation; tensor regression problem; tensor structure; Bayes methods; Brain modeling; Electroencephalography; Inverse problems; Multimodal sensors; Probabilistic logic; Tensile stress; Autoregressive processes; Bayesian models; Bayesian statistics; EEG/fMRI; Granger causality; N-PLS; PARAFAC; electroencephalography; magnetic resonance imaging; multidimensional systems; multimodal data; tensor decomposition; tensor network;
Journal_Title :
Proceedings of the IEEE
DOI :
10.1109/JPROC.2015.2455028