HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

fMRI from EEG is only Deep Learning away: the use of interpretable DL to unravel EEG-fMRI relationships

Alexander Kovalev Ilia Mikheev Alexei Ossadtchi

fMRI from EEG is only Deep Learning away: the use of interpretable DL to unravel EEG-fMRI relationships

Abstract

The access to activity of subcortical structures offers unique opportunity for building intention dependent brain-computer interfaces, renders abundant options for exploring a broad range of cognitive phenomena in the realm of affective neuroscience including complex decision making processes and the eternal free-will dilemma and facilitates diagnostics of a range of neurological deceases. So far this was possible only using bulky, expensive and immobile fMRI equipment. Here we present an interpretable domain grounded solution to recover the activity of several subcortical regions from the multichannel EEG data and demonstrate up to 60% correlation between the actual subcortical blood oxygenation level dependent sBOLD signal and its EEG-derived twin. Then, using the novel and theoretically justified weight interpretation methodology we recover individual spatial and time-frequency patterns of scalp EEG predictive of the hemodynamic signal in the subcortical nuclei. The described results not only pave the road towards wearable subcortical activity scanners but also showcase an automatic knowledge discovery process facilitated by deep learning technology in combination with an interpretable domain constrained architecture and the appropriate downstream task.

Code Repositories

kovalalvi/beira
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
eeg-decoding-on-cwl-eeg-fmri-datasetBEIRA
Pearson Correlation: 0.44

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
fMRI from EEG is only Deep Learning away: the use of interpretable DL to unravel EEG-fMRI relationships | Papers | HyperAI