Learning transferable biosignal representations

I develop compact learning methods for physiological signals. I want representations that preserve the information needed to study human function and remain useful across tasks, people, and recording conditions.

Long recordings contain many samples, but the information relevant to a particular process may lie in a few temporal, spectral, or spatial patterns. I design models around these properties, and study how their training objectives shape what they learn. This connects efficiency with generalization: I ask which aspects of the signal remain useful outside the training setting.

In WildECG, I trained a self-supervised state-space model on 275,000 ECG segments recorded in everyday settings. Its training task identifies transformations applied to a signal, encouraging sensitivity to distortions while the architecture efficiently models long sequences. [1]

I examine this question at the signal level with BioCodec, using quantization to turn continuous biosignals into discrete codes. This bottleneck learns compact signal structure: a tokenizer trained on single-channel EEG retained information useful for clinical, sleep, and neural-decoding tasks. [2]

I then used these codes to develop BrainCodes, a lightweight EEG foundation model over discrete neural codes, pretrained on recordings from over 1,000 participants. It matches or exceeds larger models on several evaluated tasks, with up to 97% fewer trainable parameters. [3]

To understand this transfer, I also examine the representations themselves. Predictive accuracy alone does not establish which aspects of physiology a model uses. My work examines generalization across recording settings [4] and bias toward aperiodic and low-frequency activity [5]. I also developed spatial and spectral probes to distinguish information encoded in a representation from information that influences its predictions [6].

I am interested in how reconstruction, contrastive, and predictive objectives preserve different aspects of physiology. I want to develop hierarchical representations that make both transient events and stable individual traits accessible, with evaluations that test signal morphology, oscillations, and spatial relationships.

References

1. Scaling Representation Learning From Ubiquitous ECG With State-Space Models

Kleanthis Avramidis, Dominika Kunc, Bartosz Perz, Kranti Adsul, Tiantian Feng, Przemysław Kazienko, Stanisław Saganowski, Shrikanth Narayanan

IEEE Journal of Biomedical and Health Informatics · 2024

Paper PDF Code

2. Neural Codecs as Biosignal Tokenizers

Kleanthis Avramidis, Tiantian Feng, Woojae Jeong, Jihwan Lee, Wenhui Cui, Richard M Leahy, Shrikanth Narayanan

arXiv preprint · 2025

Paper PDF Code

3. BrainCodes: A Lightweight EEG Foundation Model over Discrete Neural Codes

Kleanthis Avramidis, Ivan Tashev, Dimitra Emmanouilidou

arXiv preprint · 2026

Paper PDF Code Website

4. A Multi-Dimensional Framework for Evaluating Generalization in EEG Foundation Models

Aditya Kommineni, Emily Zhou, Kleanthis Avramidis, Tiantian Feng, Shrikanth Narayanan

Conference on Health, Inference, and Learning (CHIL) · 2026

Paper PDF

5. Aperiodic and Low-Frequency Spectral Bias in Reconstruction-Based EEG Foundation Models

Aditya Kommineni, Emily Zhou, Kleanthis Avramidis, Simon Bock Segaard, Jeppe Roden Münster, Andreas Peter Juhl Hansen, Takfarinas Medani, Tiantian Feng, Richard Leahy, Shrikanth Narayanan

arXiv preprint · 2026

Paper PDF

6. Probing Spatial and Spectral Grounding in EEG Foundation Models

Kleanthis Avramidis, Ivan Tashev, Dimitra Emmanouilidou

arXiv preprint · 2026

Paper PDF