Clinical Learning Systems

Direction

04

Privacy-Preserving Machine Learning

Privacy-Preserving Machine Learning

We develop machine learning methods that enable learning from sensitive clinical data while limiting what models, updates, and released data reveal about individual patients. Our work spans federated and encrypted learning, differential privacy, and anonymization, and studies their privacy-utility trade-offs across institutions, modalities, and patient populations.

Federated and collaborative learning

The training moves to the hospitals and the images stay where they were acquired. We measure what that costs against central training, and we extend it to institutions whose datasets are annotated for different findings.

Medical Image Analysis, 2024

Federated learning still sends weight updates to an aggregation server, and an untrusted server can attack those updates by model inversion or membership inference. Encrypting the weights and updating the model in the encrypted space removes that route. The encrypted federation exceeded locally trained models and matched the centrally trained models, so the cryptographic guarantee did not reduce accuracy.

INTERSPEECH 2023

Federated learning across 3 languages and 3 institutions exceeded every locally trained model without moving any data, and came close to centralized training.

Scientific Reports, 2023

Across 610,000 chest radiographs from 5 institutions, large local datasets gained little from federation and sometimes lost accuracy, while small ones improved markedly. On-domain performance followed the size of the training data and off-domain performance followed its diversity, and federated models trained across diverse external institutions beat locally trained ones off-domain everywhere. So the mechanism behind federation is data diversity and not data volume.

Scientific Reports, 2023

Public chest radiograph datasets are annotated for different findings, so conventional federated learning can use only the uniformly labeled images and discards the rest of the annotation. This paper extends the federated process to train one model across datasets whose label sets disagree. Across 695,000 chest radiographs from 5 institutions, each with its own label set, flexible federation outperformed conventional federated training.


Differential privacy

A formal privacy guarantee on a trained model costs accuracy, and the standing question is how much and for whom. We measure that cost on imaging and on speech, on external institutions as well as the training ones, and we check what it does to subgroup performance.


Anonymization

A speech recording contains the speaker's identity alongside the clinical signal, so releasing it means removing the first and keeping the second. We measure how identifiable pathological speech is to begin with, and what anonymization leaves of the diagnostic information.