DISYRE: Diffusion-Inspired SYnthetic REstoration for Unsupervised Anomaly Detection
Naval Marimont, S., Baugh, M., Siomos, V. , Tzelepis, C.
ORCID: 0000-0002-2036-9089, Kainz, B. & Tarroni, G. (2024).
DISYRE: Diffusion-Inspired SYnthetic REstoration for Unsupervised Anomaly Detection.
In:
Proceedings / IEEE International Symposium on Biomedical Imaging: from nano to macro. IEEE International Symposium on Biomedical Imaging.
IEEE International Symposium on Biomedical Imaging 2024, 27-30 May 2024, Athens, Greece.
doi: 10.1109/ISBI56570.2024.10635161
Abstract
Unsupervised Anomaly Detection (UAD) techniques aim to identify and localize anomalies without relying on annotations, only leveraging a model trained on a dataset known to be free of anomalies. Diffusion models learn to modify inputs x to increase the probability of it belonging to a desired distribution, i.e., they model the score function ∇x log p(x). Such a score function is potentially relevant for UAD, since ∇x log p(x) is itself a pixel-wise anomaly score. However, diffusion models are trained to invert a corruption process based on Gaussian noise and the learned score function is unlikely to generalize to medical anomalies. This work addresses the problem of how to learn a score function relevant for UAD and proposes DISYRE: Diffusion-Inspired SYnthetic REstoration. We retain the diffusion-like pipeline but replace the Gaussian noise corruption with a gradual, synthetic anomaly corruption so the learned score function generalizes to medical, naturally occurring anomalies. We evaluate DISYRE on three common Brain MRI UAD benchmarks and substantially outperform other methods in two out of the three tasks.
| Publication Type: | Conference or Workshop Item (Paper) |
|---|---|
| Additional Information: | © 2024 IEEE. For the purpose of open access, the author(s) has applied a Creative Commons Attribution (CC BY) license to any Accepted Manuscript version arising. |
| Publisher Keywords: | Unsupervised anomaly detection, out-of-distribution detection, diffusion models, synthetic anomalies |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
| Departments: | School of Science & Technology School of Science & Technology > Department of Computer Science |
| SWORD Depositor: |
Available under License Creative Commons Attribution.
Download (691kB) | Preview
Export
Downloads
Downloads per month over past year
Metadata
Metadata