DISYRE: Diffusion-Inspired SYnthetic REstoration for Unsupervised Anomaly Detection
Naval Marimont, S., Baugh, M., Siomos, V. , Tzelepis, C. ORCID: 0000-0002-2036-9089, Kainz, B. & Tarroni, G. (2024). DISYRE: Diffusion-Inspired SYnthetic REstoration for Unsupervised Anomaly Detection. Paper presented at the IEEE International Symposium on Biomedical Imaging 2024, 27-30 May 2024, Athens, Greece. doi: 10.1109/ISBI56570.2024.10635161
Abstract
Unsupervised Anomaly Detection (UAD) techniques aim to identify and localize anomalies without relying on annotations, only leveraging a model trained on a dataset known to be free of anomalies. Diffusion models learn to modify inputs x to increase the probability of it belonging to a desired distribution, i.e., they model the score function ∇x log p(x). Such a score function is potentially relevant for UAD, since ∇x log p(x) is itself a pixel-wise anomaly score. However, diffusion models are trained to invert a corruption process based on Gaussian noise and the learned score function is unlikely to generalize to medical anomalies. This work addresses the problem of how to learn a score function relevant for UAD and proposes DISYRE: Diffusion-Inspired SYnthetic REstoration. We retain the diffusion-like pipeline but replace the Gaussian noise corruption with a gradual, synthetic anomaly corruption so the learned score function generalizes to medical, naturally occurring anomalies. We evaluate DISYRE on three common Brain MRI UAD benchmarks and substantially outperform other methods in two out of the three tasks.
Publication Type: | Conference or Workshop Item (Paper) |
---|---|
Additional Information: | © 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
Publisher Keywords: | Unsupervised anomaly detection, out-of-distribution detection, diffusion models, synthetic anomalies |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
Departments: | School of Science & Technology School of Science & Technology > Computer Science |
SWORD Depositor: |
Download (691kB) | Preview
Export
Downloads
Downloads per month over past year