City Research Online

DISYRE: Diffusion-Inspired SYnthetic REstoration for Unsupervised Anomaly Detection

Naval Marimont, S., Baugh, M., Siomos, V. , Tzelepis, C. ORCID: 0000-0002-2036-9089, Kainz, B. & Tarroni, G. (2024). DISYRE: Diffusion-Inspired SYnthetic REstoration for Unsupervised Anomaly Detection. Paper presented at the IEEE International Symposium on Biomedical Imaging 2024, 27-30 May 2024, Athens, Greece.

Abstract

Unsupervised Anomaly Detection (UAD) techniques aim to identify and localize anomalies without relying on annotations, only leveraging a model trained on a dataset known to be free of anomalies. Diffusion models learn to modify inputs x to increase the probability of it belonging to a desired distribution, i.e., they model the score function ∇x log p(x). Such a score function is potentially relevant for UAD, since ∇x log p(x) is itself a pixel-wise anomaly score. However, diffusion models are trained to invert a corruption process based on Gaussian noise and the learned score function is unlikely to generalize to medical anomalies. This work addresses the problem of how to learn a score function relevant for UAD and proposes DISYRE: Diffusion-Inspired SYnthetic REstoration. We retain the diffusion-like pipeline but replace the Gaussian noise corruption with a gradual, synthetic anomaly corruption so the learned score function generalizes to medical, naturally occurring anomalies. We evaluate DISYRE on three common Brain MRI UAD benchmarks and substantially outperform other methods in two out of the three tasks.

Publication Type: Conference or Workshop Item (Paper)
Additional Information: © 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Publisher Keywords: Unsupervised anomaly detection, out-of-distribution detection, diffusion models, synthetic anomalies
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Departments: School of Science & Technology
School of Science & Technology > Computer Science
SWORD Depositor:
[thumbnail of DISYRE.pdf]
Preview
Text - Accepted Version
Download (719kB) | Preview

Export

Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login