Abstract
Unsupervised anomaly detection in medical imaging aims to automatically identify potential lesions that deviate from normal patterns in multimodal medical images without requiring annotations of abnormal samples, and is of great clinical value for early disease screening, unknown anomaly discovery, and label-scarce or open-set detection scenarios. Compared with industrial anomaly detection, medical images are characterized by complex anatomical structures, high semantic complexity of abnormalities, substantial inter-individual variability, and high annotation costs, which make the modeling and evaluation of related methods more challenging. This review systematically surveys unsupervised anomaly detection methods for medical imaging. By integrating task definitions, technological evolution, and clinical application needs, we comprehensively analyze 149 representative studies and 16 commonly used datasets collected from major academic databases. First, according to their core modeling paradigms, existing mainstream methods are categorized into four groups: image reconstruction-based methods, feature embedding-based methods, self-supervised learning-based methods, and foundation model-based methods. The technical characteristics, applicable scenarios, and inherent limitations of each category are then systematically discussed. Furthermore, from the perspectives of medical image structural properties and clinical application requirements, we summarize the key challenges currently faced by medical image unsupervised anomaly detection, including abnormal semantic modeling, the reliability of anomaly quantification, cross-center generalization capability, and evaluation protocols. Finally, future research directions, such as multi-task modeling, medical prior-guided learning, and multimodal fusion, are discussed in depth.
1. Introduction
Medical imaging serves as a fundamental basis for modern medical diagnosis, treatment planning, and disease management. With the widespread use of various imaging modalities such as computed tomography (CT), magnetic resonance imaging (MRI), X-ray, endoscopy, and histopathological slides, the volume of medical imaging data has increased dramatically. However, image interpretation still largely relies on the experience and subjective judgment of clinicians, which is not only time-consuming and labor-intensive but also susceptible to fatigue and inter-observer variability. Therefore, automatically identifying potential abnormalities from massive medical imaging data using artificial intelligence (AI) techniques has become an important research direction in intelligent medical image analysis [1].
In medical image analysis, anomaly detection (AD) aims to identify abnormal samples or regions that deviate from normal patterns [2]. Compared with traditional medical image classification or lesion segmentation tasks, medical imaging anomaly detection is more consistent with the actual clinical diagnostic workflow. When analyzing medical images, clinicians usually do not directly determine the disease category. Instead, they first identify suspicious abnormal manifestations and subsequently infer possible pathological conditions based on their morphology, intensity, or structural characteristics. Moreover, the types of abnormalities encountered in real-world clinical cases are often open-ended and uncertain. Consequently, anomaly detection methods can mimic this clinical reasoning process of “detection before diagnosis,” demonstrating stronger generalization capability for complex, unknown, or rare pathological patterns. In tasks such as early disease screening (e.g., brain tumors, pulmonary nodules, and retinal disorders), intraoperative navigation, lesion monitoring, and imaging quality control, anomaly detection has shown significant clinical value.
However, medical imaging data typically exhibit high dimensionality, high noise levels, and strong structural correlations. In addition, physiological variations across individuals lead to substantial diversity in the distribution of normal samples themselves [3]. Meanwhile, abnormal samples in real clinical datasets are usually scarce and highly imbalanced. Certain rare diseases or early-stage lesions account for only a very small proportion of the data. The annotation of such abnormalities often requires expert clinicians to perform fine-grained delineation or grading, which is costly and subject to subjective variability. Furthermore, the types of abnormalities encountered in clinical practice continuously evolve, and newly emerging pathological patterns may not be included in existing category systems. These factors collectively make it difficult for traditional supervised learning methods, which rely heavily on large numbers of labeled abnormal samples, to be reliably applied in medical scenarios.
Against this background, increasing attention has been directed toward medical imaging unsupervised anomaly detection (MUAD). Such methods follow the core idea of learning only the distribution of normal samples. By modeling the statistical characteristics or semantic representations of normal images (i.e., images without significant abnormal structures or pathological signs), they detect anomalous samples that deviate from the learned normal distribution during inference [4]. Unsupervised anomaly detection first achieved remarkable progress in the field of industrial visual inspection and was subsequently gradually transferred to medical imaging applications. Since normal medical images can be continuously collected through routine examinations and screenings, whereas abnormal samples are relatively scarce and highly diverse in appearance, MUAD provides a more scalable technical paradigm for addressing the challenges of limited abnormal data and open-set anomalies in medical imaging. In essence, MUAD aims to detect and localize potential abnormalities without relying on large amounts of annotated anomalous data, making it particularly suitable for real-world clinical scenarios where abnormal annotations are scarce or incomplete. Such capability is especially important in applications such as early disease screening, rare disease detection, and imaging-based monitoring, where unknown or subtle abnormalities need to be identified in a data-driven manner. Accordingly, MUAD has demonstrated promising potential in real-world clinical applications.
Existing survey studies [5,6] mainly focus on industrial image anomaly detection (industrial imaging unsupervised anomaly detection, IUAD) or specific benchmark datasets (such as MVTec AD [7] and VisA [8]). In contrast, systematic reviews dedicated to MUAD remain relatively limited. Although a few surveys on medical anomaly detection have been reported [2,9], they were either published relatively early and therefore cannot cover the rapidly emerging methods in recent years, or primarily concentrate on a single technical paradigm (e.g., image reconstruction-based approaches), lacking a comprehensive summary of multiple mainstream methodologies. Meanwhile, with the rapid development of deep learning techniques, MUAD has gradually become an important research topic in medical artificial intelligence. As illustrated in Figure 1, the number of related publications from 2019 to 2025 has steadily increased, reflecting growing research interest in this field. However, existing studies often discuss methods in an isolated manner, without providing a unified perspective to understand how different modeling paradigms address the core challenges of MUAD. Therefore, a structured and mechanism-oriented survey is needed to systematically organize existing methods and clarify their relationships, strengths, and limitations. Furthermore, medical imaging anomaly detection differs significantly from industrial visual inspection tasks in several aspects. Medical abnormalities often manifest as subtle structural variations with complex morphology and ambiguous semantics, and they are influenced by individual physiological differences, variations in imaging conditions, and clinical interpretability requirements. These characteristics pose greater challenges for feature modeling and performance evaluation. Therefore, it is necessary to systematically review MUAD methods from the perspective of medical imaging applications; clarify their technical characteristics, applicable scenarios, and development trends; and provide guidance for method design, clinical deployment, and future research directions.
Figure 1.
Annual number of publications in medical image unsupervised anomaly detection from 2019 to 2025. Data were collected from the Semantic Scholar database based on keyword retrieval.
Motivated by these considerations, this paper systematically reviews 149 representative studies and 16 commonly used public datasets. To provide a clear and coherent understanding of the field, this survey follows the general organization commonly adopted in recent survey studies [2,3,9]. We first define the MUAD problem and summarize its unique challenges. We then systematically review existing methods according to their underlying modeling mechanisms. Next, we analyze how different categories of methods address the core difficulties of MUAD and discuss their strengths and limitations. Finally, we summarize open problems and future research directions. Figure 2 illustrates the overall structure of this survey. The main contributions of this survey are summarized as follows:
Figure 2.
Structure of this survey. The paper is organized from the research background and problem definition of medical imaging unsupervised anomaly detection (MUAD), to a systematic review of methodological paradigms, followed by benchmark datasets and evaluation, and finally a discussion of current challenges and future research directions.
- We clarify the problem setting, clinical significance, and representative application scenarios of medical imaging unsupervised anomaly detection. Building on this, we compare MUAD with industrial image anomaly detection from a cross-domain perspective to highlight the distinctive challenges of medical imaging, including complex anomaly semantics, substantial domain shifts, and limited annotation resources.
- We present a systematic taxonomy of existing MUAD approaches, categorizing them into four major paradigms: image reconstruction, feature embedding, self-supervised learning, and foundation-model-based methods. In addition, we summarize representative models, widely used benchmark datasets, and evaluation metrics, providing a comprehensive overview of the MUAD research landscape.
- We analyze key challenges in current MUAD research, including reconstruction bias, domain discrepancies, reliability of anomaly scoring, and inconsistencies in evaluation protocols. Furthermore, we discuss several promising future research directions, such as cross-modal fusion, knowledge-guided learning, and the development of medical foundation models.
2. Research Background and Problem Definition
2.1. Task Definition
Medical imaging anomaly detection is an important research direction in medical artificial intelligence. Its objective is to automatically identify regions that deviate from normal anatomical or physiological patterns in various medical imaging modalities, such as CT, MRI, X-ray, and ultrasound, thereby enabling image-level anomaly detection or pixel-level lesion localization [10]. These abnormal deviations usually correspond to potential pathological conditions or functional abnormalities of tissues, including tumors, ischemia, hemorrhage, inflammation, or other pathological alterations, which serve as crucial evidence for clinical decision-making. Therefore, medical imaging anomaly detection is considered one of the key tasks in computer-aided diagnosis (CAD).
In practical applications, the primary goal of medical imaging anomaly detection is to identify various potential disease-related abnormalities from medical images. However, clinical datasets generally exhibit characteristics such as scarcity of abnormal samples, incomplete annotations, and severe class imbalance, making traditional supervised methods that rely on large amounts of labeled data difficult to apply effectively [3]. In this context, medical imaging unsupervised anomaly detection (MUAD) has emerged as a promising paradigm. The fundamental idea of MUAD is to learn the statistical distribution or semantic representations of normal tissues using only normal samples during training, and to identify potential lesions during inference through reconstruction errors, probabilistic deviations, or abnormal patterns in feature space [11].
Furthermore, medical anomalies often exhibit open-set characteristics and complex data distributions, which makes conventional modeling approaches based on fixed category assumptions insufficient to fully capture real clinical scenarios. By modeling the distribution of normal data to detect deviations, MUAD not only extends the research paradigm of open-set anomaly detection but also better aligns with practical clinical needs, such as early disease screening and the discovery of previously unseen abnormalities. Consequently, MUAD has significant research value and promising clinical application potential.
As illustrated in Figure 3, according to the detection granularity, MUAD tasks can generally be divided into two categories.
Figure 3.
Illustration of image-level anomaly detection and pixel-level anomaly localization. Image-level anomaly detection classifies images according to a global anomaly score with a predefined threshold and highlights potential abnormal regions using heatmaps. Pixel-level anomaly localization generates a pixel-wise anomaly score map (e.g., anomaly saliency or probability map) to delineate abnormal regions, which is evaluated against the ground-truth mask using metrics such as Dice, IoU, and AUPRO. Green boxes indicate the ground-truth anomaly bounding boxes provided in the dataset. Warmer colors in the heatmaps represent higher anomaly scores.
- 1.
- Image-level unsupervised anomaly detection (Image-level UAD): This task aims to determine whether an entire image deviates from the normal distribution. When trained only on normal samples, the model outputs a global anomaly score for each input image, and a predefined threshold is used to classify the image as normal or abnormal. This task is commonly applied in practical scenarios such as disease screening, medical image quality control, and diagnostic assistance. From a methodological perspective, image-level anomaly detection is closely related to paradigms such as one-class detection and out-of-distribution detection, rather than traditional medical image classification.
- 2.
- Pixel-level unsupervised anomaly detection (Pixel-level UAD): This task aims to automatically generate anomaly saliency maps or probability maps without relying on pixel-level annotations, thereby locating potential lesion regions and analyzing local structural deviations. Compared with image-level detection, this task not only determines whether anomalies exist but also emphasizes the spatial distribution of abnormal regions. It is commonly used for lesion localization, boundary analysis, and lesion volume quantification, and can essentially be regarded as a form of anomaly saliency detection.
Although image-level and pixel-level tasks differ in their output formats, they are not entirely independent in practical method frameworks. In general, these two tasks differ mainly in terms of granularity and evaluation protocols: image-level tasks focus on the accuracy of detecting abnormal images, whereas pixel-level tasks emphasize the ability to localize and segment anomalous regions. Nevertheless, in most MUAD approaches, models learn the distribution of normal samples and generate both image-level anomaly scores and pixel-level anomaly maps within a unified framework using different anomaly measurement strategies. Therefore, these two tasks can be regarded as different perspectives within the same unsupervised anomaly detection framework, both built upon the learning of normal patterns and jointly forming the primary task paradigms in current MUAD research.
2.2. General Formulation of MUAD
To provide a unified modeling perspective for the diverse MUAD methods reviewed in this survey, we briefly formulate the general learning objective and inference process of medical imaging unsupervised anomaly detection. In MUAD, the training set usually contains only normal samples, which can be denoted as
where denotes the distribution of normal medical images. The goal is to learn a model from normal data:
where denotes the training objective, which may vary across different methodological paradigms.
During inference, a test image x is assigned an anomaly score
where denotes the anomaly scoring function. For image-level anomaly detection, the prediction is obtained by thresholding the anomaly score:
where and indicate abnormal and normal images, respectively. For pixel-level anomaly localization, the model further produces an anomaly map
where each spatial location reflects the degree of abnormality of the corresponding region. Under this formulation, most MUAD methods can be viewed within a common framework of normal pattern learning, anomaly scoring, and final image-level or pixel-level prediction.
The general formulation above can be further illustrated from the perspective of the overall MUAD pipeline. As shown in Figure 4, MUAD usually consists of two stages: in the training phase, the model learns normal patterns from normal-only medical images; in the inference phase, the test image is compared with the learned normality model to produce anomaly evidence and corresponding anomaly scores, which are then used for image-level detection or pixel-level localization.
Figure 4.
General pipeline of medical imaging unsupervised anomaly detection (MUAD), including the training phase of normal pattern learning and the inference phase of anomaly scoring and prediction.
2.3. Why Medical Anomaly Detection Requires Domain-Specific Modeling
Medical anomaly detection is closely related to the broader development of visual anomaly detection, yet its problem setting is substantially more complex. Early anomaly detection research was often explored in industrial inspection, where images are usually acquired under relatively controlled conditions and anomalies tend to present clearer visual patterns. Such settings provided an important basis for the development of unsupervised anomaly detection methods. However, the purpose of introducing these related domains here is not to shift the focus away from medical imaging, but to clarify the unique challenges and modeling demands of MUAD.
Although both MUAD and IUAD aim to identify abnormal patterns from images, and IUAD has formed a relatively mature methodological framework, the two domains differ fundamentally in anomaly characteristics and task requirements. As illustrated in Figure 5, industrial defects are often localized, visually explicit, and associated with relatively stable textures or structures. In contrast, medical abnormalities are usually embedded in complex anatomical contexts and may appear as subtle structural or semantic deviations with ambiguous boundaries, multi-scale variations, and strong dependence on imaging modality and individual physiology. These differences make it difficult to directly transfer IUAD methods to medical imaging scenarios. Beyond these visual differences, MUAD and IUAD also differ substantially in data properties and modeling priorities. As summarized in Table 1, medical images involve greater modality diversity, stronger inter-subject variability, scarcer abnormal samples, and much higher annotation costs due to the need for expert knowledge as well as privacy and ethical constraints. In addition, MUAD places greater emphasis on semantic structure modeling, clinical interpretability, and reliability, whereas IUAD more often focuses on texture representation, computational efficiency, and deployment stability.
Figure 5.
Comparison diagram of medical images and industrial images. The green box represents the abnormal area.
Table 1.
Comparison between industrial imaging unsupervised anomaly detection (IUAD) and medical imaging unsupervised anomaly detection (MUAD).
Related anomaly detection studies have also been developed in remote sensing and video understanding [12,13,14]. Remote sensing anomaly detection often focuses on spectrally rare targets that deviate from the surrounding background, while video anomaly detection mainly concerns abnormal events in dynamic scenes and thus relies on spatiotemporal modeling. By comparison, MUAD is more strongly constrained by anatomical priors, modality heterogeneity, and the clinical semantics of abnormalities.
Overall, methods from industrial inspection, remote sensing, and video analysis provide useful inspiration for MUAD, such as robust representation learning, effective learning strategies, and recent foundation-model-based paradigms. Nevertheless, these methods cannot be directly applied to medical imaging without adaptation. Their transfer to MUAD requires explicit consideration of medical-specific challenges, including anatomical complexity, semantic ambiguity, modality diversity, and clinical interpretability.
2.4. Medical Imaging Modalities and Application Scenarios
Beyond differences in task objectives and data characteristics, medical imaging anomaly detection also faces more complex data source issues. Different medical imaging modalities exhibit significant variations in imaging mechanisms, structural representations, and noise characteristics, which directly influence the task focus and technical challenges of MUAD methods under different modalities.
For example, X-ray images mainly represent projection structures, CT and MRI emphasize three-dimensional anatomical consistency, histopathological and dermoscopic images present fine-grained textures, while endoscopy, ultrasound, and ophthalmic images are often significantly affected by illumination variations or imaging noise.
Therefore, understanding the imaging characteristics and abnormal manifestations across different modalities is crucial for the design and evaluation of medical imaging anomaly detection methods. Table 2 summarizes the major medical imaging modalities involved in anomaly detection research, along with their typical anomalies, imaging characteristics, modality-specific challenges, and commonly used datasets. This provides a unified background for subsequent methodological discussions.
In summary, MUAD has been explored across nearly all mainstream medical imaging modalities. From two-dimensional imaging such as X-ray, retinal fundus images, and endoscopic images, to three-dimensional modalities such as CT and MRI, and even gigapixel-scale histopathological whole slide images, unsupervised anomaly detection methods have demonstrated broad applicability across diverse imaging scenarios. A large body of research indicates that these methods show promising potential in tasks such as anomaly screening, early lesion discovery, and large-scale clinical data pre-screening. Their cross-modality applicability further highlights the importance of unsupervised anomaly detection in addressing key challenges in medical imaging, including data imbalance, rarity of abnormal samples, and limited annotation availability. In addition, from an application-oriented perspective, such cross-modality adaptability also suggests potential value for practical scenarios including suspicious case flagging, triage support, candidate lesion prompting, and image quality control [15]. For example, MUAD models with cross-scale adaptation ability may support suspicious case flagging by capturing both coarse structural abnormalities and subtle local lesions, while also providing candidate lesion prompts by highlighting anomalous regions across different spatial scales. However, robust deployment in real clinical workflows still requires further validation under heterogeneous real-world conditions.
Table 2.
Summary of typical anomalies, imaging characteristics, challenges, datasets, and representative methods across different medical imaging modalities.
2.5. Technical Evolution
Early studies on MUAD mainly relied on traditional machine learning techniques, such as principal component analysis (PCA) [50], Gaussian mixture models, and sparse coding [51]. These approaches attempted to identify anomalies by describing the low-dimensional statistical characteristics of normal samples. While such methods can achieve reasonable performance in tasks with relatively regular structures, they often struggle to capture deeper semantic variations when dealing with the high dimensionality, complex morphology, and inter-subject variability inherent in medical imaging data. With the rapid development of deep learning, medical imaging anomaly detection methods have gradually evolved from shallow statistical modeling toward deep semantic representation learning. Early deep-learning-based approaches were primarily reconstruction-based methods built upon generative models, including Autoencoders (AE) [52], Variational Autoencoders (VAE) [53], Generative Adversarial Networks (GAN) [54], and Denoising Diffusion Probabilistic Models (DDPM) [10,55]. These models learn the generative mapping of normal samples and quantify anomalies using reconstruction errors between the input and reconstructed images. Subsequently, researchers realized that medical anomalies often involve anatomical structure variations and high-level semantic differences. Therefore, relying solely on reconstruction is insufficient to accurately characterize the distribution of normal medical images. This observation has led to the rapid development of feature embedding-based approaches, which leverage pretrained models to model normal patterns in deep feature spaces. Typical strategies include teacher–student frameworks [56,57], patch-level distribution modeling [58,59], memory bank mechanisms [60], and normalizing flow models [61,62]. By learning the distribution of normal samples in high-level feature spaces, these methods significantly improve the robustness and generalization capability of anomaly detection models. To further enhance semantic representation learning under the absence of labeled anomalies, self-supervised learning [63,64,65,66] and contrastive learning [67,68] approaches have attracted increasing attention. These methods construct auxiliary proxy tasks or feature-level contrastive constraints, enabling models to automatically learn semantic representations that are sensitive to anomalies without relying on manual annotations. More recently, with the rapid development of the foundation model paradigm, researchers have begun to introduce large-scale pretrained models, including vision–language models and large language models [69,70]. By jointly modeling images, textual descriptions, and clinical knowledge, these approaches aim to enhance semantic understanding, improve model interpretability, and ultimately increase the clinical applicability of anomaly detection systems.
As shown in Figure 6, MUAD research has gradually evolved from early reconstruction-driven generative models toward approaches that model deep feature distributions, and has further integrated techniques such as self-supervised learning, diffusion models, and cross-modal foundation models. This evolution reflects a clear transition from low-level pixel modeling to high-level semantic understanding. Overall, MUAD has progressed from early “pixel reconstruction” paradigms to more comprehensive frameworks that integrate generative modeling, feature matching, and cross-modal semantic understanding. Correspondingly, the core objective of MUAD has gradually shifted from merely “detecting anomalies” toward “understanding anomalies”, providing a clearer technological trajectory for the development of future methods.
Figure 6.
A schematic diagram illustrating the development trend of unsupervised anomaly detection methods for medical images from 2020 to 2026. Different colors represent reconstruction-based methods, feature embedding-based methods, self-supervised learning approaches, and foundation model-based approaches, respectively. The methods shown and their corresponding references are: f-AnoGAN [71], VQ-VAEs [72], MADGAN [73], DifferNet [74], Patch SVDD [75], MAMA Net [76], Marimont & Tarroni, 2021 [77], STPM [78], CS-FLOW [79], PMSACL [47], HealthyGAN [80], StRegA [81], Pinaya et al., 2022 [24], mDDPM [82], EDC [83], DDAD-ASR [84], Kascenas et al., 2023 [85], Brainomaly [25], CRADL [86], SSL-AnoVAE [87], SAGAN [88], Hetero-AE [35], Fontanella et al., 2023 [89], Xu et al., 2024 [90], PatchCL-AE [91], MAFV [92], MediCLIP [93], D24FAD [94], VisualAD [42], WMoE-CLIP [95], AnomalyMoE [96], AdaptCLIP [97], SCRD [98], ESC-DRKD [36], EA2D [39], OFF-CLIP [99], MadCLIP [100], Xu et al., 2025 [101]. For works initially released as preprints, the earliest publicly available version year is used; minor discrepancies with formal publication dates may exist.
2.6. Key Challenges in MUAD Research
In recent years, although MUAD has made notable progress in method design and application scenarios, existing studies still face a number of critical challenges due to the complexity of medical data and the inherent constraints of the unsupervised learning paradigm.
- 1.
- Complex medical image structures and significant intrinsic variability. Medical images exhibit natural multi-scale structural hierarchies and strong tissue heterogeneity, covering morphological characteristics at the organ, tissue, and even cellular levels. Different scales often differ substantially in terms of spatial organization and texture patterns. As illustrated in Figure 5, chest X-ray images present global anatomical contours, brain MRI reflects complex brain region structures, and OCT images display highly layered tissue morphology. Therefore, even normal anatomical structures already exhibit highly complex hierarchical organization. In addition, substantial inter-subject variations exist in anatomical structures, physiological conditions, and imaging settings, resulting in highly dispersed distributions of normal samples and making it difficult to establish a unified and stable model of normality. Moreover, imaging devices, acquisition protocols, and imaging artifacts may introduce non-pathological variations that resemble lesion appearance, further interfering with anomaly discrimination. This issue is one of the core challenges that subsequent reconstruction-based and feature embedding-based methods attempt to address.
- 2.
- Strong semantic properties and diverse manifestations of medical anomalies. Abnormalities in medical images usually correspond to specific pathological types or disease states, and their identification is therefore closer to disease recognition than to simple visual outlier detection. As illustrated in Figure 5, many lesions do not manifest as obvious intensity or texture abnormalities; instead, they are reflected as structural deformations or abnormal tissue distributions, such as local compression caused by intracranial space-occupying lesions or disorganization of retinal layer structures. At the same time, the normal anatomical structures of different organs vary substantially, and anomalies themselves are highly diverse in scale, shape, and contrast. Consequently, unsupervised methods that rely only on low-level visual features or statistical deviations often fail to robustly characterize the essence of abnormalities, which also limits the semantic interpretability of anomaly detection results. How to move beyond low-level reconstruction toward high-level semantic modeling has therefore become an important direction in the subsequent evolution of MUAD methods.
- 3.
- Inherent limitations of unsupervised anomaly detection methods. Under the unsupervised setting for medical anomaly detection, most methods identify anomalies based on reconstruction errors, feature deviations, or similarity discrepancies. However, reconstruction-based methods are prone to partially reconstructing abnormal regions, which weakens anomaly contrast. Feature modeling methods, on the other hand, are easily affected by domain shifts and the limited suitability of pretrained models, resulting in unstable decision boundaries. In addition, self-supervised and multimodal methods still face limitations in pseudo-anomaly construction and semantic alignment. Meanwhile, features pretrained on natural images often have limited ability to represent low-contrast and weak-boundary medical structures, further reducing the reliability of anomaly measurement. These limitations have also driven the continued development of feature embedding-based, self-supervised, and foundation model-based methods.
- 4.
- Scarce annotations and limitations of evaluation metrics. Although unsupervised anomaly detection does not rely on abnormal annotations during training, reliable model evaluation still requires sufficiently accurate annotations as reference standards. However, high-quality annotations in medical imaging, especially pixel-level labels, are extremely scarce. In addition, some commonly used evaluation metrics may fail to objectively reflect clinical requirements when anomalous regions are sparse or highly localized. Under this circumstance, improving the quality of learned representations has become an important focus of self-supervised learning methods.
- 5.
- Insufficient generalization and limited clinical interpretability. Early MUAD methods were typically evaluated on a single imaging modality, whereas more recent studies have begun to explore multi-modality and cross-domain validation. However, achieving robust generalization across different medical imaging settings remains an open challenge. In practice, model performance may still degrade under cross-modality, cross-organ, multi-center, and cross-protocol scenarios, due to substantial differences in imaging mechanisms, anatomical structures, organ characteristics, acquisition devices, and population distributions. In addition, abnormal patterns in medical images are often highly heterogeneous and context-dependent, which further increases the difficulty of learning transferable representations of normality and abnormality. Meanwhile, model outputs are still commonly presented as anomaly scores or heatmaps, which are often difficult to align directly with pathological semantics and clinical diagnostic reasoning. This gap limits the practical clinical usability of current MUAD systems. These challenges have also motivated the gradual introduction of foundation models to improve cross-modal generalization and high-level semantic interpretability.
3. Medical Imaging Unsupervised Anomaly Detection Methods
This section provides a systematic review of representative methods for MUAD. As illustrated in Figure 7, existing MUAD approaches can be broadly categorized into four groups: reconstruction-based methods, feature embedding-based methods, self-supervised learning methods, and foundation model-based methods.
Figure 7.
Taxonomy of medical imaging unsupervised anomaly detection (MUAD) methods. Hybrid methods are placed according to their dominant anomaly modeling mechanism, while auxiliary components are discussed in the corresponding sections.
Given that many recent MUAD methods integrate multiple technical elements, such as hybrid frameworks that combine reconstruction-based modeling with self-supervised learning, or foundation model-based approaches that introduce proxy tasks to construct auxiliary anomaly cues, this survey adopts a dominant paradigm-oriented principle for method categorization. Specifically, each method is assigned to the category corresponding to the core modeling idea that most directly determines how normal patterns are learned and how anomaly scores are generated. This principle is adopted because it reflects the core logic of MUAD methods: the way normality is modeled determines what the method regards as a reference for normal patterns, while the way anomaly evidence is derived determines how deviations are ultimately quantified and interpreted. Concretely, the categorization in this survey is mainly based on the following three aspects:
- 1.
- Which modeling paradigm the core methodological innovation of the paper primarily contributes to.
- 2.
- Which mechanism is mainly used to model the distribution of normal data.
- 3.
- Which module serves as the primary source of anomaly evidence or anomaly scores.
For hybrid methods, we assign them to the category that plays the dominant role in anomaly detection, while secondary components are briefly discussed where appropriate. This helps reduce ambiguity in categorizing hybrid methods and allows their main modeling contribution to be understood more clearly. Overall, this strategy helps avoid excessive fragmentation caused by differences in implementation-level module combinations, thereby providing a clearer view of the fundamental modeling logic, major strengths and limitations, and overall development trajectory of different MUAD methods. More importantly, it helps readers better understand the core modeling logic of different MUAD methods, compare their strengths and limitations under a unified perspective, and follow the overall development of the field more clearly.
3.1. Reconstruction-Based Methods
Reconstruction-based unsupervised anomaly detection methods represent one of the earliest and most fundamental paradigms in MUAD. The core idea is to learn the encoding process, latent space representation, and decoding mechanism of normal images only. During inference, abnormal regions cannot be faithfully reconstructed, leading to significant reconstruction discrepancies that can be used for anomaly detection.
As illustrated in Figure 8, the input image is reconstructed into a pseudo-normal version, and the difference between the input and reconstructed image can be used to localize potential lesions. Depending on the type of generative model employed, existing reconstruction-based methods can be further divided into AE-based, VAE-based, GAN-based, and diffusion-based approaches.
Figure 8.
Illustration of reconstruction-based methods. The generative model can be implemented using AE, VAE, GAN, or diffusion models, and anomalies are detected based on reconstruction errors. High-intensity regions in the anomaly map indicate potential abnormal lesions, while the green bounding box denotes the ground-truth lesion region.
3.1.1. Autoencoder-Based Methods
AEs are among the earliest reconstruction-based methods applied to MUAD. They encode input images into latent representations through an encoder and reconstruct the images via a decoder. Due to the relatively stable structural priors in medical images (e.g., brain MRI, chest X-ray, and retinal images), AEs can effectively capture the consistency of normal anatomical structures. Early studies, such as those by Zimmerer et al. [102] and Baur et al. [103], demonstrated that convolutional AEs can reconstruct normal anatomical structures in brain MRI and highlight abnormal regions via reconstruction residuals. However, such models typically suffer from two major limitations: (1) Identity mapping problem: due to strong model capacity, the network may learn to directly copy the input image instead of reconstructing a normalized version, resulting in the so-called anomaly leakage, where abnormal regions are also reconstructed. (2) Blurry reconstruction: deep AEs often fail to preserve high-frequency texture details, leading to blurred reconstruction even in normal regions.
To improve robustness, denoising autoencoders (DAE) [104] have been introduced. By adding noise to normal images and learning to recover clean images, DAE encourages the model to focus on structural information rather than pixel-wise replication. Kascenas et al. [85,105] systematically analyzed the impact of noise patterns on DAE performance and showed that coarse-grained noise at intermediate spatial scales is more effective than pixel-level noise in enforcing structural consistency, thereby improving anomaly sensitivity. With the increasing adoption of Transformer architectures, masking strategies have also been introduced to mitigate the identity mapping problem. Tian et al. [106] employed a high ratio of random masking, forcing the model to reconstruct missing regions based on global contextual information rather than relying solely on visible patches. Additionally, multi-level cross-attention mechanisms were introduced in the decoder to fuse hierarchical semantic features, improving reconstruction consistency. In three-dimensional scenarios, AE-based methods have also been extended to volumetric modeling. Luo et al. [107] proposed a 3D residual AE framework that directly reconstructs whole-brain MRI volumes, enabling the model to capture spatial relationships across slices.
Another line of research focuses on improving the structural consistency of AE-based models. Zhang et al. [108] pointed out that skip connections may introduce semantic inconsistencies between encoder and decoder features, thereby weakening anomaly discrimination. To address this issue, they designed chained convolutional blocks for feature alignment and incorporated adversarial latent constraints to enhance reconstruction quality. Bercea et al. [109] explicitly modeled local deformation fields to align anatomical variations across individuals, while incorporating perceptual loss to preserve global structural consistency. This approach effectively mitigates the tendency of shallow AEs to reconstruct anomalies and deep AEs to produce overly smooth reconstructions. Lu et al. [35] proposed a heterogeneous architecture with a CNN-based encoder and a hybrid CNN–Transformer decoder, leveraging different inductive biases to avoid identity mapping. Furthermore, they replaced pixel-wise reconstruction errors with multi-stage feature comparison, thereby amplifying reconstruction discrepancies in anomalous regions. Bercea et al. [110] further introduced a reverse training mechanism, incorporating multi-scale consistency loss and adversarial latent constraints to improve reconstruction quality. Their method demonstrates robust performance across multiple modalities, including MRI, chest X-ray, and wrist X-ray.
Notably, Cai et al. [111] showed that the effectiveness of AE-based anomaly detection is closely related to the capacity of the latent space. An excessively large latent space tends to encourage identity mapping, allowing anomalies to be reconstructed. In contrast, a properly constrained latent space forces the model to preserve normal patterns while suppressing abnormal features. This finding provides an important guideline for the structural design of AE-based models.
3.1.2. Variational Autoencoder-Based Methods
VAEs extend standard autoencoders by introducing probabilistic modeling, where input images are mapped to latent distributions rather than deterministic feature vectors. By imposing a Kullback–Leibler (KL) divergence constraint on the latent space, VAEs learn a continuous, structured, and semantically meaningful distribution of normal samples. In the context of unsupervised anomaly detection, VAEs can identify anomalies using both reconstruction errors and deviations in latent distributions. However, this mechanism also introduces certain limitations. The KL regularization term encourages the latent space to approximate an isotropic Gaussian distribution, while the reconstruction process typically relies on an loss. Together, these factors often lead to over-smoothed reconstructions with blurred edges and loss of fine details. Early work by Zimmerer et al. [112] systematically compared reconstruction error, KL divergence, and ELBO gradients for anomaly localization, demonstrating that combining KL gradients with reconstruction errors significantly improves the stability of brain tumor localization. Importantly, they highlighted that latent distribution shift itself serves as a critical cue for anomaly detection.
To enhance structural representation, Marimont and Tarroni [77] proposed using implicit field representations instead of direct pixel-wise modeling, resulting in sharper reconstructions and alleviating the blurring issue inherent in conventional VAEs. In addition, vector quantized VAE (VQ-VAE) [113] introduces discrete latent representations, strengthening latent space constraints. Marimont et al. [72] further discretized the latent space into a visual codebook, forcing images to be projected onto normal patterns. They also proposed a latent repair strategy, which projects anomalous inputs back into the normal latent space during inference, yielding more reliable reconstructions and improving anomaly localization performance in brain MRI. Pinaya et al. [24] combined VAE with 3D Transformer architectures to enhance cross-slice semantic modeling through attention mechanisms. By incorporating an autoregressive prior, their approach improves the structural organization of the latent space and achieves better global consistency in 3D brain MRI reconstruction.
To improve clinical robustness, StRegA [81] replaces raw MRI inputs with brain tissue segmentation maps, reducing cross-center variability. Building upon ceVAE (context-encoding VAE) [102], it further constructs a more compact encoding structure, enabling the model to learn normal anatomical distributions within a more consistent structural space. Tri-VAE [114] points out that conventional projection-based VAEs cannot guarantee alignment between anomalous inputs and the normal latent space. To address this, it introduces triplet metric learning to compress the distribution of normal samples in latent space and employs a resampling strategy for anomaly alignment. Additionally, gated skip connections are used to suppress anomaly leakage, further improving anomaly detection performance.
3.1.3. GAN-Based Methods
GANs learn the distribution of normal samples through adversarial training between a generator and a discriminator. The generator produces realistic normal images from latent variables, while the discriminator distinguishes between real samples and generated outputs. Compared with AEs and VAEs, GAN-based methods are more effective at capturing high-frequency textures and fine structural details, making them particularly suitable for medical imaging tasks with strong structural priors. However, GAN training relies on adversarial optimization, which is inherently unstable and prone to mode collapse, where the generator learns only a subset of the normal distribution. This often results in limited diversity in generated images and may cause abnormal structures to be incorrectly reconstructed as normal patterns.
AnoGAN [54] is one of the earliest methods that applied GANs to reconstruction-based anomaly detection in medical imaging. It performs anomaly detection by iteratively optimizing latent variables so that the generated image matches the input as closely as possible. However, this process is computationally expensive and results in slow inference. f-AnoGAN [71] improves efficiency by introducing an encoder to directly estimate latent representations, but it still struggles to capture fine-grained details, leading to suboptimal reconstructions. Considering that structural abnormalities often exhibit continuity across slices, Han et al. [73] introduced multi-slice reconstruction by leveraging contextual information from adjacent MRI slices, thereby improving sensitivity to structural anomalies. Kuttala et al. [115] further incorporated dense connections and attention mechanisms to enhance the modeling of local structural variations. In clinical applications, Kim et al. [116] demonstrated that combining reconstruction error with feature distance enables effective anomaly scoring for CT images in breast radiotherapy patients, highlighting the practical applicability of GAN-based reconstruction methods.
As research progresses, GAN-based methods have evolved from simply reconstructing normal images to generating lesion-free images while preserving individual anatomical structures [117]. The key idea is to maintain patient-specific anatomy while repairing lesion regions to resemble normal tissue, thereby producing clearer anomaly boundaries in difference maps. For example, Bercea et al. [118] proposed a two-stage inverse generation strategy: first estimating suspicious regions in latent space and then performing localized normal restoration using GAN. This forward–backward mapping inconsistency enhances anomaly localization accuracy. More recent approaches attempt to leverage abundant unlabeled real-world data [25,80,88,119], thereby improving generalization and reducing reliance on purely normal datasets. Instead of training solely on normal samples, these methods jointly use normal and unlabeled images as input and enforce reconstruction into the normal domain, effectively enlarging the discrepancy between normal and abnormal samples in reconstruction space. For instance, HealthyGAN [80] employs mask-guided implicit cycle consistency to generate pseudo-normal images. Brainomaly [25] focuses on aligned T1 MRI data and enhances anomaly detection by learning local residual maps that preserve structure while highlighting abnormalities. Zhang et al. [88] introduced anatomical-consistent positional encoding and hierarchical attention gating mechanisms to improve lesion restoration. PAttL-GAN [119] further incorporates multi-scale fusion and pixel-level attention, making reconstructed pseudo-normal images more sensitive to local structural differences.
In addition, Bougaham et al. [120] utilized cycle-consistent adversarial networks to enforce bidirectional constraints between normal and abnormal domains, while incorporating structure-preserving loss to maintain anatomical consistency during lesion correction. To alleviate the identity mapping problem, Zhang et al. [32] proposed dynamically disabling skip connections to prevent direct copying of low-level textures, thereby enhancing the distinguishability of anomalous regions. Furthermore, they introduced histogram of oriented gradients (HOG) as an auxiliary structural feature and adopted multi-task learning to improve sensitivity to local edge and texture variations.
3.1.4. Diffusion Model-Based Methods
Diffusion models learn the distribution of normal samples by progressively adding noise to images and restoring them through a reverse denoising process. During inference, the model maps an input image to its pseudo-normal counterpart, and anomalies are revealed through reconstruction discrepancies. Compared with GAN-based approaches, diffusion models offer more stable training and are not affected by mode collapse. AnoDDPM [55] is the first work to introduce diffusion models into MUAD. It replaces conventional Gaussian noise with simplex noise to more effectively disrupt low-frequency structures and adopts a partial diffusion strategy to significantly reduce inference cost, enabling its application to high-resolution medical images. While AnoDDPM improves pseudo-normal generation from the perspective of noise design, Wolleb et al. [10] focused on the diffusion process itself and proposed multi-step reconstruction residuals for anomaly localization, systematically analyzing key design factors of diffusion-based methods.
However, performing global diffusion over entire images is computationally expensive and often lacks sensitivity to small or subtle anomalies. As a result, subsequent research has shifted toward more efficient local modeling strategies. For example, pDDPM [121] applies noise only to image patches and reconstructs them using contextual information from neighboring regions, thereby enhancing local detail modeling while preserving global consistency. mDDPM [82] further introduces higher masking ratios to encourage the model to focus on structural reconstruction rather than texture recovery, leading to more stable anomaly localization. Bercea et al. [23] proposed an automatic mask generation strategy combined with local lesion restoration, and employed multiple resampling mechanisms to improve robustness and generalization. Beizaee et al. [122] extended this idea by performing masked diffusion in latent space and applying selective reverse diffusion to predicted anomalous regions during inference, enabling targeted local restoration and more precise lesion localization.
Meanwhile, another line of work emphasizes modeling global structural consistency. Behrendt et al. [123] extended diffusion-based reconstruction to 3D volumetric data and replaced pixel-wise residuals with structure consistency scores, improving the reliability of 3D lesion separation. Bercea et al. [124] introduced an implicit guidance mechanism that dynamically integrates temporal anomaly maps across diffusion steps, encouraging more complete restoration in abnormal regions while preserving appearance consistency in normal areas. Building upon this, Fontanella et al. [89] incorporated counterfactual generation into diffusion models by using prior saliency maps as intervention masks. Their approach applies stochastic denoising in anomalous regions and deterministic denoising in normal regions, forming a dual-path sampling strategy that repairs lesions while preserving individual anatomical structures. Compared with pseudo-normal reconstruction, the resulting counterfactual images exhibit stronger anatomical consistency and clearer lesion boundaries, improving interpretability. Bi et al. [125] proposed a structured noise injection strategy and multi-stage diffusion reconstruction, enabling coarse-to-fine pseudo-normal generation and producing more stable and distinct anomaly maps. In more recent work, Kim et al. [28] combined diffusion models with medical knowledge by incorporating electronic health record (EHR) information as cross-modal semantic guidance. Additionally, a checkerboard masking strategy was employed to enhance the consistency of pseudo-normal reconstruction in chest X-ray images, improving adaptability to individual variations and structural heterogeneity.
3.1.5. Summary of Reconstruction-Based Methods
Reconstruction-based methods constitute the earliest and one of the most fundamental paradigms in MUAD. Among them, AE and VAE models are relatively simple but have limited capacity to capture fine-grained lesions. GAN-based methods are capable of modeling high-frequency textures but suffer from training instability. Diffusion models achieve the highest reconstruction fidelity but are computationally expensive and, without proper constraints, may over-reconstruct anomalous regions.
One of the central challenges of reconstruction-based methods is the identity mapping problem. Since the training objective primarily minimizes reconstruction error, models tend to directly replicate the input image, treating anomalies as normal variations and reconstructing them accordingly. This issue becomes more pronounced as model capacity increases. However, excessively restricting reconstruction capability may prevent the generation of reliable pseudo-normal images. Therefore, reconstruction-based methods face an inherent trade-off between accurately restoring normal structures and effectively amplifying anomaly discrepancies. Although reconstruction residuals or structural consistency scores can serve as anomaly indicators, clinical diagnosis requires more explicit anatomical and semantic interpretations. Existing reconstruction-based approaches still lack sufficient clinical interpretability.
From a developmental perspective, reconstruction-based MUAD methods exhibit three notable trends: (1) A shift from global image reconstruction to localized and semantically informed reconstruction. Approaches such as masked reconstruction, patch-wise diffusion, and latent space repair no longer aim to recover the entire image, but instead focus on generating anatomically plausible normal structures. (2) A transition from generic image generation to the construction of clinically meaningful normal reference images. Many recent studies explicitly incorporate medical knowledge—such as anatomical structures, imaging physics, spatial priors, and electronic health records—into pseudo-normal generation, making the results more consistent with clinical reasoning. (3) An evolution from single reconstruction objectives to multi-task integration, where reconstruction is jointly modeled with feature embedding, contrastive learning, attention mechanisms, and memory modules to achieve more robust normal pattern modeling. Recent studies [3] further indicate that relying solely on pixel-level reconstruction is insufficient for complex medical imaging tasks. Future reconstruction-based MUAD methods should therefore focus on capturing anatomical semantics and generating outputs that better align with real clinical scenarios.
3.2. Feature Embedding-Based Methods
Different from reconstruction-based approaches that rely on pixel-level reconstruction errors, feature embedding-based anomaly detection focuses on modeling the statistical structure of normal patterns in deep semantic feature spaces. These methods construct a stable normal feature space and quantify anomalies based on the degree of feature deviation. According to different feature modeling strategies, existing approaches can be broadly categorized into one-class classification methods, pre-trained feature distribution modeling methods, memory-based methods, normalizing flow models, and teacher–student frameworks.
3.2.1. One-Class Classification Methods
One-class classification (OCC) methods aim to learn a decision boundary that encloses the majority of normal samples in the feature space, and measure anomaly scores based on the deviation of a sample from this boundary or region. Classical approaches include One-Class Support Vector Machine (OC-SVM) [126] and Support Vector Data Description (SVDD) [127]. The former learns a hyperplane in a high-dimensional space using kernel functions to separate data from the origin, while the latter models normal data as a compact hypersphere with minimal enclosing volume. With the development of deep learning, DeepSVDD [128] and its variants extend this idea to deep embedding spaces, enabling end-to-end training that encourages normal samples to cluster within a hyperspherical region in latent space. Liznerski et al. [129] further introduced anomaly score maps to enhance interpretability, making the approach more applicable in practical scenarios. To address fine-grained anomaly detection, Patch SVDD [75] extends SVDD to patch-level feature modeling, improving the capability of capturing local anomalies. Nguyen et al. [130] applied Gaussian interpolation to smooth feature distributions, thereby enhancing cross-modality stability. In specific medical applications, such as COVID-19 CT screening, Alhadad et al. [131] combined DeepSVDD with transfer learning to improve model adaptability. Meta-SVDD [132] further introduces meta-learning to enable few-shot adaptation across different pathological tasks. Despite their clear theoretical formulation and structural simplicity, OCC methods face limitations in modeling the highly complex and heterogeneous distributions of medical images. Due to significant inter-patient variability and intricate anatomical structures, normal patterns are difficult to represent as compact regions in feature space, which restricts the applicability of OCC methods in modern MUAD scenarios.
3.2.2. Pre-Trained Feature Distribution Modeling Methods
Pre-trained feature distribution modeling methods utilize deep features extracted from networks such as ResNet [133] and WideResNet [134], which are pre-trained on ImageNet [135], to learn the statistical regularities of normal samples in the feature space of medical images. Compared with early one-class boundary-based methods, pre-trained features inherently capture richer semantic representations, making them more suitable for modeling structural consistency across different scales and anatomical regions.
Ouardini et al. [136] were among the first to apply pre-trained feature similarity for anomaly detection in retinal images. PaDiM [58] extracts multi-scale features and models them using multivariate Gaussian distributions, where Mahalanobis distance is used to measure feature deviations, and has become a representative approach in this category. Wang et al. [137] proposed a local–global semantic consistency strategy to identify deviations at different semantic levels. SPADE [138] performs pixel-wise nearest neighbor matching based on multi-scale feature pyramids, enhancing the localization of fine-grained structural anomalies. Das et al. [33] combined domain-specific pre-trained features with sparse dictionary learning to construct a multi-scale sparse coding framework, achieving robust anomaly detection in retinal and OCT images. ADFA [41] employs WideResNet to extract multi-level features and improves the compactness of normal feature distributions through attention mechanisms and differentiable top-k selection. González-Jiménez et al. [139] modeled pre-trained features in hyperbolic space and constructed weighted semantic centroids to enhance separability among anomaly categories. Xu et al. [90] identified issues of ambiguous mapping and misaligned mapping when transferring pre-trained features to medical images, and proposed a semantic alignment mechanism based on intra- and inter-sample correlations to improve robustness. Tang et al. [83] pointed out that directly freezing ImageNet encoders leads to a semantic gap, and introduced a stop-gradient strategy to improve feature adaptation in the medical domain. The main contribution of pre-trained feature distribution modeling methods is the establishment of a paradigm that models normal patterns in a structured feature space. This paradigm provides the basis for subsequent developments, including memory-based modeling, normalizing flow methods, and teacher–student frameworks.
3.2.3. Memory-Based Methods
To more stably characterize the diversity of normal tissues, researchers construct memory banks in the pre-trained feature space to compactly store feature templates or prototypes of normal distributions. A prototype refers to a feature vector that represents a typical normal structure or texture pattern, serving as an important reference during inference. Since memory banks provide stable normal templates, they are often combined with reconstruction models to suppress the direct reconstruction of anomalies.
As illustrated in Figure 9, such methods first map the input into a latent representation, retrieve the most similar normal prototypes from the memory bank, and reconstruct the image based only on these prototypes. Consequently, anomalous regions are difficult to reconstruct accurately. When input features fail to find sufficiently similar prototypes in the memory bank, they are considered anomalous. MemAE [60] first introduced normal feature memory units into autoencoders, restricting reconstruction to rely on a limited number of normal templates and thus reducing anomaly leakage. Park et al. [140] further proposed a read-only memory mechanism, which retrieves the most similar patches from the normal memory via attention. Different from methods relying on image reconstruction and pixel-level errors, PatchCore [59] constructs a compact prototype set by selecting representative subsets from the feature distribution and performs efficient patch-level anomaly localization based on nearest neighbor distances.
Figure 9.
Illustration of memory bank and reconstruction model-based methods. Input features retrieve the most similar normal prototypes from the memory bank for reconstruction. Regions that cannot be matched with normal prototypes are highlighted as anomalies in the anomaly score map.
With the development of pre-trained vision models and multi-scale feature modeling, memory-based methods have gradually adapted to the multi-scale and cross-anatomical characteristics of medical images. Chen et al. [76] combined attention and memory modules on multi-scale features to capture both local textures and global anatomical patterns. Ceauşescu et al. [141] proposed an adaptive feature compression strategy to better cover inter-patient variability. Tian et al. [106] embedded multi-level memory modules and cross-layer attention into masked autoencoders, encouraging the reconstruction of normal structures while suppressing anomalous features. Kim et al. [29] constructed a 3D structural memory bank from multi-view projections in chest CT, improving cross-slice consistency in low-dose imaging. More recent studies focus on structure consistency and semantic alignment for memory modeling. SimSID [19] learns structured memory by aligning anatomical regions such as lungs, mediastinum, and cardiac silhouettes, leading to clearer normal patterns in chest X-ray features. Xu et al. [90] introduced intra- and inter-sample correlation constraints to perform semantic purification before features are stored in the memory bank. Ye et al. [142] proposed a dual-memory structure to separately model local textures and global structures, enabling more fine-grained representations.
The development of memory-based methods has also promoted prototype-driven interpretability. Cho et al. [143] constructed class-level prototype sets and identified anomalies when local features fail to match any normal prototypes, generating explanation maps based on prototype inconsistency. Wei et al. [22] extended memory banks into the latent space of GANs and performed coarse-to-fine retrieval with local latent replacement for pseudo-normal reconstruction, significantly improving anomaly localization in brain MRI. Huang et al. [46] proposed an uncertainty-aware prototype learning framework using Transformer-based memory and pixel-wise Bayesian uncertainty modeling. SP-Mamba [144] further emphasizes spatially-aware prototypes, learning reliable local prototypes via sliding windows and combining them with efficient multi-scale modeling. Overall, memory-based methods explicitly construct a reference space of normal features, enabling retrieval and comparison of normal patterns, and thus better accommodating the diversity of medical images across patients and anatomical structures. However, these methods typically rely on large-scale feature repositories and nearest neighbor search, which may introduce challenges in computational efficiency and memory consumption.
3.2.4. Normalizing Flow-Based Methods
Normalizing flow (NF) models map complex data distributions to simple prior distributions (typically Gaussian) through a series of invertible transformations, which are usually implemented by stacking multiple coupling layers. During inference, normal samples tend to have higher likelihoods in the latent space, while anomalous samples exhibit lower likelihood due to deviations from the learned distribution. Therefore, likelihood deviation naturally serves as an important anomaly score. As illustrated in Figure 10, NF models perform invertible mappings of latent features and use log-likelihood as the anomaly metric. DifferNet [74] was among the first to introduce NF into image anomaly detection. However, due to limitations in gradient propagation and shallow feature representations, it shows limited capability in capturing structural anomalies. CFLOW [79] further improves stability by extracting multi-scale features using pre-trained convolutional pyramids and estimating their likelihoods via flow models. CS-FLOW [61] extends single-scale flow modeling into a cross-scale invertible structure, enabling collaborative modeling of hierarchical features. FastFlow [62] preserves spatial correspondence through a two-dimensional flow structure, although its relatively shallow architecture limits representation capacity.
Figure 10.
Illustration of normalizing flow based methods. Normalizing flows construct invertible mappings using multiple coupling layers, where conditional transformations are applied to part of the features to enable efficient bidirectional density transformation and log-likelihood computation. Regions with low likelihood are identified as anomalies in the anomaly score map.
To better adapt NF models to medical imaging scenarios, recent studies incorporate modality-specific designs. Valiuddin et al. [145] embedded wavelet transforms into flow models to perform multi-scale density modeling in the frequency domain, enhancing sensitivity to fine-grained texture anomalies in dermoscopic images. Zhao et al. [38] combined NF with reconstruction frameworks by embedding lightweight flows into autoencoders, and proposed a joint anomaly score based on reconstruction error and flow likelihood, improving detection of low-contrast lesions. Although NF models still face challenges in training stability and computational efficiency in high-dimensional feature spaces, their ability to provide explicit probabilistic modeling and interpretable likelihood-based anomaly scores makes them a valuable approach for improving the reliability and interpretability of MUAD.
3.2.5. Teacher–Student Models
The core idea of the teacher–student (TS) framework is to train a student network to mimic the multi-scale feature representations of a pre-trained teacher network using only normal samples. When anomalous medical images are input, the student network fails to accurately reproduce the normal feature patterns of the teacher across different layers, and the resulting feature discrepancy is used as the anomaly score. The overall framework is illustrated in Figure 11. This paradigm was first proposed by Bergmann et al. [146], who demonstrated that, in the absence of anomalous samples, the student network can only learn structural characteristics of normal data, and thus naturally deviates in anomalous regions. Subsequently, Salehi et al. [57] introduced a multi-resolution distillation mechanism to enhance both local and global semantic consistency, and validated its effectiveness in medical imaging. Rudolph et al. [78] further performed cross-stage distillation using feature pyramid matching, while Deng et al. [56] proposed reverse distillation, where the student network has higher capacity and stronger representation ability than the teacher. Since a stronger student is required to approximate a weaker teacher’s normal feature mapping, anomalous regions—being inherently harder to mimic—tend to produce amplified deviations.
Figure 11.
Illustration of the teacher–student framework. The student network is trained to mimic the normal feature representations learned by the teacher network. Feature discrepancies between the teacher and student at multiple layers are computed to produce feature difference maps, which are subsequently aggregated to generate the anomaly score map.
In medical scenarios, teacher–student models are particularly effective due to their sensitivity to multi-scale structural consistency. Liu et al. [147] introduced skip connections and multi-scale consistency constraints to enforce structural alignment across different receptive fields, thereby improving sensitivity to small lesions and irregular boundaries in lung images. Wang et al. [148] focused on the layered structure of OCT and applied layer-wise distillation to enhance the model’s sensitivity to retinal boundaries, enabling more precise localization of subtle thickness variations and local disruptions. Reverse distillation is especially suitable for medical tasks, as most lesions disrupt local anatomical structures, which are difficult for the student network to replicate. Based on this observation, Ge et al. [36] proposed an improved direct reverse distillation strategy by enhancing skip connections to suppress pseudo-consistency in anomalous regions, leading to sharper anomaly responses at structural boundaries. Li et al. [98] further introduced scale-aware contrastive distillation, leveraging cross-scale positive and negative pairs to enhance feature deviation at anomalous regions while simultaneously handling both large tumors and small infarctions. Dong et al. [94] combined teacher–student distillation with student self-distillation between support and query samples, and introduced a dynamic weighting strategy to adaptively evaluate the relevance of support samples, thereby improving generalization in few-shot medical anomaly detection.
For 3D medical anomaly detection tasks, teacher–student models have been further extended. Schwarz et al. [149] proposed a 3D patch-level pyramid distillation framework to maintain structural continuity across slices in MRI, addressing the limitations of 2D distillation in capturing volumetric consistency. Liu et al. [30] introduced aggregated masked convolution and centralized linear attention to dynamically filter potential anomalous regions during distillation, enhancing multi-scale structural modeling in CT images. Rahmaniar et al. [150] incorporated domain-invariant and domain-specific feature decomposition and aligned teacher and student feature distributions using adversarial learning, achieving stable performance across multiple datasets. Li et al. [49] combined graph neural networks with teacher–student models, enabling node-level feature alignment to preserve structural consistency across regions in large-scale histopathological images. Overall, by leveraging cross-layer feature imitation and deviation aggregation, teacher–student models significantly enhance anomaly saliency while maintaining model efficiency. They have become an important approach in MUAD, although their anomaly discrimination capability is still influenced by the representation capacity of the teacher network.
3.2.6. Summary of Feature Embedding-Based Methods
Feature embedding-based methods in MUAD measure anomalies by constructing a normal feature space and quantifying deviations within it. Compared with reconstruction-based approaches, they offer advantages in stability and semantic representation. However, several key challenges remain in real-world medical scenarios. First, most methods rely on encoders pre-trained on natural images, which introduces a semantic gap between learned representations and medical tasks. This often leads to feature misalignment or mismatch, making it difficult to accurately model normal feature distributions. Second, many approaches adopt Gaussian modeling, memory banks, or flow-based methods to describe feature distributions. However, due to the intrinsic variability of normal tissues in medical images, feature distributions are often non-spherical, non-Gaussian, and even multi-modal, making it difficult for a single distribution assumption to fully capture their complexity.
From a developmental perspective, feature embedding-based methods are evolving from static normal feature modeling toward dynamic semantic alignment and structural consistency modeling. On one hand, increasing efforts focus on feature purification, domain alignment, and structural guidance before entering the feature space, making normal feature distributions more compact and stable at the semantic level. On the other hand, research is gradually shifting from single-scale feature deviation detection to multi-level and cross-modal semantic fusion. By incorporating mechanisms such as cross-scale feature aggregation, cross-sequence consistency learning, knowledge distillation, and medical prompt learning, models are able to more precisely capture both fine-grained local anomalies and global structural deviations. In the future, feature embedding-based methods are expected to further emphasize medical domain-specific representation, multi-modal knowledge integration, and structured distribution modeling, in order to achieve improved robustness, interpretability, and clinical applicability.
3.3. Self-Supervised Learning Methods
Self-supervised learning (SSL) guides models to learn stable structural and semantic representations under unlabeled conditions by constructing auxiliary tasks or feature consistency constraints, thereby indirectly enhancing their ability to perceive semantic deviations of anomalies. Given the scarcity of anomaly annotations and the diversity of anomaly patterns in medical imaging, SSL has gradually become an important representation learning paradigm in MUAD. This section introduces its modeling strategies and adaptations to medical scenarios from two perspectives: proxy task-based methods and contrastive learning-based methods.
3.3.1. Proxy Task-Based Methods
Proxy task-based SSL methods transform anomaly detection into trainable surrogate tasks by constructing artificial pseudo-supervision signals. As illustrated in Figure 12, the core idea is to apply structural perturbations to normal images, enabling the model to learn implicit normal semantic patterns through recovering or recognizing these perturbations, and thus automatically detect real anomalies during inference. Early methods such as FPI [65], PII [66], and NSA [64] adopt tasks such as image restoration, occlusion completion, and noise prediction to learn contextual relationships of normal patterns. CutPaste [63] generates pseudo anomalies by cutting and pasting random regions within normal images, allowing the model to learn sensitivity to local anomalies via a binary classification proxy task. DRÆM [151] further adopts a dual-branch structure combining pseudo anomaly generation and reconstruction consistency, enhancing the model’s response to subtle defects, and has influenced subsequent extensions in medical imaging.
Figure 12.
Illustration of proxy task-based methods for medical imaging unsupervised anomaly detection. Pseudo anomalies are artificially injected during training to enable the model to learn normal structural patterns. During inference, the model can therefore identify real anomalies. The example illustrates a local pseudo-anomaly injection proxy task.
As SSL methods are adapted to medical scenarios, researchers have recognized that proxy tasks should preserve anatomical plausibility; otherwise, pseudo anomalies may disrupt real medical semantics and degrade performance. AnatPaste [152] constrains pseudo anomalies within specific anatomical regions in chest X-rays, enabling the model to learn more realistic structural deviations. AMAE [20], based on masked autoencoders (MAE), employs large-scale masking reconstruction to learn multi-scale normal priors and enhances sensitivity to structural anomalies through dual-distribution modeling. Li et al. [87] further integrate proxy tasks into reconstruction frameworks by introducing BYOL-style self-supervised modules [153], enabling the learning of multi-granularity semantic priors such as color, texture, and layered structures. Different augmentation strategies correspond to different types of anomalies (e.g., color shifts or structural disruptions), thereby improving the saliency of reconstruction residuals. DDAD-ASR [84] applies SSL to refine anomaly scores rather than directly detect pseudo anomalies, generating initial anomaly responses through dual-distribution modeling and improving localization accuracy and robustness via a self-supervised refinement network.
To better simulate structural variations in medical images, recent studies design proxy tasks based on morphology and boundary characteristics. Deng et al. [154] propose random-shaped pseudo outliers to mimic lesion-like boundary discontinuities and structural irregularities, improving the model’s ability to learn anomaly morphology. In more complex anatomical scenarios, proxy tasks are increasingly designed in a multi-task manner. Baugh et al. [155] combine multiple tasks such as rotation prediction, jigsaw puzzle solving, and strong–weak augmentation consistency, enabling the model to capture texture, spatial arrangement, and global consistency simultaneously. While these methods effectively learn structural semantics and contextual relationships without annotations, their performance depends on the design of pseudo anomaly generation, and the semantic gap between pseudo anomalies and real lesions may still limit detection performance.
3.3.2. Contrastive Learning-Based Methods
Contrastive learning learns discriminative representations through instance-level similarity constraints, with representative frameworks including SimCLR [156], MoCo [157], and SimSiam [158], which does not require explicit negative samples. The core idea is to enforce consistency between different views of the same instance, such that anomalous regions—being difficult to maintain semantic consistency—naturally deviate in feature space. As illustrated in Figure 13, contrastive learning compresses normal distributions through multi-view consistency constraints, while anomalies exhibit significant deviations due to semantic inconsistency. In MUAD, contrastive learning methods are adapted by tailoring positive and negative sample construction as well as semantic constraint granularity to better capture structural and semantic differences in medical images. Early studies primarily utilize contrastive learning as a feature enhancement strategy. Spahr et al. [159] employ SimCLR-style pretraining to learn global morphological representations of normal samples via cross-sample similarity constraints, resulting in more compact embeddings and improved anomaly discrimination. PMSACL [47] introduces a pseudo multi-class contrastive pretraining strategy, where different augmentations of the same image are treated as distinct pseudo classes, forcing the model to learn boundaries between structure-preserving and structure-disrupting transformations.
Figure 13.
Illustration of the contrastive learning framework. Multiple augmented views (e.g., flipping and cropping) are generated from the input image to construct instance-level contrastive constraints. The model learns discriminative feature representations by pulling positive pairs closer and pushing negative pairs apart in the latent space. Some implementations employ a shared encoder to learn consistent feature representations for anomaly detection.
Considering that medical anomalies often manifest as local semantic shifts rather than simple appearance changes, some studies impose contrastive constraints at a finer granularity. CCD [68] extends contrastive learning from instance-level comparison to distribution-level comparison, enabling the model to explicitly separate normal and anomalous feature distributions under unlabeled conditions, which is particularly suitable for detecting fine-grained structural anomalies. CRADL [86] proposes medically consistent augmentation strategies (e.g., preserving anatomical structure, avoiding unrealistic color perturbations, and respecting medical conventions in rotations and flips) to learn more structure-sensitive representations.
To address scale variations in high-resolution medical images, Dong et al. [160] construct local contrastive samples using sliding windows, enabling the model to learn consistent normal patterns across spatial locations and improving sensitivity to small lesions. PatchCL-AE [91] combines patch-level contrastive learning with autoencoder reconstruction, enhancing feature deviation in anomalous regions while preserving global reconstruction capability. To capture more complex semantic variations, Patrício et al. [161] introduce instance alignment and class-invariant constraints to the encoder, focusing on common anatomical structures while suppressing anomalous factors, and combine this with diffusion-based reconstruction differences for anomaly scoring. Tang et al. [39] incorporate contrastive constraints into a dual-decoder architecture, ensuring semantic consistency between reconstruction and attention branches, thereby amplifying feature deviations in anomalous regions. Overall, contrastive learning enables the formation of compact normal feature distributions through multi-view consistency, improving anomaly separability. However, its performance depends on the design of data augmentation and positive/negative sample construction, and inappropriate transformations may negatively affect the stability of anomaly representations.
3.3.3. Summary of Self-Supervised Learning Methods
In MUAD, proxy task-based methods amplify structural deviations by introducing artificial perturbations to normal images, making them well-suited for scenarios with scarce anomaly annotations. In contrast, contrastive learning methods enforce cross-view or cross-modal consistency, leading to more compact semantic representations of normal samples and enhancing sensitivity to anomalous deviations. However, the effectiveness of these methods is highly dependent on the design of proxy tasks and augmentation strategies. If pseudo anomalies differ significantly from real lesions in morphology or semantics, generalization performance may be limited. Moreover, self-supervised representations do not directly correspond to anomaly scores, and are often combined with reconstruction-based or feature embedding-based methods.
Overall, self-supervised learning is better regarded as a representation enhancement mechanism within MUAD. From a developmental perspective, its role is gradually shifting from a feature pretraining tool to an integral component of anomaly detection frameworks. Increasing efforts incorporate anatomical priors and medical imaging knowledge into SSL task design, enabling models to learn more clinically meaningful normal patterns. Furthermore, SSL is increasingly integrated with reconstruction models and feature distribution modeling through multi-task learning, strengthening both semantic representation and anomaly deviation modeling. In the future, self-supervised learning is expected to play a more important role in medical structure-aware modeling and multi-modal knowledge integration, thereby improving semantic understanding and clinical applicability in MUAD.
3.4. Foundation Model-Based Methods
In recent years, the development of foundation models has driven medical unsupervised anomaly detection from traditional visual representation learning toward semantic-enhanced and general modeling paradigms. These methods are no longer limited to feature distribution modeling or reconstruction errors, but instead leverage the visual and semantic priors embedded in large-scale pre-trained models to improve anomaly detection performance. In this survey, foundation model-based studies are discussed mainly from the perspective of transferable visual-semantic priors for anomaly scoring and localization, while their specific supervision settings may vary across normal-only, zero-shot, weakly supervised, or auxiliary-data-based scenarios. According to model types and their roles, existing approaches can be categorized into vision–language model-based methods, large language model-based methods, and visual foundation model-based methods.
3.4.1. Vision–Language Model-Based Methods
Vision–language model (VLM)-based methods mainly utilize cross-modal pre-trained models such as CLIP [162] to map medical image features into a shared semantic space, and perform anomaly detection through image–text alignment. The general pipeline is illustrated in Figure 14.
Figure 14.
Illustration of the vision–language model framework for anomaly detection. Image features extracted by the visual encoder and text features extracted by the text encoder are aligned in a shared semantic space. The anomaly score is obtained by computing the similarity between the image representation and normal semantic descriptions.
Early studies explored the direct application of general-purpose VLMs for anomaly detection. WinCLIP [69] formulates anomaly detection as an image–text similarity problem by constructing “normal/abnormal” prompts and further employs sliding windows for local anomaly localization. FADE [163] introduces both language-guided and vision-guided mechanisms, where large language models are used to generate diverse textual prompts, and patch-level alignment modules are designed to handle anomalies at different scales. Marzullo et al. [164] conducted a systematic evaluation of CLIP-based methods on brain metastasis MRI datasets, revealing the limitations of 2D VLMs in modeling 3D medical structures.
To address the limitations of general VLMs in medical semantic understanding and spatial structure modeling, researchers have introduced medically-aware prompt learning mechanisms. These approaches construct semantic descriptions in natural language to guide VLMs toward specific medical concepts and decision boundaries. MediCLIP [93] adapts CLIP to medical scenarios through anomaly synthesis, self-supervised fine-tuning, and learnable textual prompts. Park et al. [165] design disease-related positive prompts and normal-structure-related negative prompts, and suppress abnormal activations in normal regions by leveraging differences in attention responses. Sun et al. [166] incorporate anatomical priors into prompt learning by encoding lung region information together with category semantics in the text branch, while applying region masking and image prompting in the visual branch to focus on specific anatomical regions. Lai et al. [167] further decompose prompts into perception-level and recognition-level prompts, enhancing local anomaly perception and clarifying decision boundaries in semantic space, respectively.
To improve cross-domain generalization of VLMs in medical anomaly detection, Huang et al. [92] introduce lightweight residual adapters into the visual encoder and propose pixel-level and image-level vision–language alignment losses, enabling cross-modality and cross-anatomy generalization. OFF-CLIP [99] points out that the InfoNCE loss in standard CLIP may disrupt the clustering structure of normal samples, leading to high false positive rates; it addresses this issue by introducing off-diagonal loss terms and text filtering strategies to enhance representation consistency. In few-shot scenarios, MadCLIP [100] proposes a dual-branch visual adapter to model normal and abnormal distributions separately, combined with learnable prompts and optimization objectives. AdaptCLIP [97] introduces lightweight adapters into both visual and textual encoders and employs anomaly score-driven alignment objectives to focus on anomaly-related representations rather than generic semantic consistency. WMoE-CLIP [95] further incorporates global semantic distribution sampling, wavelet-enhanced cross-modal attention, and semantic-aware mixture-of-experts prompt learning, improving the modeling of complex semantics and subtle anomalies.
More recently, VLMs have been incorporated as semantic priors in generative models. Wang et al. [168] integrate pathological VLMs into diffusion-based generation, where textual information guides reconstruction toward semantically plausible normal structures. Chen et al. [169] introduce diffusion-based denoising in CLIP feature space to refine multi-level features and improve robustness to noise and sparse anomalies. Sun et al. [170] propose a co-evolution learning framework that jointly performs anomaly detection and radiology report generation by sharing vision–language representations, establishing bidirectional constraints between localization and textual descriptions. Overall, VLM-based methods provide enhanced interpretability and high-level semantic representations for medical anomaly detection. However, their performance depends on the quality of vision–language alignment and is sensitive to prompt design and semantic representation.
3.4.2. Visual Foundation Model-Based Methods
Visual foundation model-based methods primarily leverage large-scale pre-trained visual encoders, such as Vision Transformer (ViT), DINO [171], and DINOv2 [172], to extract features with strong semantic representation and cross-domain generalization ability. Based on these features, anomaly detection is performed by combining feature distribution modeling, similarity measurement, or reconstruction deviation analysis. The general framework is illustrated in Figure 15. Compared with VLM-based methods, these approaches do not rely on textual prompts or cross-modal alignment, thus avoiding instability caused by prompt design or semantic mismatch. This makes them more suitable for capturing fine-grained structural anomalies in medical images that are difficult to describe in language, providing a more direct and robust purely visual modeling pathway.
Figure 15.
Illustration of anomaly detection using vision foundation models. Patch-level features are extracted from the input image using a vision foundation model. Anomalous regions are detected by modeling the distribution of normal features or measuring deviations from normal patterns. The example shown in the figure illustrates a clustering-based modeling approach.
Schulthess et al. [173] propose a DINOv2-based anomaly detection method that models the distribution of normal patch features using a Dirichlet process mixture model and computes anomaly scores based on similarity to cluster centers, achieving anomaly detection without requiring large-scale feature memory banks. AnomalyMoE [96] utilizes visual foundation models to extract general visual representations and employs a hierarchical mixture-of-experts architecture to model local structural anomalies, part-level semantic anomalies, and global logical anomalies. AnomalyVFM [174] introduces a three-stage synthetic anomaly generation strategy and incorporates low-rank feature adapters and lightweight decoders to efficiently adapt pre-trained visual features, transforming models such as DINOv2 into general zero-shot anomaly detection frameworks. UniADet [175] learns task weights for anomaly classification and segmentation, and decouples image-level classification and pixel-level localization across different feature levels, enabling both zero-shot and few-shot anomaly detection. VisualAD [42] introduces learnable normal and abnormal global tokens into a frozen Vision Transformer, allowing interaction with patch features through multi-layer self-attention, and performs anomaly modeling directly in the feature space, combined with spatial-aware cross-attention and feature self-alignment mechanisms.
In addition to representation-oriented visual foundation models, promptable segmentation foundation models have also attracted growing attention [176], particularly SAM [177] and its medical variants such as MedSAM [178] and SAMed [179]. MedSAM [178] adapts SAM to large-scale medical image segmentation, while SAMed [179] explores lightweight fine-tuning strategies to improve its applicability to medical images. These developments are also relevant to MUAD, as they provide a promising segmentation prior for abnormal region delineation, especially in weakly supervised or zero-shot settings. Recent anomaly-related studies have begun to explore this direction. MIAS-SAM [180] integrates the SAM encoder into a memory-bank-based anomaly detection pipeline to compute anomaly maps, and then automatically converts the anomaly map into a point prompt for the SAM decoder, refining anomaly localization into threshold-free segmentation. Yang et al. [181] further show that SAM can be adapted for anomaly segmentation through task-specific tuning. Their self-perception tuning strategy enhances SAM’s perception of abnormal regions under domain shift and improves prompt-robust anomaly localization. A more direct integration is explored in STLM [182], which uses a fixed SAM as a teacher to distill generalized knowledge into a lightweight two-stream anomaly detection model and generates anomaly maps from the discrepancy between the two streams.
These studies suggest that SAM-like models may provide a useful complementary pathway for MUAD, especially in anomaly localization, mask refinement, and teacher-guided anomaly modeling. However, their role in MUAD is still at an early exploratory stage. Future research is needed to better understand how promptable segmentation foundation models can be more effectively integrated with anomaly scoring, medical semantics, and complex 3D clinical scenarios.
Overall, visual foundation model-based methods effectively leverage the general visual representations learned from large-scale pretraining, enabling anomaly detection with strong generalization ability without relying on language priors. Recent SAM-based developments further enrich this purely visual route by offering an additional option for localization refinement and task-specific adaptation.
3.4.3. Large Language Model-Based Methods
Different from vision–language models that emphasize cross-modal alignment, large language models (LLMs) in medical anomaly detection primarily serve as semantic reasoning and knowledge enhancement components. These methods organize anomaly cues into semantically interpretable information and leverage mechanisms such as prompt generation, instruction understanding, and language-based explanation to enhance open-set recognition capability and clinical interpretability. The general pipeline is illustrated in Figure 16.
Figure 16.
Illustration of anomaly detection assisted by large language models. Medical images are first processed by a visual encoder to obtain visual tokens, which are combined with textual prompts and fed into a large language model. The model performs semantic reasoning to generate diagnostic descriptions or anomaly assessment results.
Early explorations employ LLMs as prompt generators to expand semantic coverage and diversity of anomaly descriptions. For instance, FADE [163] utilizes LLMs to automatically generate large-scale and diverse textual prompts, enabling more comprehensive descriptions of potential anomalies, and effectively compensating for the limitations of visual models in semantic modeling. With further development, LLMs have gradually evolved from auxiliary generation tools to components that participate in anomaly reasoning and cross-modal alignment. As illustrated in Figure 16, medical images are first encoded into visual tokens, which are then jointly processed with user queries or textual prompts by LLMs for unified reasoning. This allows the model to combine visual information with medical knowledge to generate diagnostic descriptions or anomaly predictions, thereby enabling semantic analysis and interpretation of abnormal states. Building upon this paradigm, Li et al. [183] introduce a query-driven cross-modal attention mechanism, where textual queries actively guide the extraction of anomaly-related visual representations, enhancing alignment between visual features and semantic queries. Xu et al. [101] address the limitations of multi-modal medical models in fine-grained anomaly description and causal reasoning by constructing instruction datasets and evaluation benchmarks for anomaly detection and reasoning, and propose a “re-inspection” feature matching mechanism to refine attention on suspicious regions. Furthermore, Zhou et al. [184] propose a two-stage training strategy, including anomaly-aware instruction tuning and anomaly-aware reward learning. By introducing anomaly-related reward signals, the model is encouraged to focus on abnormal regions during report generation and produce explanations with localization evidence, thereby improving cross-modal generalization. Overall, LLM-based methods in MUAD are evolving from prompt expansion and textual explanation toward anomaly-aware instruction learning and semantic reasoning frameworks. Their primary role is to complement medical semantic priors and enhance the interpretability of anomaly detection results.
3.4.4. Summary of Foundation Model-Based Methods
Foundation model-based methods significantly expand the modeling scope of medical unsupervised anomaly detection by leveraging visual and semantic priors learned from large-scale pretraining. Vision–language models construct semantic reference spaces for anomaly discrimination through cross-modal alignment, while visual foundation models enable robust anomaly modeling within purely visual feature spaces by exploiting strong visual representations. In this context, recent SAM-based adaptations also suggest a potential direction for enhancing anomaly localization. Large language models further enhance interpretability and clinical readability through semantic reasoning and knowledge augmentation. Overall, foundation models have driven MUAD from traditional visual statistical modeling toward a unified framework that integrates visual representation, semantic priors, and reasoning capabilities.
However, most existing methods still rely on visual feature differences or distribution deviations as the primary anomaly metrics, while language models often function as auxiliary components for semantic enrichment and explanation rather than directly participating in low-level anomaly discrimination. In addition, their performance is influenced by the quality of cross-modal alignment and prompt design strategies. In high-resolution medical imaging scenarios, challenges such as computational complexity and limited capability for fine-grained localization remain. Future research should focus on deeper integration of visual representations, medical semantic knowledge, and anomaly decision mechanisms, in order to further improve the generalization ability and interpretability of MUAD in complex clinical environments.
4. Evaluation Metrics and Benchmark Datasets
4.1. Evaluation Metrics
The evaluation of medical unsupervised anomaly detection (MUAD) is typically conducted at two levels according to the detection granularity: image-level and pixel-level, with different tasks emphasizing different evaluation criteria. For image-level anomaly detection, the model outputs a global anomaly score to determine whether an entire image is abnormal. The most commonly used metrics include the Area Under the Receiver Operating Characteristic Curve (AUROC) and the Area Under the Precision–Recall Curve (AUPRC). Among them, AUROC is relatively insensitive to class imbalance, whereas AUPRC better reflects the actual detection capability in medical scenarios where anomalous samples are extremely scarce. In addition to these metrics, some studies also report Accuracy (ACC), Precision (PRE), Sensitivity/Recall (SEN), Specificity (SPE), and F1-score to provide a more intuitive characterization of the trade-off between missed detections and false positives, which is also aligned with practical clinical screening requirements. Nevertheless, these image-level metrics mainly reflect the overall separability between normal and abnormal samples. In MUAD, where lesions may be small, sparse, or only partially detected, AUROC and AUPRC may still remain relatively high even when the spatial localization is inaccurate or clinically important abnormalities are incompletely captured.
For pixel-level anomaly localization tasks (as illustrated in Figure 3), the model is required to produce spatial anomaly maps. Common evaluation metrics include pixel-level AUROC, Dice Similarity Coefficient (Dice), Intersection over Union (IoU), and the Area Under the Per-Region Overlap curve (AUPRO). These metrics not only assess whether anomalies are detected but also emphasize spatial consistency and localization accuracy, making them more suitable for lesion localization and quantitative analysis. However, Dice and IoU are still strongly influenced by lesion size and overall overlap, and may not adequately reflect boundary deviation, spatial misalignment, or the clinical importance of missed small lesions. In particular, for cases with multiple lesions or highly imbalanced lesion sizes, global overlap-based metrics may favor methods that capture large lesions while underestimating failures on smaller but clinically relevant abnormalities.
To address these limitations, recent studies have begun to explore more fine-grained or clinically meaningful evaluation criteria. For example, the BraTS 2023 official evaluation introduced lesion-wise Dice and lesion-wise HD95 to assess performance at the lesion level rather than only at the whole-image level, with the explicit aim of reducing the bias of traditional global metrics toward large lesions and better reflecting how well a model detects and segments multiple individual lesions [21]. In addition, for reconstruction- and generation-based MUAD methods, recent work has proposed normative-learning-oriented metrics, including the Restoration Quality Index (RQI), the Anomaly to Healthy Index (AHI), and the Healthy Conservation and Anomaly Correction Index (CACI), in order to evaluate not only anomaly detection itself but also the quality of pseudo-healthy restoration and the fidelity of learned normal representations [3]. These metrics highlight that, for generative MUAD models, evaluation should go beyond anomaly maps alone and also consider whether healthy structures are preserved and pathological regions are plausibly corrected.
Overall, these metrics remain the mainstream evaluation tools in MUAD and still provide an important basis for comparison. At the same time, given the complexity of medical anomalies, future evaluation protocols may benefit from incorporating lesion-level assessment, calibration of anomaly scores, uncertainty-aware evaluation, and other clinically meaningful criteria that better reflect lesion detectability, localization reliability, and potential diagnostic relevance.
4.2. Common Datasets and Experimental Benchmarks
Due to the complexity of medical imaging sources, the diversity of imaging modalities, and variations in annotation protocols, MUAD research has not yet established a unified evaluation benchmark in terms of experimental settings and dataset selection. Existing studies often construct experimental setups tailored to specific modalities or clinical scenarios, such as chest X-ray, brain MRI, chest CT, or retinal OCT. This diversity makes it difficult to perform direct and fair comparisons of model performance across different studies.
Therefore, instead of simply aggregating reported performance metrics, it is more meaningful to systematically review commonly used datasets in order to better understand the experimental contexts and applicability of different methods.
From the current literature, commonly used MUAD datasets mainly cover multiple medical imaging modalities, including chest X-ray, brain MRI, chest CT, histopathology images, and retinal OCT. These datasets differ significantly in terms of anomaly types, annotation granularity, and task settings. For example, some datasets only provide image-level labels for anomaly screening, while others offer pixel-level or region-level annotations for anomaly localization and segmentation tasks. To provide a clearer overview of data resources in MUAD research, Table 3 summarizes representative medical anomaly detection datasets in recent years, including their imaging modality, anomaly categories, annotation granularity, and typical application scenarios.
Table 3.
Overview of 16 commonly used public medical image datasets in anomaly detection research, including imaging modality, dataset split, task type, annotation type, anomaly categories, and typical application scenarios. The dataset splits shown here follow representative studies in the literature and may vary across different works.
Beyond modality and annotation differences, domain shift across datasets is another critical issue in MUAD evaluation. Even within the same modality, medical datasets collected from different institutions may vary substantially in imaging devices, acquisition protocols, reconstruction pipelines, patient populations, and disease composition. These factors can change image contrast, noise characteristics, spatial resolution, and even the apparent distribution of normal anatomy, thereby affecting the stability of anomaly modeling and making models trained on one dataset difficult to generalize reliably to another. As a result, the heterogeneity of datasets is not only a matter of benchmark diversity, but also an important source of cross-dataset generalization difficulty. The broader implications of this issue for robustness and clinical deployment are further discussed in Section 5.4.
5. Comprehensive Discussion and Future Directions
5.1. Method-Level Challenges: A Comprehensive Review and Analysis
From a methodological perspective, existing MUAD approaches all follow the general paradigm of learning normality and detecting deviations, yet they differ substantially in modeling assumptions, anomaly evidence, and clinical applicability. Reconstruction-based methods provide intuitive anomaly maps, but they are vulnerable to anomaly leakage and often struggle with subtle semantic abnormalities. Feature embedding-based methods generally offer better stability and stronger distribution modeling, but their performance is still constrained by the semantic gap between natural-image pretraining and medical imaging. Self-supervised learning methods improve representation quality by introducing proxy tasks or contrastive constraints, although their effectiveness depends heavily on the realism of pseudo anomalies and the design of augmentation strategies. Foundation model-based approaches bring stronger semantic priors and improved interpretability, but their direct contribution to fine-grained anomaly quantification and localization remains limited.
To facilitate a more explicit cross-method comparison, Table 4 summarizes major MUAD method categories in terms of their core mechanisms, strengths, limitations, suitable anomaly types, and computational complexity. Moreover, in current MUAD research, interpretability is still mainly conveyed through anomaly maps or score visualizations. Although these outputs can provide intuitive spatial cues, they often remain indirect evidence, and more rigorous validation of whether such explanations are faithful to model behavior and clinically meaningful is still relatively limited.
Table 4.
Comparison of major MUAD method categories in terms of core mechanisms, strengths, limitations, suitable anomaly types, and computational complexity.
As shown in Table 4, different MUAD paradigms exhibit clear trade-offs in anomaly modeling ability, localization performance, interpretability, and computational cost. Reconstruction-based methods are intuitive and naturally suitable for anomaly localization, especially for structural abnormalities with relatively clear morphological deviations, but they remain limited by anomaly leakage and insufficient semantic discrimination. In contrast, feature embedding-based methods are generally more stable and better suited for modeling normal distributions in deep feature spaces, making them effective for a wider range of structural and distributional anomalies, although they often rely heavily on the quality of pretrained representations. Self-supervised learning-based methods are better regarded as representation enhancement strategies, as their gains mainly come from improving the compactness and discriminability of normal features, but their robustness is sensitive to proxy-task design and augmentation realism. Foundation model-based methods further extend MUAD toward high-level semantic reasoning and cross-domain generalization, yet their advantages are currently more evident in interpretability and open-set understanding than in precise low-level anomaly quantification.
Overall, no single methodological family is uniformly superior; instead, different paradigms are complementary and should be selected or combined according to anomaly type, imaging modality, and clinical requirements.
From a broader perspective, existing unsupervised methods often simplify anomalies as a single form of “deviation,” while overlooking the multi-level inconsistencies of medical anomalies across structural, semantic, and functional dimensions. Future research should move beyond optimizing a single anomaly score and instead focus on jointly modeling multi-level inconsistencies, such as structural inconsistency, semantic inconsistency, and cross-modal inconsistency, to improve both robustness and interpretability. Furthermore, “unsupervised” does not imply the absence of prior knowledge. Incorporating anatomical constraints, medical knowledge priors, or uncertainty modeling mechanisms under limited supervision is expected to be a key direction for advancing MUAD.
5.2. Model-Level Trends and Evolution Directions
From a modeling perspective, MUAD has evolved from early single-strategy designs toward multi-mechanism collaborative modeling. This evolution is driven by the intrinsic complexity of medical anomalies in terms of structural scale, semantic hierarchy, and spatial distribution, which makes it difficult for a single representation or decision pathway to robustly capture abnormal patterns. Recent model designs exhibit several notable trends:
- 1.
- Multi-scale structural modeling has become a fundamental component. Different scales encode different levels of structural and semantic information in medical images. By integrating multi-scale representations, models can simultaneously capture global anatomical consistency and local lesion abnormalities, thereby alleviating instability caused by scale variations. In recent studies, multi-scale feature extraction, cross-level interaction, and multi-resolution consistency constraints have been widely adopted. For instance, Tian et al. [106] incorporate cross-level attention within an autoencoder framework, while pDDPM [121] and mDDPM [82] enhance local–global modeling via patch-based or masked diffusion. Methods such as PaDiM [58], SPADE [138], and CFLOW [79] also rely on multi-scale feature spaces for modeling normal distributions. These observations indicate that multi-scale modeling has evolved from a performance enhancement technique into a fundamental design principle for complex medical anomaly detection.
- 2.
- Transition from single-path anomaly detection to multi-view collaborative modeling. Multi-branch or multi-view frameworks characterize anomalies from different perspectives, such as reconstruction consistency, feature distribution stability, and semantic similarity, enabling better modeling of multi-faceted inconsistencies in medical anomalies. Recent works increasingly emphasize the complementarity among different mechanisms. For example, DRÆM [151] models anomalies via joint reconstruction and discrimination branches; Zhao et al. [38] combine normalizing flow with reconstruction frameworks; FADE [163], MadCLIP [100], and AnomalyMoE [96] explore multi-view modeling through visual guidance, normal/abnormal distribution separation, and multi-expert collaboration, respectively. However, such designs also introduce trade-offs between model complexity and training stability.
- 3.
- “Frozen backbone + lightweight adaptation” has become a mainstream paradigm. Fully end-to-end training may disrupt the general structural representations learned during large-scale pretraining, whereas lightweight adaptation modules allow models to retain stable representations while focusing on anomaly-relevant subspaces. For example, Tang et al. [83] employ a stop-gradient strategy to mitigate the semantic gap between natural and medical images; Huang et al. [92] and AdaptCLIP [97] introduce lightweight adapters into vision–language models; VisualAD [42] incorporates learnable tokens into frozen Vision Transformers to model normal and abnormal patterns. This paradigm serves as an effective bridge between general-purpose pretrained representations and domain-specific anomaly detection tasks.
- 4.
- Increasing emphasis on anomaly score stability and uncertainty modeling. Recent studies have shifted from purely improving detection accuracy toward enhancing the reliability and consistency of anomaly predictions, which is critical in medical applications. Techniques such as probabilistic modeling, ensemble strategies, and uncertainty estimation are increasingly adopted. For instance, Huang et al. [46] introduce pixel-level Bayesian uncertainty into prototype learning to model ambiguous boundaries; DDAD-ASR [84] refines anomaly scores via a self-supervised refinement module; OFF-CLIP [99] improves clustering consistency of normal samples to reduce false positives. These developments suggest that future MUAD models will place greater emphasis on probabilistic reasoning, uncertainty estimation, and multi-source consistency validation.
In summary, model evolution is driving MUAD from single-path mapping toward structure-aware, multi-view, and stability-oriented composite models. However, increased model complexity does not necessarily guarantee improved anomaly discrimination. Achieving a balance among representation capacity, reliability of anomaly quantification, and computational efficiency remains a central challenge for future model design.
5.3. Task-Level Expansion and Multi-Task Integration Trends
At the task level, MUAD is evolving from primarily image-level anomaly classification toward pixel-level anomaly localization. While a single image-level anomaly score is useful for screening abnormal samples, it is insufficient to meet clinical requirements regarding lesion location, extent, and morphology. Therefore, pixel-level anomaly localization has gradually become an important criterion for evaluating model effectiveness. Meanwhile, anomaly detection is increasingly integrated with related tasks such as segmentation, classification, image reconstruction, and report generation. Through multi-task joint modeling, models can better learn both the spatial boundaries and semantic attributes of abnormal regions, thereby extending the applicability of anomaly detection across different organs, disease types, and clinical scenarios. For example, Sun et al. [170] combine anomaly detection with medical report generation, enabling the model to produce diagnostic descriptions while detecting abnormalities.Such multi-task learning frameworks introduce complementary supervisory signals, allowing models to characterize anomalies from multiple perspectives. This not only improves robustness and generalization but also promotes the evolution of MUAD from a single-task detection paradigm toward a more comprehensive intelligent diagnostic module.
Besides, a more specific and underexplored direction is to connect MUAD with downstream clinical tasks such as prognosis assessment, longitudinal follow-up, and treatment response analysis [190,191]. In real clinical practice, detecting whether an image is abnormal is often only the first step; clinicians are also concerned with how abnormal findings evolve over time, whether they imply higher risk, and how they should be described in a clinically meaningful way. From this perspective, future MUAD systems may gradually evolve from standalone detection modules into more comprehensive task interfaces that support lesion localization, semantic description, and subsequent clinical decision-making.
5.4. Technology Integration Trends and Future Research Directions
As MUAD methods continue to evolve, future research should not only pursue higher detection performance, but also strengthen the connection between methodological advances and clinical use. Although most existing MUAD systems are still evaluated mainly in research settings, recent studies suggest that anomaly detection is particularly relevant to practical scenarios such as rare abnormality discovery, health screening, and open-set medical analysis, while its translation to real clinical workflows remains constrained by generalization, interpretability, evaluation, and deployment issues [4]. From this perspective, several key directions deserve further attention:
(1) Clinical consistency and calibration of anomaly scores. Clinical relevance and clinically usable anomaly quantification. MUAD has clear potential clinical value, particularly in supporting large-scale screening, suspicious case prioritization, candidate lesion prompting, and open-set abnormality discovery under limited-annotation conditions. Recent benchmark-oriented studies have also emphasized the importance of anomaly detection for rare disease recognition and health screening in medical imaging [11,192]. However, current anomaly scores are usually derived from reconstruction errors, feature deviations, or similarity discrepancies, and are therefore not naturally aligned with clinically meaningful factors such as lesion type, severity, progression, or diagnostic actionability. This mismatch makes it difficult to directly translate model outputs into practical clinical decisions. Future work should thus focus on clinically usable anomaly quantification frameworks by incorporating uncertainty estimation, score calibration, semantic grounding, and workflow-oriented presentation, so that anomaly predictions can better reflect not only the presence of abnormalities but also their confidence and clinical relevance. For example, calibrated anomaly scores may be used to prioritize suspicious cases according to risk level, while lesion-aware anomaly quantification may provide more actionable cues for follow-up review and clinical reporting.
(2) Generalization and robustness across institutions and imaging conditions. Generalization across datasets remains a major challenge for MUAD, especially across modalities, organs, and clinical scenarios. Recent studies suggest that foundation model-based methods show relatively better transferability, indicating that stronger pretrained representations may provide a promising direction for improving cross-dataset robustness [42,93,101]. Moreover, domain shift is not limited to cross-modality settings. Even within the same modality, differences in imaging devices, acquisition protocols, reconstruction pipelines, and patient populations can substantially affect image statistics and normal anatomical distributions, thereby reducing the stability of anomaly scoring in unseen environments. This makes cross-site and cross-institution robustness a critical issue for clinical deployment [193]. Recent MUAD studies have further emphasized that clinically useful systems must remain robust across scanning protocols and patient demographics, rather than performing well only under controlled experimental conditions [194,195]. Future research may therefore benefit from foundation model adaptation, federated learning for privacy-preserving multi-center collaboration, and domain generalization, few-shot adaptation, or zero-shot transfer techniques to enhance robustness under realistic clinical variability.
(3) Scalable modeling for high-resolution, 3D, and workflow-oriented scenarios. Medical data such as 3D CT, 3D MRI, and whole slide imaging (WSI) exhibit extremely high resolution and complex spatial structures. Directly applying 2D models often leads to excessive computational costs and loss of inter-slice or inter-region consistency. Future work should focus on scalable modeling paradigms, including patch-based processing, where recent studies have already explored patch-wise or masked diffusion for efficient local modeling [82,121], sliding-window strategies, as exemplified by sliding-window-based self-supervised learning for high-resolution images [160], sparse attention, as well as coarse-to-fine inference and multi-stage candidate filtering. Beyond computational efficiency, such paradigms may also support more practical MUAD settings, including volumetric lesion continuity analysis, large-scale WSI screening, and multi-stage candidate filtering for downstream clinical workflows.
(4) Integration of medical priors and external knowledge. Purely data-driven unsupervised learning may capture spurious correlations that are inconsistent with medical knowledge. A promising direction is to incorporate anatomical constraints, symmetry priors, inter-organ spatial relationships, and medical knowledge graphs into the learning process in a controlled manner. For instance, anatomical segmentation models, organ templates, topological constraints, or radiomic-guided priors can enhance normal structure modeling [196], as already suggested by structure-guided modeling with tissue segmentation maps [81] and anatomy-aware proxy-task design [152]. Likewise, radiology reports, large language models, or retrieval-augmented frameworks can introduce higher-level semantic knowledge, as reflected in recent work on EHR-guided diffusion reconstruction [28] and anomaly-aware report generation or reasoning with vision–language and language models [170,184]. The key challenge lies in achieving effective synergy between prior knowledge and data-driven representations while avoiding the introduction of additional biases. In the future, such integration may help MUAD move from merely detecting abnormality toward describing, contextualizing, and reasoning about abnormal findings in a clinically meaningful way.
(5) Toward rigorous evaluation of interpretability. In current MUAD research, anomaly heatmaps, anomaly score maps, and pixel-level predictions are often taken as interpretable outputs, yet they generally serve only as indirect evidence and cannot by themselves constitute explanations. More rigorous evaluation protocols are therefore needed. Future studies may assess interpretability from at least three complementary perspectives. First, clinician-centered studies can examine whether explanations help clinicians understand model outputs, improve trust, or support decision-making in realistic reading settings. Recent work in medical AI suggests that such user studies are important, because explanations do not automatically lead to better reliance or clinical utility [197,198]. Second, faithfulness-based evaluation can test whether highlighted regions are truly related to model predictions, for example through perturbation-based analysis or other fidelity metrics [199]. Third, counterfactual- or pseudo-healthy-based assessment is particularly relevant for generative MUAD methods, where explanation quality may also be reflected by the plausibility of restored images and the preservation of healthy structures. Recent generative anomaly detection studies have already proposed metrics such as RQI, AHI, and CACI in this direction [3,200]. Together, these perspectives may help make interpretability evaluation in MUAD more systematic and clinically meaningful.
(6) Toward universal foundation models and standardized benchmarks. Building general-purpose anomaly detection models for multi-modal medical data requires not only stronger foundation models, but also more clinically meaningful evaluation settings. Recent comparative benchmark studies have pointed out that the field still lacks sufficiently fair and comprehensive evaluation, and that conclusions drawn from simplified public datasets may not fully reflect performance in heterogeneous real-world scenarios [192,201]. Future efforts may therefore focus on leveraging large-scale foundation models to enable cross-organ, cross-modality, and cross-task anomaly detection, while at the same time promoting standardized benchmarks across institutions, organs, modalities, and tasks, including unified data splits, annotation granularity, and evaluation metrics. Additional evaluation dimensions, such as calibration, robustness, external validation, and clinical usability, should also be incorporated to support fairer and more reliable comparisons. Because MUAD is well suited to rare, open-set, and previously unseen abnormalities, future foundation-model-based systems may support not only anomaly detection, but also early screening, case triage, report generation, longitudinal monitoring, and potentially prognosis-related analysis.
(7) Post-deployment monitoring and governance. Even if MUAD systems achieve satisfactory performance in validation settings, safe clinical use still requires continuous monitoring after deployment [202]. Future research and application efforts should therefore also consider post-deployment issues such as performance drift, safety reporting, human–AI interaction, and governance mechanisms, so that anomaly detection systems can remain reliable, transparent, and clinically accountable in routine practice. For example, deployed systems may need routine drift monitoring across sites, devices, or patient populations, as well as human review when anomaly predictions become unstable in out-of-distribution cases.
6. Conclusions
This paper provides a comprehensive review of recent advances in medical unsupervised anomaly detection. We systematically summarize major methodological paradigms, including image reconstruction-based methods, feature embedding-based methods, self-supervised learning approaches, and foundation model-based techniques, highlighting their core principles, technical evolution, and application scenarios. Overall, MUAD has evolved from early approaches relying on low-level visual discrepancies toward a multi-paradigm framework that integrates multi-scale structural modeling and high-level semantic representation. However, due to the inherent complexity of medical images, the diversity of anomaly semantics, and the constraints of the unsupervised setting, existing methods still face challenges in anomaly quantification reliability, cross-institution generalization, and clinical interpretability. Looking forward, the integration of multi-task learning, medical prior knowledge, multi-modal information, and foundation models is expected to further advance MUAD. Beyond methodological progress, MUAD also shows practical potential in real-world scenarios such as large-scale pre-screening, suspicious case triage, rare abnormality discovery, and clinical workflow support under limited-annotation conditions. Nevertheless, translating current MUAD systems from benchmark evaluation to routine clinical use still requires further advances in robustness, calibration, interpretability, external validation, and post-deployment monitoring. These developments will enable more robust, interpretable, and clinically applicable anomaly detection systems, ultimately facilitating their deployment in real-world medical screening and computer-aided diagnosis.
Author Contributions
Conceptualization, B.L., G.L., J.L. and H.Z.; methodology, B.L.; software, B.L.; validation, B.L., G.L. and Y.Z.; formal analysis, B.L., Y.Z. and H.Z.; investigation, B.L., G.L., Y.Z., S.Z., R.W. and H.Z.; resources, B.L., Y.Z., S.Z. and R.W.; data curation, B.L.; writing—original draft preparation, B.L.; writing—review and editing, G.L.; visualization, B.L.; supervision, G.L. and H.Z.; project administration, G.L. and H.Z.; funding acquisition, G.L., S.Z., J.L. and H.Z. All authors have read and agreed to the published version of the manuscript.
Funding
This research was partly funded by the National Natural Science Foundation of China (Grant Nos. 62361027 and 62161011), the Key Research and Development Plan of Jiangxi Provincial Science and Technology Department (Key Project) (Grant No. 20223BBE51036), and the Natural Science Foundation of Jiangxi Province (Grant No. 20232BAB202004).
Data Availability Statement
This study is based on previously published works, and no new data were generated or analyzed. Therefore, data sharing is not applicable.
Acknowledgments
The authors gratefully acknowledge the contributions of researchers in the field of medical image anomaly detection, whose studies have been systematically reviewed in this work. The authors also appreciate the efforts of dataset providers for making high-quality medical imaging datasets publicly available, which have significantly advanced research in this area.
Conflicts of Interest
The authors declare no conflicts of interest.
References
- Chen, X.; Wang, X.; Zhang, K.; Zhang, R.; Fung, K.-M.; Thai, T.C.; Moore, K.M.; Mannel, R.S.; Liu, H.; Zheng, B.; et al. Recent advances and clinical applications of deep learning in medical image analysis. Med. Image Anal. 2021, 79, 102444. [Google Scholar] [CrossRef] [Scilit]
- Fernando, T.; Gammulle, H.; Denman, S.; Sridharan, S.; Fookes, C. Deep Learning for Medical Anomaly Detection—A Survey. ACM Comput. Surv. (CSUR) 2020, 54, 1–37. [Google Scholar] [CrossRef] [Scilit]
- Bercea, C.I.; Wiestler, B.; Rueckert, D.; Schnabel, J.A. Evaluating normative representation learning in generative AI for robust anomaly detection in brain imaging. Nat. Commun. 2025, 16, 1624. [Google Scholar] [CrossRef] [Scilit]
- Bao, J.; Sun, H.; Deng, H.; He, Y.; Zhang, Z.; Li, X. BMAD: Benchmarks for Medical Anomaly Detection. In Proceedings of the 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW); IEEE: New York, NY, USA, 2023; pp. 4042–4053. [Google Scholar]
- Mao, Y.; Chen, Z.; Liu, Y.; Dong, C.; Song, K. A survey on industrial image anomaly detection: Methods, benchmarks and rethinks. Measurement 2025, 256, 118377. [Google Scholar] [CrossRef] [Scilit]
- Tao, X.; Gong, X.; Zhang, X.Y.; Yan, S.; Adak, C. Deep Learning for Unsupervised Anomaly Localization in Industrial Images: A Survey. IEEE Trans. Instrum. Meas. 2022, 71, 5018021. [Google Scholar] [CrossRef] [Scilit]
- Bergmann, P.; Fauser, M.; Sattlegger, D.; Steger, C. MVTec AD—A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2019; pp. 9584–9592. [Google Scholar]
- Zou, Y.; Jeong, J.; Pemula, L.; Zhang, D.; Dabeer, O. SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentation. In European Conference on Computer Vision; Springer: Cham, Switzerland, 2022. [Google Scholar]
- Mah’e, Y.; Bannier, E.; Leplaideur, S.; Fromont, É.; Galassi, F. Unsupervised Deep Generative Models for Anomaly Detection in Neuroimaging: A Systematic Scoping Review. arXiv 2025, arXiv:2510.14462. [Google Scholar] [CrossRef] [Scilit]
- Wolleb, J.; Bieder, F.; Sandkühler, R.; Cattin, P.C. Diffusion Models for Medical Anomaly Detection. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2022. [Google Scholar]
- Lei, W.; Xu, W.; Li, K.; Zhang, X.; Zhang, S. MedIAnomaly: A comparative study of anomaly detection in medical images. Med. Image Anal. 2024, 102, 103500. [Google Scholar]
- Abdalla, M.; Javed, S.; Al Radi, M.; Ulhaq, A.; Werghi, N. Video anomaly detection in 10 years: A survey and outlook. Neural Comput. Appl. 2024, 37, 26321–26364. [Google Scholar] [CrossRef] [Scilit]
- Hu, X.; Xie, C.; Fan, Z.; Duan, Q.; Zhang, D.; Jiang, L.; Wei, X.; Hong, D.; Li, G.; Zeng, X.; et al. Hyperspectral Anomaly Detection Using Deep Learning: A Review. Remote Sens. 2022, 14, 1973. [Google Scholar] [CrossRef] [Scilit]
- Samaila, Y.A.; Sebastian, P.; Singh, N.S.S.; Shuaibu, A.N.; Ali, S.S.A.; Amosa, T.I.; Abro, G.E.M.; Shuaibu, I. Video anomaly detection: A systematic review of issues and prospects. Neurocomputing 2024, 591, 127726. [Google Scholar] [CrossRef] [Scilit]
- Guo, L.; Fu, Y.; Tan, S.; Wang, Q.; Zhang, Y.; Huang, X.; Yuan, X. RadioGuide-DCN: A Radiomics-Guided Decorrelated Network for Medical Image Classification. Bioengineering 2025, 13, 46. [Google Scholar] [CrossRef] [Scilit]
- Nguyen, H.Q.; Lam, K.; Le, L.T.; Pham, H.; Tran, D.Q.; Nguyen, D.B.; Le, D.D.; Pham, C.M.; Tong, H.; Dinh, D.H.; et al. VinDr-CXR: An open dataset of chest X-rays with radiologist’s annotations. Sci. Data 2020, 9, 429. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Irvin, J.A.; Rajpurkar, P.; Ko, M.; Yu, Y.; Ciurea-Ilcus, S.; Chute, C.; Marklund, H.; Haghgoo, B.; Ball, R.L.; Shpanskaya, K.S.; et al. CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison. AAAI Conf. Artif. Intell. 2019, 33, 590–597. [Google Scholar] [CrossRef] [Scilit]
- Nagy, E.; Janisch, M.; Hržić, F.; Sorantin, E.; Tschauner, S. A pediatric wrist trauma X-ray dataset (GRAZPEDWRI-DX) for machine learning. Sci. Data 2022, 9, 222. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Xiang, T.; Zhang, Y.; Lu, Y.; Yuille, A.L.; Zhang, C.; Cai, W.; Zhou, Z. Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Images. IEEE Trans. Pattern Anal. Mach. Intell. 2024, 46, 6070–6081. [Google Scholar] [CrossRef] [Scilit]
- Bozorgtabar, B.; Mahapatra, D.; Thiran, J.-P. AMAE: Adaptation of Pre-Trained Masked Autoencoder for Dual-Distribution Anomaly Detection in Chest X-Rays. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2023. [Google Scholar]
- Baid, U.; Ghodasara, S.; Bilello, M.; Mohan, S.; Calabrese, E.; Colak, E.; Farahani, K.; Kalpathy-Cramer, J.; Kitamura, F.C.; Pati, S.; et al. The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classification. arXiv 2021, arXiv:2107.02314. [Google Scholar]
- Wei, J.; Hu, X.; Zhang, S.; Wang, G. StyleGAN-Based Brain MRI Anomaly Detection via Latent Code Retrieval and Partial Swap. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2025. [Google Scholar]
- Bercea, C.I.; Neumayr, M.; Rueckert, D.; Schnabel, J.A. Mask, Stitch, and Re-Sample: Enhancing Robustness and Generalizability in Anomaly Detection through Automatic Diffusion Models. arXiv 2023, arXiv:2305.19643. [Google Scholar] [CrossRef] [Scilit]
- Pinaya, W.H.L.; Tudosiu, P.-D.D.; Gray, R.J.; Rees, G.; Nachev, P.; Ourselin, S.; Cardoso, M.J. Unsupervised brain imaging 3D anomaly detection and segmentation with transformers. Med. Image Anal. 2022, 79, 102475. [Google Scholar] [CrossRef] [Scilit]
- Siddiquee, M.M.R.; Shah, J.; Wu, T.; Chong, C.D.; Schwedt, T.J.; Dumkrieger, G.M.; Nikolova, S.; Li, B. Brainomaly: Unsupervised Neurologic Disease Detection Utilizing Unannotated T1-weighted Brain MR Images. In 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV); IEEE: New York, NY, USA, 2023; pp. 7558–7567. [Google Scholar]
- Setio, A.A.A.; Traverso, A.; de Bel, T.; Berens, M.S.N.; van den Bogaard, C.; Cerello, P.; Chen, H.; Dou, Q.; Fantacci, M.E.; Geurts, B.; et al. Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge. Med. Image Anal. 2016, 42, 1–13. [Google Scholar] [CrossRef] [Scilit]
- Heller, N.; Sathianathen, N.J.; Kalapara, A.A.; Walczak, E.; Moore, K.; Kaluzniak, H.; Rosenberg, J.E.; Blake, P.; Rengel, Z.; Oestreich, M.; et al. The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomes. arXiv 2019, arXiv:1904.00445. [Google Scholar]
- Kim, H.; Wang, Y.; Ahn, M.; Choi, H.; Zhou, Y.; Hong, C. Harnessing EHRs for Diffusion-based Anomaly Detection on Chest X-rays. arXiv 2025, arXiv:2505.17311. [Google Scholar] [CrossRef] [Scilit]
- Kim, K.; Oh, S.J.; Lee, J.H.; Chung, M.-J. 3D unsupervised anomaly detection through virtual multi-view projection and reconstruction: Clinical validation on low-dose chest computed tomography. Expert Syst. Appl. 2023, 236, 121165. [Google Scholar] [CrossRef] [Scilit]
- Liu, D.; Wang, H.; Zhang, F. TS-AC: Teacher–Student Model with Aggregation Masked Convolution and Concentrated Linear Attention for Chest CT Abnormality Detection. IEEE Trans. Instrum. Meas. 2025, 74, 4015814. [Google Scholar] [CrossRef] [Scilit]
- Li, L.; Xu, M.; Wang, X.; Jiang, L.; Liu, H. Attention Based Glaucoma Detection: A Large-Scale Database and CNN Model. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2019; pp. 10563–10572. [Google Scholar]
- Zhang, W.; Liu, H.; Xie, J.; Huang, Y.; Zhang, Y.; Li, Y.; Ramachandra, R.; Zheng, Y. Anomaly detection via gating highway connection for retinal fundus images. Pattern Recognit. 2023, 148, 110167. [Google Scholar] [CrossRef] [Scilit]
- Das, S.D.; Dutta, S.; Shah, N.A.; Mahapatra, D.; Ge, Z.Y. Anomaly Detection In Retinal Images Using Multi-Scale Deep Feature Sparse Coding. In 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI); IEEE: New York, NY, USA, 2022; pp. 1–5. [Google Scholar]
- Kermany, D.S.; Zhang, K.; Goldbaum, M.H. Labeled Optical Coherence Tomography (OCT) and Chest X-Ray Images for Classification; Version 2; Mendeley Data: London, UK, 2018. [Google Scholar]
- Lu, S.; Zhang, W.; Zhao, H.; Liu, H.; Wang, N.; Li, H. Anomaly Detection for Medical Images Using Heterogeneous Auto-Encoder. IEEE Trans. Image Process. 2024, 33, 2770–2782. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Ge, C.; Yu, X.; Zheng, H.; Fan, Z.; Muhammad, U.; Chen, J.; Shum, P.P. ESC-DRKD: Enhanced skip connection-based direct reverse knowledge distillation for medical image anomaly detection. Neurocomputing 2025, 651, 130994. [Google Scholar] [CrossRef] [Scilit]
- Codella, N.C.F.; Rotemberg, V.M.; Tschandl, P.; Celebi, M.E.; Dusza, S.W.; Gutman, D.; Helba, B.; Kalloo, A.; Liopyris, K.; Marchetti, M.A.; et al. Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC). arXiv 2019, arXiv:1902.03368. [Google Scholar] [CrossRef] [Scilit]
- Zhao, Y.; Ding, Q.; Zhang, X. AE-FLOW: Autoencoders with Normalizing Flows for Medical Images Anomaly Detection. In International Conference on Learning Representations; Springer: Cham, Switzerland, 2024. [Google Scholar]
- Tang, P.; Yan, X.; Hu, X.; Wu, K.; Lasser, T.; Shi, K. Anomaly Detection in Medical Images Using Encoder-Attention-2Decoders Reconstruction. IEEE Trans. Med. Imaging 2025, 44, 3370–3382. [Google Scholar] [CrossRef] [Scilit]
- Al-Dhabyani, W.; Gomaa, M.; Khaled, H.; Fahmy, A.A. Dataset of breast ultrasound images. Data Brief 2019, 28, 104863. [Google Scholar] [CrossRef] [Scilit]
- Huang, Y.; Liu, G.-S.; Luo, Y.; Yang, G. ADFA: Attention-Augmented Differentiable Top-K Feature Adaptation for Unsupervised Medical Anomaly Detection. In 2023 IEEE International Conference on Image Processing (ICIP); IEEE: New York, NY, USA, 2023; pp. 206–210. [Google Scholar]
- Hou, Y.; Li, P.; Liu, Z.; Wang, Y.; Ruan, Y.; Qiu, J.; Xu, K. VisualAD: Language-Free Zero-Shot Anomaly Detection via Vision Transformer. arXiv 2026, arXiv:2603.07952. [Google Scholar]
- Jha, D.; Smedsrud, P.H.; Riegler, M.; Halvorsen, P.; de Lange, T.; Johansen, D.; Johansen, H.D. Kvasir-SEG: A Segmented Polyp Dataset. In Conference on Multimedia Modeling; Springer: Cham, Switzerland, 2019. [Google Scholar]
- Pogorelov, K.; Randel, K.R.; Griwodz, C.; Eskeland, S.L.; de Lange, T.; Johansen, D.; Spampinato, C.; Dang-Nguyen, D.-T.; Lux, M.; Schmidt, P.T.; et al. KVASIR: A Multi-Class Image Dataset for Computer Aided Gastrointestinal Disease Detection. In Proceedings of the 8th ACM on Multimedia Systems Conference; Association for Computing Machinery: New York, NY, USA, 2017. [Google Scholar]
- Borgli, H.; Thambawita, V.L.; Smedsrud, P.H.; Hicks, S.; Jha, D.; Eskeland, S.L.; Randel, K.R.; Pogorelov, K.; Lux, M.; Nguyen, D.T.D.; et al. HyperKvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy. Sci. Data 2019, 7, 283. [Google Scholar] [CrossRef] [Scilit]
- Huang, C.; Shi, Y.; Zhang, B.; Lyu, K. Uncertainty-aware prototypical learning for anomaly detection in medical images. Neural Netw. 2024, 175, 106284. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Tian, Y.; Liu, F.; Pang, G.; Chen, Y.; Liu, Y.; Verjans, J.; Singh, R.; Carneiro, G. Self-supervised pseudo multi-class pre-training for unsupervised anomaly detection and segmentation in medical images. Med. Image Anal. 2021, 90, 102930. [Google Scholar] [CrossRef] [Scilit]
- Ehteshami Bejnordi, B.; Veta, M.; Johannes van Diest, P.; van Ginneken, B.; Karssemeijer, N.; Litjens, G.J.S.; van der Laak, J.A.W.M.; Hermsen, M.; Manson, Q.F.; Balkenhol, M.C.A.; et al. Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women with Breast Cancer. JAMA 2017, 318, 2199–2210. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Li, L.; Shelton, L.; Forest, T.; Janardhan, K.S.; Jenkins, T.; Napolitano, M.J.; Wang, R.; Leigh, D.; Shah, T.; Carlson, G.E.; et al. Unsupervised Anomaly Detection on Preclinical Liver H &E Whole Slide Images Using Graph Based Feature Distillation. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2025. [Google Scholar]
- Mejia, A.F.; Nebel, M.B.; Eloyan, A.; Caffo, B.S.; Lindquist, M.A. PCA leverage: Outlier detection for high-dimensional functional magnetic resonance imaging data. Biostatistics 2015, 18, 521–536. [Google Scholar] [CrossRef] [Scilit]
- Olshausen, B.A.; Field, D.J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 1996, 381, 607–609. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hasan, M.; Choi, J.; Neumann, J.; Roy-Chowdhury, A.K.; Davis, L.S. Learning Temporal Regularity in Video Sequences. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2016; pp. 733–742. [Google Scholar]
- An, J.; Cho, S. Variational Autoencoder based Anomaly Detection using Reconstruction Probability. Spec. Lect. IE 2015, 2, 1–18. [Google Scholar]
- Schlegl, T.; Seeböck, P.; Waldstein, S.M.; Schmidt-Erfurth, U.M.; Langs, G. Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery. In Information Processing in Medical Imaging; Springer: Cham, Switzerland, 2017. [Google Scholar]
- Wyatt, J.; Leach, A.; Schmon, S.M.; Willcocks, C.G. AnoDDPM: Anomaly Detection with Denoising Diffusion Probabilistic Models using Simplex Noise. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW); IEEE: New York, NY, USA, 2022; pp. 649–655. [Google Scholar]
- Deng, H.; Li, X. Anomaly Detection via Reverse Distillation from One-Class Embedding. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2022; pp. 9727–9736. [Google Scholar]
- Salehi, M.; Sadjadi, N.; Baselizadeh, S.; Rohban, M.H.; Rabiee, H.R. Multiresolution Knowledge Distillation for Anomaly Detection. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2020; pp. 14897–14907. [Google Scholar]
- Defard, T.; Setkov, A.; Loesch, A.; Audigier, R. PaDiM: A Patch Distribution Modeling Framework for Anomaly Detection and Localization. In ICPR International Workshops and Challenges; Springer: Cham, Switzerland, 2021. [Google Scholar]
- Roth, K.; Pemula, L.; Zepeda, J.; Scholkopf, B.; Brox, T.; Gehler, P. Towards Total Recall in Industrial Anomaly Detection. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2021; pp. 14298–14308. [Google Scholar]
- Gong, D.; Liu, L.; Le, V.; Saha, B.; Mansour, M.R.; Venkatesh, S.; van den Hengel, A. Memorizing Normality to Detect Anomaly: Memory-Augmented Deep Autoencoder for Unsupervised Anomaly Detection. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV); IEEE: New York, NY, USA, 2019; pp. 1705–1714. [Google Scholar]
- Rudolph, M.; Wehrbein, T.; Rosenhahn, B.; Wandt, B. Fully Convolutional Cross-Scale-Flows for Image-based Defect Detection. In 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV); IEEE: New York, NY, USA, 2021; pp. 1829–1838. [Google Scholar]
- Yu1, J.; Zheng, Y.; Wang, X.; Li, W.; Wu, Y.; Zhao, R.; Wu, L. FastFlow: Unsupervised Anomaly Detection and Localization via 2D Normalizing Flows. arXiv 2021, arXiv:2111.07677. [Google Scholar] [CrossRef] [Scilit]
- Li, C.-L.; Sohn, K.; Yoon, J.; Pfister, T. CutPaste: Self-Supervised Learning for Anomaly Detection and Localization. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2021; pp. 9659–9669. [Google Scholar]
- Schlüter, H.M.; Tan, J.; Hou, B.; Kainz, B. Natural Synthetic Anomalies for Self-supervised Anomaly Detection and Localization. In European Conference on Computer Vision; Springer: Cham, Switzerland, 2022. [Google Scholar]
- Tan, J.; Hou, B.; Batten, J.; Qiu, H.; Kainz, B. Detecting Outliers with Foreign Patch Interpolation. arXiv 2020, arXiv:2011.04197. [Google Scholar] [CrossRef] [Scilit]
- Tan, J.; Hou, B.; Day, T.G.; Simpson, J.M.; Rueckert, D.; Kainz, B. Detecting Outliers with Poisson Image Interpolation. arXiv 2021, arXiv:2107.02622. [Google Scholar] [CrossRef] [Scilit]
- Tack, J.; Mo, S.; Jeong, J.; Shin, J. CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instances. arXiv 2020, arXiv:2007.08176. [Google Scholar] [CrossRef] [Scilit]
- Tian, Y.; Pang, G.; Liu, F.; Chen, Y.; Shin, S.H.; Verjans, J.; Singh, R.; Carneiro, G. Constrained Contrastive Distribution Learning for Unsupervised Anomaly Detection and Localisation in Medical Images. arXiv 2021, arXiv:2103.03423. [Google Scholar] [CrossRef] [Scilit]
- Jeong, J.; Zou, Y.; Kim, T.; Zhang, D.; Ravichandran, A.; Dabeer, O. WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2023; pp. 19606–19616. [Google Scholar]
- Zhou, Q.; Pang, G.; Tian, Y.; He, S.; Chen, J. AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection. arXiv 2023, arXiv:2310.18961. [Google Scholar]
- Schlegl, T.; Seeböck, P.; Waldstein, S.M.; Langs, G.; Schmidt-Erfurth, U.M. f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks. Med. Image Anal. 2019, 54, 30–44. [Google Scholar] [CrossRef] [Scilit]
- Marimont, S.N.; Tarroni, G. Anomaly Detection Through Latent Space Restoration Using Vector Quantized Variational Autoencoders. In 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI); IEEE: New York, NY, USA, 2020; pp. 1764–1767. [Google Scholar]
- Han, C.; Rundo, L.; Murao, K.; Noguchi, T.; Shimahara, Y.; Milacski, Z.Á.; Koshino, S.; Sala, E.; Nakayama, H.; Satoh, S. MADGAN: Unsupervised medical anomaly detection GAN using multiple adjacent brain MRI slice reconstruction. BMC Bioinform. 2020, 22, 31. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rudolph, M.; Wandt, B.; Rosenhahn, B. Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flows. In 2021 IEEE Winter Conference on Applications of Computer Vision (WACV); IEEE: New York, NY, USA, 2020; pp. 1906–1915. [Google Scholar]
- Yi, J.; Yoon, S. Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentation. arXiv 2020, arXiv:2006.16067. [Google Scholar] [CrossRef] [Scilit]
- Chen, Y.; Zhang, H.; Wang, Y.; Yang, Y.; Zhou, X.; Jonathan Wu, Q.M. MAMA Net: Multi-Scale Attention Memory Autoencoder Network for Anomaly Detection. IEEE Trans. Med. Imaging 2020, 40, 1032–1041. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Marimont, S.N.; Tarroni, G. Implicit field learning for unsupervised anomaly detection in medical images. arXiv 2021, arXiv:2106.05214. [Google Scholar] [CrossRef] [Scilit]
- Wang, G.; Han, S.; Ding, E.; Huang, D. Student-Teacher Feature Pyramid Matching for Anomaly Detection. In British Machine Vision Conference; The British Machine Vision Association: Durham, UK, 2021. [Google Scholar]
- Gudovskiy, D.A.; Ishizaka, S.; Kozuka, K. CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flows. In 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV); IEEE: New York, NY, USA, 2021; pp. 1819–1828. [Google Scholar]
- Siddiquee, M.M.R.; Shah, J.; Wu, T.; Chong, C.D.; Schwedt, T.J.; Li, B. HealthyGAN: Learning from Unannotated Medical Images to Detect Anomalies Associated with Human Disease. Simul. Synth. Med. Imaging 2022, 13570, 43–54. [Google Scholar]
- Chatterjee, S.; Sciarra, A.; Dünnwald, M.; Tummala, P.; Agrawal, S.K.; Jauhari, A.; Kalra, A.; Oeltze-Jafra, S.; Speck, O.; Nürnberger, A. StRegA: Unsupervised Anomaly Detection in Brain MRIs using a Compact Context-encoding Variational Autoencoder. Comput. Biol. Med. 2022, 149, 106093. [Google Scholar] [CrossRef] [Scilit]
- Iqbal, H.; Khalid, U.; Hua, J.; Chen, C. Unsupervised Anomaly Detection in Medical Images Using Masked Diffusion Model. In International Workshop on Machine Learning in Medical Imaging; Springer: Cham, Switzerland, 2023. [Google Scholar]
- Guo, J.; Lu, S.; Jia, L.; Zhang, W.; Li, H. Encoder-Decoder Contrast for Unsupervised Anomaly Detection in Medical Images. IEEE Trans. Med. Imaging 2023, 43, 1102–1112. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Cai, Y.; Chen, H.; Yang, X.; Zhou, Y.; Cheng, K.-T. Dual-distribution discrepancy with self-supervised refinement for anomaly detection in medical images. Med. Image Anal. 2022, 86, 102794. [Google Scholar] [CrossRef] [Scilit]
- Kascenas, A.; Sanchez, P.; Schrempf, P.; Wang, C.P.; Clackett, W.; Mikhael, S.S.; Voisey, J.P.; Goatman, K.A.; Weir, A.; Pugeault, N.; et al. The role of noise in denoising models for anomaly detection in medical images. Med. Image Anal. 2023, 90, 102963. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Luth, C.T.; Zimmerer, D.; Koehler, G.; Jaeger, P.F.; Isensee, F.; Petersen, J.; Maier-Hein, K.H. CRADL: Contrastive Representations for Unsupervised Anomaly Detection and Localization. arXiv 2023, arXiv:2301.02126. [Google Scholar] [CrossRef] [Scilit]
- Li, Y.; Lao, Q.; Kang, Q.; Jiang, Z.; Du, S.; Zhang, S.; Li, K. Self-supervised anomaly detection, staging and segmentation for retinal images. Med. Image Anal. 2023, 87, 102805. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Z.; Sun, Z.; Liu, Z.; Du, B.; Yu, R.; Zhao, Z.; Xu, Y. Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2024. [Google Scholar]
- Fontanella, A.; Mair, G.; Wardlaw, J.M.; Trucco, E.; Storkey, A.J. Diffusion Models for Counterfactual Generation and Anomaly Detection in Brain Images. IEEE Trans. Med. Imaging 2023, 44, 3574–3585. [Google Scholar] [CrossRef] [Scilit]
- Xu, S.; Li, W.; Li, Z.; Zhao, T.; Zhang, B. Facing Differences of Similarity: Intra- and Inter-Correlation Unsupervised Learning for Chest X-Ray Anomaly Detection. IEEE Trans. Med. Imaging 2024, 44, 801–814. [Google Scholar] [CrossRef] [Scilit]
- Lu, S.; Zhang, W.; Guo, J.; Liu, H.; Li, H.; Wang, N. PatchCL-AE: Anomaly detection for medical images using patch-wise contrastive learning-based auto-encoder. Comput. Med. Imaging Graph. 2024, 114, 102366. [Google Scholar] [CrossRef] [Scilit]
- Huang, C.; Jiang, A.; Feng, J.; Zhang, Y.; Wang, X.; Wang, Y. Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images. In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2024; pp. 11375–11385. [Google Scholar]
- Zhang, X.; Xu, M.; Qiu, D.; Yan, R.; Lang, N.; Zhou, X. MediCLIP: Adapting CLIP for Few-shot Medical Image Anomaly Detection. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2024. [Google Scholar]
- Dong, L.; Tan, Q.; Li, C.; Hu, J.; Shi, Y.; Dong, W.; Zhu, X.X.; Mou, L. Dual Distillation for Few-Shot Anomaly Detection. arXiv 2026, arXiv:2603.01713. [Google Scholar] [CrossRef] [Scilit]
- Chen, P.; Huang, C. WMoE-CLIP: Wavelet-Enhanced Mixture-of-Experts Prompt Learning for Zero-Shot Anomaly Detection. arXiv 2026, arXiv:2603.06313. [Google Scholar]
- Gu, Z.; Zhu, B.; Zhu, G.; Chen, Y.; Ge, W.-L.; Tang, M.; Wang, J. AnomalyMoE: Towards a Language-free Generalist Model for Unified Visual Anomaly Detection. arXiv 2025, arXiv:2508.06203. [Google Scholar] [CrossRef] [Scilit]
- Gao, B.-B.; Zhou, Y.; Yan, J.; Cai, Y.; Zhang, W.; Wang, M.; Liu, J.; Liu, Y.; Wang, L.; Wang, C. AdaptCLIP: Adapting CLIP for Universal Visual Anomaly Detection. arXiv 2025, arXiv:2505.09926. [Google Scholar] [CrossRef] [Scilit]
- Li, C.; Shi, Y.; Hu, J.; Zhu, X.X.; Mou, L. Scale-Aware Contrastive Reverse Distillation for Unsupervised Medical Anomaly Detection. arXiv 2025, arXiv:2503.13828. [Google Scholar] [CrossRef] [Scilit]
- Park, J.; Moon, C.; Lee, D.; Kim, K.; Hwang, M. OFF-CLIP: Improving Normal Detection Confidence in Radiology CLIP with Simple Off-Diagonal Term Auto-Adjustment. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2025. [Google Scholar]
- Shiri, M.; Beyan, C.; Murino, V. MadCLIP: Few-shot Medical Anomaly Detection with CLIP. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2025. [Google Scholar]
- Xu, J.; Lo, S.-Y.; Safaei, B.; Patel, V.M.; Dwivedi, I. Towards Zero-Shot Anomaly Detection and Reasoning with Multimodal Large Language Models. In 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2025; pp. 20370–20382. [Google Scholar]
- Zimmerer, D.; Kohl, S.A.A.; Petersen, J.; Isensee, F.; Maier-Hein, K.H. Context-encoding Variational Autoencoder for Unsupervised Anomaly Detection. arXiv 2018, arXiv:1812.05941. [Google Scholar] [CrossRef] [Scilit]
- Baur, C.; Wiestler, B.; Albarqouni, S.; Navab, N. Deep Autoencoding Models for Unsupervised Anomaly Segmentation in Brain MR Images. In International MICCAI Brainlesion Workshop; Springer: Cham, Switzerland, 2018. [Google Scholar]
- Vincent, P.; Larochelle, H.; Lajoie, I.; Bengio, Y.; Manzagol, P.-A. Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion. J. Mach. Learn. Res. 2010, 11, 3371–3408. [Google Scholar]
- Kascenas, A.; Pugeault, N.; O’Neil, A.Q. Denoising Autoencoders for Unsupervised Anomaly Detection in Brain MRI. In International Conference on Medical Imaging with Deep Learning; PMLR: London, UK, 2022. [Google Scholar]
- Tian, Y.; Pang, G.; Liu, Y.; Wang, C.; Chen, Y.; Liu, F.; Singh, R.; Verjans, J.; Carneiro, G. Unsupervised Anomaly Detection in Medical Images with a Memory-augmented Multi-level Cross-attentional Masked Autoencoder. arXiv 2022, arXiv:2203.11725. [Google Scholar]
- Luo, G.; Xie, W.; Gao, R.; Zheng, T.; Chen, L.; Sun, H. Unsupervised anomaly detection in brain MRI: Learning abstract distribution from massive healthy brains. Comput. Biol. Med. 2023, 154, 106610. [Google Scholar] [CrossRef] [Scilit]
- Zhang, H.; Guo, W.; Zhang, S.; Lu, H.; Zhao, X. Unsupervised Deep Anomaly Detection for Medical Images Using an Improved Adversarial Autoencoder. J. Digit. Imaging 2022, 35, 153–161. [Google Scholar] [CrossRef] [Scilit]
- Bercea, C.I.; Rueckert, D.; Schnabel, J.A. What do we learn? Debunking the Myth of Unsupervised Outlier Detection. arXiv 2022, arXiv:2206.03698. [Google Scholar]
- Bercea, C.I.; Wiestler, B.; Rueckert, D.; Schnabel, J.A. Towards Universal Unsupervised Anomaly Detection in Medical Imaging. arXiv 2024, arXiv:2401.10637. [Google Scholar] [CrossRef] [Scilit]
- Cai, Y.; Chen, H.; Cheng, K.-T. Rethinking Autoencoders for Medical Anomaly Detection from A Theoretical Perspective. arXiv 2024, arXiv:2403.09303. [Google Scholar] [CrossRef] [Scilit]
- Zimmerer, D.; Isensee, F.; Petersen, J.; Kohl, S.A.A.; Maier-Hein, K.H. Unsupervised Anomaly Localization using Variational Auto-Encoders. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2019. [Google Scholar]
- van den Oord, A.; Vinyals, O.; Kavukcuoglu, K. Neural Discrete Representation Learning. Adv. Neural Inf. Process. Syst. 2017, 30, 6306–6315. [Google Scholar]
- Wijanarko, H.; Calista, E.; Chen, L.-F.; Chen, Y.-S. Tri-VAE: Triplet Variational Autoencoder for Unsupervised Anomaly Detection in Brain Tumor MRI. In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW); IEEE: New York, NY, USA, 2024; pp. 3930–3939. [Google Scholar]
- Kuttala, D.; Mahapatra, D.; Ramanathan, S.; Oruganti, V.R.M. Dense attentive GAN-based one-class model for detection of autism and ADHD. J. King Saud. Univ. Comput. Inf. Sci. 2022, 34, 10444–10458. [Google Scholar] [CrossRef] [Scilit]
- Kim, D.-Y.; Lee, S.J.; Kim, E.-K.; Kang, E.; Heo, C.-Y.; Jeong, J.H.; Myung, Y.; Kim, I.A.; Jang, B.-S. Feasibility of anomaly score detected with deep learning in irradiated breast cancer patients with reconstruction. npj Digit. Med. 2022, 5, 125. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Basaran, B.D.; Qiao, M.; Matthews, P.M.; Bai, W. Subject-Specific Lesion Generation and Pseudo-Healthy Synthesis for Multiple Sclerosis Brain Images. In International Workshop on Simulation and Synthesis in Medical Imaging; Springer: Cham, Switzerland, 2022. [Google Scholar]
- Bercea, C.I.; Wiestler, B.; Rueckert, D.; Schnabel, J.A. Reversing the Abnormal: Pseudo-Healthy Generative Networks for Anomaly Detection. arXiv 2023, arXiv:2303.08452. [Google Scholar] [CrossRef] [Scilit]
- Li, G.; Zou, Y.; Liu, B.; Jiang, N.; Lv, J.; Ai, W.; Ji, D.-H.; Zhou, Q.; Zhang, H. PAttL-GAN: Pixel Attention Localization Generative Adversarial Network for Unsupervised Anomaly Detection in Medical Images. Neurocomputing 2025, 654, 131345. [Google Scholar] [CrossRef] [Scilit]
- Bougaham, A.; Delchevalerie, V.; El Adoui, M.; Fr’enay, B. Industrial and Medical Anomaly Detection Through Cycle-Consistent Adversarial Networks. arXiv 2023, arXiv:2302.05154. [Google Scholar] [CrossRef] [Scilit]
- Behrendt, F.; Bhattacharya, D.; Kruger, J.; Opfer, R.; Schlaefer, A. Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI. In International Conference on Medical Imaging with Deep Learning; PMLR: London, UK, 2024. [Google Scholar]
- Beizaee, F.; Lodygensky, G.A.; Desrosiers, C.; Dolz, J. MAD-AD: Masked Diffusion for Unsupervised Brain Anomaly Detection. arXiv 2025, arXiv:2502.16943. [Google Scholar] [CrossRef] [Scilit]
- Behrendt, F.; Bhattacharya, D.; Maack, L.; Krüger, J.; Opfer, R.; Mieling, R.; Schlaefer, A. Diffusion Models with Ensembled Structure-Based Anomaly Scoring for Unsupervised Anomaly Detection. In 2024 IEEE International Symposium on Biomedical Imaging (ISBI); IEEE: New York, NY, USA, 2024; pp. 1–4. [Google Scholar]
- Bercea, C.I.; Wiestler, B.; Rueckert, D.; Schnabel, J.A. Diffusion Models with Implicit Guidance for Medical Anomaly Detection. arXiv 2024, arXiv:2403.08464. [Google Scholar] [CrossRef] [Scilit]
- Bi, Y.; Huang, L.; Clarenbach, R.; Ghotbi, R.; Karlas, A.; Navab, N.; Jiang, Z. Synomaly noise and multi-stage diffusion: A novel approach for unsupervised anomaly detection in medical images. Med. Image Anal. 2024, 105, 103737. [Google Scholar] [CrossRef] [Scilit]
- Scholkopf, B.; Platt, J.C.; Shawe-Taylor, J.; Smola, A.; Williamson, R.C. Estimating the Support of a High-Dimensional Distribution. Neural Comput. 2001, 13, 1443–1471. [Google Scholar] [CrossRef] [Scilit]
- Tax, D.M.J.; Duin, R.P.W. Support Vector Data Description. Mach. Learn. 2004, 54, 45–66. [Google Scholar] [CrossRef] [Scilit]
- Ruff, L.; Görnitz, N.; Deecke, L.; Siddiqui, S.A.; Vandermeulen, R.A.; Binder, A.; Müller, E.; Kloft, M. Deep One-Class Classification. In International Conference on Machine Learning; PMLR: London, UK, 2018. [Google Scholar]
- Liznerski, P.; Ruff, L.; Vandermeulen, R.A.; Franks, B.J.; Kloft, M.; Muller, K.-R. Explainable Deep One-Class Classification. arXiv 2020, arXiv:2007.01760. [Google Scholar]
- Chen, Y.; Tian, Y.; Pang, G.; Carneiro, G. Deep One-Class Classification via Interpolated Gaussian Descriptor. AAAI Conf. Artif. Intell. 2022, 36, 383–392. [Google Scholar] [CrossRef] [Scilit]
- Alhadad, A.A.; Mostafa, R.R.; El-Bakry, H.M. Deep SVDD and Transfer Learning for COVID-19 Diagnosis Using CT Images. Comput. Intell. Neurosci. 2023, 2023, 6070970. [Google Scholar] [CrossRef] [Scilit]
- Gamper, J.; Chan, B.; Tsang, Y.-W.; Snead, D.R.J.; Rajpoot, N.M. Meta-SVDD: Probabilistic Meta-Learning for One-Class Classification in Cancer Histology Images. arXiv 2020, arXiv:2003.03109. [Google Scholar]
- He, K.; Zhang, X.; Ren, S.; Sun, J. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2015; pp. 770–778. [Google Scholar]
- Zagoruyko, S.; Komodakis, N. Wide Residual Networks. arXiv 2016, arXiv:1605.07146. [Google Scholar] [CrossRef] [Scilit]
- Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K.; Li, F.-F. ImageNet: A large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2009; pp. 248–255. [Google Scholar]
- Ouardini, K.; Yang, H.; Unnikrishnan, B.; Romain, M.; Garcin, C.; Zenati, H.; Campbell, J.; Chiang, M.F.; Kalpathy-Cramer, J.; Chandrasekhar, V.R.; et al. Towards Practical Unsupervised Anomaly Detection on Retinal Images. In MICCAI Workshop on Domain Adaptation and Representation Transfer; Springer: Cham, Switzerland, 2019. [Google Scholar]
- Wang, S.Z.; Wu, L.; Cui, L.; Shen, Y. Glancing at the Patch: Anomaly Localization with Global and Local Feature Comparison. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2021; pp. 254–263. [Google Scholar]
- Cohen, N.; Hoshen, Y. Sub-Image Anomaly Detection with Deep Pyramid Correspondences. arXiv 2020, arXiv:2005.02357. [Google Scholar]
- González-Jiménez, Á.; Lionetti, S.; Amruthalingam, L.; Gottfrois, P.; Gröger, F.; Pouly, M.; Navarini, A.A. Is Hyperbolic Space All You Need for Medical Anomaly Detection? In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2025. [Google Scholar]
- Park, H.; Noh, J.; Ham, B. Learning Memory-Guided Normality for Anomaly Detection. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2020; pp. 14360–14369. [Google Scholar]
- Ceausescu, C.-M.; Alexe, B.; Volpi, R. Coreset Based Medical Image Anomaly Detection and Segmentation. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2024)—Volume 4: VISAPP; SCITEPRESS—Science and Technology Publications, Lda: Setúbal, Portugal, 2024. [Google Scholar]
- Ye, J.; Gao, W.; Wu, Y.; Jiao, G. Compact structural feature enhancement for unsupervised anomaly detection in chest radiographs. Vis. Comput. 2025, 41, 11519–11536. [Google Scholar] [CrossRef] [Scilit]
- Cho, W.; Park, J.; Choo, J. Training Auxiliary Prototypical Classifiers for Explainable Anomaly Detection in Medical Image Segmentation. In 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV); IEEE: New York, NY, USA, 2023; pp. 2623–2632. [Google Scholar]
- Pan, R.; Lu, R. SP-Mamba: Spatial-Perception State Space Model for Unsupervised Medical Anomaly Detection. In Proceedings of the 33rd ACM International Conference on Multimedia; Association for Computing Machinery: New York, NY, USA, 2025. [Google Scholar]
- Valiuddin, M.M.A.; Viviers, C.G.A.; van Sloun, R.J.G.; de With, P.H.N.; der Sommen, F.v. Efficient Out-of-Distribution Detection of Melanoma with Wavelet-based Normalizing Flows. arXiv 2022, arXiv:2208.04639. [Google Scholar]
- Bergmann, P.; Fauser, M.; Sattlegger, D.; Steger, C. Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddings. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2019; pp. 4182–4191. [Google Scholar]
- Liu, M.; Jiao, Y.; Lu, J.; Chen, H. Anomaly Detection for Medical Images Using Teacher–Student Model with Skip Connections and Multiscale Anomaly Consistency. IEEE Trans. Instrum. Meas. 2024, 73, 2520415. [Google Scholar] [CrossRef] [Scilit]
- Aresta, G.; Araújo, T.; Schmidt-Erfurth, U.M.; Bogunović, H. Anomaly Detection in Retinal OCT Images with Deep Learning-Based Knowledge Distillation. Transl. Vis. Sci. Technol. 2025, 14, 26. [Google Scholar] [CrossRef] [Scilit]
- Schwarz, J.; Will, L.; Wellmer, J.; Mosig, A. A Patch-based Student-Teacher Pyramid Matching Approach to Anomaly Detection in 3D Magnetic Resonance Imaging. In International Conference on Medical Imaging with Deep Learning; PMLR: London, UK, 2024. [Google Scholar]
- Rahmaniar, W.; Suzuki, K. Multi-AD: Cross-domain unsupervised anomaly detection for medical and industrial applications. Pattern Recognit. 2025, 172, 112486. [Google Scholar] [CrossRef] [Scilit]
- Zavrtanik, V.; Kristan, M.; Skočaj, D. DRÆM—A discriminatively trained reconstruction embedding for surface anomaly detection. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV); IEEE: New York, NY, USA, 2021; pp. 8310–8319. [Google Scholar]
- Junya, S.; Yuki, S.; Tomohiro, W.; Daiki, N.; Kosuke, K.; Kazuki, Y.; Noriyuki, T.; Shoji, K. Anatomy-aware self-supervised learning for anomaly detection in chest radiographs. iScience 2022, 26, 107086. [Google Scholar]
- Grill, J.-B.; Strub, F.; Altch’e, F.; Tallec, C.; Richemond, P.H.; Buchatskaya, E.; Doersch, C.; Pires, B.Á.; Guo, Z.D.; Azar, M.G.; et al. Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning. arXiv 2020, arXiv:2006.07733. [Google Scholar] [CrossRef] [Scilit]
- Deng, H.; Li, X. Self-supervised Anomaly Detection with Random-shape Pseudo-outliers. In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC); IEEE: New York, NY, USA, 2022; pp. 4768–4772. [Google Scholar]
- Baugh, M.; Tan, J.; Muller, J.P.; Dombrowski, M.; Batten, J.; Kainz, B. Many tasks make light work: Learning to localise medical anomalies from multiple synthetic tasks. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2023. [Google Scholar]
- Chen, T.; Kornblith, S.; Norouzi, M.; Hinton, G.E. A Simple Framework for Contrastive Learning of Visual Representations. arXiv 2020, arXiv:2002.05709. [Google Scholar] [CrossRef] [Scilit]
- He, K.; Fan, H.; Wu, Y.; Xie, S.; Girshick, R.B. Momentum Contrast for Unsupervised Visual Representation Learning. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2019; pp. 9726–9735. [Google Scholar]
- Chen, X.; He, K. Exploring Simple Siamese Representation Learning. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2020; pp. 15745–15753. [Google Scholar]
- Spahr, A.; Bozorgtabar, B.; Thiran, J.-P. Self-Taught Semi-Supervised Anomaly Detection On Upper Limb X-Rays. In 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI); IEEE: New York, NY, USA, 2021; pp. 1632–1636. [Google Scholar]
- Dong, H.; Zhang, Y.; Gu, H.; Konz, N.; Zhang, Y.; Mazurowski, M.A. SWSSL: Sliding Window-Based Self-Supervised Learning for Anomaly Detection in High-Resolution Images. IEEE Trans. Med. Imaging 2023, 42, 3860–3870. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Patr’icio, C.; Barbano, C.A.; Fiandrotti, A.; Renzulli, R.; Grangetto, M.; Teixeira, L.F.; Neves, J.C. Unsupervised contrastive analysis for anomaly detection in brain MRIs via conditional diffusion models. Pattern Recognit. Lett. 2024, 199, 82–89. [Google Scholar] [CrossRef] [Scilit]
- Radford, A.; Kim, J.W.; Hallacy, C.; Ramesh, A.; Goh, G.; Agarwal, S.; Sastry, G.; Askell, A.; Mishkin, P.; Clark, J.; et al. Learning Transferable Visual Models from Natural Language Supervision. In International Conference on Machine Learning; PMLR: London, UK, 2021. [Google Scholar]
- Li, Y.; Ivanova, E.; Bruveris, M. FADE: Few-shot/zero-shot Anomaly Detection Engine using Large Vision-Language Model. arXiv 2024, arXiv:2409.00556. [Google Scholar]
- Marzullo, A.; Ranzini, M.B.M. Exploring Zero-Shot Anomaly Detection with CLIP in Medical Imaging: Are We There Yet? arXiv 2024, arXiv:2411.09310. [Google Scholar] [CrossRef] [Scilit]
- Park, Y.; Kim, M.J.; Kim, H.S. Contrastive Language Prompting to Ease False Positives in Medical Anomaly Detection. In 2025 IEEE 22nd International Symposium on Biomedical Imaging (ISBI); IEEE: New York, NY, USA, 2024; pp. 1–4. [Google Scholar]
- Sun, Z.; Gu, Y.; Liu, Y.; Zhang, Z.; Zhao, Z.; Xu, Y. Position-Guided Prompt Learning for Anomaly Detection in Chest X-Rays. arXiv 2024, arXiv:2405.11976. [Google Scholar] [CrossRef] [Scilit]
- Lai, J.; Wu, Z.; Peng, L.; Liu, H. Prompting across perception and recognition: A unified CLIP-based visual-text prompt framework for zero-shot anomaly detection. Expert Syst. Appl. 2025, 299, 129936. [Google Scholar] [CrossRef] [Scilit]
- Wang, J.; Byeon, K.; Song, J.S.; Nguyen, A.T.; Ahn, S.; Lee, S.H.; Kwak, J.T. Pathology-Informed Latent Diffusion Model for Anomaly Detection in Lymph Node Metastasis. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2025. [Google Scholar]
- Chen, Y.; Tao, H.; Yang, Z.; Cao, Y.; Jiang, C.; Hu, L.; Xiong, P.; Qiu, H. Diffusion-based vision-language model for zero-shot anomaly detection in medical images. Eng. Appl. Artif. Intell. 2025, 161, 112181. [Google Scholar] [CrossRef] [Scilit]
- Sun, J.; Wei, D.; Xu, Z.; Lu, D.; Liu, H.; Wang, H.; Tsaftaris, S.A.; McDonagh, S.; Zheng, Y.; Wang, L. Unlocking the Potential of Weakly Labeled Data: A Co-Evolutionary Learning Framework for Abnormality Detection and Report Generation. IEEE Trans. Med. Imaging 2024, 44, 1671–1685. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Caron, M.; Touvron, H.; Misra, I.; J’egou, H.; Mairal, J.; Bojanowski, P.; Joulin, A. Emerging Properties in Self-Supervised Vision Transformers. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV); IEEE: New York, NY, USA, 2021; pp. 9630–9640. [Google Scholar]
- Oquab, M.; Darcet, T.; Moutakanni, T.; Vo, H.V.; Szafraniec, M.; Khalidov, V.; Fernandez, P.; Haziza, D.; Massa, F.; El-Nouby, A.; et al. DINOv2: Learning Robust Visual Features without Supervision. arXiv 2023, arXiv:2304.07193. [Google Scholar]
- Schulthess, N.; Konukoglu, E. Anomaly Detection by Clustering DINO Embeddings Using a Dirichlet Process Mixture. arXiv 2025, arXiv:2509.19997. [Google Scholar] [CrossRef] [Scilit]
- Fucka, M.; Zavrtanik, V.; Skočaj, D. AnomalyVFM - Transforming Vision Foundation Models into Zero-Shot Anomaly Detectors. arXiv 2026, arXiv:2601.20524. [Google Scholar]
- Gao, B.-B.; Wang, C. One Language-Free Foundation Model Is Enough for Universal Vision Anomaly Detection. arXiv 2026, arXiv:2601.05552. [Google Scholar] [CrossRef] [Scilit]
- Koishiyeva, D.; Mukhammejanova, D.; Kang, J.W.; Mukasheva, A. A Review of Deep Learning Approaches Based on Segment Anything Model for Medical Image Segmentation. Bioengineering 2025, 12, 1312. [Google Scholar] [CrossRef] [Scilit]
- Roy, S.; Wald, T.; Koehler, G.; Rokuss, M.R.; Disch, N.; Holzschuh, J.; Zimmerer, D.; Maier-Hein, K.H. SAM.MD: Zero-shot medical image segmentation capabilities of the Segment Anything Model. arXiv 2023, arXiv:2304.05396. [Google Scholar]
- Chang, C.; Law, H.; Poon, C.; Yen, S.; Lall, K.; Jamshidi, A.; Malis, V.; Hwang, D.; Bae, W.C. Segment Anything Model (SAM) and Medical SAM (MedSAM) for Lumbar Spine MRI. Sensors 2025, 25, 3596. [Google Scholar] [CrossRef] [Scilit]
- Zhang, K.; Liu, D. Customized Segment Anything Model for Medical Image Segmentation (SAMed). arXiv 2023, arXiv:2304.13785. [Google Scholar]
- Colussi, M.; Ahmetovic, D.; Mascetti, S. MIAS-SAM: Medical Image Anomaly Segmentation without thresholding. arXiv 2025, arXiv:2505.22762. [Google Scholar] [CrossRef] [Scilit]
- Yang, H.; Chen, H.; Wang, A.; Chen, K.; Lin, Z.; Tang, Y.; Gao, P.; Quan, Y.; Han, J.; Ding, G. Promptable Anomaly Segmentation with SAM Through Self-Perception Tuning. AAAI Conf. Artif. Intell. 2025, 39, 13017–13025. [Google Scholar] [CrossRef] [Scilit]
- Li, C.; Qi, L.; Geng, X. A SAM-guided Two-stream Lightweight Model for Anomaly Detection. ACM Trans. Multimed. Comput. Commun. Appl. 2024, 21, 1–23. [Google Scholar] [CrossRef] [Scilit]
- Li, J.; Bercea, C.I.; Müller, P.; Felsner, L.; Kim, S.; Rueckert, D.; Wiestler, B.; Schnabel, J.A. Language Models Meet Anomaly Detection for Better Interpretability and Generalizability. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2024. [Google Scholar]
- Zhou, Y.; Song, L.; Shen, J. Training Medical Large Vision-Language Models with Abnormal-Aware Feedback. arXiv 2025, arXiv:2501.01377. [Google Scholar]
- Wang, L.; Lin, Z.Q.; Wong, A. COVID-Net: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images. Sci. Rep. 2020, 10, 19549. [Google Scholar] [CrossRef] [Scilit]
- Bakas, S.; Akbari, H.; Sotiras, A.; Bilello, M.; Rozycki, M.; Kirby, J.S.; Freymann, J.B.; Farahani, K.; Davatzikos, C. Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features. Sci. Data 2017, 4, 170117. [Google Scholar] [CrossRef] [Scilit]
- Menze, B.H.; Jakab, A.; Bauer, S.; Kalpathy-Cramer, J.; Farahani, K.; Kirby, J.S.; Burren, Y.; Porz, N.; Slotboom, J.; Wiest, R.; et al. The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS). IEEE Trans. Med. Imaging 2015, 34, 1993–2024. [Google Scholar] [CrossRef] [Scilit]
- Bilic, P.; Christ, P.F.; Vorontsov, E.; Chlebus, G.; Chen, H.; Dou, Q.; Fu, C.-W.; Han, X.; Heng, P.-A.; Hesser, J.W.; et al. The Liver Tumor Segmentation Benchmark (LiTS). Med. Image Anal. 2019, 84, 102680. [Google Scholar] [CrossRef] [Scilit]
- Fang, H.; Li, F.; Fu, H.; Sun, X.; Cao, X.; Lin, F.; Son, J.; Kim, S.; Quellec, G.; Matta, S.; et al. ADAM Challenge: Detecting Age-Related Macular Degeneration From Fundus Images. IEEE Trans. Med. Imaging 2022, 41, 2828–2847. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Jiang, Z.; Yang, D.; Nath, V.; Parida, A.; Kulkarni, N.; Xu, Z.; Xu, D.; Anwar, S.M.; Roth, H.R.; Linguraru, M.G. LUMEN: Longitudinal Multi-Modal Radiology Model for Prognosis and Diagnosis. arXiv 2026, arXiv:2602.21142. [Google Scholar] [CrossRef] [Scilit]
- Ruffini, F.; Mulero Ayllon, E.; Shen, L.; Soda, P.; Guarrasi, V. Benchmarking foundation models and parameter-efficient fine-tuning for prognosis prediction in medical imaging. Comput. Methods Programs Biomed. 2025, 275, 109196. [Google Scholar] [CrossRef] [Scilit]
- Frötscher, A.; Baumgartner, C.F.; Wolfers, T. Deep Unsupervised Anomaly Detection in Brain Imaging: Large-Scale Benchmarking and Bias Analysis. arXiv 2025, arXiv:2512.01534. [Google Scholar] [CrossRef] [Scilit]
- Musa, A.; Prasad, R.; Hernandez, M. Addressing cross-population domain shift in chest X-ray classification through supervised adversarial domain adaptation. Sci. Rep. 2025, 15, 11383. [Google Scholar] [CrossRef] [Scilit]
- Bercea, C.I.; Wiestler, B.; Rueckert, D.; Albarqouni, S. Federated disentangled representation learning for unsupervised brain anomaly detection. Nat. Mach. Intell. 2021, 4, 685–695. [Google Scholar] [CrossRef] [Scilit]
- Su, J.; Shen, H.; Peng, L.; Hu, D. Few-shot domain-adaptive anomaly detection for cross-site brain images. IEEE Trans. Pattern Anal. Mach. Intell. 2021, 46, 1819–1835. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Woodland, M.; Altaie, M.; O’Connor, C.S.; Castelo, A.H.; Lebimoyo, O.C.; Gupta, A.C.; Yung, J.P.; Kinahan, P.E.; Fuller, C.D.; Koay, E.J.; et al. Generative Modeling for Interpretable Anomaly Detection in Medical Imaging: Applications in Failure Detection and Data Curation. Bioengineering 2025, 12, 1106. [Google Scholar] [CrossRef] [Scilit]
- Hur, S.; Lee, Y.; Park, J.; Jeon, Y.J.; Cho, J.H.; Cho, D.; Lim, D.; Hwang, W.; Cha, W.C.; Yoo, J. Comparison of SHAP and clinician friendly explanations reveals effects on clinical decision behaviour. npj Digit. Med. 2025, 8, 578. [Google Scholar] [CrossRef] [Scilit]
- Nicolson, A.; Bradburn, E.; Gal, Y.; Papageorghiou, A.T.; Noble, J.A. The human factor in explainable artificial intelligence: Clinician variability in trust, reliance, and performance. npj Digit. Med. 2025, 8, 658. [Google Scholar] [CrossRef] [Scilit]
- Wong, C.Y.T.; Antaki, F.; Woodward-Court, P.; Ong, A.Y.; Keane, P.A. The role of saliency maps in enhancing ophthalmologists’ trust in artificial intelligence models. Asia-Pac. J. Ophthalmol. 2024, 13, 100087. [Google Scholar] [CrossRef] [Scilit]
- Singla, S.; Eslami, M.; Pollack, B.; Wallace, S.; Batmanghelich, K. Explaining the black-box smoothly—A counterfactual approach. Med. Image Anal. 2023, 84, 102721. [Google Scholar] [CrossRef] [Scilit]
- Leming, M.; Bron, E.; Bruffaerts, R.; Ou, Y.; Iglesias, J.E.; Gollub, R.L.; Im, H. Challenges of implementing computer-aided diagnostic models for neuroimages in a clinical setting. npj Digit. Med. 2023, 6, 129. [Google Scholar] [CrossRef] [Scilit]
- Cook, C.J.; Klug, J.R.; Kandler, B.W.; Baez-Suarez, A.; Dachowicz, A.P.; Blezek, D.J.; Missert, A.D.; Conte, G.; Benfield, J.D.; Mensing-Diggs, A.; et al. State of the AI: Post-Deployment Monitoring of Radiology-Focused Internally Developed AI. Mayo Clin. Proc. Digit. Health 2026, 4, 100342. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.















