1. Introduction
In forensic science, biometric identification, and anthropological research, the extraction and analysis of physical evidence play a crucial role in establishing suspect identities and reconstructing crime scenes. Among various traces left at crime scenes, footprints stand out as one of the most common forms of physical evidence [
1]. As a fundamental human biological characteristic, footprint morphology may remain relatively stable over time and can provide discriminative information. Whether representing two-dimensional impressions from bare feet, three-dimensional impressions, or shoe prints containing sole texture features, they contain rich morphological and biomechanical information. Traditional footprint analysis primarily relies on experienced experts conducting manual measurements and morphological comparisons [
1]. However, practical forensic applications face significant challenges due to complex collection environments. These adverse factors significantly hinder the extraction of high-contrast and complete footprint features. Moreover, manual analysis consumes substantial time and labor resources [
2] and is susceptible to subjective judgment biases, thereby limiting its credibility in modern forensic investigations [
3]. Therefore, computer-vision methods for high-precision footprint image segmentation, accurate region extraction, and background-noise suppression are needed to support automated footprint recognition.
Footprint image segmentation serves as the foundation for subsequent morphological feature extraction, suspect profiling, and identity matching. Consequently, segmentation accuracy can strongly influence the performance of an automated identification system. Early footprint processing methods primarily relied on traditional image processing techniques or manual feature-based region extraction, such as using convex hull and defect point recognition algorithms to identify regions of interest (ROIs) like toe tips and lateral heel points [
2]. Regarding anthropometric feature inference, Wicaksono et al. [
4] utilized Gabor wavelet features combined with the k-nearest neighbors (k-NN) algorithm to achieve automatic measurement of height and weight. Garcia-Mora et al.’s systematic review [
3] also demonstrated significant statistical correlations between physical measurements obtained via traditional inked footprint methods, foot contour analysis, and pedigraphs and individual height. However, these conventional approaches are highly susceptible to noise and environmental variations. They often exhibit poor robustness when processing complex footprint images, particularly those with blurred boundaries or low contrast.
In recent years, with the rapid advancement of deep learning technologies, significant progress has been made in footprint analysis and recognition methods based on discriminative deep models. In identity matching and recognition tasks, Abuqadumah et al. [
5] demonstrated the feasibility of transfer learning for small-sample footprint recognition by fine-tuning five classical models including Inception v3. Jang et al. [
6] developed the Shoe-MS algorithm that effectively enhances the objectivity of shoeprint comparison through deep learning. To meet the real-time requirements of portable forensic evidence devices, Shen et al. [
7] proposed a lightweight YOLOv8-StarNet detection method with low computational complexity. Meanwhile, in the field of footprint multimodal development, Zhou Xudong et al. [
8] recently established a large-scale, standardized multimodal footprint dataset encompassing single-pressure impressions, sequential pressure patterns, and optical features. They introduced a Spatiotemporal Prompt Transformer (STPT) baseline model that successfully captures often-overlooked dynamic pressure sequence characteristics, providing robust data and technical support for footprint deep modeling.
Although existing research has made progress in the fields of footprint recognition and image segmentation, several technical limitations remain: First, footprint image segmentation differs substantially from conventional semantic segmentation tasks due to its unique forensic and biometric characteristics. Unlike natural objects, footprint images contain fine-grained anatomical structures, such as toe boundaries, arch regions, and heel pressure areas. These structures often exhibit significant local intensity variations and weak edge continuity. In forensic applications, these subtle structural details are directly related to downstream tasks such as identity recognition, gait analysis, and stature estimation. Therefore, footprint segmentation requires not only accurate foreground extraction but also preservation of anatomical geometry and local structural continuity. Second, there is a lack of network structure optimization for the footprint segmentation task. The standard segmentation network has limited ability to capture the details of key anatomical sites such as the toes, heel, and heavy-pressure areas. Meanwhile, as traditional noise suppression methods have limitations in adapting to complex noise environments, it is difficult for the standard segmentation network to effectively suppress the interference of background noise, while deep learning-based noise suppression technologies have shown remarkable progress in improving noise suppression effects in related fields.
While footprint image segmentation is a fundamental task, its ultimate significance lies in enabling downstream forensic applications, particularly biometric height estimation. Accurate height prediction demands highly precise extraction of anatomical landmarks and geometric contours. Therefore, this study aims to develop a segmentation framework that generates high-fidelity binary masks for footprint images acquired under the evaluated conditions. The downstream height-prediction experiment is included as an exploratory analysis to examine whether improved segmentation masks may benefit subsequent morphological feature extraction, rather than to establish operationally reliable stature estimation from forensic evidence. The contributions of this study are summarized as follows: (1) A GAN-based segmentation framework is adapted for forensic footprint images, where fine anatomical structures, weak boundaries, and background interference make accurate mask generation challenging. (2) CPCA modules are integrated into the decoder stages of the generator to recalibrate fused encoder–decoder features and improve the preservation of fine details in the toe, arch, and heel regions. (3) A dual-branch discriminator operating at two input scales is employed to evaluate image–mask pairs at the original and downsampled resolutions, providing complementary constraints on local boundary details and global footprint morphology. (4) Robustness experiments and an exploratory downstream footprint-based height-prediction analysis are conducted to assess the stability of the proposed framework and to examine whether improved segmentation masks may provide potential benefits for subsequent footprint analysis. The downstream results are interpreted as preliminary evidence rather than definitive proof of a substantial forensic advantage.
The remainder of this paper is organized as follows.
Section 2 reviews the related work.
Section 3 describes the proposed GAN-based footprint segmentation method, including the network architecture and optimization strategy.
Section 4 presents the experimental setup, comparative studies, ablation analyses, and robustness evaluations. Finally,
Section 5 concludes the paper and outlines future work.
3. Methods
Recent adversarial generative frameworks based on GANs have received substantial attention in image analysis [
26,
27,
28,
29]. Their ability to model data distributions and generate high-fidelity outputs makes GANs useful for image-segmentation tasks [
30]. However, CNN-based generators used in most GAN architectures suffer from an inherent limitation. As network depth increases, local spatial information gradually diminishes, and deeper features become dominated by global semantic representations. Although skip connections are commonly employed to mitigate local information loss, traditional skip connections typically rely solely on direct concatenation or simple addition of shallow and deep features, lacking selective fusion across layers. This straightforward fusion strategy may introduce redundant information and unnecessary noise, potentially compromising the generator’s representation capacity and adversely affecting overall generation performance.
3.1. Generative Adversarial Network
The proposed footprint image segmentation approach is based on a generative adversarial network. The generator produces binary segmentation masks from the original footprint image, whereas the discriminator distinguishes generated masks from ground-truth masks, as illustrated in
Figure 1. The proposed framework integrates the CPCA module into the generator and employs a multi-scale discriminator. These designs are intended to improve footprint segmentation quality in the evaluated image-acquisition setting by enhancing the representation of boundary details and footprint morphology. CPCA enables the dynamic allocation of attention weights across the channel and spatial dimensions. This mechanism allows the model to focus on informative feature channels and critical spatial regions. Meanwhile, channel prior information is preserved during feature extraction. As a result, it enhances feature representation capability.
Following conditional GAN-based image-to-image translation methods, footprint segmentation is formulated as a mapping from an input footprint image
x to a binary mask
y [
11]. To improve adversarial training stability, the least-squares adversarial objective proposed in LSGAN is adopted [
10]. The discriminator evaluates whether an image–mask pair is real or generated. The detailed adversarial losses are provided in
Section 3.4.1.
3.2. Generator Network Design
The generator follows the encoder–decoder architecture of U-Net [
31]. CPCA modules are inserted at each decoder stage to recalibrate the fused encoder–decoder features [
25]. Unlike standard U-Net architectures that rely solely on skip connections for feature fusion, this design enhances the network’s ability to focus on critical footprint regions such as toes and heels, while suppressing interference from the background and irrelevant textures. This improves the generator’s ability to reconstruct detailed footprint structures.
3.2.1. Feature Fusion
denotes the high-resolution feature map output by the encoder. denotes the feature map obtained after upsampling at the next level of the decoder.
First, channel concatenation and dimensionality reduction are performed.
where
represents channel concatenation,
restores the number of channels to
C.
3.2.2. CPCA Module
The Channel Prior Convolutional Attention (CPCA) mechanism was originally introduced to jointly model channel priors and multi-scale spatial information [
25]. In this study, CPCA is integrated into the decoder stages of the generator for forensic footprint segmentation.
The CPCA module is designed to enhance feature representation by combining channel-level priors with multi-scale spatial information. As illustrated in
Figure 2, the CPCA module consists of three sequential stages: channel-prior attention, multi-scale spatial attention, and adaptive feature calibration. The channel-prior attention stage generates channel-wise weights from global average-pooled and max-pooled descriptors. The resulting channel-attention map is multiplied by the fused feature map to obtain the channel-prior feature representation. The multi-scale spatial-attention stage then extracts local and long-range spatial information using an initial depthwise convolution and parallel depthwise strip-convolution branches. Finally, the spatial-attention map is multiplied by the channel-prior feature map to obtain the refined output feature.
- (1)
Channel Prior Weight Calculation
Given the feature map
, CPCA computes inter-channel correlations to generate a prior distribution. First, global average pooling and global max pooling reduce the spatial dimensions. A shared multilayer perceptron (MLP) is used to capture dependencies between channels
Then, channel prior weights are generated using the sigmoid function.
where
denotes the sigmoid activation function. The weights
quantify the contribution of different feature channels to the footprint feature representation.
- (2)
Multi-scale Spatial Representation Extraction
The intermediate feature map
is processed through a series of convolutions to extract multi-scale spatial representations. The resulting feature map is processed by four parallel branches. Branch 0 is an identity connection, whereas Branches 1–3 use depthwise strip convolutions. Let the convolution kernel size of the
i-th parallel branch be
, then the output feature is
The branch outputs are fused by element-wise summation and subsequently processed by a
convolution for channel mixing.
This design enlarges the receptive field without introducing substantial computational overhead [
25]. As a result, the module can effectively capture the overall footprint contour. As shown in
Table 1, the module employs four parallel depthwise convolution branches: An initial 5 × 5 depthwise convolution is first applied to extract local spatial information. The resulting feature map is then processed by four parallel branches, including an identity branch and three depthwise strip-convolution branches. Branches 1–3 adopt depthwise strip convolutions with kernel pairs of (1 × 7, 7 × 1), (1 × 11, 11 × 1), and (1 × 21, 21 × 1), respectively, to capture multi-scale contextual information. All depthwise convolutions preserve the channel dimension
C and preserve spatial resolution through appropriate padding. The outputs of the four branches are fused by element-wise summation, and then passed through a 1 × 1 convolution to generate a spatial attention map.
- (3)
Adaptive Feature Calibration
The channel prior weights
are combined with the feature
F to produce an intermediate feature map
The operation performs element-wise multiplication.
Then,
is multiplied element-wise with
to obtain the final feature map.
The final output feature map not only enhances the edge features of the footprint in the spatial dimension but also suppresses redundant background responses in the channel dimension.
3.2.3. Forward Propagation of the Generator
The calibrated feature map
is passed to the subsequent decoder convolutional layer. The final output layer uses a 1 × 1 convolution followed by a sigmoid activation function to produce a pixel-level segmentation probability map:
where
is the feature map output by the final decoder layer.
3.3. Discriminator Network Design
Multi-scale adversarial discrimination has been used to capture structural information at different resolutions [
26]. Building on this idea, this study employs a dual-branch discriminator that processes image–mask pairs at the original and downsampled scales. The discriminator employs a multi-scale architecture to extract local and global features, including edges, textures, and region-level structures, at various scales, thereby enhancing robustness and reducing noise interference.
We design a dual-branch, multi-scale discriminator D. The original-scale branch directly processes image–mask pairs at the original resolution. This branch focuses on evaluating edge consistency and local texture realism. The downsampling branch applies 2× downsampling to the input pairs. It is designed to capture global geometric structures and anatomical features.
Each discriminator branch contains six convolutional layers, as summarized in
Table 2. The discriminator input is formed by concatenating a three-channel RGB footprint image and a one-channel segmentation mask, resulting in a four-channel input. The original-scale branch processes the original image–mask pair, whereas the downsampled-scale branch processes the corresponding pair after 2× downsampling. The two branches have identical layer configurations but independent parameters.
Each branch produces a PatchGAN score map rather than a single scalar output. The two branches have identical architectures but independent parameters, and no feature-level fusion is performed between them. Their branch-specific adversarial losses are calculated independently and then combined through weighted loss aggregation, as described in
Section 3.4.1.
The branch-weighting coefficient α was selected using a validation-set parameter sweep over {0.1, 0.3, 0.5, 0.7, 0.9}. All other experimental settings were kept unchanged. Validation IoU was used as the primary criterion for selection. The highest validation IoU was obtained at = 0.5; therefore, equal loss weights were assigned to the two branches in all subsequent experiments. The held-out test set was not used for parameter selection.
High-level features have larger receptive fields and stronger semantic abstraction but lower spatial resolution. A larger receptive field means each neuron can access a wider range of the original image, implying it may contain more global and higher-level semantic features. The high-level network has strong global geometric information representation capabilities, and the low-level network has a small receptive field and strong geometric detail information representation capabilities. As mentioned in relevant research, the multi-scale design can expand the discriminator’s perception range, improving its ability to capture image details, reduce artifacts in generated images and correct errors. This allows the discriminator to concurrently focus on global structural consistency and local edge details, which in turn guides the generator to generate more realistic and continuous segmentation results. This aligns with the application logic of multi-scale feature fusion in image segmentation, which has been verified by experiments to effectively improve the accuracy of image segmentation, and has been widely applied in fields such as medical image segmentation.
3.4. Loss Functions
The overall training objective of the proposed framework comprises two distinct types of loss functions, each serving a specific purpose in the adversarial learning process. The first is the adversarial loss, which governs the competition between the generator and the discriminator, ensuring that the generated segmentation masks progressively become indistinguishable from the ground-truth labels. The second is the segmentation loss, which directly supervises the generator’s output at the pixel level, enforcing classification accuracy and structural consistency with the target masks.
3.4.1. Least-Squares Adversarial Loss
To alleviate gradient vanishing and training instability in standard GAN training, this paper adopts Least-Squares GAN (LSGAN) as the optimization target. Unlike the sigmoid cross-entropy loss used in standard GANs, which tends to saturate and cause gradient vanishing during training, LSGAN uses mean squared error (MSE) as the loss function. This loss penalizes generated samples that are far from the decision boundary. Therefore, the generated distribution is encouraged to better approximate the real data distribution. In addition, the loss provides more stable gradients during training, which improves convergence stability and sample quality. Let
and
denote the original-scale and downsampled-scale discriminator branches, respectively. Each branch independently evaluates real and generated image–mask pairs using the least-squares objective. For branch s, where
, the discriminator loss is defined as:
The corresponding adversarial loss of the generator for branch
s is:
The discriminator losses from the two branches are combined as:
Similarly, the generator adversarial losses from the two branches are combined as:
Here,
x denotes the input footprint image,
y is the corresponding ground-truth mask, and
G(
x) is the predicted segmentation probability map.
and
denote the original-scale and downsampled-scale discriminator branches, respectively. The discriminator assigns real image–mask pairs target values close to 1 and generated image–mask pairs target values close to 0, whereas the generator encourages generated pairs to receive scores close to 1. The coefficient
controls the relative contributions of the two discriminator branches. Based on the validation-set parameter sweep described in
Section 3.3,
was set to 0.5 in all subsequent experiments.
3.4.2. Hybrid Segmentation Loss for Generator Supervision
While the adversarial loss guides the generator toward producing masks that are statistically consistent with the ground-truth mask distribution, it does not provide explicit spatial or categorical supervision. Therefore, we introduce a dedicated segmentation loss that directly compares the generated mask with the ground-truth annotation at the pixel level. This loss is crucial for preserving local structural details, especially in challenging regions such as toe boundaries and heel contours, where the adversarial signal alone may be insufficient or ambiguous.
The segmentation loss combines binary cross-entropy (BCE) with a Dice-based overlap term. Dice-based optimization has been widely used to mitigate foreground–background imbalance in segmentation tasks [
32]. Combined cross-entropy and Dice objectives have also been used to balance pixel-wise classification and region-overlap supervision [
33]. In this study, we employ a weighted BCE–Dice formulation tailored to the footprint segmentation task.
BCE loss evaluates the classification accuracy independently per pixel, providing a strong and stable gradient for every spatial position. It treats all pixels equally, which helps in reducing false positives and false negatives across the entire image.
Dice loss measures the overlap between the predicted mask and the ground truth. It is particularly effective in handling class imbalance, which is prevalent in footprint images where the foreground (foot region) often occupies a much smaller area than the background. By directly optimizing mask overlap, Dice loss penalizes missed foreground regions more strongly, thereby encouraging the generator to preserve the integrity of the foot silhouette.
The combined segmentation loss is defined as:
where
Here, and denote the ground-truth label and predicted probability at pixel i, N the total number of pixels, and is a small smoothing term to avoid numerical instability. In our experiments, we set and to balance pixel-wise accuracy and regional overlap.
3.4.3. Overall Generator Objective
The total loss for the generator combines the adversarial loss and the segmentation loss in a weighted sum:
where
is the weighted adversarial loss aggregated from the original-scale and downsampled-scale discriminator branches, as defined in Equation (12).
denotes the hybrid BCE–Dice segmentation loss, and
controls the relative contribution of segmentation supervision. During adversarial training, the two discriminator branches jointly minimize the weighted discriminator objective
. The generator minimizes the total objective
, which consists of the weighted dual-branch adversarial loss
and the hybrid segmentation loss
. Thus, the adversarial component constrains the predicted masks at both the original and downsampled scales, whereas the BCE–Dice component provides direct pixel-level and region-overlap supervision.
5. Conclusions
This paper presents a GAN-based method for footprint image segmentation evaluated on the self-collected aFoot_2025 dataset under controlled acquisition conditions. The main findings can be summarized as follows. A channel-prior convolutional attention module is incorporated into the GAN framework. The module employs multi-scale depthwise convolutions to extract spatial features. Channel prior weights are further used for adaptive feature calibration. Experimental results show that CPCA outperforms representative attention mechanisms, including SE, ECA, and CBAM on both IoU and Dice metrics, highlighting its advantages in preserving spatial details while leveraging channel priors. The BCE–Dice hybrid loss achieved the best overall performance in the loss comparison experiment. It outperforms both individual loss functions and alternative formulations, including Focal, Tversky, and Lovász Hinge losses. This combination effectively balances pixel-level accuracy and regional overlap, making it particularly suitable for footprint images with extreme foreground-to-background imbalance. The proposed GAN + CPCA architecture achieved an IoU of 0.9448 and a Dice coefficient of 0.9713 on the self-built aFoot_2025 dataset, highlighting the complementary benefits of adversarial learning and attention mechanisms. The model showed modest IoU reductions under the evaluated synthetic Gaussian-noise conditions; however, these experiments should not be interpreted as validation under realistic forensic degradation. Feature-map and attention visualizations provided qualitative illustrations of the hierarchical feature patterns learned by the model.
Limitations and Future Directions. Several limitations should be acknowledged. The present findings are based on a participant-independent split of a single, self-collected dataset acquired under controlled conditions. Although participant-level separation reduces the risk of identity-related information leakage between the training and test subsets, it remains an internal evaluation within the aFoot_2025 dataset and does not constitute external validation. Consequently, the generalizability of the proposed method to data acquired from different populations, devices, substrates, and acquisition environments remains unknown. Moreover, the evaluated Gaussian and salt-and-pepper noise conditions represent synthetic perturbations and do not reproduce the full range of degradation encountered in operational forensic settings. The downstream height-prediction experiment was also exploratory and should not be interpreted as establishing the operational reliability of footprint-based stature estimation. Therefore, the reported results should be interpreted as evidence of methodological performance within the present dataset rather than as evidence of operational forensic validity.
Future work will focus on collecting and validating more diverse, multi-source footprint datasets; evaluating performance under realistic degradation and occlusion conditions; and incorporating approaches that improve long-range contextual modeling and shape completion. These efforts may further improve the reliability and practical applicability of footprint segmentation in forensic settings.