Next Article in Journal
From Spatial Evolution to Low-Carbon Transition: Regional Heterogeneity and Stage Diagnosis of Carbon Emissions Across 19 Urban Agglomerations in China
Previous Article in Journal
Fine-Grained Cultural Perception and Evaluation of Beijing’s Capital Culture Integrating Large Language Models with Higher-Order Tensor Decomposition
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Direction-Aware Lightweight Network for Camera-Based Underground Mine Track Region Segmentation

School of Electrical and Energy Engineering, Shanghai Dianji University, Shanghai 201306, China
*
Author to whom correspondence should be addressed.
ISPRS Int. J. Geo-Inf. 2026, 15(8), 351; https://doi.org/10.3390/ijgi15080351
Submission received: 9 May 2026 / Revised: 27 July 2026 / Accepted: 2 August 2026 / Published: 4 August 2026

Abstract

Accurate localization of the visible track region is essential for perception using front-mounted cameras on underground rail-guided mine vehicles. The task is difficult because the track foreground occupies only a small image area, and its boundary appearance changes with illumination, water, dust, and scene clutter. This study formulates local perception of the track corridor as binary semantic segmentation of the surface bounded by the two visible rails. RailDLA is a lightweight encoder–decoder network. It combines track context preconditioning, RDLA directional strip propagation, context-guided feature fusion, and track axis proxy decoding. On a self-constructed dataset of underground mine vehicle imagery, RailDLA achieves 96.50% mIoU, 92.10% track IoU, 97.50% track accuracy, and 99.70% pixel accuracy. On the working split, its track IoU exceeds those of FastSCNN, PIDNet-S, DDRNet-23-slim, and SegNeXt-S by absolute margins of 6.06, 1.70, 1.56, and 0.37 percentage points, respectively. Under the unified runtime protocol, RailDLA reaches 120.00 FPS on an NVIDIA GeForce RTX 3070 Laptop GPU. These results demonstrate accurate, real-time inference for underground mine vehicle perception.

1. Introduction

Underground railways are widely used in mines for material transport, equipment movement, and inspection patrols. Reliable perception of the visible track region ahead of a rail-guided vehicle is therefore important for navigation assistance, inspection, and local operational awareness based on front-camera imagery in confined mine tunnels. Recent studies on mine automation, underground sensing, and robotic inspection have emphasized that perception reliability is a key requirement for reducing operational risk in poorly illuminated and communication-limited mining environments [1,2]. Research on industrial intelligent diagnosis also shows that incorporating physical constraints and multimodal information can improve model robustness under imbalanced or under-sampled operating data [3]. Recent video surveillance studies have also used transfer learning and spatiotemporal visual cues for abnormal activity detection, further supporting the need for reliable visual monitoring in constrained scenes [4]. This study focuses on image-based segmentation of the local track region. Given an image from a front camera, the model predicts a binary mask of the visible track region bounded by the rails.
Perception of underground track regions from camera images differs from general object parsing. The rail-bounded track region occupies a small fraction of each image and forms a narrow, elongated perspective structure, while dust, exposed sleeper ends outside the rails, cables, water stains, equipment occlusion, specular reflections, and nonuniform illumination can disturb the local visual evidence. In the target application, a front-mounted camera observes the track area ahead during routine transport and inspection. As illustrated in Figure 1, this perception setting requires reliable local estimation of track position and extent from weak visual evidence while remaining efficient enough for real-time GPU inference.
Semantic segmentation provides a direct formulation for this perception task: given an underground image, the model predicts a pixel-level mask of the visible track surface bounded by the rails. The foreground track region is defined as the surface between the outer edges of the left and right visible rails. It includes the rail bodies and the interior surface between them, while exposed sleepers, ballast, mud, and tunnel floor regions outside the rails are treated as background. The predicted mask represents a local perception output for the front camera view.
General dense prediction networks, including fully convolutional and encoder–decoder models, provide the basic technical foundation for this formulation [5,6,7]. Domain-specific visual learning has also been applied to UAV-assisted monitoring, multi-task object detection, and ecological detection from acoustic video [8,9,10]. Above-ground railway track region segmentation has shown that lightweight encoder–decoder networks can support real-time railway safety applications [11]. Directly transferring these generic or above-ground designs to underground mine images is still difficult because the operational target is a sparse foreground structure whose local integrity matters more than accuracy on the dominant background class. A fragmented track mask may preserve a high pixel accuracy score, but it can degrade subsequent track axis extraction or inspection modules.
The mine track region is strongly directional in the image plane. Under perspective projection, the visible rail-bounded track surface forms an elongated region delimited by the rail outer edges, while exposed sleeper ends and surrounding floor regions remain background. This geometry motivates the use of directional context on the image feature grid. Purely local convolution can preserve edges but may miss long-range evidence along the track region. Unrestricted self-attention can model global interaction, but it introduces the quadratic affinity cost of dense pairwise comparison [12,13]. One effective way to introduce this prior is to use low-cost horizontal and vertical strip context rather than a dense pairwise attention map.
To address this problem, RailDLA is proposed as a lightweight encoder–decoder for the track task. Its RDLA block aggregates context through horizontal and vertical strip propagation on the image feature grid. The term “direction” refers to image plane strip directions derived from the elongated geometry of the visible track region. The two strip responses are introduced through gated residual injection to provide structured context at low cost. The complete network contains compact spatial–semantic feature extraction, track context preconditioning, RDLA, context-guided feature fusion, and a track axis proxy decoder. Under the working validation protocol, the resulting model achieves 96.50% mIoU, 92.10% track IoU, and 120.00 FPS in the runtime test on the same GPU. On the working split, RailDLA exceeds SegNeXt-S, the strongest generic reference in terms of validation accuracy, by 0.80 percentage points in best mIoU and 0.37 percentage points in track IoU.
The main contributions of this work are summarized as follows:
  • An underground mine track region segmentation task is formulated for front-camera imagery from rail-guided mine vehicles, with the foreground defined as the visible rail-bounded track surface in the local camera view.
  • RailDLA is developed as a lightweight encoder–decoder for this task, combining a track context preconditioning block, an RDLA block, context-guided feature fusion, and a track axis proxy decoding branch for sparse, elongated foreground segmentation.
  • Comparative accuracy and efficiency experiments are conducted on a self-constructed dataset of underground mine vehicle imagery; track region metrics and controlled runtime measurements are reported using the same GPU.

2. Related Work

The related work is organized around computer vision and underground perception studies most directly connected to the proposed image-based segmentation task. The task is related to underground infrastructure monitoring, while the benchmark used in this study contains images from a front camera and pixel-level masks of the track region without georeferenced coordinates, topological corridor annotations, or spatial database metadata. Accordingly, RailDLA is positioned as a local visual perception model that may provide inputs for broader mine mapping or decision support systems.

2.1. Railway and Underground Track Perception

Track perception has been studied in the broader context of railway safety, infrastructure monitoring, and automated inspection. Recent work has extended this line to catenary support component detection with graph-guided and multireceptive-field Mamba models, prompt-based component anomaly detection, and machine-vision-driven physics-informed state estimation for the pantograph–catenary system [14,15,16,17], and meta-learning-based dynamic modeling of high-speed rail subsystems [18]. However, these studies mostly focus on above-ground railway inspection, component-level defect recognition, or image classification rather than pixel-level segmentation of the rail-bounded track surface from a front-mounted vehicle camera. Recent research on illumination-aware multispectral detection shows that adverse illumination can degrade RGB perception and that explicit illumination modeling with cross-modal alignment can improve visual robustness [19]. This evidence supports the need to consider poor illumination in underground visual perception, including settings that use a monocular front camera. Recent railway environment perception studies have further extended visual learning to sparse-to-dense fusion for three-dimensional object detection [20] and to lightweight LiDAR-based 3-D object detection for railway transportation [21]. Visual–inertial SLAM based on line features further shows that structured visual lines can provide useful cues for real-time navigation using cameras [22].
Underground mine perception introduces a different set of constraints. Mine automation, underground IoT, and mobile inspection robot studies identify perception reliability as a key requirement for safe operation in confined, poorly illuminated, and communication-limited environments [1,2]. For mine vehicles with a front camera, the perception target is the visible rail-bounded track surface ahead of the vehicle. The interior surface between the rails may be contaminated by mud or water stains, while exposed sleeper ends, cables, dust, equipment, and shadows around the rails create difficult background clutter. Accordingly, the perception problem is formulated as binary segmentation of the rail-bounded track surface, distinct from rail line extraction, segmentation of sleepers or ballast outside the rails, and defect classification.

2.2. Track Region Segmentation and Dense Prediction

Semantic segmentation provides a direct way to obtain a pixel-level mask of the track region. Classical dense prediction networks such as FCN and U-Net established end-to-end pixel prediction and skip-based spatial recovery [5,6]. DeepLabv3+ further showed that an encoder–decoder structure can combine contextual aggregation with sharper object boundaries [7]. These principles are useful for track region segmentation, where the model must recover both foreground structure and local boundaries. Segmentation systems designed for specific domains, such as mammogram analysis based on adaptive Trans-ResUnet++, also illustrate how encoder–decoder designs can be adapted to domain-dependent boundary recovery [23].
Railway-specific segmentation has also been investigated. Chen et al. [11] proposed an efficient railway track region segmentation network for real-time railway safety applications, combining a lightweight encoder with a cross-fusion decoder and additional training strategies. Their work demonstrates that semantic segmentation can support track region understanding while balancing accuracy and speed. The present task differs in both environment and foreground geometry. Underground mine rail-bounded track surfaces occupy a small and elongated area, are affected by low illumination and contamination, and require a coherent response across the surface between the two rail outer edges, including both the rail bodies and the interior surface. Therefore, RailDLA introduces track axis proxy modulation, local geometry supervision, and directional context to address fragmented foreground masks.

2.3. Real-Time Semantic Segmentation

Real-time semantic segmentation aims to maintain dense prediction accuracy under strict inference constraints. FastSCNN [24] is a representative lightweight model that separates rapid spatial downsampling from semantic extraction at low resolution. The structure is attractive for edge or onboard platforms because it uses few parameters and a low FLOP count, while the original architecture remains generic and lacks explicit geometry modeling for the track region. Lightweight perception architectures have also been investigated for railway catenary foreign object detection, where real-time sensing is important for railway safety monitoring [25]. Video surveillance recognition and tracking studies similarly emphasize compact feature extraction and temporal association for efficient scene understanding [26]. Efficient vehicle detection in traffic scenes has also been explored with improved single-stage detectors, where lightweight backbones, attention-based feature weighting, and cross-level feature fusion improve the speed–accuracy trade-off [27].
Another line of efficient segmentation models preserves fine spatial detail through multi-resolution or multi-branch representations. BiSeNet V2 [28] separates detail and semantic branches and fuses them through guided aggregation. DDRNet [29] maintains dual-resolution streams for real-time segmentation, while PIDNet [30] introduces parsing, detail, and boundary branches inspired by PID control. These studies indicate that efficient segmentation requires reduced computation together with preservation of boundary and thin-region information. The proposed model follows this principle and adapts it to underground track region segmentation by keeping spatial detail in a shallow branch while placing context modules for the track task in the semantic pathway at low resolution. Dedicated railway perception datasets have also supported visual recognition research in related safety scenarios, such as foreign object detection on railroad transmission lines [31]. These dataset construction efforts provide useful references for railway visual perception and data organization.

2.4. Convolutional Attention, Transformers, and Linear Context

Convolutional attention and Transformer-style attention provide different routes for enlarging the receptive field. Channel and spatial attention mechanisms, including squeeze-and-excitation and CBAM, recalibrate feature responses with modest overhead [32,33]. Cross-modal attention has also been used in infrared–visible pedestrian detection to combine complementary thermal and texture cues [34]. Multimodal attention has also been explored in medical image fusion with modified Swin cross-attention [35]. Large-kernel and criss-cross context designs further show that structured long-range interaction can improve semantic segmentation without requiring unrestricted global attention [36,37]. SegNeXt [38] follows this direction and shows that carefully designed convolutional attention can achieve high segmentation accuracy. In the full benchmark of this study, SegNeXt-S is the strongest generic reference in terms of validation accuracy, reaching 95.70% mIoU. Because this study targets a compact model for the track task, SegNeXt-S is interpreted as a larger generic reference rather than a direct lightweight competitor.
Transformer models have also become important segmentation references. Self-attention was originally introduced as a general sequence modeling mechanism [12]; ViT extended Transformer tokenization to images [39]. Dense prediction models such as SETR, Segmenter, and SegFormer then adapted Transformer representations to semantic segmentation [40,41,42]. Although these mechanisms are expressive, dense self-attention constructs a global interaction matrix whose memory and computation costs can be excessive for high-resolution prediction. Linear attention variants reduce this cost by rearranging the computation or using kernelized feature maps [43]. The strip attention module in RailDLA is aligned with the motivation for efficient context modeling but introduces a stronger task constraint: context is propagated through horizontal and vertical strips on the image feature grid rather than through arbitrary global interaction. The design uses the elongated structure of the target class as an inductive bias and avoids the cost of dense pairwise affinity.
The above studies provide useful components for visual track understanding, dense prediction, efficient inference, and contextual feature modeling. In broader industrial sensing, heterogeneous multimodal fusion has also been used in rotating-machinery fault diagnosis to improve interpretability and robustness under complex industrial signals [44]. Few existing studies jointly address rail-bounded track region segmentation, underground mine visual degradation, and lightweight inference from images captured by front cameras.

3. Method

3.1. Problem Formulation and Track Structural Prior

Let  I R 3 × H × W  denote an underground mine image and  Y { 0 , 1 } H × W  denote the corresponding binary mask of the rail-bounded track region. The foreground is the surface between the outer edges of the two visible steel rails; exposed sleepers and ground regions outside the rails are treated as background. The proposed model  f θ  produces two-class segmentation logits  Z s = f θ ( I ) R 2 × H × W , and the foreground probability is the softmax probability of class 1, denoted by P. With  τ  denoting the decision threshold, the supervised learning objective is formulated as
θ = arg min θ E ( I , Y ) D m i n e L f θ ( I ) , Y , P i j = softmax ( Z s ) 1 i j , Y ^ i j = 1 ( P i j τ ) .
The validation protocol uses  τ = 0.5  unless otherwise specified. The task has two dominant properties: the positive class is sparse, and its visible region is geometrically elongated. As a lightweight structural prior, the context support around a spatial location  p = ( i , j )  is restricted to horizontal and vertical strip neighborhoods on the image feature grid:
Ω r ( p ) = { p + t e h : | t | r } { p + t e v : | t | r } , e h = ( 0 , 1 ) , e v = ( 1 , 0 ) , k = 2 r + 1 .
The strip support on the image grid provides an intermediate form of context between dense global interaction and purely local convolution: it propagates evidence along two long axes while avoiding dense pairwise affinity. This design follows structured context modules in dense prediction, where long-range evidence is introduced beyond small convolutional kernels [36,37]. The support is restricted to two orthogonal directional spans that often connect evidence inside the elongated rail-bounded track surface while keeping the operator inexpensive.

3.2. Network Overview

The overall architecture follows a lightweight encoder–decoder design, which is commonly used to recover spatial detail after semantic feature extraction [6,7]. It comprises a shallow spatial branch, a semantic branch, a track context preconditioning block, the proposed RDLA block, a context-guided feature fusion module, and a track axis proxy decoding branch. RDLA models direction-aware context through horizontal and vertical strip propagation on the image feature grid. The strip support aggregates context for elongated track foregrounds with linear spatial cost. Figure 2 gives the overall data flow, showing how shallow spatial detail, lower-resolution directional context, and track axis proxy decoding are connected for final segmentation. The forward computation is summarized as
F s = D ( I ) , F g = G ( F s ) , F r = B t r a c k ( F g ) , F ˜ g = R r d l a ( F r ) , F f = ϕ s ( F s ) + ϕ g up ( F ˜ g ) + ϕ c g F s , up ( F ˜ g ) .
Here,  D  denotes the learning-to-downsample branch,  G  is the semantic extractor,  B t r a c k  prepares track-oriented context,  R r d l a  denotes the RDLA directional strip attention operation, and  F f  is the fused decoder feature. Following real-time segmentation networks that separate detail preservation from semantic abstraction [24,28,30], the operations specific to the track task are placed in the semantic pathway at low resolution so that longer context can be introduced without dominating inference cost, while the shallow branch preserves spatial detail for boundary localization. The figure also introduces the two prediction heads used throughout the method: the rail-bounded segmentation mask  Z s  and the auxiliary track axis proxy cue  Z c .
Figure 2. Overview of the RailDLA lightweight encoder–decoder for underground mine track region segmentation.  C  denotes the ground-truth centerline target used for the auxiliary track-axis supervision.
Figure 2. Overview of the RailDLA lightweight encoder–decoder for underground mine track region segmentation.  C  denotes the ground-truth centerline target used for the auxiliary track-axis supervision.
Ijgi 15 00351 g002
Table 1 gives the network structure in a compact notation similar to MobileNetV2 [45]. The symbols t, c, n, and s denote the expansion ratio, output channels, number of repetitions, and stride, respectively; for upsampling, s denotes the scale factor. For modules specific to the task, the table reports the module name and the number of channels in its main output.

3.3. Track Context Preconditioning

The track context preconditioning block is inserted before the strip attention block. It enriches the semantic feature with local, directional, and mildly dilated cues from the rail-bounded surface. Figure 3 details this preconditioning stage. For  X R C × h × w , the track context preconditioner in Figure 3 is
B t r a c k ( X ) = X + Γ b ( U ) U , Γ b ( U ) = σ W b GAP ( U ) , U = ϕ b [ D 3 ( X ) ; S h k r ( X ) ; S v k r ( X ) ; D 3 , d ( X ) ] .
Here,  D 3  is a depthwise  3 × 3  operator,  S h k r  and  S v k r  are horizontal and vertical strip operators,  D 3 , d  is a dilated depthwise  3 × 3  operator, and  ϕ b  is a pointwise projection. The gate  Γ b  makes the residual update channel-adaptive, following the general principle of channel recalibration in attention modules [32,33]. The gate prevents the directional prior from being injected uniformly into all semantic channels. In the proposed architecture,  k r = 11  and  d = 2 . The gate is learned end-to-end through the segmentation losses. It is computed from global average pooled responses and a learned pointwise channel projection followed by a sigmoid activation. Therefore, channels that respond to elongated rail-edge or track-interior evidence can receive a larger residual update from the preconditioned feature U, whereas channels dominated by local texture clutter, water stains, or equipment shadows can receive a smaller update. No manually specified channel weights are used.
Figure 3. Track context preconditioning block with local, strip, and dilated depthwise responses followed by gated residual injection.
Figure 3. Track context preconditioning block with local, strip, and dilated depthwise responses followed by gated residual injection.
Ijgi 15 00351 g003

3.4. Direction-Aware Rail Linear Attention

After preconditioning, RDLA provides low-cost directional context for track region features without constructing a dense pairwise attention matrix. As shown in Figure 4, RDLA is inspired by attention, but it performs structured propagation. Its direction-aware context is implemented by two strip axes on the image feature grid. The horizontal response collects evidence along image rows, and the vertical response collects evidence along image columns. These two directions reflect the elongated perspective geometry of the rail-bounded track region. Compared with dense self-attention, RDLA restricts the interaction support from data-dependent pairwise query–key affinity to learned horizontal and vertical strip propagation. Linear attention variants such as Performer and Linear Transformer reduce the cost of global attention through kernel feature maps or recurrent computation. RDLA follows a different design: it fixes the spatial support to two orthogonal directions on the image grid and learns strip weights for each channel and relative offset. The two directional strip responses are generated, projected, and injected through a gated residual path. For each channel c, RDLA first applies two learnable strip operators:
T h ( X ) c , i , j = t = r r a c , t ( h ) X c , i , j + t , T v ( X ) c , i , j = t = r r a c , t ( v ) X c , i + t , j .
These operators can be viewed as channel-wise banded Toeplitz maps over the flattened spatial grid. Their nonzero entries are restricted to the support defined in Equation (2), which gives RDLA a linear spatial cost with respect to image area. The formulation is consistent with efficient attention research, which reduces the quadratic cost of dense self-attention by changing the interaction structure or computation order [43]. In implementation,  a c , t ( h )  and  a c , t ( v )  are the learned weights of depthwise horizontal and vertical strip kernels. They are optimized by back-propagation together with the remaining network parameters. The weights are specific to each channel and relative offset. They are shared over spatial locations, allowing RDLA to produce adaptive directional responses while preserving a fixed strip-shaped structural bias.
Figure 4. RDLA block with horizontal and vertical strip operators and gated residual injection for directional context aggregation. Arrows indicate the data flow through the strip operators, channel gate, and gated residual injection.
Figure 4. RDLA block with horizontal and vertical strip operators and gated residual injection for directional context aggregation. Arrows indicate the data flow through the strip operators, channel gate, and gated residual injection.
Ijgi 15 00351 g004
The two directional responses are then mixed and injected through a gated residual update:
C ( X ) = ϕ f [ T h ( X ) ; T v ( X ) ] , g ( X ) = σ W 2 δ W 1 GAP ( X ) , R r d l a ( X ) = X + α g ( X ) C ( X ) .
The projection  ϕ f  performs dense channel mixing after directional spatial aggregation, while  g ( X ) ( 0 , 1 ) C  controls which channels should receive the directional residual. For channel c, the injected directional update is  α g c ( X ) C c ( X ) . A larger  g c ( X )  increases the contribution of the horizontal–vertical strip response for that channel, whereas a smaller  g c ( X )  suppresses the directional residual when the channel response is less consistent with the learned global context. Thus, the gate provides a channel-wise mechanism for injecting the directional prior to different degrees without manually assigning channel weights. The final RDLA block uses a strip kernel size of  k = 11  and a residual scale of  α = 0.25 .

3.5. Structured Affinity and Stability

To clarify why this design differs from local convolution and dense attention, Figure 5 gives a conceptual comparison of receptive support. The proposed operator can be interpreted as a learned structured directional operator with strip support on the image grid. Standard self-attention and non-local operations permit all pairwise spatial interactions over  N = h w  positions [12,13]. RDLA instead parameterizes only the horizontal and vertical strip interactions in  Ω r ( p ) :
A d e n s e = softmax Q K / d a , A p q , c s t r i p = t = r r a c , t ( h ) 1 ( q = p + t e h ) + t = r r a c , t ( v ) 1 ( q = p + t e v ) .
Equation (7) provides a conceptual comparison rather than an implementation step: neither  A d e n s e  nor  A s t r i p  is explicitly materialized during inference. The comparison clarifies the design constraint. RDLA uses learnable strip weights for relative offsets in place of unrestricted, data-dependent spatial affinity, yielding a structured propagation mechanism for efficient track region representation. The distinction from generic linear attention mechanisms lies in the interaction structure. Performer-type attention reduces the cost of global attention by approximating the softmax kernel, and Linear Transformer variants rearrange the attention computation to avoid materializing a quadratic affinity matrix. RDLA instead uses fixed horizontal and vertical strip support with learned weights specific to each channel and relative offset, yielding task-specific structured propagation for the rail-bounded foreground.
Figure 5. Conceptual comparison of local convolution, dense pairwise attention, and strip attention for elongated track context modeling.
Figure 5. Conceptual comparison of local convolution, dense pairwise attention, and strip attention for elongated track context modeling.
Ijgi 15 00351 g005
The residual formulation also provides an interpretive bound for the perturbation introduced by RDLA. If the spectral norms of  T h T v , and  ϕ f  are bounded by  ρ h ρ v , and  ρ f , respectively, then  0 < g c ( X ) < 1  gives
R r d l a ( X ) X F α ρ f ( ρ h + ρ v ) X F , R r d l a ( X ) F 1 + α ρ f ( ρ h + ρ v ) X F .
The bound indicates that RDLA modifies the semantic representation through a controlled residual perturbation under bounded operator norms. It is an interpretive property of the residual form rather than an explicit spectral regularization constraint. Such control is important in cluttered scenes, where the directional prior should support local appearance evidence rather than override it.
The corresponding computational and memory complexities are contrasted with dense attention as follows:
C r d l a = O ( C k N + C 2 N + C 2 / r g ) , M r d l a = O ( C N ) , C d e n s e = O ( N 2 d a + N d a C ) , M d e n s e = O ( N 2 ) .
Here,  C k N  corresponds to the two depthwise strip operators up to a constant factor,  C 2 N  to the pointwise projection used for channel mixing, and  C 2 / r g  to the lightweight channel gate with reduction ratio  r g . Exact constants can vary with kernel implementation and operator fusion. Since  k N  in dense prediction, RDLA provides directional context for track region features while avoiding the quadratic memory cost associated with dense attention affinities.

3.6. Track Axis Proxy Decoding

The track axis proxy decoder introduces a lightweight auxiliary cue that guides the final segmentation head. Algorithm 1 summarizes its forward propagation. Given the fused decoder feature  F f R B × C f × h × w  with  C f = 128 , the branch uses an internal width  C a = 64 . The projection  ϕ c  is a  1 × 1  ConvModule that maps  C f  channels to  C a  channels. The local operator  D 3  is a depthwise separable  3 × 3  convolution with padding of one and channel width  C a . The strip operators  S h k c  and  S v k c  are depthwise ConvModules with kernels  1 × k c  and  k c × 1 , respectively; they use channel groups equal to  C a , preserve the spatial size, and use  k c = 9 . The concatenated feature  [ R ; H ; V ]  has  3 C a  channels, and  ϕ u  is a  1 × 1  ConvModule that fuses it back to  C a  channels. The predictor  W c  is a  1 × 1  convolution that produces the one-channel logit  Z c  for the track axis proxy, while  W s  is the final  1 × 1  segmentation classifier. The guide  G = σ ( Z c )  is broadcast over the  C f  feature channels before modulation. The branch supplies a spatial modulation path for the final mask prediction, and the corresponding auxiliary supervision is defined in the training objective.
Algorithm 1 Forward propagation of the track axis proxy decoder propagation of the track axis proxy decoder
Require:  fused decoder feature  F f R B × 128 × h × w
Require:  branch width  C a = 64 , strip kernel size  k c = 9 , modulation factor  β = 0.4
Ensure:  segmentation logits  Z s R B × 2 × h × w  and proxy logit  Z c R B × 1 × h × w
  1: Q ϕ c 1 × 1 ( F f ) 128 C a  ConvModule
  2: R D 3 dw - sep ( Q ) 3 × 3  depthwise separable convolution
  3: H S h 1 × k c ( Q ) ,     V S v k c × 1 ( Q ) ▹ depthwise strip convolutions
  4: A ϕ u 1 × 1 ( [ R ; H ; V ] ) 3 C a C a  ConvModule
  5: Z c W c 1 × 1 ( A ) C a 1  convolution
  6:   G σ ( Z c )
  7:   G ˜ Broadcast 128 ( G )
  8:   F ¯ f F f ( 1 + β G ˜ )
  9: Z s W s 1 × 1 ( F ¯ f ) 128 2  classifier
10: return   Z s , Z c

3.7. Geometry-Aware Objective

When the loss is evaluated, logits at decoder resolution are bilinearly resized to the ground truth mask resolution when their spatial size differs from the label size. The training objective combines foreground classification, local boundary and curvature consistency, and auxiliary track axis proxy supervision:
L = L s e g ( Z s , Y ) + λ g L g e o ( P , Y ) + λ c L a x i s ( Z c , C ) , L s e g = 1 N ( i , j ) Ω c = 0 1 1 ( Y i j = c ) log [ softmax ( Z s ) ] c i j , L g e o = i , j S i j | K x ( P Y ) | i j + | K y ( P Y ) | i j + η | K Δ ( P Y ) | i j i , j S i j + ϵ , L a x i s = 1 N ( i , j ) Ω C i j log σ ( Z c , i j ) + ( 1 C i j ) log ( 1 σ ( Z c , i j ) ) .
Here,  K x  and  K y  are Sobel kernels,  K Δ  is the Laplacian kernel, and S is a local support mask around the track class. The foreground probability P is obtained from the class-1 softmax response of  Z s . The support mask is formed by clamping the sum of a  5 × 5  max-pooling dilation of the ground truth foreground and a stop-gradient dilation of P, so the geometric term is concentrated near the target region and its uncertain boundary.
The auxiliary target  C  follows the erosion-based target used by the track axis proxy branch. Let  R 0 = 1 ( Y = 1 )  and  R l + 1 = E 3 × 3 ( R l )  for  l = 0 , , L 2 , where  E 3 × 3  denotes binary erosion with a  3 × 3  kernel. With  L = 4 , the four levels  R 0 , , R L 1  are combined as
C ˜ = l = 0 L 1 ( l + 1 ) R l l = 0 L 1 ( l + 1 ) , C = C ˜ / ( max i , j C ˜ i j + ϵ ) , max i , j C ˜ i j > 0 , C ˜ , otherwise .
The target assigns larger supervision values to pixels that remain after repeated erosion operations, matching the intended inner-region proxy without requiring additional annotations. The final model uses  λ g = 0.05 λ c = 0.05 , and  η = 0.5 . The segmentation term is implemented as standard two-class cross-entropy on  Z s . The auxiliary term is implemented as the numerically stable binary cross-entropy loss applied directly to the logits  Z c , which is algebraically equivalent to  L a x i s  in Equation (10). The objective penalizes fragmented track boundaries and unstable local curvature while retaining the standard segmentation supervision.

4. Experiments

4.1. Dataset and Task Setting

Collection design. The dataset was constructed from forward-view videos acquired during routine bidirectional vehicle operation at four underground mines in Xinjiang, China (M1–M4; one collection site per mine). The sites provide complementary variations in roadway inclination, illumination, dust, water reflections, traffic, and track geometry. Each retained RGB frame is paired with a binary mask of the visible rail-bounded track region. Table 2 reports the common acquisition configuration and the contribution of each site.
Two annotators from the research team, both familiar with underground mine track imagery, produced polygon masks using Labelme. They followed a shared annotation rule under which the two visible rail bodies and the surface between their outer edges were labeled as foreground. A senior researcher with field acquisition experience reviewed every mask; ambiguous boundaries were returned for correction and checked again before inclusion.
One candidate RGB frame was sampled at an interval of 100 recorded frames. The candidates were then manually reviewed to remove residual near-duplicate images. After screening and annotation, the final dataset contained 9129 image–mask pairs; the retained count for each site is reported in Table 2. The retained images were divided once at the image level using a fixed 80:20 split, giving 7303 training and 1826 validation images. The site-wise training/validation counts describe the resulting split composition and were recovered from aggregate acquisition records. However, the retained archive does not preserve stable per-image identifiers linking every frame to its mine, route, video, or operating period; these factors could not be used to group the images. All models used the same image lists and label definition. The reported results therefore evaluate the fixed image-level task rather than generalization to unseen sites or routes.

4.2. Evaluation Metrics

Mean Intersection over Union (mIoU) is used as the primary evaluation criterion, following common practice in semantic segmentation [5,7]. Because the foreground track class occupies a small and elongated region, foreground IoU and foreground accuracy are reported explicitly in addition to aggregate metrics. For class c, let  TP c FP c , and  FN c  denote the numbers of true-positive, false-positive, and false-negative pixels, respectively. The class IoU, class accuracy, and mean IoU are computed as
IoU c = TP c TP c + FP c + FN c , Acc c = TP c TP c + FN c , mIoU = 1 2 c { b g , t r a c k } IoU c .
Overall pixel accuracy (aAcc) and mean class accuracy (mAcc) are used as secondary indicators.

4.3. Implementation Details

The final training and implementation settings are summarized in Table 3. Unless otherwise specified, all final comparisons use the same training and augmentation protocol.
The settings in Table 3 define the common protocol for the locally trained entries in Table 4. All models use the same binary label definition, input crop size, augmentation policy, metric implementation, and checkpoint selection rule. GPU timing under the unified local protocol was measured with a batch size of 1 over 200 inference iterations on the RTX 3070 Laptop GPU. The CPU check uses eager execution in PyTorch on an Intel Core i7-11800H CPU with 16 GB memory, four PyTorch CPU threads, and a fixed  1 × 3 × 512 × 512  tensor.

4.4. Compared Methods

The comparison includes lightweight CNNs, hybrid CNN architectures, and Transformer segmentation models. The full benchmark covers FastSCNN, ConvNeXtV2-Tiny, PIDNet-S, PIDNet-M, DDRNet-23-slim, SegNeXt-T, SegNeXt-S, SegFormer-B0, and Segmenter-ViT-T [24,29,30,38,41,42,46]. Additional Transformer variants are included as references in the benchmark table. The set includes lightweight and real-time references as well as higher-capacity references designed for accuracy.

5. Results

5.1. Overall Quantitative Comparison

Table 4 reports the full validation comparison, including best and final mIoU, per-class IoU, per-class accuracy, aAcc, mAcc, and throughput values where they are available. The following discussion focuses on segmentation accuracy. Figure 6 visualizes the accuracy results in Table 4 from two complementary views: the best mIoU ranking and the foreground track IoU gain relative to the FastSCNN reference.
RailDLA achieves the highest values in the full benchmark table, with 96.50% best mIoU, 96.50% final mIoU, 99.70% background IoU, and 92.10% track IoU. SegNeXt-S is the strongest generic reference in terms of validation accuracy. It obtains 95.70% best mIoU, 95.66% final mIoU, and 91.73% track IoU. SegNeXt-T, DDRNet-23-slim, PIDNet-M, and PIDNet-S also achieve best mIoU values above 94.9%. These results indicate that larger convolutional attention models and two-branch backbones for real-time segmentation remain competitive on this dataset [29,30,38].
On the working split, the numerical differences between RailDLA and SegNeXt-S are 0.80 percentage points in best mIoU and 0.37 percentage points in track IoU. These are working-split differences; the paired five-fold comparison in Section 5.6 reports performance variation across the same image-level folds relative to this closest strong baseline. Relative to FastSCNN [24], RailDLA improves best mIoU from 92.85% to 96.50% and track IoU from 86.04% to 92.10%. The foreground improvement is particularly relevant because the track class is the operational target and is more sensitive to missed or fragmented predictions than the dominant background class.

5.2. Focused Lightweight Accuracy Comparison

Figure 7 and Table 5 isolate a focused comparison subset. The figure gives a compact view of the selected metrics, while the table reports foreground metrics and differences relative to FastSCNN. The subset includes FastSCNN, ConvNeXtV2-Tiny [46], representative Transformer references [41,42], and the proposed lightweight model designed for this task under the same validation protocol. The focused table reports best and final mIoU, background IoU, foreground metrics, and differences relative to the FastSCNN reference. In this targeted lightweight comparison, RailDLA achieves the highest mIoU and track IoU values in the subset.

5.3. Ablation Study

Table 6 reports the internal component ablation under the same train–validation split, input resolution, metric definitions, and validation protocol. The table is organized as a compact component ablation. Variant A is a plain lightweight encoder–decoder scaffold of the FastSCNN type [24]; under the shared protocol it reproduces the FastSCNN accuracy values in Table 5 (92.85% mIoU and 86.04% track IoU). Variant B adds local geometry supervision and track axis proxy decoding for the track task, and Variant C further activates the strip attention pathway for the rail-bounded structure. The increment columns report the gain over the preceding variant in the sequence, rather than a comparison against an external baseline.
Adding track priors improves the plain lightweight variant from 92.85% to 94.64% mIoU and from 86.04% to 89.80% track IoU. The improvement indicates that the underground track task benefits from explicit foreground structure supervision and decoder modulation for the track interior. Adding the strip attention pathway further increases mIoU to 96.50% and track IoU to 92.10%, corresponding to additional gains of 1.86 and 2.30 percentage points over the track prior variant.
The ablation follows a progressive structural sequence from a plain lightweight encoder–decoder to track prior modeling and then to the full directional context model. Variant A provides the basic lightweight segmentation scaffold. Variant B adds the grouped track prior design, including local geometry supervision and track axis proxy decoding, and evaluates whether track structure supervision and decoding improve the underground track task. Variant C then adds the RDLA strip attention pathway on top of Variant B, isolating the additional effect of directional strip context in the complete track model. Adding this pathway introduces only a small change in theoretical complexity, increasing FLOPs from 1.035 G to 1.044 G. The grouped component design follows the development sequence of the model. It first establishes a lightweight task baseline, then tests track prior modeling, and finally tests the proposed directional context module.
Table 7 and Table 8 isolate the main component switches. Removing the geometry loss, track axis proxy pathway, decoder modulation, or RDLA strip pathway reduces track IoU by 0.78, 1.05, 0.62, and 2.30 percentage points, respectively. The full H/V, H-only, V-only, and ungated H/V variants obtain 92.10%, 90.64%, 90.32%, and 91.12% track IoU, respectively. SegNeXt uses 7, 11, and 21 in its multi-scale strip branches [38]; we select the intermediate value  k = 11  for moderate directional support. Under Equation (8),  α = 0.25  keeps the directional update controlled relative to the identity path. The gated H/V configuration gives the strongest result.

5.4. CPU Runtime Check

A runtime check on the CPU is reported under the local workstation setting described in Section 4.3. The test uses a  512 × 512  input, 20 warm-up iterations, and 200 measured iterations grouped into ten consecutive 20-iteration segments. As shown in Figure 8, the mean CPU latency is 23.80 ms/image, corresponding to 42.03 FPS. The segment-level mean latency ranges from 22.54 to 25.30 ms/image. The CPU check provides a local runtime reference without GPU acceleration and indicates stable execution under the tested setting.

5.5. Qualitative and Failure Case Analysis

Figure 9 and Figure 10 show representative validation cases in which RailDLA achieves the highest track IoU among the strong baselines compared. Together with Figure 11, these qualitative results illustrate several challenging conditions, including weak illumination, reflective floor regions, water stains, occlusion, and locally ambiguous rail boundaries. These examples provide qualitative evidence consistent with the aggregate results under the image-level validation protocol. In some difficult cases, the model may still confuse the track region with adjacent floor regions when local visual evidence is weak or miss a narrow track segment. Such cases motivate the explicit limitation note in Section 6.
Figure 11 presents the original set of failure case samples with manually corrected reference masks and per-image track IoU values. The corrected masks represent the visible rail-bounded track surfaces under difficult illumination and serve as references for this qualitative failure analysis. These corrected samples are excluded from training and aggregate validation metrics, and their IDs are provided in the caption for traceability. The panel retains the original comparison between FastSCNN and RailDLA and adds SegNeXt-S as a strong reference. In some cases, SegNeXt-S achieves a track IoU similar to or higher than that of RailDLA. Figure 12 shows Seg-Grad-CAM maps computed from the RDLA layer for selected successful RailDLA cases. The CAM is computed by backpropagating the mean track-class logit within the predicted track mask to the RDLA layer. The resulting spatial saliency maps show where features in the RDLA layer contribute to the track segmentation decision. These maps show CAM saliency rather than dense query–key attention weights. These panels supplement the positive qualitative examples under the same image-level validation protocol.

5.6. Image-Level Five-Fold Stability Check

Following standard K-fold cross-validation, all 9129 images were assigned to five mutually exclusive, near-equal folds. Folds 1–4 each contained 1826 images and Fold 5 contained 1825 images. In run k, Fold k was used once for validation and the union of the other four folds was used for training, giving 7303/1826 training/validation images in runs 1–4 and 7304/1825 in run 5. Thus, every image appeared in exactly one validation fold across the five runs, with no train–validation overlap within a run. The fold lists were fixed before model training and were identical for RailDLA and SegNeXt-S.
The same input size, training schedule, checkpoint selection rule, and metric definitions were retained for both models. Table 9 reports their paired results. RailDLA obtains 96.48% ± 0.09 mIoU and 92.05% ± 0.17 track IoU, while SegNeXt-S obtains 95.67% ± 0.11 mIoU and 91.83% ± 0.20 track IoU. The mean paired differences are 0.81 ± 0.05 percentage points for mIoU and 0.22 ± 0.10 percentage points for track IoU. Although aggregate collection statistics were recovered, reliable per-image identifiers linking each retained frame to its mine, route, recording sequence, or operating period are unavailable. These factors could not be used to keep correlated frames in the same fold. The experiment therefore measures image-level cross-split stability and does not establish generalization to unseen mines, routes, or recording sequences.

6. Conclusions

This study formulates underground mine track region perception from front-camera images as binary semantic segmentation of the visible surface bounded by the rails. It develops RailDLA, a lightweight encoder–decoder for this sparse foreground. The network combines track context preconditioning, RDLA directional strip propagation, context-guided fusion, and track axis proxy decoding to improve track region localization under variable underground appearance. On the self-constructed dataset of underground mine vehicle imagery, RailDLA achieves 96.50% mIoU, 92.10% track IoU, 97.50% track accuracy, and 99.70% pixel accuracy, while reaching 120.00 FPS under the runtime protocol on the same GPU. These results show that this task-specific design provides a favorable balance between accuracy and efficiency on the current working benchmark. The main limitations are the image-level split construction and the absence of route- or site-independent validation against strong baselines. Future work will focus on grouped route- or site-level validation, comparisons across repeated random seeds, runtime measurements on embedded platforms, metrics for boundary quality and skeleton continuity, and evaluation in downstream navigation use cases.

Author Contributions

Conceptualization: Zhichao Chen; Methodology: Haijun Li, Jie Yang, Kuangang Fan and Zhichao Chen; Software: Jianjun Gong, Jie Yang and Zhichao Chen; Validation: Haijun Li, Dengyin Jiang and Zhichao Chen; Formal analysis: Jianjun Gong and Dengyin Jiang; Investigation: Haijun Li, Jianjun Gong and Zhichao Chen; Resources: Haijun Li, Baolong Ma and Zhichao Chen; Data curation: Haijun Li, Baolong Ma and Dengyin Jiang; Writing—original draft: Zhichao Chen; Writing—review and editing: Zhichao Chen; Visualization: Haijun Li and Zhichao Chen; Supervision: Zhichao Chen. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key Research and Development Program of China under Grant 2024YFB4303203 and the Ganzhou City Key Research and Development Program under Grant GZ2024ZDZ007.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The raw underground mine driving images cannot be released publicly because of industrial site safety and operational confidentiality requirements. Upon reasonable request and with permission from the data owner, the materials that can be shared include the train–validation split lists, five-fold image lists, model configuration files, evaluation scripts, and processed or anonymized example images and masks for verifying the reported protocol.

Acknowledgments

This work was supported in part by the National Key R&D Program of China under Grant 2024YFB4303203 and in part by the Ganzhou City Key Research and Development Program under Grant GZ2024ZDZ007.

Conflicts of Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

References

  1. Jiskani, I.M.; Zhou, W.; Hosseini, S.; Wang, Z. Mining 4.0 and climate neutrality: A unified and reliable decision system for safe, intelligent, and green & climate-smart mining. J. Clean. Prod. 2023, 410, 137313. [Google Scholar] [CrossRef]
  2. Zhang, H.; Li, B.; Karimi, M.; Saydam, S.; Hassan, M. Recent Advancements in IoT Implementation for Environmental, Safety, and Production Monitoring in Underground Mines. IEEE Internet Things J. 2023, 10, 14507–14526. [Google Scholar] [CrossRef]
  3. You, K.; Shao, H.; Chen, Z.; Yang, J.; Du, X.; Lin, Y.; Wang, Y. A physics-constrained multimodal LLM for fault diagnosis of pressurized water reactor coolant systems with imbalanced and under-sampled data. J. Ind. Inf. Integr. 2026, 52, 101143. [Google Scholar] [CrossRef]
  4. UH, D.; Prem Kumar, J. Enhanced Transfer Learning-Based CNN for Abnormal Human Activity Detection in Video Surveillance Using Spatial-Temporal Features. Cybern. Syst. 2025, 1–30. [Google Scholar] [CrossRef]
  5. Long, J.; Shelhamer, E.; Darrell, T. Fully Convolutional Networks for Semantic Segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2015; pp. 3431–3440. [Google Scholar]
  6. Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Proceedings of the Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2015; pp. 234–241. [Google Scholar]
  7. Chen, L.C.; Zhu, Y.; Papandreou, G.; Schroff, F.; Adam, H. Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. In Proceedings of the European Conference on Computer Vision; Springer: Cham, Switzerland, 2018; pp. 801–818. [Google Scholar]
  8. Zhao, F.; He, Y.; Song, J.; Wang, J.; Xi, D.; Shao, X.; Wu, Q.; Liu, Y.; Chen, Y.; Zhang, G.; et al. Smart UAV-assisted blueberry maturity monitoring with Mamba-based computer vision. Precis. Agric. 2025, 26, 56. [Google Scholar] [CrossRef]
  9. Sun, J.; Li, D.; Kuai, Y.; Belotserkovsky, A.; Lukashevich, P. Towards Unified Transformer for UAV-Based Multi-Task Oriented Object Detection. IET Image Process. 2026, 20, e70343. [Google Scholar] [CrossRef]
  10. Zhao, F.; Xu, D.; Ren, Z.; Shao, X.; Wu, Q.; Liu, Y.; Wang, J.; Song, J.; Chen, Y.; Zhang, G.; et al. Mamba-based super-resolution and semi-supervised YOLOv10 for freshwater mussel detection using acoustic video camera: A case study at Lake Izunuma, Japan. Ecol. Inform. 2025, 90, 103324. [Google Scholar] [CrossRef]
  11. Chen, Z.; Yang, J.; Chen, L.; Feng, Z.; Jia, L. Efficient Railway Track Region Segmentation Algorithm Based on Lightweight Neural Network and Cross-fusion Decoder. Autom. Constr. 2023, 155, 105069. [Google Scholar] [CrossRef]
  12. Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, L.; Polosukhin, I. Attention Is All You Need. Adv. Neural Inf. Process. Syst. 2017, 30, 5998–6008. [Google Scholar]
  13. Wang, X.; Girshick, R.; Gupta, A.; He, K. Non-Local Neural Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2018; pp. 7794–7803. [Google Scholar]
  14. Yang, H.; Liu, Z.; Liu, W.; Wang, H.; Zhang, Y.; Wang, H. Graph-MDETR: A Graph-Guided Mamba-DETR Network for UAV Catenary Support Components Detection in Electrified Railways. IEEE Trans. Intell. Transp. Syst. 2026, 27, 6319–6332. [Google Scholar] [CrossRef]
  15. Duan, F.; Wang, H.; Yang, H.; Wei, C.; Zhang, C.; Song, Y.; Liu, Z. MRFM-IFCOS: An Anchor-Free Interactive Detector Based on Multireceptive Field Mamba for Detecting Catenary Support Components. IEEE Trans. Instrum. Meas. 2025, 74, 2553415. [Google Scholar] [CrossRef]
  16. Yang, H.; Hu, K.; Wang, H.; Hong, W.; Wang, X.; Wang, H.; Song, Y.; Liu, Z. BCLIP-ADer: A Bayesian Prompt Contrastive Language-Image Pretraining Method for Catenary Component Anomaly Detection in Electrified Railways. IEEE Trans. Transp. Electrif. 2026. [Google Scholar] [CrossRef]
  17. Yan, J.; Zhou, N.; Cheng, Y.; Zhang, F.; Wang, H.; Wang, M.; Jin, B.; Li, M.; Lu, Q.; Zhang, W. Application of Machine-Vision-Driven Physics-Informed Neural Networks in Pantograph–Catenary System State Detection. Mech. Syst. Signal Process. 2026, 257, 114577. [Google Scholar] [CrossRef]
  18. Yan, J.; Chen, B.; Zhang, F.; Cheng, Y.; Wang, H.; Wang, H.; Wang, M.; Li, T.; Zhang, W. Meta-Learning-Based Graph Convolutional Wavelet Network for Intelligent Dynamic Modeling of High-Speed Rail Subsystems. IEEE Trans. Veh. Technol. 2026, 1–16. [Google Scholar] [CrossRef]
  19. Gong, Y.; Lin, L.; Luo, Y.; Liu, H.; Gao, Y.; Zhao, J.; Song, Z.; Hu, X. Implicit Illumination-Aware Representation with Cross-Modal Prefusion Alignment for Universal Multispectral Pedestrian Detection. IEEE Trans. Neural Netw. Learn. Syst. 2026, 37, 3247–3261. [Google Scholar] [CrossRef] [PubMed]
  20. Chen, Z.; You, K.; Yang, J.; Chen, L.; Li, F.; Feng, Z.; Jia, L. A sparse-to-dense guided fusion framework for three-dimensional object detection in railway environments. Eng. Appl. Artif. Intell. 2026, 178, 115095. [Google Scholar] [CrossRef]
  21. Chen, Z.; Yang, J.; Chen, L.; Li, F.; Feng, Z.; Jia, L.; Li, P. RailVoxelDet: A Lightweight 3-D Object Detection Method for Railway Transportation Driven by Onboard LiDAR Data. IEEE Internet Things J. 2025, 12, 37175–37189. [Google Scholar] [CrossRef]
  22. Yang, G.; Jiang, Y.; Wang, S.; Chen, K. VinsFusion-Line: Binocular Vision Inertial Navigation Real-Time SLAM System Based on Line Features. Cybern. Syst. 2026, 57, 350–375. [Google Scholar] [CrossRef]
  23. Mounika, P.; Narayanan, B.; Balmuri, K.R. An Adaptive Trans-ResUnet++Based Segmentation and Hybrid CNN-Aided Classification for Detecting Breast Cancer from Mammogram Images. Cybern. Syst. 2025, 1–38. [Google Scholar] [CrossRef]
  24. Poudel, R.P.; Liwicki, S.; Cipolla, R. Fast-SCNN: Fast Semantic Segmentation Network. In Proceedings of the British Machine Vision Conference; BMVA Press: Durham, UK, 2019; p. 289. [Google Scholar]
  25. Chen, Z.; Yang, J.; Li, F.; Feng, Z.; Chen, L.; Jia, L.; Li, P. Foreign Object Detection Method for Railway Catenary Based on a Scarce Image Generation Model and Lightweight Perception Architecture. IEEE Trans. Circuits Syst. Video Technol. 2026, 36, 1377–1391. [Google Scholar] [CrossRef]
  26. Shajeena, J.; Govindasamy, B.; Gnanasundaram, M.; Joel, M.R. Mobile-Le Harmonic Fusion Network for Object Recognition and SiamMoT Based Multi-Object Tracking Using Video Surveillance. Cybern. Syst. 2026, 57, 866–896. [Google Scholar] [CrossRef]
  27. Chen, Z.; Guo, H.; Yang, J.; Jiao, H.; Feng, Z.; Chen, L.; Gao, T. Fast vehicle detection algorithm in traffic scene based on improved SSD. Measurement 2022, 201, 111655. [Google Scholar] [CrossRef]
  28. Yu, C.; Gao, C.; Wang, J.; Yu, G.; Shen, C.; Sang, N. BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentation. Int. J. Comput. Vis. 2021, 129, 3051–3068. [Google Scholar] [CrossRef]
  29. Pan, H.; Hong, Y.; Sun, W.; Jia, Y. Deep Dual-Resolution Networks for Real-Time and Accurate Semantic Segmentation of Traffic Scenes. IEEE Trans. Intell. Transp. Syst. 2023, 24, 3448–3460. [Google Scholar] [CrossRef]
  30. Xu, J.; Xiong, Z.; Bhattacharyya, S.P. PIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2023; pp. 19529–19539. [Google Scholar]
  31. Chen, Z.; Yang, J.; Feng, Z.; Zhu, H. RailFOD23: A dataset for foreign object detection on railroad transmission lines. Sci. Data 2024, 11, 72. [Google Scholar] [CrossRef] [PubMed]
  32. Hu, J.; Shen, L.; Sun, G. Squeeze-and-Excitation Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2018; pp. 7132–7141. [Google Scholar]
  33. Woo, S.; Park, J.; Lee, J.Y.; Kweon, I.S. CBAM: Convolutional Block Attention Module. In Proceedings of the European Conference on Computer Vision; Springer: Cham, Switzerland, 2018; pp. 3–19. [Google Scholar]
  34. Yang, J.; Jiang, Y.; Jiang, D.; Chen, Z. Infrared–Visible Fusion via Cross-Modality Attention and Small-Object Enhancement for Pedestrian Detection. ISPRS Int. J. Geo-Inf. 2025, 14, 477. [Google Scholar] [CrossRef]
  35. Sreekala, K.; Maniraj, S.P.; Singh, A.; Singh, A.P.; Pyingkodi, M.; Inthiyaz, S. Enhancing Medical Diagnosis through Multimodal Image Fusion: A Novel Approach Using Modified Swin-Based Cross Attention Fusion. Cybern. Syst. 2026, 57, 765–807. [Google Scholar] [CrossRef]
  36. Peng, C.; Zhang, X.; Yu, G.; Luo, G.; Sun, J. Large Kernel Matters: Improve Semantic Segmentation by Global Convolutional Network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2017; pp. 4353–4361. [Google Scholar]
  37. Huang, Z.; Wang, X.; Huang, L.; Huang, C.; Wei, Y.; Liu, W. CCNet: Criss-Cross Attention for Semantic Segmentation. In Proceedings of the IEEE/CVF International Conference on Computer Vision; IEEE: Piscataway, NJ, USA, 2019; pp. 603–612. [Google Scholar]
  38. Guo, M.H.; Lu, C.Z.; Hou, Q.; Liu, Z.; Cheng, M.M.; Hu, S.M. SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentation. Adv. Neural Inf. Process. Syst. 2022, 35, 1140–1156. [Google Scholar] [CrossRef]
  39. Dosovitskiy, A.; Beyer, L.; Kolesnikov, A.; Weissenborn, D.; Zhai, X.; Unterthiner, T.; Dehghani, M.; Minderer, M.; Heigold, G.; Gelly, S.; et al. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In Proceedings of the International Conference on Learning Representations; Curran Associates, Inc.: Red Hook, NY, USA, 2021. [Google Scholar]
  40. Zheng, S.; Lu, J.; Zhao, H.; Zhu, X.; Luo, Z.; Wang, Y.; Fu, Y.; Feng, J.; Xiang, T.; Torr, P.H.S.; et al. Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2021; pp. 6881–6890. [Google Scholar]
  41. Strudel, R.; Garcia, R.; Laptev, I.; Schmid, C. Segmenter: Transformer for Semantic Segmentation. In Proceedings of the IEEE/CVF International Conference on Computer Vision; IEEE: Piscataway, NJ, USA, 2021; pp. 7262–7272. [Google Scholar]
  42. Xie, E.; Wang, W.; Yu, Z.; Anandkumar, A.; Alvarez, J.M.; Luo, P. SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers. Adv. Neural Inf. Process. Syst. 2021, 34, 12077–12090. [Google Scholar]
  43. Katharopoulos, A.; Vyas, A.; Pappas, N.; Fleuret, F. Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention. In Proceedings of the International Conference on Machine Learning, PMLR; JMLR: New York, NY, USA, 2020; pp. 5156–5165. [Google Scholar]
  44. You, K.; Gu, Y.; Shao, H.; Wang, Y. A liquid-impulse neural network model based on heterogeneous fusion of multimodal information for interpretable rotating machinery fault diagnosis. Mech. Syst. Signal Process. 2026, 246, 113923. [Google Scholar] [CrossRef]
  45. Sandler, M.; Howard, A.; Zhu, M.; Zhmoginov, A.; Chen, L.C. MobileNetV2: Inverted Residuals and Linear Bottlenecks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2018; pp. 4510–4520. [Google Scholar]
  46. Woo, S.; Debnath, S.; Hu, R.; Chen, X.; Liu, Z.; Kweon, I.S.; Xie, S. ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoders. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2023; pp. 16133–16142. [Google Scholar]
  47. Xu, M.; Zhang, Z.; Wei, F.; Hu, H.; Bai, X. Side Adapter Network for Open-Vocabulary Semantic Segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2023; pp. 2945–2954. [Google Scholar]
  48. Zhu, C.; Suri, S.; Jose, C.; Oquab, M.; Szafraniec, M.; Wen, W.; Xiong, Y.; Labatut, P.; Bojanowski, P.; Krishnamoorthi, R.; et al. Efficient Universal Perception Encoder. arXiv 2026, arXiv:2603.22387. [Google Scholar]
Figure 1. Application background for underground mine track region perception from a front camera under confined tunnel imaging conditions.
Figure 1. Application background for underground mine track region perception from a front camera under confined tunnel imaging conditions.
Ijgi 15 00351 g001
Figure 6. Overall validation comparison showing best mIoU ranking and track IoU relative to the FastSCNN baseline.
Figure 6. Overall validation comparison showing best mIoU ranking and track IoU relative to the FastSCNN baseline.
Ijgi 15 00351 g006
Figure 7. Focused lightweight accuracy comparison using paired mIoU and track IoU markers for selected models. Markers with black frames denote the proposed RailDLA.
Figure 7. Focused lightweight accuracy comparison using paired mIoU and track IoU markers for selected models. Markers with black frames denote the proposed RailDLA.
Ijgi 15 00351 g007
Figure 8. CPU runtime curves for individual iterations and averaged segments of RailDLA on a  512 × 512  input.
Figure 8. CPU runtime curves for individual iterations and averaged segments of RailDLA on a  512 × 512  input.
Ijgi 15 00351 g008
Figure 9. Representative positive validation cases with input images, ground truth masks, and predictions from RailDLA, PIDNet-S, DDRNet-23-slim, and SegNeXt-S.
Figure 9. Representative positive validation cases with input images, ground truth masks, and predictions from RailDLA, PIDNet-S, DDRNet-23-slim, and SegNeXt-S.
Ijgi 15 00351 g009
Figure 10. Additional representative positive validation cases comparing RailDLA with PIDNet-S, DDRNet-23-slim, and SegNeXt-S.
Figure 10. Additional representative positive validation cases comparing RailDLA with PIDNet-S, DDRNet-23-slim, and SegNeXt-S.
Ijgi 15 00351 g010
Figure 11. Difficult validation cases with corrected ground truth reference masks and per-image track IoU values for FastSCNN, SegNeXt-S, and RailDLA. Sample IDs from top to bottom are 3984, 5108, and 5977.
Figure 11. Difficult validation cases with corrected ground truth reference masks and per-image track IoU values for FastSCNN, SegNeXt-S, and RailDLA. Sample IDs from top to bottom are 3984, 5108, and 5977.
Ijgi 15 00351 g011
Figure 12. Seg-Grad-CAM maps computed from the RDLA layer for selected successful RailDLA validation cases.
Figure 12. Seg-Grad-CAM maps computed from the RDLA layer for selected successful RailDLA validation cases.
Ijgi 15 00351 g012
Table 1. Network layer configuration of RailDLA. DSConv denotes depthwise separable convolution, and IRB denotes a MobileNetV2 inverted-residual block [45].
Table 1. Network layer configuration of RailDLA. DSConv denotes depthwise separable convolution, and IRB denotes a MobileNetV2 inverted-residual block [45].
Input SizeOperatortcns
  512 2 × 3 Conv  3 × 3 3212
  256 2 × 32 DSConv  3 × 3 4812
  128 2 × 48 DSConv  3 × 3 6412
  64 2 × 64 IRB66432
  32 2 × 64 IRB69632
  16 2 × 96 IRB612831
  16 2 × 128 Conv  3 × 3 12811
  16 2 × 128 Track context preconditioning block12811
  16 2 × 128 RDLA block12811
  16 2 × 128 Bilinear upsampling1281   × 4
64 2 × 128 / 64 2 × 64 Context-guided feature fusion12811
  64 2 × 128 Decoder DSConv  3 × 3 12821
  64 2 × 128 Track axis proxy decoding branch6411
  64 2 × 128 Final segmentation head211
Table 2. Acquisition configuration and site-wise composition of the underground mine dataset.
Table 2. Acquisition configuration and site-wise composition of the underground mine dataset.
(a) Common acquisition configuration
ItemSetting
Platform and operationRail-guided mine vehicle with an NVIDIA Jetson Orin Nano; routine bidirectional recording
Camera and modalityFront-facing Orbbec Gemini 335Le RGB-D camera (Orbbec, Shenzhen, China); RGB stream used; depth stream excluded
RGB acquisition 1280 × 720  or  1920 × 1080  pixels; 30 frames/s; automatic exposure and white balance
Mounting geometryFront-center mounting, approximately 1.35 m above the rail top, with an 8° downward pitch
Temporal samplingOne RGB frame retained every 100 recorded frames (approximately every 3.3 s)
(b) Site coverage and retained-frame allocation
Acquisition volumeImage split
SiteRoutesVideosFramesTrainVal.Representative conditions
M132422781822456Inclined roadway; weak illumination
M222018761501375Dust; mixed pedestrian–vehicle traffic
M332826892151538Water reflection; multiple tracks
M422422861829457Curved track; illumination transitions
Total1096912973031826Four underground mines
Notes: A video is one uninterrupted recording run. Train/Val. denote the training and validation portions of the fixed image-level split.
Table 3. Implementation settings for model training and evaluation.
Table 3. Implementation settings for model training and evaluation.
CategorySetting
Training schedule100 epochs; validation every 10 epochs
Implementation frameworkMMSegmentation 1.2.2 with MMEngine 0.10.7 and MMCV 2.2.0
Training scopeModels corresponding to all accuracy entries in Table 4 were trained from scratch by the authors
Weight initializationDefault random initialization in MMSegmentation and PyTorch 2.4.0, without pretrained backbone weights
Random seed1,655,745,629 for the local training runs
Training hardwareNVIDIA GeForce RTX 3070 Laptop GPU with 8 GB memory
Checkpoint selectionBest validation mIoU over the 100-epoch schedule
OptimizerStochastic gradient descent (SGD)
Initial learning rate0.12
Learning-rate schedulePolynomial decay, power 0.9
Momentum0.9
Weight decay   4 × 10 5
Batch size16
Training cropRandom  512 × 512  crop
Input scale augmentationRandom resize ratio from 0.5 to 2.0
Horizontal flipProbability 0.5
Photometric augmentationPhotometric distortion
Complexity input size   512 × 512
Table 4. Full validation comparison on the underground mine track region segmentation benchmark. All models were implemented and trained by the authors under the unified experimental setting.
Table 4. Full validation comparison on the underground mine track region segmentation benchmark. All models were implemented and trained by the authors under the unified experimental setting.
ModelmIoU (%)IoU (%)Acc. (%)Overall (%)FPS ↑
Best ↑Final ↑Bg ↑Track ↑Bg ↑Track ↑aAcc ↑mAcc ↑
SegNeXt-S [38]95.7095.6699.6091.7399.8395.0699.6197.44
SegNeXt-T [38]95.3695.3699.5791.1599.8194.7299.5897.2759.71
DDRNet-23-slim [29]95.0395.0399.5390.5499.7196.0099.5597.8689.56
PIDNet-M [30]94.9894.9899.5290.4499.6697.0099.5498.3338.77
PIDNet-S [30]94.9694.9699.5190.4099.6597.1099.5398.3776.84
RailDLA96.5096.5099.7092.1099.9097.5099.7098.50120.00
ConvNeXtV2-Tiny [46]94.4194.4199.4889.3499.8192.9399.5096.37
FastSCNN [24]92.8592.6899.3286.0499.8389.1199.3594.47107.58
SegFormer-B0 [42]89.7686.3698.7673.9799.9075.5498.8087.7216.33
SAN-ViT-B16 [47]87.7883.6498.2968.9899.1881.0098.3590.0923.28
EuPE-ViT-T16 [48]82.5180.1998.2062.1999.8963.6998.2581.79
Segmenter-ViT-T [41]77.6964.8296.8832.7599.9533.0896.9366.52
Notes: ↑ indicates that higher values are better. Bold indicates the best value; underline indicates the second-best value.
Table 5. Focused lightweight accuracy comparison. The final columns report differences relative to the FastSCNN [24] reference.
Table 5. Focused lightweight accuracy comparison. The final columns report differences relative to the FastSCNN [24] reference.
ModelBest
mIoU ↑
Final
mIoU ↑
Bg
IoU ↑
Track
IoU ↑
Track
Acc. ↑
Δ mIoU ↑ Δ Track ↑
Segmenter-ViT-T [41]77.6964.8296.8832.7533.08   15.16   53.29
EuPE-ViT-T16 [48]82.5180.1998.2062.1963.69   10.34   23.85
SAN-ViT-B16 [47]87.7883.6498.2968.9881.00   5.07   17.06
SegFormer-B0 [42]89.7686.3698.7673.9775.54   3.09   12.07
FastSCNN [25]92.8592.6899.3286.0489.110.000.00
ConvNeXtV2-Tiny [46]94.4194.4199.4889.3492.93   + 1.56   + 3.30
RailDLA96.5096.5099.7092.1097.50+3.65+6.06
Notes: ↑ indicates that higher values are better. Bold indicates the best value.
Table 6. Grouped internal ablation of RailDLA. The plain variant uses the same lightweight encoder–decoder scaffold without structural components for the track task. The track prior variant adds local geometry supervision and track axis proxy decoding, and the full model further adds the strip attention pathway. FLOPs are reported as a complexity reference.
Table 6. Grouped internal ablation of RailDLA. The plain variant uses the same lightweight encoder–decoder scaffold without structural components for the track task. The track prior variant adds local geometry supervision and track axis proxy decoding, and the full model further adds the strip attention pathway. FLOPs are reported as a complexity reference.
VariantTrack-Specific ComponentAccuracy (%)Complexity
Local
Geom.
Axis
Decoder
Strip
Attn.
mIoU ↑Track
IoU ↑
Δ
mIoU
Δ
Track
FLOPs
(G) ↓
A: Plain lightweight variant92.8586.040.927
B: Track prior variant94.6489.80   + 1.79   + 3.76 1.035
C: RailDLA96.5092.10+1.86+2.301.044
Notes: ↑ indicates that higher values are better; ↓ indicates that lower values are better. Bold indicates the best value.
Table 7. Subtractive ablation of RailDLA components. TAP denotes the track axis proxy pathway, and  Δ Track IoU is the absolute change relative to full RailDLA.
Table 7. Subtractive ablation of RailDLA components. TAP denotes the track axis proxy pathway, and  Δ Track IoU is the absolute change relative to full RailDLA.
VariantGeom.TAPMod.RDLAGatemIoU ↑ Track IoU ↑ Δ Track IoU
Full RailDLA96.5092.10
w/o geom. loss95.9691.32−0.78
w/o TAP pathway95.7491.05−1.05
w/o decoder mod.96.0291.48−0.62
w/o RDLA pathway94.6489.80−2.30
Notes: ↑ indicates that higher values are better.
Table 8. Ablation of directional operators and the gate in RailDLA. H and V denote horizontal and vertical strip propagation, and  Δ Track IoU is the absolute change relative to the full gated H/V RDLA configuration.
Table 8. Ablation of directional operators and the gate in RailDLA. H and V denote horizontal and vertical strip propagation, and  Δ Track IoU is the absolute change relative to the full gated H/V RDLA configuration.
VariantHVGateSupportmIoU ↑ Track IoU ↑ Δ Track IoU
Full H/V RDLAH + V96.5092.10
H-onlyH95.3690.64−1.46
V-onlyV95.1890.32−1.78
w/o gateH + V95.7491.12−0.98
Notes: ↑ indicates that higher values are better.
Table 9. Paired five-fold comparison at the image level between RailDLA and SegNeXt-S. Each fold cell reports mIoU/track IoU (%), and the mean ± standard deviation is computed across the five validation folds.
Table 9. Paired five-fold comparison at the image level between RailDLA and SegNeXt-S. Each fold cell reports mIoU/track IoU (%), and the mean ± standard deviation is computed across the five validation folds.
ModelFold 1Fold 2Fold 3Fold 4Fold 5Mean ± Std
RailDLA96.42/91.9496.57/92.2496.48/92.0596.36/91.8296.55/92.1896.48 ± 0.09/92.05 ± 0.17
SegNeXt-S95.58/91.6295.73/91.9495.66/91.8295.55/91.6695.83/92.1195.67 ± 0.11/91.83 ± 0.20
RailDLA − SegNeXt-S0.84/0.320.84/0.300.82/0.230.81/0.160.72/0.070.81 ± 0.05/0.22 ± 0.10
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Li, H.; Ma, B.; Gong, J.; Jiang, D.; Yang, J.; Fan, K.; Chen, Z. A Direction-Aware Lightweight Network for Camera-Based Underground Mine Track Region Segmentation. ISPRS Int. J. Geo-Inf. 2026, 15, 351. https://doi.org/10.3390/ijgi15080351

AMA Style

Li H, Ma B, Gong J, Jiang D, Yang J, Fan K, Chen Z. A Direction-Aware Lightweight Network for Camera-Based Underground Mine Track Region Segmentation. ISPRS International Journal of Geo-Information. 2026; 15(8):351. https://doi.org/10.3390/ijgi15080351

Chicago/Turabian Style

Li, Haijun, Baolong Ma, Jianjun Gong, Dengyin Jiang, Jie Yang, Kuangang Fan, and Zhichao Chen. 2026. "A Direction-Aware Lightweight Network for Camera-Based Underground Mine Track Region Segmentation" ISPRS International Journal of Geo-Information 15, no. 8: 351. https://doi.org/10.3390/ijgi15080351

APA Style

Li, H., Ma, B., Gong, J., Jiang, D., Yang, J., Fan, K., & Chen, Z. (2026). A Direction-Aware Lightweight Network for Camera-Based Underground Mine Track Region Segmentation. ISPRS International Journal of Geo-Information, 15(8), 351. https://doi.org/10.3390/ijgi15080351

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop