Next Article in Journal
Modelling the Longevity of Beach Nourishment and the Influence of a Detached Breakwater
Previous Article in Journal
Fixed-Time Event-Triggered Fault-Tolerant Formation Control for Autonomous Underwater Vehicle Swarms
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

MFP-PAINet: Enhancing Underwater Images Through Multi-Dimensional Feature Fusion and Probabilistic Uncertainty Modeling

1
College of Artificial Intelligence, Nanjing Agricultural University, Nanjing 210095, China
2
Nanjing Hundun Information Technology Co., Ltd., Nanjing 211153, China
*
Author to whom correspondence should be addressed.
J. Mar. Sci. Eng. 2025, 13(12), 2250; https://doi.org/10.3390/jmse13122250
Submission received: 21 October 2025 / Revised: 21 November 2025 / Accepted: 24 November 2025 / Published: 27 November 2025
(This article belongs to the Section Ocean Engineering)

Abstract

In supervised training for underwater image enhancement (UIE), many deep learning methods rely on approximate reference images; however, they tend to neglect the inherent uncertainty of these references. To address this problem, this study proposes MFP-PAINet, an underwater image enhancement network, which can integrate multi-dimensional feature fusion with probabilistic adaptive uncertainty modeling. Specifically, histogram equalization, white balance correction, and gamma correction were first implemented to generate preliminary enhanced inputs so as to improve contrast and color balance. Subsequently, a multi-dimensional feature mapping module was used to extract high-dimensional representations and produce multiple feature maps, which were dynamically weighted and adaptively fused by a confidence generation module to initially handle the uncertainty at the feature level. Finally, a probabilistic module was introduced to further model the uncertainty and refine image details. Extensive experiments conducted on eight publicly available datasets demonstrate that the proposed MFP-PAINet outperforms both traditional and deep learning-based UIE methods. For example, on the LSUI dataset, MFP-PAINet achieved SSIM, PSNR, and UIQM scores of 0.854, 23.044, and 3.056, respectively. Furthermore, MFP-PAINet exhibited certain promising performance in image deraining and image dehazing tasks, proving that it can effectively retrieve image details and improve image clarity.

1. Introduction

Underwater Image Enhancement (UIE) has become a focal research direction in such fields as image processing and underwater vision over recent years [1,2]. High-quality underwater images are of significant application value in many tasks, and they play a crucial role in such disciplines as marine biology, archeology, and marine ecology [3,4,5], while becoming essential in practical operations like underwater engineering, search and rescue, and resource exploration. Nevertheless, given the complexity of underwater environments, such as variable lighting conditions and the scattering and absorption characteristics of water, underwater images are often compromised by certain factors, such as reduced contrast and color distortion, thus severely degrading their quality and usability.
The root cause of underwater images’ degradation lies in the wavelength absorption and scattering that light would inescapably encounter as it propagates through water. Typically, such images would exhibit a distinct blue or green hue [6], because as light travels through water, red wavelengths would be absorbed first, enabling blue and green light to penetrate farther. In a word, underwater images degrade due to wavelength absorption and scattering, including both forward and backward scattering [7,8]: the former causes images to blur, while the latter results in reduced brightness, thus further degrading image quality [9,10,11]. Moreover, the attenuation of wavelengths [10,12], scattering, and other optical properties of water bodies can cause irregular nonlinear distortions [13,14,15], which lead to low image contrast and are often accompanied by blurring and color degradation. Although traditional UIE methods can improve image quality to some extent, they usually rely on specific assumptions and prior knowledge, which limits their adaptability to different water environments. As a result, these methods often suffer from color deviation or over-enhancement in complex underwater scenes, reflecting their limited generalization capability.
Over recent years, significant advancements have been made with deep learning in the UIE field, and the methods adopted typically rely on paired distorted and reference images so as to learn the mapping between them [6,16]. However, due to the complexity and variability of underwater environments, it becomes a challenging task to take perfect, undistorted underwater images (i.e., the reference images). To address this issue, the currently mainstream solutions often involve generating approximate reference images, which are used as undistorted, clear underwater images. For example, the solution in reference [17] enhances distorted images by using various advanced algorithms, and then the best-quality image is selected as the reference image. However, this approach is influenced by multiple factors, such as human visual perception, imaging equipment, and algorithmic parameters, therefore leading to uncertainty in the reference image. This means that there may be multiple potential solutions to the same distorted image. If directly training a model with such distorted images and their corresponding reference images, poor model generalization performance may be the result due to the uncertainty of such reference images [18]. Moreover, similar challenges related to uncertainty and unstable supervision have also been dealt with in other signal enhancement domains. For instance, Siddique et al. [19,20] found that improving robustness under noise and uncertain signal patterns requires enhanced representations and reliable feature learning, a principle that is also essential for underwater image enhancement for ambiguous or approximate reference images.
To address the aforementioned issues, this study proposes a novel UIE network, called MFP-PAINet, which combines multi-dimensional feature fusion with probabilistic adaptive uncertainty distribution to generate high-quality underwater images. The main contributions of this study include
(1)
“Fusion-then-Modeling” Hierarchical UIE Framework: A hierarchical framework was constructed to integrate multi-dimensional feature fusion with probabilistic uncertainty modeling. By fusing multi-dimensional features prior to performing probabilistic modeling, the framework could obtain more stable and robust feature representations.
(2)
Confidence-Guided Multi-Dimensional Feature Fusion Strategy: A collaborative design for the multi-dimensional feature mapping module and the confidence generation module is proposed. By virtue of dynamic weighting and adaptive fusion of multi-dimensional features, this design strategy can preliminarily handle uncertainty at the feature level.
(3)
Experimental Validation and Cross-Task Adaptability: On all the eight public UIE datasets, the proposed method achieved superior performance over the existing UIE approaches. In addition, the method exhibits a certain degree of cross-task adaptability in image deraining and image dehazing tasks, demonstrating promising generalization capability and practical application potential.

2. Related Work

2.1. Traditional UIE Methods

Traditionally, UIE methods were based on physical approaches [21], and prior knowledge was utilized to estimate the parameters of underwater imaging models for improving image quality. Such priors include underwater dark channel prior [22], minimum information prior [23], haziness prior [24], etc. For example, Ancuti et al. [25] proposed a method to deliver color correction and contrast enhancement through weighted mapping and image fusion techniques, ultimately improving the visual impact of images. By using local adaptive contrast enhancement techniques while minimizing color loss, Zhang et al. [26] sharpened image clarity and contrast. He et al. [27] introduced the Dark Channel Prior (DCP) algorithm to estimate the transmission of light by calculating the “dark channel” in images, effectively enhancing image quality. Based on DCP, Peng et al. [28] proposed the Generalized Dark Channel Prior (GDCP) method, which assumes dark channel information in underwater images to restore image clarity. On the basis of dehazing algorithms, Chiang et al. [29] developed a UIE method to improve image clarity by removing haze from images. Galdran et al. [30] introduced an improved dark channel prior method, which used red channel information to estimate the depth of underwater images, thus improving image quality. Li et al. [31] created a physics-based UIE method to estimate an intermediary transmission map and recover image visibility and color, and this method was found to perform well in various water bodies and adverse weather conditions, thus demonstrating broad applicability.
Generally, traditional methods tend to implement physical and statistical techniques to enhance underwater image quality. Although they improve the visual appeal of images to some extent, they often rely on specific assumptions and prior knowledge. Unfortunately, they may encounter limitations when dealing with complex and unstable underwater environments.

2.2. Deep Learning-Based UIE Methods

Deep learning-based methods for UIE are designed to leverage automatic feature extraction and utilize extensive paired or unpaired training data to learn enhancement mappings. As a UIE network based on medium transmission guidance embedded in multiple color spaces, UColor [32] can significantly enhance the visual quality and quantitative metrics of underwater images by integrating feature representations across different color spaces and utilizing medium transmission information from physical models. Li et al. [17] introduced a UIE network called Water-Net, which, after being trained on a large-scale underwater image dataset, could significantly enhance visual quality and detail retention by combining multi-scale features with adversarial learning strategies. Shallow-UWNet [33] is a lightweight neural network structure to reduce the number of parameters and enhance a model’s compression rate and speed while maintaining performance comparable to the existing state-of-the-art models on multiple synthetic and real datasets. Water-CycleGAN [34] is a weakly supervised color transfer method for underwater image color correction, and it is designed with a multi-loss function, including adversarial loss, cycle consistency loss, and Structural Similarity Index Measure (SSIM) loss; this method can correct image colors to render them as taken in air, while preserving the content and structure of the input images. By using Generative Adversarial Networks (GAN) for UIE, Fabbri et al. [6] proposed a method called UGAN, which improved the visual quality of underwater scenes through generative adversarial networks and enhanced the performance of autonomous underwater robot visual-driven behaviors, delivering significant effects in multiple tests. Jiang et al. [35] introduced a target-oriented perceptual adversarial fusion network called TOPAL by combining multi-scale dense enhancement modules with deep esthetic rendering modules; through a dual-channel attention mechanism and a global-local adversarial mechanism, it achieved high-quality enhancement for underwater images.
In a word, through advanced neural network architectures and optimization tricks, the deep learning approaches above performed excellently in complex underwater environments, significantly improving image clarity, color accuracy, and contrast. Nevertheless, although these methods overcame the limitations of traditional approaches, they all failed to give proper consideration to the uncertainties in the image enhancement process. In contrast, by combining multi-dimensional feature fusion strategies with probabilistic adaptive distribution, the MFP-PAINet proposed in this study can learn and handle uncertainties in a better manner in the image enhancement process, thereby generating high-quality underwater images.

3. The Proposed Model

3.1. The Principle and Overall Framework of the Model

This study proposes a UIE network, called MFP-PAINet, based on multi-dimensional feature fusion and probabilistic adaptive uncertainty distribution. As shown in Figure 1 for the overall architecture of the network, it includes a multi-dimensional feature mapping module, a confidence generation module, and a probabilistic module, which is composed of a Conditional Variational Autoencoder (CVAE) [36,37] and Probabilistic Adaptive Instance Normalization (PAdaIN) [18].
After being inputted, the distorted underwater images would undergo certain preprocessing operations, including histogram equalization (HE), white balance correction (WB) and gamma correction (GC), so as to preliminarily enhance the contrast and color balance of the images. Specifically, HE is implemented at the luminance channel in the HSV color space to enhance the overall image contrast; WB adopts the Perfect Reflector method, purposed to normalize the maximum values of the RGB channels and eliminate color deviation; and GC employs a power-law transformation with γ = 2.0 , so as to enhance the dark-region details and optimize the overall visual quality. The preprocessed images are then fed into the multi-dimensional feature mapping module, which generates various multi-dimensional feature mappings of the images while capturing and integrating more advanced features to improve naturalness and detail quality. The confidence generation module would, based on the output of the multi-dimensional feature mapping module, assign corresponding confidence maps to these multi-dimensional feature mappings and dynamically fuse them. This module can preliminarily resolve the uncertainties by synthesizing multiple potential solutions so as to improve the final image quality. The merged results are then inputted into the probabilistic module, which uses the PAdaIN module to encode the uncertainties in a deeper manner. In addition, this module can dynamically adjust the mean and standard deviation of the image features and introduce random variables to express uncertainties, thus further ensuring the consistency and stability of the enhancement results.
Proposed by Fuet et al. [18], PUIE-Net first introduced uncertainty modeling into UIE and designed the PAdaIN module for probabilistic feature encoding. Subsequently, Saleh et al. [38] extended this concept by constructing an unsupervised enhancement model, called UDnet, to further broaden the application of uncertainty modeling. Similarly to PUIE-Net and UDnet, the method used in this study also adopts PAdaIN for feature-level uncertainty encoding. However, there is a key distinction: this study implements a multi-dimensional feature fusion and confidence-based dynamic weighting mechanism prior to uncertainty modeling. This mechanism adaptively integrates results from different enhancement paths (e.g., HE, WB, and GC), thereby explicitly mitigating early-stage uncertainties at the feature level. The differences in the workflow among PUIE-Net, UDnet, and the proposed method are illustrated in Figure 2. This “fusion-then-modeling” strategy enables the model proposed in this study to obtain more stable and reliable feature representations before probabilistic distribution learning, eventually resulting in enhanced consistency and structural fidelity in the final enhanced images.

3.2. Multi-Dimensional Feature Mapping Module

Images of different types are inputted into the multi-dimensional feature mapping module to generate corresponding feature mappings. This module integrates a multi-branch structure, Atrous Spatial Pyramid Pooling (ASPP) [39], and SE channel attention mechanisms, and its structure is illustrated in Figure 3. The multi-branch module captures features from local to global scales by using different convolution kernel sizes and then fuses these features along the channel dimension. Subsequently, the SE [40] module enhances feature expression capabilities, and residual blocks further optimize feature extraction effects. After multiple iterations, the feature maps are inputted into the ASPP module, which uses convolution layers with varying dilation rates to extract multi-scale contextual information and ultimately produce the feature mappings of the inputted images. By virtue of multi-dimensional feature fusion and residual learning, the network enables multi-dimensional feature mappings to capture and integrate more advanced features, thus significantly enhancing the naturalness and detail representation of the images. The ASPP module is introduced to exploit convolutions with different dilation rates for extracting multi-scale contextual information, thereby enhancing the network’s global perception of complex underwater scenes. The SE attention mechanism is employed to adaptively adjust channel-wise feature weights so as to highlight the critical information while suppressing redundant features, purposed to improve the effectiveness of feature representation.

3.3. Confidence Generation Module

The Confidence Generation Module, a key component in the UIE framework, is responsible for generating confidence maps for different feature mappings of the multi-dimensional feature mapping module and dynamically weighting and merging these feature mappings to preliminarily address uncertainties in the enhancement process. As shown in Figure 4, the structure of this module is based on the U-Net architecture [41] and enhanced with residual blocks and SE (Squeeze-and-Excitation) modules, purposed to improve the capability and precision of feature extraction. The multi-dimensional feature mappings outputted from the multi-dimensional feature mapping module are sequentially fed into the encoder of the Confidence Generation Module, where the encoder, working with residual blocks, progressively downsamples to extract high-dimensional feature representations. In the decoding phase, skip connections are used to fuse the features extracted in the encoding phase, with them gradually restored during decoding, so as to ensure the comprehensive integration of the multi-dimensional features. The SE module in the decoder is used to adaptively adjust weights between channels so as to enhance key information specific to each feature mapping, thereby highlighting high-confidence features. The formula for dynamically weighting and fusing the multi-dimensional feature mappings with the confidence maps is as follows:
I e n = R W B C W B + R H E C H E + R G C C G C
where R H E , R W B , and R G C are the three feature mappings outputted from the multi-dimensional feature mapping module; C H E , C W B , and C G C are the confidence maps for these feature mappings; I e n is the feature map after dynamically weighted fusion; and represents element-wise multiplication.

3.4. Probabilistic Module

To further address the uncertainties, the probabilistic module introduces a latent variable z to represent uncertainties in the enhancement process. By integrating a CVAE [36,37] and PAdaIN [18], this module generates diverse enhancement results. The objective is to learn the mapping from the degraded image x to the clean image y , while accounting for the uncertainty represented by z . This process can be formulated as:
p y x 1 S s = 1 S p y z S , x ,   z S ~ p z x
where p z x denotes the uncertainty distribution, and S represents the number of samples. In this way, the model cannot only generate multiple enhancement results, but can capture the diversity across different enhancement strategies. To identify the optimal enhancement result, the maximum likelihood estimation is implemented, and the sample with the highest probability among the generated samples is selected as the final output:
p y x p y z m a x , x ,   z m a x ~ p z x
where z m a x represents the latent variable sample with the highest probability.
Assume that x is a distorted image and y is a reference image. In the CVAE process, the feature extractor maps the input image into feature representations to construct a probability distribution, from which random samples are drawn and fed into the PAdaIN module. The structure of the feature extractor is illustrated in Figure 5. PAdaIN can be expressed as:
P A d a I N x = b x μ x σ x + a
where a and b indicate the random variables sampled from the mean and standard deviation distributions; and μ x and σ x indicate the mean and standard deviation. During training, the feature extractor computes the posterior distribution; during testing, it computes the prior distribution. In the training phase, a and b can be represented as:
a ~ N m μ y , x   , σ 2 y , x
b ~ N s m y , x   , v 2 y , x
In the testing phase, a and b can be represented as:
a ~ N m μ x   , σ 2 x
b ~ N s m x   , v 2 x
where N m and N s denote N-dimensional Gaussian distributions for the mean and standard deviation, respectively.

3.5. Loss Function

This study combines the Mean Squared Error (MSE) loss [42], VGG16 perceptual loss [43], KL divergence loss [44] and edge detection loss to synergistically enhance the model’s image enhancement effect.
Mean Squared Error loss is used to measure the pixel difference between the enhanced image and the reference image, with the following formula:
L M S E = 1 N i = 1 N y i y ^ i 2
where y i represents the pixel values of the reference image, y ^ i represents the pixel values of the enhanced image, and N represents the total number of pixels.
VGG16 perceptual loss is used to measure the difference between the enhanced image and the reference image in a higher feature dimension. Specifically, both the enhanced and reference images pass through the first 31 layers of the pretrained VGG16 network to extract high-level perceptual features; and then, the Mean Squared Error (MSE) between these feature representations is computed. The formula is as follows:
L V G G 16 = 1 N i = 1 N y i y ^ i 2
where · represents the feature vectors extracted through the VGG16 model, and N represents the total number of feature vectors.
KL divergence loss is used to measure the difference between the posterior distribution q z x and the prior distribution p z , so as to help the model learn more accurate representations in the latent space. The formula is as follows:
L K L = D K L q z x p z
where D K L represents the KL divergence. Specifically, the calculations of KL divergence include the following two components:
L m = D K L N m x N m y   , x
L s = D K L N s x N s y   , x
where N m and N s represent the Gaussian distributions of means and standard deviations, respectively.
To better preserve details and edge information, the edge detection loss is introduced in this study. Edge maps of the enhanced and reference images are extracted using a Laplacian edge detector, with the edge loss calculated as follows:
L e d g e = M S E E p r e d   , E t a r g e t
where L e d g e represents the edge loss; E p r e d and E t a r g e t represent the edge maps of the enhanced and reference images, respectively; and MSE represents the mean squared error.
The total loss function integrates the pixel difference, perceptual difference, distribution alignment, and edge information:
L = L M S E + L V G G 16 + L m + L s + L e d g e
By minimizing the total loss, the model is optimized at the pixel, feature, and distribution levels, therefore significantly enhancing the quality and robustness of image enhancement.

4. Experimental Results and Analysis

This section would, through a series of experiments, evaluate the performance of the proposed method. Both quantitative and qualitative comparison results of the image enhancement method proposed in this study would be presented against various models on multiple public datasets. Ablation studies are also conducted to demonstrate the effectiveness of each module in this study’s approach. To illustrate the model’s generalization and effectiveness in a better manner, additional experiments were conducted on image deraining and dehazing.

4.1. Datasets

Following the experimental settings provided in [45], this study used 800 pairs of real-world underwater images from the UIEB [17] dataset (each pair consisting of a degraded image and its corresponding reference image), together with 800 pairs of synthetic un-derwater images generated by CycleGan [46]. Therefore, a total of 1600 image pairs were utilized for the training. In the testing phase, eight datasets covering diverse scenes and task types were employed, including: (1) EUVP [47], LSUI [48], UFO-120 [49], and UIEB [17]: they are four mainstream UIE benchmark datasets with available reference images; (2) RUIE [16]: a no-reference UIE dataset collected from real-world underwater scenes; (3) AUDD [50] and DUO [51]: they are underwater object detection datasets; and (4) UOT32 [52]: an underwater object tracking dataset. Table 1 summarizes the detailed statistics of these datasets, and Figure 6 displays certain samples from each dataset.
Figure 7 compares the RGB channel distributions between the synthetic and real-world underwater datasets. As can be observed, the synthetic data exhibit smoother and more idealized color distributions, whereas the real-world underwater images show case greater variability and imbalance among color channels due to complex illumination and scattering effects. These findings indicates a clear domain gap between the synthetic and real-world data in terms of color distribution and contrast. Therefore, it is necessary to introduce of probabilistic modeling and adaptive fusion, in order to enhance cross-domain generalization.

4.2. Evaluation Metrics

To comprehensively evaluate the performance of the proposed model, both full-reference and no-reference evaluation metrics were employed. Full-reference metrics include Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM) [53]. A higher PSNR indicates that the output image is perceptually closer to the reference image, while a higher SSIM suggests greater structural similarity between them. The no-reference metric used is the Underwater Image Quality Measure (UIQM) [54], which combines Colorfulness Measure (UICM), Sharpness Measure (UISM), and Contrast Measure (UIConM). A higher UIQM indicates better visual quality.

4.3. Implementation Details

This study’s model was trained on images with a resolution of 256 × 256 pixels. First, the shortest side of the images was scaled to 256 pixels, and then regions of 256 × 256 were randomly cropped to ensure diversity and consistency in the input images so as to enhance the model’s generalization capability. The training process was conducted over 400 epochs, with a batch size of 4, on an NVIDIA GeForce RTX 3090 GPU with 24 GB of RAM (Nvidia Corporation, Santa Clara, CA, USA). The model construction and training were based on the Pytorch framework (version 1.11.0) [55], using the ADAM optimizer with a learning rate of 1 × 10 4 .

4.4. Comparison Methods

To comprehensively evaluate the performance of the proposed UIE method, four traditional unsupervised methods and seven deep learning methods were selected for comparison, covering the main research advancements in the field of UIE. For the traditional methods, UDCP [56], Fusion [25], Retinex [57], and Haze-line [14] were selected. UDCP used the dark channel prior to removing blue-green tones from underwater images; Fusion enhanced image quality through weighted mapping of multiple enhancement results; Retinex improved the contrast based on the separation of illumination and reflection; and Haze-line restored image colors by simplifying the attenuation ratio. For deep learning methods, this study selected UDnet [38], FUNIE-GAN [47], UGAN [6], CycleGan [46], U-Shape [48], PUGAN [58], and Mamba-UIE [59]. Specifically, UDnet is an unsupervised UIE method based on uncertainty modeling; FUNIE-GAN, UGAN, CycleGan, and PUGAN are UIE methods built on generative adversarial networks (GANs); U-Shape is a UIE method designed with a Transformer-based architecture; and Mamba-UIE is a recently developed UIE framework based on the Mamba architecture.
For a fair comparison, all deep learning models were retrained and evaluated on the same datasets. Each baseline deep learning model was strictly reproduced and trained following the parameter settings and training strategies given in their original publication, purposed to ensure that all models would be evaluated under their optimal performance conditions.

4.5. Quantitative Comparison

The quantitative comparison results on the eight datasets are summarized in Table 2, Table 3 and Table 4, where the red color indicates the best performance, the blue the second-best, and the green the third-best values for each metric. Given that no reference images were available for the datasets reported in Table 4, only the no-reference metric UIQM is used for the quantitative evaluation. It can be found that overall, the proposed MFP-PAINet achieved the best comprehensive performance across all the eight datasets, indicating its superior robustness and strong generalization ability under varying water types and illumination conditions.
On the EUVP and UFO-120 datasets, MFP-PAINet attained the highest SSIM values (0.735 and 0.741, respectively), and its PSNR and UIQM scores could be consistently ranked second. For example, on EUVP, its UIQM score of 3.051 was only slightly lower than that of UDnet (3.170). On LSUI dataset, MFP-PAINet achieved the highest PSNR (23.044), and its SSIM (0.854) was marginally lower than that of Mamba-UIE (0.877). Although its UIQM score on UIEB ranked third (2.980), its SSIM and PSNR values remained at a comparatively high level, demonstrating stable performance on this challenging dataset, which is representative of diverse underwater scenes and degradation patterns. On the no-reference datasets (Table 4), MFP-PAINet achieved the highest UIQM scores on RUIE and UOT32 (3.342 and 3.502, respectively), and remained close to the best performance on AUDD and DUO, indicating that even under significant distribution shifts and across heterogeneous underwater scenarios, the proposed model could maintain high perceptual quality, thus reflecting its strong generalization capability and robustness.
Furthermore, the computational complexity and parameter counts of different methods are reported in Table 5. As can be observed, the parameter size of MFP-PAINet (17.481 M) lies at a moderate level among all the compared models. Although its MACs are higher than those of some lightweight models (e.g., U-Shape), they remain substantially lower than those of the Mamba-UIE model. With both enhancement performance and model size considered, MFP-PAINet achieved a reasonable trade-off between computational cost and restoration quality.

4.6. Qualitative Comparison

The qualitative comparison results on the eight datasets are shown in Figure 8, Figure 9, Figure 10, Figure 11, Figure 12 and Figure 13, and they are further supported by the corresponding SSIM and UIQM values. Figure 8, Figure 9, Figure 10 and Figure 11 present the results on the datasets with reference images, whereas Figure 12 and Figure 13 correspond to the datasets without reference images. It can be found that overall, in all the competing methods tested, the proposed MFP-PAINet could most effectively mitigate image turbidity and color distortion, while producing more visually natural colors, better balanced contrast, and clearer structural details. By contrast, traditional UIE methods often exhibited over- or under-enhancement and pronounced color bias; on the other hand, although deep learning–based methods are superior to traditional approaches, they still suffered from varying degrees of color shifts and color artifacts.
On the EUVP dataset (see Figure 8), the results of UDCP and CycleGan exhibit an overall bluish-green color cast; Retinex and Haze-line tend to over-enhance the images; UDnet and UGAN render insufficient color restoration; and the enhancement results of FUNIE-GAN, U-Shape, and PUGAN showcase noticeable color deviations. Although Mamba-UIE yielded better visual results than the aforementioned methods, it was still inferior to MFP-PAINet in terms of color fidelity and local detail preservation. On the LSUI dataset (see Figure 9), the results produced by PUGAN display obvious color bias. On the UFO-120 dataset (see Figure 10), the enhanced images generated by UGAN, CycleGan, and Mamba-UIE retained a prominent bluish-green background, which was more evident in locally zoomed regions, while U-Shape and FUNIE-GAN introduce distinct color artifacts, again clearly visible in local enlargements. It can be concluded that overall, for the datasets with reference images, MFP-PAINet is visually the closest to the ground truth (GT) in terms of global tone, local texture, and perceptual naturalness, indicating that it possesses strong color restoration and detail reconstruction capabilities in complex underwater scenes. For the no-reference datasets, the enhancement results produced by deep learning–based UIE methods generally look more natural in visual perception and exhibit richer color content, whereas traditional UIE methods, such as UDCP and Haze-line, still suffer from a pronounced bluish-green background and noticeable color distortion.
To further verify the effect of uncertainty modeling in the UIE process, multiple potential candidate enhancement results are compared with the final enhanced output (Figure 14). As illustrated in Equations (7) and (8), the model can generate several potential enhancement candidates during the testing phase (six of which are shown in this study, denoted as Samples 1–6), while the final enhancement result (Sample 7) corresponds to the latent variable sample with the highest probability, as determined by Equation (3). To visually demonstrate the differences among these enhancement results, the PSNR heatmaps were computed and visualized for all the samples. As shown in Figure 14, distinct variations exist across different candidate samples, particularly in local regions. The final enhancement result, obtained based on Equation (3), achieved the highest PSNR value (24.60), indicating superior performance in terms of structural preservation and detail restoration. These findings validate that the proposed probabilistic modeling mechanism can effectively evaluate and sort out the optimal enhancement outcome, thereby improving the entire model’s stability and robustness under complex underwater conditions.

4.7. Ablation Studies

To validate the effectiveness of each module in MFP-PAINet, ablation studies were conducted on the LSUI dataset, with the results presented in Table 6 for the impact of removing different modules on network performance. The LSUI dataset was chosen for ablation studies because its rich, high-quality reference images and diverse underwater scenes provide ideal conditions for assessing the model’s performance in terms of detail preservation, structural similarity, and color restoration. As can be observed, compared to other datasets, the diversity and standards of LSUI better reveal the contributions of each module in image enhancement, making the experimental results more representative and persuasive.
When the probabilistic module was removed, SSIM and PSNR dropped to 0.841 and 21.963, respectively, indicating that the probabilistic module plays a key role in handling image uncertainty, enhancing structural similarity, and improving the signal-to-noise ratio. Removing the multi-dimensional feature mapping module drove SSIM and PSNR to decrease to 0.851 and 22.677, respectively. Although with weakened performance, the ablated model still closely approached the complete model in terms of performance. When the confidence generation module was removed, there was only a slight decrease in performance (SSIM of 0.851 and PSNR of 22.795), indicating that the confidence module mainly addressed the uncertainties in image enhancement initially. Keeping only the probabilistic module resulted in an SSIM and PSNR of 0.848 and 22.754, respectively, suggesting that while the probabilistic module could handle some uncertainties, it performed best when functioning with other modules. Overall, the complete network (SSIM of 0.854 and PSNR of 23.044) delivered the highest performance, validating the critical role of the synergy in enhancing image quality for the modules.

4.8. Extended Experiments

To further assess the generalization ability of MFP-PAINet, this study additionally evaluated it on image deraining (Rain1400 [60]) and dehazing (RESIDE [61]) tasks. SSIM, PSNR, and RMSE were used as the evaluation metrics, with the quantitative results shown in Table 7 and the qualitative results in Figure 15 and Figure 16.
As can be seen, on the Rain1400 deraining task, MFP-PAINet achieved the highest SSIM (0.900), indicating that its outputs are structurally closest to the reference images. In addition, its PSNR (28.214) and RMSE (10.421) were the second best, only slightly lower than those of Mamba-UIE (28.229 and 10.383, respectively). As shown in Figure 15, the derained results produced by MFP-PAINet and Mamba-UIE are visually closest to the ground truth, effectively removing rain streaks across the entire image, while preserving fine details and restoring natural colors in a better manner. In contrast, such traditional methods as UDCP and Haze-line failed to remove most rain streaks, but introduced noticeable color casts; on the other hand, although deep learning–based methods, such as UDnet, UGAN, and PUGAN, were able to eliminate a large portion of rain streaks, they still left residual streaks and showed limited detail recovery.
On the RESIDE dehazing task, MFP-PAINet attained the highest SSIM (0.920) again, and its PSNR (25.987) and RMSE (13.643) were close to those of Mamba-UIE (26.256 and 12.844, respectively), thus demonstrating its overall superior ability over traditional methods and other GAN-based approaches. As illustrated in Figure 16, MFP-PAINet provided the best performance in terms of detail and structural reconstruction, a result consistent with its leading SSIM score. By comparison, Fusion and Retinex almost failed to remove haze effectively, while UDCP and Haze-line introduced obvious artifacts and color shifts. Other deep learning–based methods, such as FUNIE-GAN and UGAN, delivered certain dehazing effects but still suffered from color artifacts and loss of fine details, especially in the locally enlarged regions.
It is important to note that MFP-PAINet is designed primarily for UIE tasks. The goal of the extended experiments as described in this section is not to emphasize its general applicability to other image enhancement tasks but to demonstrate its adaptability across different task scenarios. These experiments validate that MFP-PAINet not only performs excellently in UIE but can deliver superior performance in cross-task applications. The extended experiments in this section validate the generalization and high performance of MFP-PAINet and further reveal its practical application potential in other domains.

5. Conclusions

This study proposes MFP-PAINet, a UIE method based on multi-dimensional feature fusion and probabilistic adaptive uncertainty distribution to address the limitations of the existing methods in handling uncertainties and visual degradation. MFP-PAINet comprises three modules: a multi-dimensional feature mapping module, a confidence generation module, and a probabilistic module. Specifically, the multi-dimensional feature mapping module is used to capture and integrate higher-level features through a multi-scale feature fusion strategy and generate multi-dimensional feature mappings; the confidence generation module preliminarily addresses uncertainties in the enhancement process by dynamically weighting and fusing various feature mappings; and the probabilistic module further manages these uncertainties through the combination of CVAE and PAdaIN. Experimental results demonstrate that the model proposed in this study significantly outperforms the existing approaches in such metrics as SSIM, PSNR, and UIQM, with SSIM (0.854) and PSNR (23.044) delivered on the LSUI dataset, a performance surpassing other methods. Ablation studies validate the contribution of each module to the model’s performance, and extended experiments in image de-raining and de-hazing tasks further demonstrate the applicability and robustness of MFP-PAINet. While delivering superior structural clarity and perceptual quality, MFP-PAINet created slight fluctuations in color metrics (e.g., UIQM), suggesting a trade-off between structural fidelity and color accuracy. Moreover, the experiments in this study were conducted on publicly available datasets, which might fail to fully map the complexity of real-world underwater environments. Therefore, future efforts are needed to be focused on improving color consistency and further test the proposed method in practical underwater scenarios.

Author Contributions

S.W.: Writing—original draft, methodology, investigation, conceptualization. H.X.: Writing—review and editing, supervision, resources, funding acquisition. X.Z.: Resources, Writing—review and editing. Z.W.: Formal analysis, Resources. Z.Z.: Writing—review and editing, supervision, formal analysis, resources. X.W.: Investigation, Supervision, Writing—review and editing, formal analysis, resources. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Fundamental Research Funds for the Central Universities (Grant No. 106-YDZX2025022) and the Program for Student Innovation through Research and Training (Grant No. X2025103070785).

Data Availability Statement

Data are available on request.

Conflicts of Interest

Author Xinfei Zhou was employed by the company Nanjing Hundun Information Technology Co., Ltd. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. Jaffe, J.S. Underwater optical imaging: The past, the present, and the prospects. IEEE J. Ocean. Eng. 2014, 40, 683–700. [Google Scholar] [CrossRef]
  2. Sheinin, M.; Schechner, Y.Y. The next best underwater view. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016; pp. 3764–3773. [Google Scholar]
  3. Ludvigsen, M.; Sortland, B.; Johnsen, G.; Singh, H. Applications of geo-referenced underwater photo mosaics in marine biology and archaeology. Oceanography 2007, 20, 140–149. [Google Scholar] [CrossRef]
  4. Strachan, N.J.C. Recognition of fish species by colour and shape. Image Vis. Comput. 1993, 11, 2–10. [Google Scholar] [CrossRef]
  5. Yang, M.; Hu, J.; Li, C.; Rohde, G.; Du, Y.; Hu, K. An in-depth survey of underwater image enhancement and restoration. IEEE Access 2019, 7, 123638–123657. [Google Scholar] [CrossRef]
  6. Fabbri, C.; Islam, M.J.; Sattar, J. Enhancing underwater imagery using generative adversarial networks. In Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia, 21–25 May 2018; IEEE: New York, NY, USA, 2018; pp. 7159–7165. [Google Scholar]
  7. McGlamery, B.L. A computer model for underwater camera systems. In Proceedings of the Ocean Optics VI, Monterey, CA, USA, 23–25 October 1979; SPIE: Bellingham, WA, USA, 1980; Volume 208, pp. 221–231. [Google Scholar]
  8. Jaffe, J.S. Computer modeling and the design of optimal underwater imaging systems. IEEE J. Ocean. Eng. 1990, 15, 101–111. [Google Scholar] [CrossRef]
  9. Hou, W.; Woods, S.; Jarosz, E.; Goode, W.; Weidemann, A. Optical turbulence on underwater image degradation in natural environments. Appl. Opt. 2012, 51, 2678–2686. [Google Scholar] [CrossRef]
  10. Akkaynak, D.; Treibitz, T. A revised underwater image formation model. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–23 June 2018; pp. 6723–6732. [Google Scholar]
  11. Akkaynak, D.; Treibitz, T.; Shlesinger, T.; Loya, Y.; Tamir, R.; Iluz, D. What is the space of attenuation coefficients in underwater computer vision? In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 4931–4940. [Google Scholar]
  12. Guo, Y.; Li, H.; Zhuang, P. Underwater image enhancement using a multiscale dense generative adversarial network. IEEE J. Ocean. Eng. 2019, 45, 862–870. [Google Scholar] [CrossRef]
  13. Zhang, S.; Wang, T.; Dong, J.; Yu, H. Underwater image enhancement via extended multi-scale Retinex. Neurocomputing 2017, 245, 1–9. [Google Scholar] [CrossRef]
  14. Berman, D.; Levy, D.; Avidan, S.; Treibitz, T. Underwater single image color restoration using haze-lines and a new quantitative dataset. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 43, 2822–2837. [Google Scholar] [CrossRef]
  15. Bryson, M.; Johnson-Roberson, M.; Pizarro, O.; Williams, S.B. True color correction of autonomous underwater vehicle imagery. J. Field Robot. 2016, 33, 853–874. [Google Scholar] [CrossRef]
  16. Liu, R.; Fan, X.; Zhu, M.; Hou, M.; Luo, Z. Real-world underwater enhancement: Challenges, benchmarks, and solutions under natural light. IEEE Trans. Circuits Syst. Video Technol. 2020, 30, 4861–4875. [Google Scholar] [CrossRef]
  17. Li, C.; Guo, C.; Ren, W.; Cong, R.; Hou, J.; Kwong, S.; Tao, D. An underwater image enhancement benchmark dataset and beyond. IEEE Trans. Image Process. 2019, 29, 4376–4389. [Google Scholar] [CrossRef] [PubMed]
  18. Fu, Z.; Wang, W.; Huang, Y.; Ding, X.; Ma, K.-K. Uncertainty inspired underwater image enhancement. In Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel, 23–27 October 2022; Springer Nature Switzerland: Cham, Switzerland, 2022; pp. 465–482. [Google Scholar]
  19. Siddique, M.F.; Ahmad, Z.; Kim, J.M. Pipeline leak diagnosis based on leak-augmented scalograms and deep learning. Eng. Appl. Comput. Fluid Mech. 2023, 17, 2225577. [Google Scholar] [CrossRef]
  20. Siddique, M.F.; Zaman, W.; Umar, M.; Kim, J.-Y.; Kim, J.-M. A Hybrid Deep Learning Framework for Fault Diagnosis in Milling Machines. Sensors 2025, 25, 5866. [Google Scholar] [CrossRef]
  21. Sahu, P.; Gupta, N.; Sharma, N. A survey on underwater image enhancement techniques. Int. J. Comput. Appl. 2014, 87, 19–23. [Google Scholar] [CrossRef]
  22. Drews, P.L.J.; Nascimento, E.R.; Botelho, S.S.C.; Campos, M.F.M. Underwater depth estimation and image restoration based on single images. IEEE Comput. Graph. Appl. 2016, 36, 24–35. [Google Scholar] [CrossRef]
  23. Li, C.Y.; Guo, J.C.; Cong, R.M.; Pang, Y.-W.; Wang, B. Underwater image enhancement by dehazing with minimum information loss and histogram distribution prior. IEEE Trans. Image Process. 2016, 25, 5664–5677. [Google Scholar] [CrossRef] [PubMed]
  24. Peng, Y.T.; Cosman, P.C. Underwater image restoration based on image blurriness and light absorption. IEEE Trans. Image Process. 2017, 26, 1579–1594. [Google Scholar] [CrossRef]
  25. Ancuti, C.; Ancuti, C.O.; Haber, T.; Bekaert, P. Enhancing underwater images and videos by fusion. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012; IEEE: New York, NY, USA, 2012; pp. 81–88. [Google Scholar]
  26. Zhang, W.; Zhuang, P.; Sun, H.H.; Li, G.; Kwong, S.; Li, C. Underwater image enhancement via minimal color loss and locally adaptive contrast enhancement. IEEE Trans. Image Process. 2022, 31, 3997–4010. [Google Scholar] [CrossRef]
  27. He, K.; Sun, J.; Tang, X. Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 33, 2341–2353. [Google Scholar] [CrossRef]
  28. Peng, Y.T.; Cao, K.; Cosman, P.C. Generalization of the dark channel prior for single image restoration. IEEE Trans. Image Process. 2018, 27, 2856–2868. [Google Scholar] [CrossRef]
  29. Chiang, J.Y.; Chen, Y.C. Underwater image enhancement by wavelength compensation and dehazing. IEEE Trans. Image Process. 2011, 21, 1756–1769. [Google Scholar] [CrossRef] [PubMed]
  30. Galdran, A.; Pardo, D.; Picón, A.; Alvarez-Gila, A. Automatic red-channel underwater image restoration. J. Vis. Commun. Image Represent. 2015, 26, 132–145. [Google Scholar] [CrossRef]
  31. Li, C.; Anwar, S.; Porikli, F. Underwater scene prior inspired deep underwater image and video enhancement. Pattern Recognit. 2020, 98, 107038. [Google Scholar] [CrossRef]
  32. Li, C.; Anwar, S.; Hou, J.; Cong, R.; Guo, C.; Ren, W. Underwater image enhancement via medium transmission-guided multi-color space embedding. IEEE Trans. Image Process. 2021, 30, 4985–5000. [Google Scholar] [CrossRef]
  33. Naik, A.; Swarnakar, A.; Mittal, K. Shallow-uwnet: Compressed model for underwater image enhancement (student abstract). In Proceedings of the AAAI Conference on Artificial Intelligence, Virtual, 2–9 February 2021; Volume 35, pp. 15853–15854. [Google Scholar]
  34. Li, C.; Guo, J.; Guo, C. Emerging from water: Underwater image color correction based on weakly supervised color transfer. IEEE Signal Process. Lett. 2018, 25, 323–327. [Google Scholar] [CrossRef]
  35. Jiang, Z.; Li, Z.; Yang, S.; Fan, X.; Liu, R. Target oriented perceptual adversarial fusion network for underwater image enhancement. IEEE Trans. Circuits Syst. Video Technol. 2022, 32, 6584–6598. [Google Scholar] [CrossRef]
  36. Rezende, D.J.; Mohamed, S.; Wierstra, D. Stochastic backpropagation and approximate inference in deep generative models. In Proceedings of the International Conference on Machine Learning, PMLR, Beijing, China, 21–26 June 2014; pp. 1278–1286. [Google Scholar]
  37. Sohn, K.; Lee, H.; Yan, X. Learning structured output representation using deep conditional generative models. In Advances in Neural Information Processing Systems 28, Proceedings of the 29th International Conference on Neural Information Processing Systems, Montreal, Canada, 7–12 December 2015; Curran Associates, Inc.: Red Hook, NY, USA, 2016. [Google Scholar]
  38. Saleh, A.; Sheaves, M.; Jerry, D.; Azghadi, M.R. Adaptive deep learning framework for robust unsupervised underwater image enhancement. Expert Syst. Appl. 2025, 268, 126314. [Google Scholar] [CrossRef]
  39. Chen, L.C.; Zhu, Y.; Papandreou, G.; Schroff, F.; Adam, H. Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018; pp. 801–818. [Google Scholar]
  40. Hu, J.; Shen, L.; Sun, G. Squeeze-and-excitation networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–23 June 2018; pp. 7132–7141. [Google Scholar]
  41. Ronneberger, O.; Fischer, P.; Brox, T. U-net: Convolutional networks for biomedical image segmentation. In Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, 5–9 October 2015; Proceedings, Part III 18. Springer International Publishing: Cham, Switzerland, 2015; pp. 234–241. [Google Scholar]
  42. LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436–444. [Google Scholar] [CrossRef]
  43. Johnson, J.; Alahi, A.; Li, F.-F. Perceptual losses for real-time style transfer and super-resolution. In Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands, 11–14 October 2016; Springer International Publishing: Cham, Switzerland, 2016; pp. 694–711. [Google Scholar]
  44. Kingma, D.P.; Welling, M. Auto-encoding variational bayes. arXiv 2013, arXiv:1312.6114. [Google Scholar]
  45. Huang, S.; Wang, K.; Liu, H.; Chen, J.; Li, Y. Contrastive semi-supervised learning for underwater image restoration via reliable bank. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 17–24 June 2023; pp. 18145–18155. [Google Scholar]
  46. Zhu, J.Y.; Park, T.; Isola, P.; Efros, A.A. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 22–29 October 2017; pp. 2223–2232. [Google Scholar]
  47. Islam, M.J.; Xia, Y.; Sattar, J. Fast underwater image enhancement for improved visual perception. IEEE Robot. Autom. Lett. 2020, 5, 3227–3234. [Google Scholar] [CrossRef]
  48. Peng, L.; Zhu, C.; Bian, L. U-shape transformer for underwater image enhancement. IEEE Trans. Image Process. 2023, 32, 3066–3079. [Google Scholar] [CrossRef]
  49. Islam, M.J.; Luo, P.; Sattar, J. Simultaneous enhancement and super-resolution of underwater imagery for improved visual perception. arXiv 2020, arXiv:2002.01155. [Google Scholar] [CrossRef]
  50. Liu, C.; Wang, Z.; Wang, S.; Tang, T.; Tao, Y.; Yang, C.; Li, H.; Liu, X.; Fan, X. A new dataset, Poisson GAN and AquaNet for underwater object grabbing. IEEE Trans. Circuits Syst. Video Technol. 2021, 32, 2831–2844. [Google Scholar] [CrossRef]
  51. Liu, C.; Li, H.; Wang, S.; Zhu, M.; Wang, D.; Fan, X.; Wang, Z. A dataset and benchmark of underwater object detection for robot picking. In Proceedings of the 2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Shenzhen, China, 5–9 July 2021; IEEE: New York, NY, USA, 2021; pp. 1–6. [Google Scholar]
  52. Kezebou, L.; Oludare, V.; Panetta, K.; Agaian, S.S. Underwater object tracking benchmark and dataset. In Proceedings of the 2019 IEEE International Symposium on Technologies for Homeland Security (HST), Woburn, MA, USA, 5–6 November 2019; IEEE: New York, NY, USA, 2019; pp. 1–6. [Google Scholar]
  53. Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef]
  54. Panetta, K.; Gao, C.; Agaian, S. Human-visual-system-inspired underwater image quality measures. IEEE J. Ocean. Eng. 2015, 41, 541–551. [Google Scholar] [CrossRef]
  55. Paszke, A.; Gross, S.; Massa, F.; Lerer, A.; Bradbury, J.; Chanan, G.; Killeen, T.; Lin, Z.; Gimelshein, N.; Antiga, L.; et al. Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems 32, Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, Canada, 8-14 December 2019; Curran Associates, Inc.: Red Hook, NY, USA, 2020. [Google Scholar]
  56. Drews, P.; Nascimento, E.; Moraes, F.; Botelho, S.; Campos, M. Transmission estimation in underwater single images. In Proceedings of the IEEE International Conference on Computer Vision Workshops, Sydney, Australia, 2–8 December 2013; pp. 825–830. [Google Scholar]
  57. Fu, X.; Zhuang, P.; Huang, Y.; Liao, Y.; Zhang, X.-P.; Ding, X. A retinex-based enhancing approach for single underwater image. In Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France, 27–30 October 2014; IEEE: New York, NY, USA, 2014; pp. 4572–4576. [Google Scholar]
  58. Cong, R.; Yang, W.; Zhang, W.; Li, C.; Guo, C.-L.; Huang, Q.; Kwong, S. Pugan: Physical model-guided underwater image enhancement using gan with dual-discriminators. IEEE Trans. Image Process. 2023, 32, 4472–4485. [Google Scholar] [CrossRef]
  59. Zhang, S.; Duan, Y.; Li, D.; Zhao, R. Mamba-uie: Enhancing underwater images with physical model constraint. arXiv 2024, arXiv:2407.19248. [Google Scholar] [CrossRef]
  60. Fu, X.; Huang, J.; Zeng, D.; Huang, Y.; Ding, X.; Paisley, J. Removing rain from single images via a deep detail network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 3855–3863. [Google Scholar]
  61. Li, B.; Ren, W.; Fu, D.; Zeng, W.; Wang, Z. Benchmarking single-image dehazing and beyond. IEEE Trans. Image Process. 2018, 28, 492–505. [Google Scholar] [CrossRef]
Figure 1. Overall Structure of MFP-PAINet. R H E , R W B , and R G C indicate the feature mappings of I H E I R A W , I W B I R A W , and I G C I R A W , respectively, processed by the multi-dimensional feature mapping module. R R A W _ M A P , R H E _ M A P , R W B _ M A P , and R G C _ M A P indicate the feature mappings of I R A W , I H E , I W B , and I G C after processed by the multi-dimensional feature mapping module, which are then inputted into the confidence generation module to generate the confidence maps C H E , C W B , and C G C . I R A W indicates the original distorted underwater image; and I H E , I W B , and I G C indicate the results of implementing histogram equalization, white balance correction, and gamma correction to I R A W , respectively.
Figure 1. Overall Structure of MFP-PAINet. R H E , R W B , and R G C indicate the feature mappings of I H E I R A W , I W B I R A W , and I G C I R A W , respectively, processed by the multi-dimensional feature mapping module. R R A W _ M A P , R H E _ M A P , R W B _ M A P , and R G C _ M A P indicate the feature mappings of I R A W , I H E , I W B , and I G C after processed by the multi-dimensional feature mapping module, which are then inputted into the confidence generation module to generate the confidence maps C H E , C W B , and C G C . I R A W indicates the original distorted underwater image; and I H E , I W B , and I G C indicate the results of implementing histogram equalization, white balance correction, and gamma correction to I R A W , respectively.
Jmse 13 02250 g001
Figure 2. Comparison of the workflow between the proposed MFP-PAINet and existing probabilistic uncertainty modeling methods.
Figure 2. Comparison of the workflow between the proposed MFP-PAINet and existing probabilistic uncertainty modeling methods.
Jmse 13 02250 g002
Figure 3. Multi-dimensional Feature Extraction Module. The multi-branch module consists of three branches, each containing 1 × 1, 3 × 3, and 5 × 5 convolutional layers, followed by batch normalization and ReLU activation layers to extract features at different scales. As a commonly used nonlinear activation function, ReLU enhances the network’s nonlinear representation capability and accelerates the model’s convergence. The outputs are finally merged through residual connections. The ASPP module includes 1 × 1 convolution and several 3 × 3 convolutional layers with different dilation rates (1, 6, 12, and 18) to capture multi-scale contextual information. The integrated feature maps are further processed through convolution, batch normalization, and ReLU activation layers to ultimately generate multi-dimensional feature representations.
Figure 3. Multi-dimensional Feature Extraction Module. The multi-branch module consists of three branches, each containing 1 × 1, 3 × 3, and 5 × 5 convolutional layers, followed by batch normalization and ReLU activation layers to extract features at different scales. As a commonly used nonlinear activation function, ReLU enhances the network’s nonlinear representation capability and accelerates the model’s convergence. The outputs are finally merged through residual connections. The ASPP module includes 1 × 1 convolution and several 3 × 3 convolutional layers with different dilation rates (1, 6, 12, and 18) to capture multi-scale contextual information. The integrated feature maps are further processed through convolution, batch normalization, and ReLU activation layers to ultimately generate multi-dimensional feature representations.
Jmse 13 02250 g003
Figure 4. Confidence Generation Network. This module consists of 5 pairs of encoder–decoder structures. Each encoder and decoder includes convolutional layers, batch normalization layers, activation layers and residual blocks to ensure effective feature extraction and representation. In addition, the decoder incorporates an SE attention mechanism to enhance focus on key features. Finally, the Split operation is implemented to process the feature maps within the module, finally acquiring three different confidence maps.
Figure 4. Confidence Generation Network. This module consists of 5 pairs of encoder–decoder structures. Each encoder and decoder includes convolutional layers, batch normalization layers, activation layers and residual blocks to ensure effective feature extraction and representation. In addition, the decoder incorporates an SE attention mechanism to enhance focus on key features. Finally, the Split operation is implemented to process the feature maps within the module, finally acquiring three different confidence maps.
Jmse 13 02250 g004
Figure 5. The feature extractor consists of convolutional layers, pooling layers, and residual blocks. It can extract four different scales of feature maps as input for constructing the probability distribution.
Figure 5. The feature extractor consists of convolutional layers, pooling layers, and residual blocks. It can extract four different scales of feature maps as input for constructing the probability distribution.
Jmse 13 02250 g005
Figure 6. Example images abstracted from each dataset. The first row shows the degraded images, and the second the corresponding reference ones (Note: no reference images are available for RUIE, AUDD, DUO, and UOT32).
Figure 6. Example images abstracted from each dataset. The first row shows the degraded images, and the second the corresponding reference ones (Note: no reference images are available for RUIE, AUDD, DUO, and UOT32).
Jmse 13 02250 g006
Figure 7. Average RGB distribution statistics on the training datasets: (a,b) represent the synthetic dataset’s distorted images and corresponding ground-truth images, respectively; and (c,d) represent the UIEB dataset’s distorted images and ground-truth images, respectively.
Figure 7. Average RGB distribution statistics on the training datasets: (a,b) represent the synthetic dataset’s distorted images and corresponding ground-truth images, respectively; and (c,d) represent the UIEB dataset’s distorted images and ground-truth images, respectively.
Jmse 13 02250 g007
Figure 8. Enhancement results on the EUVP dataset.
Figure 8. Enhancement results on the EUVP dataset.
Jmse 13 02250 g008
Figure 9. Enhancement results on the LSUI dataset.
Figure 9. Enhancement results on the LSUI dataset.
Jmse 13 02250 g009
Figure 10. Enhancement results on the UFO-120 dataset.
Figure 10. Enhancement results on the UFO-120 dataset.
Jmse 13 02250 g010
Figure 11. Enhancement results on the UIEB dataset.
Figure 11. Enhancement results on the UIEB dataset.
Jmse 13 02250 g011
Figure 12. Enhancement results on the AUDD and DUO datasets.
Figure 12. Enhancement results on the AUDD and DUO datasets.
Jmse 13 02250 g012
Figure 13. Enhancement results on the RUIE and UOT32 datasets.
Figure 13. Enhancement results on the RUIE and UOT32 datasets.
Jmse 13 02250 g013
Figure 14. Comparison of candidate enhancement samples and the final result with corresponding PSNR heatmap visualization.
Figure 14. Comparison of candidate enhancement samples and the final result with corresponding PSNR heatmap visualization.
Jmse 13 02250 g014
Figure 15. Qualitative results of image deraining.
Figure 15. Qualitative results of image deraining.
Jmse 13 02250 g015
Figure 16. Qualitative results of image dehazing.
Figure 16. Qualitative results of image dehazing.
Jmse 13 02250 g016
Table 1. Summary of the datasets used in this study (including the numbers of image pairs).
Table 1. Summary of the datasets used in this study (including the numbers of image pairs).
PhaseDatasetReference TypeImages
TrainingSyntheticPaired800
UIEBPaired800
Testing—ReferenceEUVPPaired500
LSUIPaired500
UFO-120Paired120
UIEBPaired90
Testing—No-referenceAUDDUnpaired100
DUOUnpaired100
RUIEUnpaired100
UOT32Unpaired100
Table 2. Quantitative comparison on EUVP and LSUI datasets (red indicates the best performance, blue the second-best, and green the third-best values; denotes that higher values correspond to better performance; the same notation applies to remaining tables).
Table 2. Quantitative comparison on EUVP and LSUI datasets (red indicates the best performance, blue the second-best, and green the third-best values; denotes that higher values correspond to better performance; the same notation applies to remaining tables).
MethodEUVPLSUI
SSIM   PSNR   UIQM   SSIM   PSNR   UIQM  
UDCP0.72319.0992.3060.68213.3982.326
Fusion0.72617.0873.0430.77317.6322.941
Retinex0.53811.2723.0090.72713.9813.015
Haze-line0.69616.8632.2890.69714.5542.386
UDnet0.72219.2783.1700.82920.7123.119
FUNIE-GAN0.70118.3563.0450.77919.1463.083
UGAN0.72118.6593.0260.84222.6253.091
CycleGan0.72219.7302.8660.78720.4842.963
U-Shape0.72318.7122.9140.84621.9612.998
PUGAN0.66616.5232.9290.76619.6383.003
Mamba-UIE0.72918.3262.9110.87722.9672.949
Ours0.73519.5013.0510.85423.0443.056
Table 3. Quantitative comparison on UFO-120 and UIEB datasets.
Table 3. Quantitative comparison on UFO-120 and UIEB datasets.
MethodUFO-120UIEB
SSIM  PSNR  UIQM  SSIM   PSNR   UIQM  
UDCP0.72318.7272.3240.66314.6582.287
Fusion0.73317.3512.9760.75517.2622.834
Retinex0.63212.7142.9560.53910.4612.805
Haze-line0.69115.3102.2040.69316.1702.304
UDnet0.72818.8443.1130.77318.9623.000
FUNIE-GAN0.71218.7272.9920.76818.5732.968
UGAN0.72618.7882.9660.81221.2883.005
CycleGan0.72619.3882.8360.75119.7792.765
U-Shape0.71818.8132.8410.81121.0002.947
PUGAN0.66616.6132.790.73118.3812.785
Mamba-UIE0.73118.1202.8450.85021.7812.843
Ours0.74119.3592.9910.81020.5692.980
Table 4. Quantitative comparison on AUDD, DUO, RUIE, and UOT32 datasets.
Table 4. Quantitative comparison on AUDD, DUO, RUIE, and UOT32 datasets.
MethodAUDDDUORUIEUOT32
UIQM  UIQM   UIQM   UIQM  
UDCP2.6743.0722.6173.055
Fusion3.1613.4843.3033.355
Retinex3.2273.4173.1963.084
Haze-line2.6712.5822.6282.907
UDnet3.2833.4533.3383.483
FUNIE-GAN3.1643.4133.1553.207
UGAN3.1513.4733.2133.289
CycleGan2.9433.1543.0733.171
U-Shape3.2093.2073.1503.069
PUGAN3.1023.4443.1942.677
Mamba-UIE3.0853.3843.0853.092
Ours3.2343.4673.3423.502
Table 5. Comparison of MACs (Multiply–Accumulate Operations) and Parameters between Different Methods.
Table 5. Comparison of MACs (Multiply–Accumulate Operations) and Parameters between Different Methods.
UDnetFUNIE-GANUGANCycleGanU-ShapePUGANMamba-UIEOurs
MACs (G)30.15010.69519.82056.8642.98575.400381.569211.204
Params (M)1.4027.71657.16911.37822.817101.1876.04617.481
Table 6. Ablation Study Results: Comparison of Metrics Across Different Baselines on the LSUI Dataset.
Table 6. Ablation Study Results: Comparison of Metrics Across Different Baselines on the LSUI Dataset.
Multi-dimensional Feature Mapping ModuleConfidence Generation ModuleProbabilistic Module SSIM   PSNR  
0.84121.963
0.85122.677
0.85122.795
0.84822.754
0.85423.044
Table 7. Quantitative results for image deraining and dehazing. lowest value.
Table 7. Quantitative results for image deraining and dehazing. lowest value.
MethodRain1400 (Deraining)RESIDE (Dehazing)
SSIM   PSNR   RMSE   SSIM   PSNR   RMSE  
UDCP0.65318.41932.5940.70416.96437.842
Fusion0.70418.50131.4840.63210.84176.369
Retinex0.5128.36899.1660.63411.30971.816
Haze-line0.69717.52936.1900.63611.30873.775
UDnet0.73320.46925.6530.78716.72641.160
FUNIE-GAN0.84226.68712.2470.85025.93813.349
UGAN0.82126.28212.7320.81924.47115.774
CycleGan0.85828.18610.6100.82621.91422.411
U-Shape0.82026.88112.0240.84427.84310.640
PUGAN0.78424.49115.8060.78720.94424.103
Mamba-UIE0.89428.22910.3830.89726.25612.844
Ours0.90028.21410.4210.92025.98713.643
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wu, S.; Xu, H.; Zhou, X.; Wan, Z.; Zhai, Z.; Wu, X. MFP-PAINet: Enhancing Underwater Images Through Multi-Dimensional Feature Fusion and Probabilistic Uncertainty Modeling. J. Mar. Sci. Eng. 2025, 13, 2250. https://doi.org/10.3390/jmse13122250

AMA Style

Wu S, Xu H, Zhou X, Wan Z, Zhai Z, Wu X. MFP-PAINet: Enhancing Underwater Images Through Multi-Dimensional Feature Fusion and Probabilistic Uncertainty Modeling. Journal of Marine Science and Engineering. 2025; 13(12):2250. https://doi.org/10.3390/jmse13122250

Chicago/Turabian Style

Wu, Shuangquan, Huanliang Xu, Xinfei Zhou, Zhuobing Wan, Zhaoyu Zhai, and Xuehui Wu. 2025. "MFP-PAINet: Enhancing Underwater Images Through Multi-Dimensional Feature Fusion and Probabilistic Uncertainty Modeling" Journal of Marine Science and Engineering 13, no. 12: 2250. https://doi.org/10.3390/jmse13122250

APA Style

Wu, S., Xu, H., Zhou, X., Wan, Z., Zhai, Z., & Wu, X. (2025). MFP-PAINet: Enhancing Underwater Images Through Multi-Dimensional Feature Fusion and Probabilistic Uncertainty Modeling. Journal of Marine Science and Engineering, 13(12), 2250. https://doi.org/10.3390/jmse13122250

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop