LABFNet: A Restoration Network Guided by the LAB Colour Space and Frequency-Domain Constraints
Abstract
1. Introduction
- We propose LABFNet, a novel mural-restoration model that incorporates LAB colour parameters and frequency-domain constraints to reduce colour deviation and improve frequency consistency during restoration.
- We introduce LAB colour-space parameters by converting mural images from RGB to LAB, thereby strengthening inter-channel colour correlation. Information from the A and B channels is used to guide colour restoration during image generation.
- We introduce frequency-domain constraints by decomposing mural images into low- and high-frequency components and enforcing frequency consistency during restoration, thereby guiding the generation of more realistic high-frequency details.
2. Methods
2.1. Overview
2.2. LAB Space Loss
2.3. Frequency-Domain Loss
2.4. Overall Loss
- (1)
- Dynamic task balance: Different loss terms have disparate value magnitudes and optimisation convergence speeds. Fixed manual weights cannot adapt to training stage changes; homoscedastic uncertainty automatically assigns larger weights to loss branches with higher reconstruction uncertainty at each iteration, dynamically balancing colour restoration, frequency consistency, and spatial reconstruction objectives without manual hyperparameter tuning.
- (2)
- Objective-driven optimisation: The weight learning process is fully data-driven rather than artificially predefined, eliminating arbitrary loss combination bias, ensuring the overall objective function always optimises the mural restoration task from the joint perspective of colour perception, frequency features, and pixel reconstruction.
2.5. Compared Methods
2.6. Evaluation Metrics
3. Results
3.1. Experimental Settings
3.1.1. Datasets
3.1.2. Implementation Details
3.2. Quantitative Evaluation
3.3. Qualitative Evaluation
3.4. Ablation Study
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
| RGB | Red–Green–Blue |
| LABFNet | Laboratory frequency network |
| LAB | Laboratory |
| PSNR | Peak Signal-to-Noise Ratio |
| SSIM | Structural Similarity |
| MAE | Mean Absolute Error |
| LPIPS | Learned Perceptual Image Patch Similarity |
| CNN | Convolutional Neural Network |
| U-Net | U-shaped Network |
| GAN | Generative Adversarial Network |
| CMAMR | Contextual Mask-Aware Mural Restoration |
| MSE | Mean Squared Error |
| FDIT | frequency domain image translation |
| FFT | Fast Fourier Transform |
| MISF | Multi-level Interactive Siamese Filtering |
| HINT | Hypernetwork Instruction Tuning |
| GT | Ground truth |
| Fre | Frequency-domain |
References
- Wang, Y.; Wu, X. Current Progress on Murals: Distribution, Conservation and Utilization. Herit. Sci. 2023, 11, 61. [Google Scholar] [CrossRef] [PubMed]
- Li, J.; Zhang, H.; Fan, Z.; He, X.; He, S.; Sun, M.; Ma, Y.; Fang, S.; Zhang, H.; Zhang, B. Investigation of the Renewed Diseases on Murals at Mogao Grottoes. Herit. Sci. 2013, 1, 1–9. [Google Scholar] [CrossRef]
- Blau, Y.; Michaeli, T. The Perception-Distortion Tradeoff. In 2018 IEEE Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2018. [Google Scholar]
- Bai, J.; Yin, Y.; Dong, Y.; Zhang, X.; Pun, C.-M.; Chen, X. Lensnet: An End-to-End Learning Framework for Empirical Point Spread Function Modeling and Lensless Imaging Reconstruction. arXiv 2025, arXiv:2505.01755. [Google Scholar]
- Xia, J.; Bai, J.; Dong, Y. Dlen: Dual Branch of Transformer for Low-Light Image Enhancement in Dual Domains. In Proceedings of the 2025 International Joint Conference on Neural Networks (IJCNN); IEEE: New York, NY, USA, 2025. [Google Scholar]
- Yu, J.; Lin, Z.; Yang, J.; Shen, X.; Lu, X.; Huang, T.S. Free-Form Image Inpainting with Gated Convolution. In Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision; IEEE: New York, NY, USA, 2019. [Google Scholar]
- Hong, X.; Xiong, P.; Ji, R.; Fan, H. Deep Fusion Network for Image Completion. In MM’19: Proceedings of the 27th ACM International Conference on Multimedia; Association for Computing Machinery: New York, NY, USA, 2019. [Google Scholar]
- Pathak, D.; Krahenbuhl, P.; Donahue, J.; Darrell, T.; Efros, A.A. Context Encoders: Feature Learning by Inpainting. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2016. [Google Scholar]
- Liu, G.; Reda, F.A.; Shih, K.J.; Wang, T.-C.; Tao, A.; Catanzaro, B. Image Inpainting for Irregular Holes Using Partial Convolutions. In Proceedings of the Computer Vision—ECCV 2018 European Conference on Computer Vision (ECCV); Springer: Cham, Switzerland, 2018. [Google Scholar]
- Nazeri, K.; Ng, E.; Joseph, T.; Qureshi, F.Z.; Ebrahimi, M. Edgeconnect: Generative Image Inpainting with Adversarial Edge Learning. arXiv 2019, arXiv:1901.00212. [Google Scholar]
- Song, L.; Cao, J.; Song, L.; Hu, Y.; He, R. Geometry-Aware Face Completion and Editing. In Proceedings of the AAAI’19: AAAI Conference on Artificial Intelligence; Association for the Advancement of Artificial Intelligence: Washington, DC, USA, 2019. [Google Scholar]
- Chang, Y.-L.; Liu, Z.Y.; Lee, K.-Y.; Hsu, W. Free-Form Video Inpainting with 3d Gated Convolution and Temporal Patchgan. In Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision; IEEE: New York, NY, USA, 2019. [Google Scholar]
- Goodfellow, I.J.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative Adversarial Nets. In Advances in Neural Information Processing Systems; Curran Associates, Inc.: San Francisco, CA, USA, 2014; Volume 27. [Google Scholar]
- Wang, Y.; Tao, X.; Qi, X.; Shen, X.; Jia, J. Image Inpainting Via Generative Multi-Column Convolutional Neural Networks. In Advances in Neural Information Processing Systems; Curran Associates, Inc.: San Francisco, CA, USA, 2018; Volume 31. [Google Scholar]
- Deng, X.; Yang, R.; Xu, M.; Dragotti, P.L. Wavelet Domain Style Transfer for an Effective Perception-Distortion Tradeoff in Single Image Super-Resolution. In Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision; IEEE: New York, NY, USA, 2019. [Google Scholar]
- Zeng, Y.; Gong, Y.; Zhang, J. Feature Learning and Patch Matching for Diverse Image Inpainting. Pattern Recognit. 2021, 119, 108036. [Google Scholar] [CrossRef]
- Sajjadi, M.S.M.; Scholkopf, B.; Hirsch, M. Enhancenet: Single Image Super-Resolution through Automated Texture Synthesis. In Proceedings of the 2017 IEEE International Conference on Computer Vision; IEEE: New York, NY, USA, 2017. [Google Scholar]
- Deng, Y.; Hui, S.; Zhou, S.; Meng, D.; Wang, J. T-Former: An Efficient Transformer for Image Inpainting. In MM’22: Proceedings of the 30th ACM International Conference on Multimedia; Association for Computing Machinery: New York, NY, USA, 2022. [Google Scholar]
- Chen, S.; Atapour-Abarghouei, A.; Shum, H.P.H. Hint: High-Quality Inpainting Transformer with Mask-Aware Encoding and Enhanced Attention. IEEE Trans. Multimed. 2024, 26, 7649–7660. [Google Scholar] [CrossRef]
- Shamsolmoali, P.; Zareapoor, M.; Zhou, H.; Li, X.; Lu, Y. Distance-Based Weighted Transformer Network for Image Completion. Pattern Recognit. 2024, 147, 110120. [Google Scholar] [CrossRef]
- Wu, J.; Feng, Y.; Xu, H.; Zhu, C.; Zheng, J. Syformer: Structure-Guided Synergism Transformer for Large-Portion Image Inpainting. In AAAI’24: AAAI Conference on Artificial Intelligence; Association for the Advancement of Artificial Intelligence: Washington, DC, USA, 2024. [Google Scholar]
- Xiao, J.; Fu, X.; Zhou, M.; Liu, H.; Zha, Z.-J. Random Shuffle Transformer for Image Restoration. In Proceedings of the 40th International Conference on Machine Learning; PMLR: New York, NY, USA, 2023. [Google Scholar]
- Yeo, W.-H.; Ryu, H.-C. An Integration Framework for the Inpainting and Colorization of Arbitrary Masked Grayscale Images. Appl. Sci. 2025, 15, 1978. [Google Scholar] [CrossRef]
- Li, Z.; Han, N.; Wang, Y.; Zhang, Y.; Yan, J.; Du, Y.; Geng, G. Image Inpainting Based on Cnn-Transformer Framework Via Structure and Texture Restoration. Appl. Soft Comput. 2025, 170, 112671. [Google Scholar] [CrossRef]
- Yang, C.; Liang, L.; Su, Z. Real-World Denoising Via Diffusion Model. arXiv 2023, arXiv:2305.04457. [Google Scholar]
- Li, T.; Feng, H.; Wang, L.; Zhu, L.; Xiong, Z.; Huang, H. Stimulating Diffusion Model for Image Denoising Via Adaptive Embedding and Ensembling. IEEE Trans. Pattern Anal. Mach. Intell. 2024, 46, 8240–8257. [Google Scholar] [CrossRef] [PubMed]
- Li, L.; Zou, Q.; Zhang, F.; Yu, H.; Chen, L.; Song, C.; Huang, X.; Wang, X.; Li, Q. Line Drawing-Guided Progressive Inpainting for Mural Damage. ACM J. Comput. Cult. Herit. 2025, 18, 1–20. [Google Scholar] [CrossRef]
- Xin, D.; Ren, Y.; Mai, X.; Pier Luigi, D. Wavelet domain style transfer for an effective perception distortion tradeoff in single image super-resolution. In Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea, 27 October–2 November 2019; IEEE: Piscataway, NJ, USA, 2020. [Google Scholar]
- Meng, W.; Wang, H.; Yang, W. Perceptual Uniform Simulation for Tang Tomb Mural Inapinting by Camera Array. Int. J. Simul. Syst. Sci. Technol. 2016, 17, 5.1. [Google Scholar] [CrossRef]
- Ren, Y.; Yu, X.; Zhang, R.; Li, T.H.; Liu, S.; Li, G. Structureflow: Image Inpainting Via Structure-Aware Appearance Flow. In Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision; IEEE: New York, NY, USA, 2019. [Google Scholar]
- Suvorov, R.; Logacheva, E.; Mashikhin, A.; Remizova, A.; Ashukha, A.; Silvestrov, A.; Kong, N.; Goka, H.; Park, K.; Lempitsky, V. Resolution-Robust Large Mask Inpainting with Fourier Convolutions. In Proceedings of the 2022 IEEE/CVF Winter Conference on Applications of Computer Vision; IEEE: New York, NY, USA, 2022. [Google Scholar]
- Yu, Y.; Zhan, F.; Lu, S.; Pan, J.; Ma, F.; Xie, X.; Miao, C. Wavefill: A Wavelet-Based Generation Network for Image Inpainting. In Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision; IEEE: New York, NY, USA, 2021. [Google Scholar]
- Lei, Y.; Yi, F.; Dong, Y.; Liu, W.; Zhang, X.; Li, Z.; Pun, C.-M.; Chen, X. Cmamrnet: A Contextual Mask-Aware Network Enhancing Mural Restoration through Comprehensive Mask Guidance. arXiv 2025, arXiv:2508.07140. [Google Scholar]
- Mefteh, S.; Kaâniche, M.B.; Ksantini, R.; Bouhoula, A. A Novel Multispectral Lab-Depth Based Edge Detector for Color Images with Occluded Objects. In VISIGRAPP 2019 (4: VISAPP); SciTePress: Setúbal, Portugal, 2019. [Google Scholar]
- Wyszecki, G.; Stiles, W.S. Color Science: Concepts and Methods, Quantitative Data and Formulae; John Wiley & Sons: Hoboken, NJ, USA, 2000. [Google Scholar]
- Roy, H.; Chaudhury, S.; Yamasaki, T.; Hashimoto, T. Image Inpainting Using Frequency-Domain Priors. J. Electron. Imaging 2021, 30, 023016. [Google Scholar] [CrossRef]
- Cai, M.; Zhang, H.; Huang, H.; Geng, Q.; Li, Y.; Huang, G. Frequency Domain Image Translation: More Photo-Realistic, Better Identity-Preserving. In Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision; IEEE: New York, NY, USA, 2021. [Google Scholar]
- Kendall, A.; Gal, Y.; Cipolla, R. Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics. In Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2018. [Google Scholar]
- Li, X.; Guo, Q.; Lin, D.; Li, P.; Feng, W.; Wang, S. Misf: Multi-Level Interactive Siamese Filtering for High-Fidelity Image Inpainting. In Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2022. [Google Scholar]
- Xu, Z.; Yang, Y.; Fang, Q.; Chen, W.; Xu, T.; Liu, J.; Wang, Z. A Comprehensive Dataset for Digital Restoration of Dunhuang Murals. Sci. Data 2024, 11, 955. [Google Scholar] [CrossRef]
- Yu, T.; Zhang, S.; Lin, C.; You, S.; Wu, J.; Zhang, J.; Ding, X.; An, H. Dunhuang Grottoes Painting Dataset and Benchmark. arXiv 2019, arXiv:1907.04589. [Google Scholar]
- Frank, H.; Ilya, L. Decoupled Weight Decay Regularization. In Proceedings of the International Conference on Learning Representations (ICLR 2019); Curran Associates, Inc.: San Francisco, CA, USA, 2019. [Google Scholar]
- Liu, Z. Super Convergence Cosine Annealing with Warm-up Learning Rate. In CAIBDA 2022; 2nd International Conference on Artificial Intelligence, Big Data and Algorithms; VDE: Berlin, Germany, 2022. [Google Scholar]




| Dunhuang | CMAMR | MISF | HINT | Ours | |
|---|---|---|---|---|---|
| 0–20% | PSNR ↑ | 43.8476 ± 1.2569 | 40.6103 ± 1.7135 | 43.4013 ± 1.1374 | 44.4646 ± 1.2303 |
| SSIM ↑ | 0.9931 ± 0.0012 | 0.9896 ± 0.0069 | 0.9923 ± 0.0015 | 0.9952 ± 0.0011 | |
| MAE ↓ | 0.3139 ± 0.0856 | 0.4504 ± 0.1067 | 0.3382 ± 0.0639 | 0.2996 ± 0.0811 | |
| LPIPS ↓ | 0.0069 ± 0.0017 | 0.0095 ± 0.0034 | 0.0072 ± 0.0018 | 0.0066 ± 0.0016 | |
| CIEDE2000 ↓ | 0.1788 ± 0.0414 | 2.3348 ± 0.1632 | 0.1590 ± 0.0284 | 0.1298 ± 0.0265 | |
| 20–40% | PSNR ↑ | 30.0332 ± 0.8567 | 29.0854 ± 0.6128 | 30.2370 ± 0.8643 | 30.7143 ± 0.8463 |
| SSIM ↑ | 0.9294 ± 0.0077 | 0.9116 ± 0.0085 | 0.9306 ± 0.0078 | 0.9331 ± 0.0074 | |
| MAE ↓ | 2.5729 ± 0.2906 | 3.2554 ± 0.3472 | 2.4732 ± 0.2695 | 2.3361 ± 0.2685 | |
| LPIPS ↓ | 0.1020 ± 0.0098 | 0.1753 ± 0.0075 | 0.1025 ± 0.0078 | 0.0971 ± 0.0095 | |
| CIEDE2000 ↓ | 1.0897 ± 0.1483 | 2.5926 ± 0.1878 | 0.9920 ± 0.1048 | 0.8957 ± 0.1091 | |
| MuralDH | PSNR ↑ | SSIM ↑ | MAE ↓ | LPIPS ↓ | CIEDE2000 ↓ |
|---|---|---|---|---|---|
| CMAMR | 30.9226 ± 1.0631 | 0.9385 ± 0.0147 | 3.2785 ± 0.5879 | 0.0685 ± 0.0152 | 1.9588 ± 0.3067 |
| MISF | 30.3441 ± 1.1768 | 0.9362 ± 0.0153 | 4.0050 ± 0.5169 | 0.0753 ± 0.0137 | 2.1938 ± 0.3912 |
| HINT | 30.8151 ± 1.2214 | 0.9366 ± 0.0146 | 3.3635 ± 0.7633 | 0.0721 ± 0.0150 | 1.6489 ± 0.2454 |
| ours | 31.3160 ± 1.0188 | 0.9409 ± 0.0148 | 3.2123 ± 0.5038 | 0.0643 ± 0.1451 | 1.4666 ± 0.1943 |
| Index | LAB Loss | Fre Loss | Metric | ||||
|---|---|---|---|---|---|---|---|
| PSNR ↑ | SSIM ↑ | MAE ↓ | LPIPS ↓ | CIEDE2000 ↓ | |||
| (1) | ✗ | ✓ | 30.8447 ± 1.0236 | 0.9349 ± 0.0167 | 3.4732 ± 0.6216 | 0.0749 ± 0.1557 | 1.6392 ± 0.1998 |
| (2) | ✓ | ✗ | 30.7143 ± 1.0254 | 0.9293 ± 0.0153 | 3.4645 ± 0.6039 | 0.0675 ± 0.1602 | 1.5881 ± 0.2056 |
| (3) | ✓ | ✓ | 31.3160 ± 1.0188 | 0.9409 ± 0.0148 | 3.2123 ± 0.5038 | 0.0643 ± 0.1451 | 1.4666 ± 0.1943 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Zhang, Y.; Wang, G.; Zhang, Q.; Zhou, B. LABFNet: A Restoration Network Guided by the LAB Colour Space and Frequency-Domain Constraints. J. Imaging 2026, 12, 332. https://doi.org/10.3390/jimaging12070332
Zhang Y, Wang G, Zhang Q, Zhou B. LABFNet: A Restoration Network Guided by the LAB Colour Space and Frequency-Domain Constraints. Journal of Imaging. 2026; 12(7):332. https://doi.org/10.3390/jimaging12070332
Chicago/Turabian StyleZhang, Yaqian, Guanjun Wang, Quan Zhang, and Bochao Zhou. 2026. "LABFNet: A Restoration Network Guided by the LAB Colour Space and Frequency-Domain Constraints" Journal of Imaging 12, no. 7: 332. https://doi.org/10.3390/jimaging12070332
APA StyleZhang, Y., Wang, G., Zhang, Q., & Zhou, B. (2026). LABFNet: A Restoration Network Guided by the LAB Colour Space and Frequency-Domain Constraints. Journal of Imaging, 12(7), 332. https://doi.org/10.3390/jimaging12070332

