Reinforcement Learning Technique for Self-Healing FBG Sensor Systems in Optical Wireless Communication Networks
Abstract
1. Introduction
- A reliable ring-mesh fiber architecture designed for large-scale, multipoint FBG sensing with inherent self-healing capability.
- Integration of FBG sensors with FSO technology to enhance network scalability and address challenges caused by physical obstacles in fiber installation.
- An RL-based intelligent path selection mechanism that utilizes efficient routing techniques to improve system survivability, scalability, and transmission efficiency.
2. Operational Principles of the Multi-Point Sensing System
2.1. Conceptual Structure of Multi-Point Sensing System Using Reinforcement Learning
2.2. Working Principle of the Experimental Setup
- State: The condition of the network as perceived after each action (e.g., path success, failures, or partial sensing).
- Action: The decision to select a specific path or reconfigure a node.
- Reward: Feedback given based on the success of the action, often derived from cost metrics such as loss rate, energy consumption, or sensing delay.
3. The Proposed Methodology
- Number of iterations.
- Learning rate (α): A value of 0 means no learning occurs (Q-values remain unchanged),while α = 1 allows full updates based on the most recent reward.
- Attenuation factor (γ): If γ = 1, future rewards are weighted equally with current ones,which can hinder present-focused decision-making. If γ = 0, only immediate rewards are considered, limiting long-term planning.
- Greedy coefficient (ε): Set initially to 1 for full exploration, and exponentially decayed (0.9 per interaction) to gradually increase exploitation.
| Algorithm 1. Q-learning Algorithm Applied to this System | |
| Step | Description |
| 1 | Initialize Q table: ε = 0.8, α = 0.9, γ = 0.8 |
| 2 | Repeat (for each episode): |
| 3 | Initialize s |
| 4 | Repeat (for each step in the episode): |
| 5 | Define A from R table |
| 6 | If rand () < ε, then: |
| 7 | Select a randomly from A |
| 8 | Else: |
| 9 | Choose a from s in Q table |
| 10 | Next s = a |
| 11 | Define reward from R table |
| 12 | Next a = arg maxₐ Q (next s, next a) |
| 13 | Q (s, a) = Q (s, a) + α [reward + γ Q (next s, next a) − Q (s, a)] |
| 14 | s = next s |
| 15 | ε = ε × 0.6 |
| 16 | α = α × 0.6 |
4. Experimental Results and Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Domingues, M.D.F.F.; Radwan, A. Optical Fiber Sensors in IoT. In Optical Fiber Sensors for IoT and Smart Devices; Springer: Cham, Switzerland, 2017; pp. 73–86. [Google Scholar]
- Kok, S.P.; Go, Y.I.; Wang, X.; Wong, M.L.D. Advances in Fiber Bragg Grating (FBG) Sensing: A Review of Conventional and New Approaches and Novel Sensing Materials in Harsh and Emerging Industrial Sensing. IEEE Sens. J. 2024, 24, 29485–29505. [Google Scholar] [CrossRef]
- Zhang, B.; Kahrizi, M. High-Temperature Resistance Fiber Bragg Grating Temperature Sensor Fabrication. IEEE Sens. J. 2007, 7, 586–591. [Google Scholar] [CrossRef]
- Abedin, S.; Biondi, A.M.; Wu, R.; Cao, L.; Wang, X. Structural Health Monitoring Using a New Type of Distributed Fiber Optic Smart Textiles in Combination with Optical Frequency Domain Reflectometry (OFDR): Taking a Pedestrian Bridge as Case Study. Sensors 2023, 23, 1591. [Google Scholar] [CrossRef]
- Jia, D.; Zhang, Y.; Chen, Z.; Zhang, H.; Liu, T.; Zhang, Y. A Self-Healing Passive Fiber Bragg Grating Sensor Network. J. Light. Technol. 2015, 33, 2062–2067. [Google Scholar] [CrossRef]
- Yeh, C.-H.; Chow, C.-W.; Wu, P.-C.; Tseng, F.-G. A Simple Fiber Bragg Grating-Based Sensor Network Architecture with Self-Protecting and Monitoring Functions. Sensors 2011, 11, 1375–1382. [Google Scholar] [CrossRef]
- Yeh, C.H.; Chow, C.W.; Wang, C.H.; Shih, F.Y.; Wu, Y.F.; Chi, S. A simple self-restored fiber Bragg grating (FBG)-based passive sensing ring network. Meas. Sci. Technol. 2009, 20, 43001. [Google Scholar] [CrossRef]
- Vallejo, M.F.; Perez-Herrera, R.A.; Elosua, C.; Diaz, S.; Urquhart, P.; Bariain, C.; Lopez-Amo, M. Resilient amplified double-ring optical networks to multiplex optical fiber sensors. J. Light. Technol. 2009, 27, 1301–1306. [Google Scholar] [CrossRef]
- Lopez, O.G.; Schires, K.; Urquhart, P.; Gueyne, N.; Duhamel, B. Optical fiber bus protection network to multiplex sensors: Amplification by remotely pumped EDFAs. IEEE Trans. Instrum. Meas. 2009, 58, 2945–2951. [Google Scholar] [CrossRef]
- Izquierdo, E.L.; Urquhart, P.; Lopez-Amo, M. Protection architectures for WDM optical fibre bus sensor arrays. J. Eng. Sci. Int. 2007, 1, 1–18. [Google Scholar]
- Yuan, L.; Wang, Q.; Zhao, Y. A passive ladder-shaped sensor architecture with failure detection based on fiber Bragg grating. Opt. Fiber Technol. 2023, 81, 103540. [Google Scholar] [CrossRef]
- Kuroda, K. A passive ladder-shaped fiber Bragg grating sensor network with fault detection using time-and wavelength-division multiplexing. Sensors 2025, 25, 4261. [Google Scholar] [CrossRef]
- Wu, C.Y.; Feng, K.M.; Peng, P.C.; Lin, C.Y. Three-dimensional mesh-based multipoint sensing system with self-healing functionality. IEEE Photonics Technol. Lett. 2010, 22, 565–567. [Google Scholar] [CrossRef]
- Feng, K.-M.; Wu, C.-Y.; Yan, J.-H.; Lin, C.-Y.; Peng, P.-C. Fiber Bragg Grating-Based Three-Dimensional Multipoint Ring-Mesh Sensing System with Robust Self-Healing Function. IEEE J. Sel. Top. Quantum Electron. 2012, 18, 1613–1620. [Google Scholar] [CrossRef]
- Yeh, C.-H.; Tsai, N.; Zhuang, Y.-H.; Chow, C.-W.; Liu, W.-F. Fault self-detection technique in fiber Bragg grating-based passive sensor network. IEEE Sens. J. 2016, 16, 8070–8074. [Google Scholar] [CrossRef]
- Yeh, C.-H.; Chang, Y.-J.; Huang, T.-J.; Yang, Z.-Q.; Chow, C.-W.; Chen, K.-H. A fiber Bragg grating-based passive semicircular sensor architecture with fault monitoring. Opt. Fiber Technol. 2019, 48, 258–262. [Google Scholar] [CrossRef]
- Chang, C.-H.; Lu, D.-Y.; Lin, W.-H. All-Passive Optical Fiber Sensor Network with Self-Healing Functionality. IEEE Photonics J. 2018, 10, 7203310. [Google Scholar] [CrossRef]
- Chang, C.-H.; Tsai, C.-H. A large-scale optical fiber sensor network with reconfigurable routing path functionality. IEEE Photonics J. 2019, 11, 6801811. [Google Scholar] [CrossRef]
- Hu, J.; Hu, X.; Shen, Z.; Wang, Z.; Li, J.; Hu, J. Self-Healing FBG Sensor Network Fault-Detection Based on a Multi-Class SVM Algorithm. Opt. Express 2023, 31, 41313–41327. [Google Scholar] [CrossRef]
- Hu, X.; Si, H.; Mao, J.; Wang, Y. Self-healing and shortest path in optical fiber sensor network. J. Sens. 2022, 2022, 5717041. [Google Scholar] [CrossRef]
- Zhang, R.; Liu, H.; Wang, Y.; Li, Z.; Zhang, Y. Research on Self-Diagnosis and Self-Healing Technologies for Fiber Optic Sensing Networks in Complex Environments. Sensors 2025, 25, 1641. [Google Scholar] [CrossRef]
- Zhang, Y.; Xin, J. Survivable deployments of optical sensor networks against multiple failures and disasters: A survey. Sensors 2019, 19, 4790. [Google Scholar] [CrossRef] [PubMed]
- Zhang, R.; Lu, F.; Xu, M.; Liu, S.; Peng, P.-C.; Shen, S.; He, J.; Cho, H.J.; Zhou, Q.; Yao, S.; et al. An Ultra-Reliable MMW/FSO A-RoF System Based on Coordinated Mapping and Combining Technique for 5G and Beyond Mobile Fronthaul. J. Light. Technol. 2018, 36, 4952–4959. [Google Scholar] [CrossRef]
- Alfadhli, Y.; Peng, P.-C.; Cho, H.; Liu, S.; Zhang, R.; Chen, Y.-W.; Chang, G.-K. Real-time FPGA demonstration of hybrid bi-directional MMW and FSO fronthaul architecture. In Proceedings of the Optical Fiber Communications Conference and Exhibition (OFC), San Diego, CA, USA, 3–7 March 2019; pp. 1–3. [Google Scholar]
- Chen, Y.-W.; Zhang, R.; Hsu, C.-W.; Chang, G.-K. Key Enabling Technologies for the Post-5G Era: Fully Adaptive, All-Spectra Coordinated Radio Access Network with Function Decoupling. IEEE Commun. Mag. 2020, 58, 60–66. [Google Scholar] [CrossRef]
- Jeon, H.-B.; Kim, S.-M.; Moon, H.-J.; Kwon, D.-H.; Lee, J.-W.; Chung, J.-M.; Han, S.-K.; Chae, C.-B.; Alouini, M.-S. Free-space optical communications for 6G wireless networks: Challenges, opportunities, and prototype validation. IEEE Commun. Mag. 2023, 61, 116–121. [Google Scholar] [CrossRef]
- Yeh, C.-H.; Lin, W.-P.; Jiang, S.-Y.; Hsieh, S.-E.; Hsu, C.-H.; Chow, C.-W. Integrated Fiber-FSO WDM Access System with Fiber Fault Protection. Electronics 2022, 11, 2101. [Google Scholar] [CrossRef]
- Hayle, S.T.; Manie, Y.C.; Dehnaw, A.M.; Hsu, Y.-T.; Li, J.-W.; Liang, H.-C.; Peng, P.-C. Reliable self-healing FBG sensor network for improvement of multipoint strain sensing. Opt. Commun. 2021, 499, 127286. [Google Scholar] [CrossRef]
- Yeh, C.-H.; Ko, H.-S.; Liaw, S.-K.; Liu, L.-H.; Chen, J.-H.; Chow, C.-W. A Survivable and Flexible WDM Access Network by Alternate FSO- and Fiber-Paths for Fault Protection. IEEE Photonics J. 2022, 14, 1–5. [Google Scholar] [CrossRef]
- Wu, T.-H.; Liao, C.-Y.; Yeh, C.-H.; Chen, Y.-W.; Kao, Y.-H.; Lin, S.-Y.; Lin, Y.-H.; Liaw, S.-K. A Self-Healing WDM Access Network with Protected Fiber and FSO Link Paths Effective Against Fiber Breaks. Photonics 2025, 12, 323. [Google Scholar] [CrossRef]
- Manie, Y.C.; Peng, P.-C.; Shiu, R.-K.; Hsu, Y.-T.; Chen, Y.-Y.; Shao, G.-M.; Chiu, J. Enhancement of the Multiplexing Capacity and Measurement Accuracy of FBG Sensor System Using IWDM Technique and Deep Learning Algorithm. J. Light. Technol. 2020, 38, 1589–1603. [Google Scholar] [CrossRef]
- Sun, Y.; Zeng, W.; Shen, H.; Chen, W.; Chen, Y.; Liu, J.; Fan, Z. Separation of distorted overlapping spectra in fiber Bragg grating sensor networks using self-supervised contrastive learning. Opt. Express 2025, 33, 44654–44670. [Google Scholar] [CrossRef]
- Arockiyadoss, M.A.; Dehnaw, A.M.; Manie, Y.C.; Hayle, S.T.; Yao, C.-K.; Peng, C.-H.; Kumar, P.; Peng, P.-C. Self-healing fiber Bragg grating sensor system using free-space optics link and machine learning for enhancing temperature measurement. Electronics 2024, 13, 1276. [Google Scholar] [CrossRef]
- Arockiyadoss, M.A.; Yao, C.-K.; Liu, P.-C.; Kumar, P.; Nagi, S.K.; Dehnaw, A.M.; Peng, P.-C. Spectral demodulation of mixed-linewidth fiber Bragg grating sensor networks using cloud-based deep learning for land monitoring. Sensors 2025, 25, 5627. [Google Scholar] [CrossRef] [PubMed]
- Tefera, M.A.; Manie, Y.C.; Yao, C.-K.; Fan, T.-P.; Peng, P.-C. Meta-Learning for Boosting the Sensing Quality and Utility of FSO-Based Multichannel FBG Sensor System. IEEE Sens. J. 2023, 23, 31506–31512. [Google Scholar] [CrossRef]
- Sutton, R.S.; Barto, A.G. Reinforcement Learning: An Introduction; MIT Press: Cambridge, MA, USA, 2018. [Google Scholar]
- Huang, R.; Guan, W.; Zhai, G.; He, J.; Chu, X. Deep Graph Reinforcement Learning Based Intelligent Traffic Routing Control for Software-Defined Wireless Sensor Networks. Appl. Sci. 2022, 12, 1951. [Google Scholar] [CrossRef]
- Jin, Z.; Zhao, Q.; Su, Y. RCAR: A Reinforcement-Learning-Based Routing Protocol for Congestion-Avoided Underwater Acoustic Sensor Networks. IEEE Sens. J. 2019, 19, 10881–10891. [Google Scholar] [CrossRef]
- Mammeri, Z. Reinforcement Learning Based Routing in Networks: Review and Classification of Approaches. IEEE Access 2019, 7, 55916–55950. [Google Scholar] [CrossRef]
- Ottoni, A.L.C.; Nepomuceno, E.G.; Oliveira, M.S.d.; de Oliveira, D.C.R. Reinforcement learning for the traveling salesman problem with refueling. Complex Intell. Syst. 2022, 8, 2001–2015. [Google Scholar] [CrossRef]
- Wang, Y.; Chen, L.; Zhou, H.; Zhou, X.; Zheng, Z.; Zeng, Q.; Jiang, L.; Lu, L. Flexible Transmission Network Expansion Planning Based on DQN Algorithm. Energies 2021, 14, 1944. [Google Scholar] [CrossRef]
- Chen, X.; Li, B.; Proietti, R.; Lu, H.; Zhu, Z.; Yoo, S.J.B. DeepRMSA: A deep reinforcement learning framework for routing, modulation and spectrum assignment in elastic optical networks. J. Light. Technol. 2019, 37, 4155–4163. [Google Scholar] [CrossRef]
- Nevin, J.W.; Nallaperuma, S.; Shevchenko, N.A.; Shabka, Z.; Zervas, G.; Savory, S.J. Techniques for applying reinforcement learning to routing and wavelength assignment problems in optical fiber communication networks. J. Opt. Commun. Netw. 2022, 14, 733–748. [Google Scholar] [CrossRef]
- Kafaei, P.; Cappart, Q.; Chapados, N.; Pouya, H.; Rousseau, L.-M. Dynamic routing and wavelength assignment with reinforcement learning. Inf. J. Optim. 2023, 6, 1–18. [Google Scholar] [CrossRef]











Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Dellimore, R.A.; Li, J.-W.; Huang, H.-W.; Dehnaw, A.M.; Yao, C.-K.; Liu, P.-C.; Peng, P.-C. Reinforcement Learning Technique for Self-Healing FBG Sensor Systems in Optical Wireless Communication Networks. Appl. Sci. 2026, 16, 1012. https://doi.org/10.3390/app16021012
Dellimore RA, Li J-W, Huang H-W, Dehnaw AM, Yao C-K, Liu P-C, Peng P-C. Reinforcement Learning Technique for Self-Healing FBG Sensor Systems in Optical Wireless Communication Networks. Applied Sciences. 2026; 16(2):1012. https://doi.org/10.3390/app16021012
Chicago/Turabian StyleDellimore, Rénauld A., Jyun-Wei Li, Hung-Wei Huang, Amare Mulatie Dehnaw, Cheng-Kai Yao, Pei-Chung Liu, and Peng-Chun Peng. 2026. "Reinforcement Learning Technique for Self-Healing FBG Sensor Systems in Optical Wireless Communication Networks" Applied Sciences 16, no. 2: 1012. https://doi.org/10.3390/app16021012
APA StyleDellimore, R. A., Li, J.-W., Huang, H.-W., Dehnaw, A. M., Yao, C.-K., Liu, P.-C., & Peng, P.-C. (2026). Reinforcement Learning Technique for Self-Healing FBG Sensor Systems in Optical Wireless Communication Networks. Applied Sciences, 16(2), 1012. https://doi.org/10.3390/app16021012

