A Cyber-Physical System for Real-Time Flood Monitoring: Integration of Semantic Segmentation and Edge Computing in Taiwan
Abstract
1. Introduction
2. Cyber-Physical System Architectures
- Smart connection level: The Smart Connection Level establishes a robust IoT infrastructure for environmental data acquisition. The sensing network integrates over 10,000 cameras as sources of images, comprising WRA stationary units, interfaced surveillance nodes, and vehicle-mounted CCTV units. Six surveillance nodes as virtual water level gauges utilize Axis Q1805LE cameras (Axis Communications, Lund, Sweden), which feature deep-learning-optimized chipsets and localized data storage capabilities. Data transmission is primarily facilitated via the 4G FDD-LTE standard. To ensure operational resilience, WRA stations utilize a DC power supply with a DC-DC buck converter module (TaiwanIoT, Tainan, Taiwan) supported by a 14.4 V/20 A rechargeable lithium-ion battery pack consist of a Panasonic NCR18650PF battery cell (Panasonic Holdings Corporation, Osaka, Japan), which is capable of providing 30 h of continuous operation during power failures. The maximum power consumption of the edge-computing camera is approximately 25 W, while typical operational consumption is around 12 W. Compared with conventional surveillance cameras, the additional annual electricity cost is estimated to be approximately NTD 200–300 per device.
- Data-to-Information conversion level: At this level, multi-modal data—including high-resolution imagery, geospatial coordinates, precipitation records, and flood alert areas—are ingested and stored within a centralized database. These datasets are integrated and visualized through system dashboards, GIS maps (Figure 3), and dynamic image carousel (Figure 4) interfaces to provide comprehensive situational awareness.
- Cyber level: The Cyber Level serves as the information hub, utilizing APIs to interface with multiple real-time external intelligence sources. Key integrated data streams include precipitation data from the CWA, sensor telemetry from the EMIC, and flood alerts from the WRA. This multi-modal fusion enables the platform to achieve deep data integration and drive informed decision-making.
- Cognition level: The Cognition Level implements AI-driven analytical modules that utilize real-time precipitation and spatial alert information to trigger the image recognition workflows. The deep learning model performs semantic segmentation to accurately delineate inundation boundaries and offer the application of virtual water level gauges. Thresholds to trigger the semantic segmentation model are defined as follows: (1) the 10-min accumulated rainfall at the rain gauge associated with a given camera reaches 10 mm, or the hourly accumulated rainfall reaches 30 mm; or (2) the camera is located in the officially announced inundation warning area by the CWA.
- Configuration level: The Configuration Level governs the execution of response measures and alert disseminations. When the image recognition module identifies inundation events meeting specified thresholds, the platform immediately issues automated alerts via email and instant messaging (IM) to designated personnel. To ensure high reliability and ethical accountability, the platform currently operates under a Human-in-the-Loop (HITL) architecture [29,30]. Upon receiving alerts, designated personnel perform a manual verification of the AI-detected event before issuing formal public warnings and coordinating emergency response measures, such as road closures or pump deployment.
Platform Architecture and Environment
3. Robust Image Recognition Methodology
3.1. Proprietary Dataset
3.2. Image Segmentation Architectures and Evaluations
3.3. Performance Optimization Solutions
- Illumination and Reflection Mitigation: Environmental noise, including low ambient light, overexposure, and reflections from traffic signals or wet surfaces, significantly challenges nocturnal recognition. This was addressed via:HSV Pre-processing: An HSV (Hue, Saturation, Value) filter decouples color information from intensity, enhancing the model’s adaptability to non-uniform lighting. The HSV filtering algorithm for image preprocessing was developed in-house using Python 3.5 in conjunction with the OpenCV library (version 3.4.2).Targeted Augmentation: Problematic images underwent contrast and saturation adjustments, including horizontal flipping and color/lighting normalization, before reintegration into the training pipeline to improve illumination invariance. The data augmentation pipeline was developed in-house using Python 3.5 in conjunction with the OpenCV library (version 3.4.2).
- Advanced Image Restoration: To resolve quality degradation caused by lens water droplets, fog, or mechanical vibrations, a Deblur GAN architecture [36] was integrated into the pre-processing workflow. This provides a robust solution for restoring clarity across various types of blur.
- Temporal Adaptive Modeling: Given the visual contrast between day and night, independent diurnal and nocturnal models are utilized. The system executes an automated model switch at 06:00 and 17:00 to maintain optimal detection accuracy throughout the 24 h cycle.
- Attentive Feature Recalibration: To prevent fragmented segmentation in urban environments, an attentive-recurrent network [37] was implemented. This mechanism utilizes a lightweight parallel architecture to recalibrate features, effectively prioritizing inundation (FLOOD) signals while suppressing background interference.
3.4. Application and Optimization in Virtual Water Level Gauge
4. Results
4.1. Results of Loss Function, PA, MPA, and mIoU
4.2. Effectiveness of Recognition Performance Enhancement Strategies
5. Validation and Discussion
5.1. Field Validation
- Dynamic Geographic Coverage: Mobile units traverse various traffic routes, extending monitoring capabilities into residential zones and narrow urban alleys that often lie beyond the reach of stationary surveillance nodes.
- Precision Spatiotemporal Tagging: Each vehicle-mounted unit is equipped with Global Positioning System (GPS) technology, ensuring that disaster imagery is precisely localized with high-accuracy spatial coordinates.
- Data Diversity and System Resilience: The broad coverage provided by various driving routes significantly enriches the platform’s image database, enhancing the sensitivity of the AI image recognition module to sudden and localized inundation events.
5.2. Framework of Edge Computing
5.3. False Analysis and System Limitations
- Spatial Resolution Constraints: When the inundated area is too far from the sensing camera, the pixel proportion of the water body becomes insufficient for effective model segmentation. This often leads to recognition failure and may cause visual misjudgment during the subsequent manual verification phase.
- Communication Latency and Failures: Occasional anomalies in the Instant Messaging (IM) push protocols can prevent the system from delivering alerts to emergency personnel in real-time, even if the AI has successfully identified the event.
- Data Integration Delays: Latency in the transmission of heterogeneous external data, such as precipitation records from rainfall stations, can delay the activation of the image recognition trigger mechanism, resulting in the loss of critical early-warning windows.
- Ethical Accountability: It ensures that disaster response decisions align with social and ethical norms while clarifying legal and administrative responsibilities during complex incidents.
- Establishment of Trust: By maintaining transparency in the execution and logic of the decision process, the HITL architecture fosters long-term user trust in automated early-warning tools.
- Empirical Case Accumulation: The HITL architecture facilitates the collection of high-quality, contextually relevant labeled cases, which serve as a foundational dataset for constructing automated execution mechanisms, such as reinforcement learning with human feedback (RLHF) [30,43] within the CPS Configuration Level.
6. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Chang, K.-H.; Chiu, Y.-T.; Su, W.-R.; Yu, Y.-C.; Chang, C.-H. A Spatial–Temporal Deep Learning-Based Warning System against Flooding Hazards with an Empirical Study in Taiwan. Int. J. Disaster Risk Reduct. 2024, 102, 104263. [Google Scholar] [CrossRef]
- Lin, M.-Y.; Sun, M.-H.; Sun, W.-Y.; Fu, H.-S.; Chen, W.-B.; Chang, C.-H. Formulating a Warning Threshold for Coastal Compound Flooding: A Copula-Based Approach. Ecol. Indic. 2024, 162, 111994. [Google Scholar] [CrossRef]
- Le, T.V.; Nguyen, K.A. Landslide Responses to Typhoon Events in Taiwan During 2019 and 2023. Sustainability 2025, 17, 9673. [Google Scholar] [CrossRef]
- Su, Y.-F.; Lin, Y.-T.; Jang, J.-H.; Han, J.-Y. High-Resolution Flood Simulation in Urban Areas Through the Application of Remote Sensing and Crowdsourcing Technologies. Front. Earth Sci. 2022, 9, 756198. [Google Scholar] [CrossRef]
- Lau, Y.M.; Wang, K.L.; Wang, Y.H.; Yiu, W.H.; Ooi, G.H.; Tan, P.S.; Wu, J.; Leung, M.L.; Lui, H.L.; Chen, C.W. Monitoring of Rainfall-Induced Landslides at Songmao and Lushan, Taiwan, Using IoT and Big Data-Based Monitoring System. Landslides 2023, 20, 271–296. [Google Scholar] [CrossRef]
- Moy De Vitry, M.; Kramer, S.; Wegner, J.D.; Leitão, J.P. Scalable Flood Level Trend Monitoring with Surveillance Cameras Using a Deep Convolutional Neural Network. Hydrol. Earth Syst. Sci. 2019, 23, 4621–4634. [Google Scholar] [CrossRef]
- Tolentino, L.K.S.; Baron, R.E.; Blacer, C.A.C.; Aliswag, J.M.D.; De Guzman, D.C.E.; Fronda, J.B.A.; Valeriano, R.C.; Quijano, J.F.C.; Padilla, M.V.C.; Madrigal, G.A.M.; et al. Real Time Flood Detection, Alarm and Monitoring System Using Image Processing and Multiple Linear Regression. SSRN J. 2023, 7, 12–23. [Google Scholar] [CrossRef]
- Wieland, M.; Martinis, S.; Kiefl, R.; Gstaiger, V. Semantic Segmentation of Water Bodies in Very High-Resolution Satellite and Aerial Images. Remote Sens. Environ. 2023, 287, 113452. [Google Scholar] [CrossRef]
- Wang, Z.; Mahmoudian, N. Aerial Fluvial Image Dataset for Deep Semantic Segmentation Neural Networks and Its Benchmarks. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2023, 16, 4755–4766. [Google Scholar] [CrossRef]
- Jonnala, N.S.; Siraaj, S.; Prastuti, Y.; Chinnababu, P.; Praveen Babu, B.; Bansal, S.; Upadhyaya, P.; Prakash, K.; Faruque, M.R.I.; Al-Mugren, K.S. AER U-Net: Attention-Enhanced Multi-Scale Residual U-Net Structure for Water Body Segmentation Using Sentinel-2 Satellite Images. Sci. Rep. 2025, 15, 16099. [Google Scholar] [CrossRef]
- Sun, D.; Gao, G.; Huang, L.; Liu, Y.; Liu, D. Extraction of Water Bodies from High-Resolution Remote Sensing Imagery Based on a Deep Semantic Segmentation Network. Sci. Rep. 2024, 14, 14604. [Google Scholar] [CrossRef]
- Attya, M.; Abo-Seida, O.M.; Abdulkader, H.M.; Mohammed, A.M. A Hybrid Deep Learning Approach for Accurate Water Body Segmentation in Satellite Imagery. Earth Sci. Inform. 2025, 18, 418. [Google Scholar] [CrossRef]
- Shankar, G.; Geetha, M.K.; Ezhumalai, P. Disaster Management Systems: Utilizing YOLOv9 for Precise Monitoring of River Flood Flow Levels Using Video Surveillance. SN Comput. Sci. 2025, 6, 288. [Google Scholar] [CrossRef]
- Zhao, J.; Wang, X.; Zhang, C.; Hu, J.; Wan, J.; Cheng, L.; Shi, S.; Zhu, X. Urban Waterlogging Monitoring and Recognition in Low-Light Scenarios Using Surveillance Videos and Deep Learning. Water 2025, 17, 707. [Google Scholar] [CrossRef]
- Lu, A.; Cao, R.; Wang, Y.; Hu, W.; Gao, Y.; Hu, Z.; Zang, Y. Edge Computing and Server-Based High-Precision Flood Level Classification System. Eng. Appl. Artif. Intell. 2025, 162, 112442. [Google Scholar] [CrossRef]
- Zhong, P.; Liu, Y.; Zheng, H.; Zhao, J. Detection of Urban Flood Inundation from Traffic Images Using Deep Learning Methods. Water Resour. Manag. 2024, 38, 287–301. [Google Scholar] [CrossRef]
- Zhang, D.; Tong, J. Robust Water Level Measurement Method Based on Computer Vision. J. Hydrol. 2023, 620, 129456. [Google Scholar] [CrossRef]
- Zeng, Y.-F.; Chang, M.-J.; Lin, G.-F. A Novel AI-Based Model for Real-Time Flooding Image Recognition Using Super-Resolution Generative Adversarial Network. J. Hydrol. 2024, 638, 131475. [Google Scholar] [CrossRef]
- Kerim, A.; Chamone, F.; Ramos, W.; Marcolino, L.S.; Nascimento, E.R.; Jiang, R. Semantic Segmentation under Adverse Conditions: A Weather and Nighttime-Aware Synthetic Data-Based Approach. arXiv 2022, arXiv:2210.05626. [Google Scholar]
- Bai, G.; Hou, J.; Zhang, Y.; Li, B.; Han, H.; Wang, T.; Hinkelmann, R.; Zhang, D.; Guo, L. An Intelligent Water Level Monitoring Method Based on SSD Algorithm. Measurement 2021, 185, 110047. [Google Scholar] [CrossRef]
- Wang, Y.; Shen, Y.; Salahshour, B.; Cetin, M.; Iftekharuddin, K.; Tahvildari, N.; Huang, G.; Harris, D.K.; Ampofo, K.; Goodall, J.L. Urban Flood Extent Segmentation and Evaluation from Real-World Surveillance Camera Images Using Deep Convolutional Neural Network. Environ. Model. Softw. 2024, 173, 105939. [Google Scholar] [CrossRef]
- Wan, J.; Wang, X.; Cheng, Y.; Zhang, C.; Xue, F.; Yang, T.; Tong, F.; Wang, Q.J. Identification of Nighttime Urban Flood Inundation Extent Using Deep Learning. Nat. Hazards Earth Syst. Sci. 2025, 25, 4361–4373. [Google Scholar] [CrossRef]
- Khan, S.M.; Shafi, I.; Butt, W.H.; Diez, I.d.l.T.; Flores, M.A.L.; Galán, J.C.; Ashraf, I. A Systematic Review of Disaster Management Systems: Approaches, Challenges, and Future Directions. Land 2023, 12, 1514. [Google Scholar] [CrossRef]
- Yang, S.-H.; Hsieh, S.-L.; Wang, X.-J.; Chang, D.-L.; Wei, S.-T.; Song, D.-R.; Pan, J.-H.; Yeh, K.-C. Adaptive Pluvial Flood Disaster Management in Taiwan: Infrastructure and IoT Technologies. Water 2025, 17, 2269. [Google Scholar] [CrossRef]
- Yang, T.-H.; Yang, S.-C.; Kao, H.-M.; Wu, M.-C.; Hsu, H.-M. Cyber-Physical-System-Based Smart Water System to Prevent Flood Hazards. Smart Water 2018, 3, 1. [Google Scholar] [CrossRef]
- Alexandra, C.; Daniell, K.A.; Guillaume, J.; Saraswat, C.; Feldman, H.R. Cyber-Physical Systems in Water Management and Governance. Curr. Opin. Environ. Sustain. 2023, 62, 101290. [Google Scholar] [CrossRef]
- Musa, A.A.; Hussaini, A.; Liao, W.; Liang, F.; Yu, W. Deep Neural Networks for Spatial-Temporal Cyber-Physical Systems: A Survey. Future Internet 2023, 15, 199. [Google Scholar] [CrossRef]
- Lee, J.; Bagheri, B.; Kao, H.-A. A Cyber-Physical Systems Architecture for Industry 4.0-Based Manufacturing Systems. Manuf. Lett. 2015, 3, 18–23. [Google Scholar] [CrossRef]
- Pagano, T.C.; Pappenberger, F.; Wood, A.W.; Ramos, M.; Persson, A.; Anderson, B. Automation and Human Expertise in Operational River Forecasting. WIREs Water 2016, 3, 692–705. [Google Scholar] [CrossRef]
- Debnath, R.; Tkachenko, N.; Bhattacharyya, M. Enabling People-Centric Climate Action Using Human-in-the-Loop Artificial Intelligence: A Review. Curr. Opin. Behav. Sci. 2025, 61, 101482. [Google Scholar] [CrossRef]
- Wang, J.; Sun, K.; Cheng, T.; Jiang, B.; Deng, C.; Zhao, Y.; Liu, D.; Mu, Y.; Tan, M.; Wang, X.; et al. Deep High-Resolution Representation Learning for Visual Recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2021, 43, 3349–3364. [Google Scholar] [CrossRef]
- Gao, L.; Huang, X.; Si, W.; Yang, F.; Qiao, X.; Zhu, Y.; Fu, T.; Zhao, J. An Improved HRNetV2-Based Semantic Segmentation Algorithm for Pipe Corrosion Detection in Smart City Drainage Networks. J. Imaging 2025, 11, 325. [Google Scholar] [CrossRef]
- Chen, L.-C.; Zhu, Y.; Papandreou, G.; Schroff, F.; Adam, H. Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018. [Google Scholar]
- Sorboni, N.G.; Wang, J.; Najafi, M.R. Urban Flood Mapping Using Sentinel-1 and RADARSAT Constellation Mission Image and Convolutional Siamese Network. In Proceedings of the AGU Fall Meeting, Chicago, IL, USA, 12–16 December 2022. [Google Scholar]
- Wei, D.; Chang, Y.; Kuang, H. Extraction and Spatiotemporal Analysis of Impervious Surfaces in Chongqing Based on Enhanced DeepLabv3+. Sci. Rep. 2025, 15, 9807. [Google Scholar] [CrossRef]
- Kupyn, O.; Martyniuk, T.; Wu, J.; Wang, Z. DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Better. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea, 27 October–2 November 2019. [Google Scholar]
- Qian, R.; Tan, R.T.; Yang, W.; Su, J.; Liu, J. Attentive Generative Adversarial Network for Raindrop Removal from a Single Image. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017. [Google Scholar]
- Nunes, D.; Silva, J.; Boavida, F. A Practical Introduction to Human-in-the-Loop Cyber-Physical Systems, 1st ed.; Wiley: Hoboken, NJ, USA, 2017. [Google Scholar]
- Domfeh, E.A.; Dancy, C.L. Human-AI Use Patterns for Decision-Making in Disaster Scenarios: A Systematic Review. In Proceedings of the 2025 IEEE International Symposium on Technology and Society (ISTAS), Santa Clara, CA, USA, 10–12 September 2025. [Google Scholar]
- Kuglitsch, M.; Pelivan, I.; Danakkaew, C.; Dramsch, J.; Arghandeh, R. Cultivating Trust in AI for Disaster Management. Eos 2024, 105. [Google Scholar] [CrossRef]
- Clemmensen, T.; Moghaddam, M.T.; Nørbjerg, J. Cyber-Physical Systems with Human-in-the-Loop: A Systematic Review of Socio-Technical Perspectives. J. Syst. Softw. 2025, 226, 112348. [Google Scholar] [CrossRef]
- Lazaros, K.; Vrahatis, A.G.; Kotsiantis, S. Human-in-the-Loop Artificial Intelligence: A Systematic Review of Concepts, Methods, and Applications. Entropy 2026, 28, 377. [Google Scholar] [CrossRef] [PubMed]
- Dai, J.; Pan, X.; Sun, R.; Ji, J.; Xu, X.; Liu, M.; Wang, Y.; Yang, Y. Safe RLHF: Safe Reinforcement Learning from Human Feedback. In Proceedings of the International Conference on Learning Representations (ICLR 2024), Vienna, Austria, 7–11 May 2024. [Google Scholar]

















| Items | This Study | Yang et al., 2025 [24] |
|---|---|---|
| Service Area | Taiwan | New Taipei City |
| System architecture | Multi-layer Cyber-Physical System | Service-Oriented Architecture with IoT cluster-based |
| AI technology | Semantic Segmentation: DeepLabV3+ with Xception71 | CNN Classification: VGG-19, ResNet. |
| Image source | Stationary and Mobile CCTVs | CCTVs and UAV |
| Heterogeneous information | Rainfall, water leveling sensor, location, flood warning area | Rainfall, Various-sensor information, Drainage pipe flow depth |
| Special application | Virtual water level gauges | Pumping machine management according to the pipe flow depth |
| The role of humans in the system | Human in the Loop | Reduce man–machine interactions and dependence on human experience |
| Feature Extraction Architecture | DeepLabV3+ | HRNetV2+OCR |
|---|---|---|
| Backbone network | Xception71 | HRNetV1-W48 |
| Batch Size | 1 | 1 |
| Learning Rate | 0.0001 | 0.0001 |
| Optimizer | Adam | Adam |
| Step | 120,000 | 120,000 |
| DeepLabV3+ (Xception71) | HRNetV2+OCR | |
|---|---|---|
| Parameter count | 46.73 M | 72.1 M |
| Training time | ≒1 day | At least 5 days |
| Inference time | ≒0.1 s | ≒0.5 s |
| Model and Network | DeepLabV3+ and Xception71 | HRNetV2+OCR | ||||
|---|---|---|---|---|---|---|
| PA | MPA | mIoU | PA | MPA | mIoU | |
| FLOOD | 0.845 | 0.842 | 0.773 | 0.815 | 0.813 | 0.746 |
| FLOOD+ROAD | 0.834 | 0.801 | 0.731 | 0.768 | 0.767 | 0.693 |
| ROAD | 0.836 | 0.828 | 0.755 | 0.821 | 0.817 | 0.741 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Fang, Y.-M.; Tsai, T.-S.; Chien, F.-J. A Cyber-Physical System for Real-Time Flood Monitoring: Integration of Semantic Segmentation and Edge Computing in Taiwan. Water 2026, 18, 1286. https://doi.org/10.3390/w18111286
Fang Y-M, Tsai T-S, Chien F-J. A Cyber-Physical System for Real-Time Flood Monitoring: Integration of Semantic Segmentation and Edge Computing in Taiwan. Water. 2026; 18(11):1286. https://doi.org/10.3390/w18111286
Chicago/Turabian StyleFang, Yao-Min, Tung-Sheng Tsai, and Fu-Jen Chien. 2026. "A Cyber-Physical System for Real-Time Flood Monitoring: Integration of Semantic Segmentation and Edge Computing in Taiwan" Water 18, no. 11: 1286. https://doi.org/10.3390/w18111286
APA StyleFang, Y.-M., Tsai, T.-S., & Chien, F.-J. (2026). A Cyber-Physical System for Real-Time Flood Monitoring: Integration of Semantic Segmentation and Edge Computing in Taiwan. Water, 18(11), 1286. https://doi.org/10.3390/w18111286
