Knowledge-Organized and Retrieval-Augmented Intelligent Decision-Making Model for Remote Monitoring of Power System Secondary Equipment
Abstract
1. Introduction
- (1)
- a corpus normalization and knowledge unit organization method for secondary equipment remote monitoring;
- (2)
- an evidence-oriented assisted analysis workflow integrating terminology alignment, hybrid retrieval, evidence organization, and source-traceable output;
- (3)
- an evaluation framework for secondary equipment scenarios from the perspectives of retrieval performance, analysis correctness, evidence sufficiency, output usability, and source traceability.
2. Framework and Knowledge Organization Method
2.1. Scenario Analysis and Overall Workflow
2.2. Composition and Characteristics of Multi-Source Domain Corpora
2.3. Domain Corpus Normalization Method for Remote Monitoring
- (1)
- Text cleaning. Invalid characters, repeated symbols, and obvious redundancies are removed, while the expressions of time, numbering, and common fields are unified to reduce noise in the original records.
- (2)
- Terminology normalization. A “controlled vocabulary + rule-based merging” strategy is adopted. The controlled vocabulary currently contains approximately 400 standardized terms covering equipment objects, protection functions, abnormal phenomena, action/state descriptions, and handling actions, with original expressions and aliases retained through mapping rules. Mapping rules are then established for abbreviations, aliases, shorthand expressions, and colloquial descriptions to merge different expressions into standardized terms. For example, “bus differential protection,” “busbar differential protection,” and “No. I bus differential protection device” are unified as “busbar differential protection device,” while “no return signal” and “action information not returned” are merged into “return-signal abnormality/information upload abnormality”. For terms not covered by the vocabulary, candidate terms are first identified through high-frequency term statistics and similar-expression discovery, and then checked against their source context before being added to the vocabulary. To reduce arbitrary merging, both the original expression and the standardized term are retained with the corresponding source identifier. Term merging is performed only when the expressions refer to the same equipment object, abnormal phenomenon, action state, or handling meaning in the source context, while ambiguous expressions are preserved in their original form for later evidence checking and source tracing. New unmatched expressions can be incrementally collected from updated corpora or retrieval queries, and lexical and semantic similarity can be used to generate candidate groups with existing standardized terms for subsequent source-context verification.
- (3)
- Semantic chunking. Instead of fixed-length truncation, semantic integrity is used as the primary principle. Periods, semicolons, bullet markers, and field tags are treated as candidate boundaries, while elements such as equipment object, abnormal phenomenon, action status, handling result, and rule requirement are used to determine whether a segment forms an independent knowledge unit. For causal or procedural chains such as “caused by …,” “restored after inspection,” and “no return signal after action,” the cause, phenomenon, and result are kept within the same unit. For long regulation-related texts, priority is given to preserving the correspondence between applicable conditions and handling requirements, with necessary context retained through source identifiers. The logical boundary determination process for semantic chunking is summarized in Algorithm 1.
| Algorithm 1 Semantic chunking with condition–requirement preservation |
| Input: normalized corpus item source identifier |
| Output: knowledge-unit set |
|
- (4)
- Metadata annotation. Metadata such as equipment category, abnormality category, action type, temporal attribute, and source category are annotated for each unit. After normalization, a knowledge unit is represented as:where denotes the normalized text, denotes the metadata, and denotes the source identifier.
2.4. Knowledge Unit Construction and Representation of Organized Results
3. Hybrid Retrieval and Evidence-Constrained Assisted Analysis Method
3.1. Monitoring Problem Representation and Query Understanding
3.2. Hybrid Retrieval Method Integrating Keywords, Vectors, and Hierarchical Indexing
3.3. Re-Ranking of Retrieval Results and Evidence Aggregation
3.4. Retrieval-Augmented Assisted Analysis Output Mechanism Under Evidence Constraints
3.4.1. Unified Input and Structured Output
3.4.2. Principles of Evidence-Constrained Generation
4. Result Analysis
4.1. Data and Evaluation Task Design
4.2. Comparative Verification on Hybrid Retrieval Performance
4.3. Verification on Evidence-Constrained Assisted Analysis Output
4.4. Representative Case Analysis
4.5. Lightweight Ablation Experiments on Key Modules
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Appendix A
| Corpus Type | Defect handling records |
| Data Form | Unstructured/semi-structured |
| Core Role | Reflect abnormal phenomena and handling processes |
| Main Characteristics | Flexible expression and relatively noisy content |
| Corpus Type | Regulations and standards |
| Data Form | Semi-structured |
| Core Role | Provide judgment criteria and handling requirements |
| Main Characteristics | Clear hierarchy and relatively long text length |
| Corpus Type | Operation and maintenance records |
| Data Form | Semi-structured/unstructured |
| Core Role | Supplement operational background and process information |
| Main Characteristics | Strong temporal characteristics and dispersed records |
| Corpus Type | Typical cases |
| Data Form | Unstructured |
| Core Role | Provide historical experience and similar references |
| Main Characteristics | Knowledge-intensive and uneven in granularity |
| Corpus Type | Action anomaly reports |
| Data Form | Unstructured/semi-structured |
| Core Role | Reflect abnormal phenomena and link-related issues during action processes |
| Main Characteristics | Strong event orientation, facilitating the tracing of action status and communication abnormalities |
| Corpus source 1 | Defect handling record |
| Raw text | The No. I bus differential protection device continuously reported sampling interruption and recovered after terminal inspection |
| Normalized representation | Object: busbar differential protection device; Event: sampling interruption alarm; Handling: terminal inspection; Status: restored |
| Field mapping | Equipment category: relay protection device; Abnormality category: sampling abnormality; Action type: alarm; Handling action: terminal inspection; State attribute: restored; Source category: defect record |
| Unit type | Abnormal phenomenon unit |
| Corpus source 2 | Action anomaly report |
| Raw text | No return signal was received after protection action, and no action information was uploaded to the backend system. |
| Normalized representation | Event 1: protection action. Event 2: return-signal abnormality. Result: missing backend information. |
| Field mapping | Action type: protection action. Abnormality category: return-signal abnormality. Result attribute: information not uploaded. Source category: action anomaly report |
| Unit type | Action anomaly unit |
| Corpus source 3 | Operation and maintenance record |
| Raw text | A channel abnormality occurred in a 220 kV line protection device, and the device returned to normal after coordinated troubleshooting by communication personnel. |
| Normalized representation | Object: 220 kV line protection device. Event: channel abnormality. Handling: coordinated troubleshooting. Status: restored to normal. |
| Field mapping | Equipment category: line protection device. Abnormality category: communication abnormality. Handling action: coordinated troubleshooting. State attribute: restored to normal. Source category: operation and maintenance record. |
| Unit type | Handling result unit |
| Corpus source 4 | Regulations and standards |
| Raw text | In the event of sampling abnormality in a protection device, the sampling circuit, transformer secondary circuit, and communication status shall be checked. |
| Normalized representation | Condition: sampling abnormality. Requirement 1: check the sampling circuit. Requirement 2: check the transformer secondary circuit. Requirement 3: check the communication status. |
| Field mapping | Applicable object: protection device. Rule type: handling requirement. Abnormality category: sampling abnormality. Source category: regulations and standards. |
| Unit type | Rule-evidence unit |
| Corpus source 5 | Typical case |
| Raw text | On a 220 kV line, a loose N600 connection caused secondary voltage distortion, resulting in maloperation of the pilot zero-sequence directional protection. |
| Normalized representation | Object: 220 kV line protection device. Event: maloperation of the pilot zero-sequence directional protection. Cause: loose N600 connection. Intermediate phenomenon: secondary voltage distortion. |
| Field mapping | Equipment category: line protection device. Abnormality category: directional protection misjudgment. Cause attribute: secondary-circuit abnormality. Result attribute: protection maloperation. Source category: typical case. |
| Unit type | Case experience unit |
| Raw input 1 | The No. I bus differential protection device continuously reports sampling interruption. What are the possible causes? |
| Equipment object | Busbar differential protection device |
| Abnormal phenomenon | Sampling interruption |
| Action/state | Continuous alarm |
| Retrieval intent | Cause investigation |
| Retrieval request | Object = busbar differential protection device; Abnormality = sampling interruption; State = continuous alarm; Intent = cause analysis |
| Raw input 2 | What regulations or rule-based evidence apply when no return signal is received after a protection action? |
| Equipment object | Not explicitly specified |
| Abnormal phenomenon | Return-signal abnormality |
| Action/state | After protection action |
| Retrieval intent | Rule/evidence query |
| Retrieval request | Abnormality = return-signal abnormality; State = after protection action; Intent = rule/evidence query |
| Raw input 3 | During an external fault on a 220 kV line, the pilot zero-sequence directional protection maloperated. Are there any similar cases? |
| Equipment object | 220 kV line protection device |
| Abnormal phenomenon | Maloperation of pilot zero-sequence directional protection |
| Action/state | External fault |
| Retrieval intent | Similar case retrieval |
| Retrieval request | Object = 220 kV line protection device; Abnormality = maloperation of pilot zero-sequence directional protection; Scenario = external fault; Intent = case retrieval |
| Raw input 4 | How should abnormalities in the voltage secondary circuit that lead to protection misjudgment be investigated and handled? |
| Equipment object | Voltage secondary circuit |
| Abnormal phenomenon | Protection misjudgment |
| Action/state | Secondary voltage abnormality |
| Retrieval intent | Acquisition of handling recommendations |
| Retrieval request | Object = voltage secondary circuit; Abnormality = protection misjudgment; State = secondary voltage abnormality; Intent = handling recommendation |
| Raw input 5 | A line protection device frequently issues alarms and is accompanied by communication abnormalities. What may be the cause? |
| Equipment object | Line protection device |
| Abnormal phenomenon | Frequent alarms |
| Action/state | Communication abnormality |
| Retrieval intent | Cause investigation |
| Retrieval request | Object = line protection device; Abnormality = frequent alarms; State = communication abnormality; Intent = cause analysis |
| Case 1 | |
| Monitoring problem | A line protection device reports abnormal zero-sequence voltage accompanied by misjudgment of the directional element. What may be the cause, and which links should be prioritized for inspection? |
| Abnormality judgment | Priority should be given to abnormalities in the voltage secondary circuit that cause deviation or distortion of zero-sequence voltage. Typical causes include abnormal PT neutral line conditions, loose or broken N-line connections, and poor contact of phase leads or terminals. |
| Evidence explanation | Typical cases show that a loose N600 connection can distort the secondary voltage waveform and introduce additional zero-sequence voltage, thereby causing misjudgment of the directional element. Regulations require monitoring and alarming for disconnection or voltage loss in the voltage transformer circuit, and emphasize inspection of the PT secondary circuit, N line, grounding, and external wiring. |
| Recommended handling actions | Priority should be given to checking the PT neutral line, N line, terminals, and phase leads. Disturbance records should be used to verify the phase relationship between zero-sequence voltage and current, while the external wiring and the condition of the entire secondary circuit should also be examined simultaneously. |
| Source traceability | Typical case unit + regulations and standards unit |
| Case 2 | |
| Monitoring problem | When abnormal signals are received by the remote monitoring system after a protection action, which types of communication or return-signal faults should be suspected first, and how should they be checked? |
| Abnormality judgment | Priority should be given to abnormalities in the return-signal link, the SOE/action information upload link, interface configuration, or backend mapping. Communication-link problems such as packet loss, abnormal delay, and poor port contact should also be considered. |
| Evidence explanation | Communication-link abnormalities do not necessarily manifest as a complete interruption; they may also appear as packet loss, abnormal delay, or poor connector contact, thereby preventing protection action information from being uploaded correctly. Regulations require that channel abnormalities should be monitored and investigated collaboratively by communication and relay protection personnel. |
| Recommended handling actions | The return-signal circuit, SOE/uploaded messages, backend point table, and interface configuration should be checked first. This should be followed by inspection of frame loss, delay, ports, and switching equipment status in the communication link. When necessary, defects should be eliminated jointly by communication and relay protection personnel. |
| Source traceability | Action anomaly unit + operation and maintenance record unit + regulations and standards unit |
References
- Zheng, S.; Liu, Z.; Yu, Y.; Dong, P.; Yang, X.; Wang, S.; Tao, C.; Xue, A. A Quality Evaluation Method for the Unstructured Defect Record of Relay Protection Devices Based on Ontology and Knowledge Graph. Energy Rep. 2023, 9, 771–781. [Google Scholar] [CrossRef]
- Wei, W.; Zhou, J.; Nan, D.; Wang, L.; Zhang, L.; Tang, X. Short Text Data Model of Secondary Equipment Faults in Power Grids Based on LDA Topic Model and Convolutional Neural Network. In Proceedings of the 2020 35th Youth Academic Annual Conference of Chinese Association of Automation (YAC), Zhanjiang, China, 16–18 October 2020; pp. 156–160. [Google Scholar]
- Chen, K.; Mahfoud, R.J.; Sun, Y.; Nan, D.; Wang, K.; Haes Alhelou, H.; Siano, P. Defect Texts Mining of Secondary Device in Smart Substation with GloVe and Attention-Based Bidirectional LSTM. Energies 2020, 13, 4522. [Google Scholar] [CrossRef]
- Nan, D.; Wang, K.; Wang, W.; Wei, W.; Chen, K.; Sun, Y. Defect Classification of Power Secondary Equipment Based on XGBoost Algorithm. In Proceedings of the 2019 Chinese Automation Congress (CAC), Hangzhou, China, 22–24 November 2019. [Google Scholar]
- Liu, J.; Ma, H.; Xie, X.; Cheng, J. Short Text Classification for Faults Information of Secondary Equipment Based on Convolutional Neural Networks. Energies 2022, 15, 2400. [Google Scholar] [CrossRef]
- Chen, K.; Nan, D.; Sun, Y.; Wang, K. Text Mining of Power Secondary Equipment Based on BiLSTM-Attention. In Proceedings of the 2020 Chinese Control and Decision Conference (CCDC), Hefei, China, 22–24 August 2020; pp. 709–714. [Google Scholar]
- Zheng, M.; Gao, Z.; Yu, J.; Mu, J.; Chen, Z.; Li, Z. Defect Analysis of Power System Secondary Equipment Based on Cluster Analysis and Association Rule. In Proceedings of the 2021 8th International Forum on Electrical Engineering and Automation (IFEEA), Xi’an, China, 10–12 September 2021; pp. 500–504. [Google Scholar]
- Shi, B.; Lu, S.; Yi, K. State Evaluation Method of Smart Substation Secondary Equipment Based on Big Data Mining. In Proceedings of the 2022 IEEE/IAS Industrial and Commercial Power System Asia (I&CPS Asia), Shanghai, China, 9–12 July 2022; pp. 929–933. [Google Scholar]
- Wang, W.; Zhang, J.; Wang, S.; Chen, X. A Comprehensive Performance Evaluation Algorithm for Substation Secondary Equipment: An Improved Analytic Hierarchy Process Entropy Weight and Learning Vector Quantization Neural Network Approach. J. Eng. 2024, 2024, e12347. [Google Scholar] [CrossRef]
- Xiang, X.-M.; Dong, X.-C.; He, J.-Q.; Zheng, Y.-K.; Li, X.-Y. A Study on the Fault Location of Secondary Equipment in Smart Substation Based on the Graph Attention Network. Sensors 2023, 23, 9384. [Google Scholar] [CrossRef] [PubMed]
- Guo, Z.; Luo, W.; Wei, J.; Wang, J. Intelligent Diagnosis of Power System Secondary Equipment Based on Selective Bayesian Networks and XGBoost. Eng. Res. Express 2025, 7, 035343. [Google Scholar] [CrossRef]
- Pan, J.; Gao, X.; Chen, Q.; Wang, Y. Predictive Modeling of Power Equipment Operation and Maintenance Based on Event Knowledge Graph. In Proceedings of the 2023 International Conference on Power, Electrical Engineering, Electronics and Control (PEEEC), Shenyang, China, 15–17 September 2023. [Google Scholar]
- Huang, X.; Li, P.; Wang, Y.; Ren, X.; Zhao, Z.; Li, G. Knowledge Graph-Augmented ERNIE-CNN Method for Risk Assessment in Secondary Power System Operations. Energies 2025, 18, 2104. [Google Scholar] [CrossRef]
- Zhu, P.; Li, Y.; Xu, P.; Li, P.; Zhao, Z.; Li, G. Secondary Operation Risk Assessment Method Integrating Graph Convolutional Networks and Semantic Embeddings. Sensors 2025, 25, 1934. [Google Scholar] [CrossRef] [PubMed]
- Tan, J.C.; Crossley, P.A.; Kirschen, D.; Goody, J.; Downes, J.A. An expert system for the back-up protection of a transmission network. IEEE Trans. Power Deliv. 2000, 15, 508–514. [Google Scholar] [CrossRef]
- Xiong, J.; Yang, P.; Chen, B.; Chen, Z. Defect Identification Method of Power Grid Secondary Equipment Based on Coordination of Knowledge Graph and Bayesian Network Fusion. Energy Eng. 2026, 123, 1–18. [Google Scholar] [CrossRef]
- Wu, D.; Zhao, R.; Tan, Y.; Yao, T.; Yang, X. A Method for Power Equipment Faults Knowledge Reasoning Based on Retrieval-Augmented Generation. In Proceedings of the 2025 2nd International Conference on the Frontiers of Electronic, Electrical and Information Engineering (ICFEEIE), Wuhan, China, 8–10 August 2025; pp. 448–455. [Google Scholar]
- Cheng, Y.; Zhao, H.; Xiang, D.; Zhang, Z.; Liu, G.; Liu, Y.; Zhao, J.; Cai, X. Power System Operational Reliability Evaluation with Retrieval-Augmented Generation Enhanced Large Language Model. Energy AI 2026, 24, 100688. [Google Scholar] [CrossRef]
- Zhao, H.; Cheng, Y.; Xiang, D.; Zhou, X.; Zhao, J.; Cai, X.; Dong, Z. Large Language Model-Based Power Dispatch Agent: Framework, Application and Challenges. Int. J. Electr. Power Energy Syst. 2026, 175, 111653. [Google Scholar] [CrossRef]
- Xiao, Z.; Liu, H.; Zhou, X.; Cong, S.; Ju, Y. Power Ops Agent: A Knowledge and Data Dual-Driven Multi-Agent Framework for Substation Operation and Maintenance. Expert Syst. Appl. 2026, 318, 131965. [Google Scholar] [CrossRef]
- Gao, Y.; Xiong, Y.; Gao, X.; Jia, K.; Pan, J.; Bi, Y.; Dai, Y.; Sun, J.; Wang, M.; Wang, H. Retrieval-Augmented Generation for Large Language Models: A Survey. arXiv 2023, arXiv:2312.10997. [Google Scholar]
- Edge, D.; Trinh, H.; Cheng, N.; Bradley, J.; Chao, A.; Mody, A.; Truitt, S.; Larson, J. From Local to Global: A Graph RAG Approach to Query-Focused Summarization. arXiv 2024, arXiv:2404.16130. [Google Scholar]
- Guo, Z.; Xia, L.; Yu, Y.; Ao, T.; Huang, C. LightRAG: Simple and Fast Retrieval-Augmented Generation. arXiv 2024, arXiv:2410.05779. [Google Scholar]
- Chen, Q.; Li, Q.; Wu, J.; Mao, C.; Peng, G.; Wang, D. Application of Knowledge Graph in Power System Fault Diagnosis and Disposal: A Critical Review and Perspectives. Front. Energy Res. 2022, 10, 988280. [Google Scholar] [CrossRef]









| Retrieval Method | Recall@5 Mean [95% CI] | ΔRecall@5 | nDCG@5 Mean [95% CI] | ΔnDCG@5 |
|---|---|---|---|---|
| Raw text chunking + BM25 retrieval | 0.87 [0.80, 0.93] | +0.07 | 0.79 [0.73, 0.84] | +0.10 |
| Raw text chunking + vector retrieval | 0.85 [0.78, 0.91] | +0.09 | 0.76 [0.69, 0.82] | +0.13 |
| Raw text + semantic chunking + BM25 retrieval | 0.89 [0.83, 0.94] | +0.05 | 0.81 [0.75, 0.86] | +0.08 |
| Raw text + semantic chunking + vector retrieval | 0.88 [0.82, 0.93] | +0.06 | 0.80 [0.74, 0.85] | +0.09 |
| Knowledge units + hybrid retrieval (without re-ranking) | 0.91 [0.85, 0.96] | +0.03 | 0.84 [0.78, 0.89] | +0.05 |
| Proposed method | 0.94 [0.89, 0.98] | -- | 0.89 [0.84, 0.93] | -- |
| Setting | α Semantic | β Object | γ Abnormality | δ Action/State | λ Source–Intent | Recall@5 | nDCG@5 |
|---|---|---|---|---|---|---|---|
| Final setting | 0.35 | 0.20 | 0.20 | 0.10 | 0.15 | 0.94 | 0.89 |
| Higher semantic weight | 0.40 | 0.18 | 0.18 | 0.09 | 0.15 | 0.93 | 0.88 |
| Lower semantic weight | 0.30 | 0.22 | 0.22 | 0.11 | 0.15 | 0.93 | 0.88 |
| Higher object/category weight | 0.32 | 0.23 | 0.23 | 0.09 | 0.13 | 0.94 | 0.88 |
| Higher source–intent weight | 0.33 | 0.19 | 0.19 | 0.10 | 0.19 | 0.93 | 0.88 |
| Output Method | Manual Evaluation | Automatic Evaluation | ||||||
|---|---|---|---|---|---|---|---|---|
| Judgment Correctness (ICC = 0.81) | Evidence Sufficiency (ICC = 0.84) | Recommendation Usefulness (ICC = 0.77) | Source Traceability (ICC = 0.86) | Accuracy | ECR | RCR | SCR | |
| Direct LLM output | 3.9 | 2.4 | 3.0 | 1.1 | 0.78 | 0.46 | 0.58 | 0.18 |
| Conventional RAG output | 4.4 | 3.8 | 4.0 | 2.2 | 0.87 | 0.72 | 0.79 | 0.41 |
| Proposed method | 4.7 | 4.6 | 4.5 | 4.7 | 0.93 | 0.89 | 0.88 | 0.90 |
| Ablation Setting | Retrieval Evaluation | Output Evaluation | ||||
|---|---|---|---|---|---|---|
| Recall@5 | nDCG@5 | Accuracy | ECR | RCR | SCR | |
| Proposed method | 0.94 | 0.89 | 0.93 | 0.89 | 0.88 | 0.90 |
| Without knowledge unit organization | 0.89 | 0.81 | — | — | — | — |
| Without metadata constraints and unified re-ranking | 0.91 | 0.84 | — | — | — | — |
| Without evidence-constrained output | — | — | 0.91 | 0.71 | 0.80 | 0.43 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Jin, L.; Ju, L.; Zhang, X.; Lu, Z.; Wang, T.; Zhou, J.; Liu, K. Knowledge-Organized and Retrieval-Augmented Intelligent Decision-Making Model for Remote Monitoring of Power System Secondary Equipment. Modelling 2026, 7, 148. https://doi.org/10.3390/modelling7040148
Jin L, Ju L, Zhang X, Lu Z, Wang T, Zhou J, Liu K. Knowledge-Organized and Retrieval-Augmented Intelligent Decision-Making Model for Remote Monitoring of Power System Secondary Equipment. Modelling. 2026; 7(4):148. https://doi.org/10.3390/modelling7040148
Chicago/Turabian StyleJin, Longxing, Luemou Ju, Xu Zhang, Zhengfei Lu, Tinghuang Wang, Jingyang Zhou, and Kangli Liu. 2026. "Knowledge-Organized and Retrieval-Augmented Intelligent Decision-Making Model for Remote Monitoring of Power System Secondary Equipment" Modelling 7, no. 4: 148. https://doi.org/10.3390/modelling7040148
APA StyleJin, L., Ju, L., Zhang, X., Lu, Z., Wang, T., Zhou, J., & Liu, K. (2026). Knowledge-Organized and Retrieval-Augmented Intelligent Decision-Making Model for Remote Monitoring of Power System Secondary Equipment. Modelling, 7(4), 148. https://doi.org/10.3390/modelling7040148

