Abstract
To address the challenges of quantifying expert experience, handling missing data, and managing class imbalance in evaluating the autonomous controllability of power equipment, this paper proposes a quantitative evaluation method that integrates expert prior rules with machine learning. First, building upon a five-dimensional evaluation indicator system, expert decision logic—including dimension-average threshold judgments, multi-dimensional weakness-based cumulative downgrading mechanisms, and key sub-item interaction rules—is formalized into a 15-dimensional rule prior feature vector, which is concatenated with the original 21-dimensional raw indicators to construct a RAW + RULE augmented feature space. Second, a KNN algorithm is employed for missing value imputation, while cost-sensitive learning combined with the SMOTE is adopted in a dual-path parallel scheme to address class imbalance. Six machine learning models are evaluated and compared via 30 repeated stratified cross-validations on a real-world dataset of 97 high-voltage bushing suppliers. Experimental results show that, on complete datasets, the RAW + RULE configuration with the Random Forest model achieves a mean test accuracy of 0.936 and a Kappa of 0.938, substantially outperforming the pure raw-feature model (accuracy 0.769, Kappa 0.766). Under weighted random missingness ranging from 10% to 50%, the RAW + RULE configuration demonstrates superior robustness, with ensemble tree models maintaining mean accuracies of 0.614–0.636 even at a 50% missing rate. This study provides a practically deployable technical solution and methodological reference for the quantitative assessment of autonomous controllability levels and early security warning in the power equipment supply chain.