Abstract
In situ detection of the tracking poses of heliostats can help improve the tracking accuracies of heliostats and reduce the task loads of heliostat calibration in a large-scale concentrated solar power (CSP) plant, as the traditional methods normally require the heliostats to be off from sun-tracking during the calibration process. This paper presents a deep learning-based framework for in situ detection of geometric keypoints of the heliostat surface. The proposed framework is built upon YOLOv8-Pose but integrates a high-resolution P2 feature branch to recover fine-grained spatial details that are otherwise lost in deep semantic layers. Further, a geometry-consistency loss is introduced to regularize the predicted quadrilateral, enforcing strict structural integrity under dynamically changing illumination. An experimental study on a real-world heliostat image dataset shows that the proposed framework achieves an end-to-end inference speed of 25.14 FPS. The mean end-point error (EPE) of detected keypoints is around 1.22 pixels, while the stringent mAP@0.5:0.95 metric reaches 0.9823. The keypoint detection framework could be integrated with an in-field heliostat control system for further improvement of the working efficiency of heliostats in a large-scale CSP plant in future.