1. Introduction
In recent years, component miniaturization has been important to the development of micromanufacturing technology, and some progress has been made in dimensional detection equipment [
1], which has led to a demand for precise measurement methods for such scales [
2]. Accurately detecting miniature parts and microblind holes has attracted attention in various fields, such as aviation, instrumentation, and biomedicine [
3,
4,
5]. In many industries, manufacturing microblind holes is common, but precise measurement of their size and three-dimensional profiles can be expensive or challenging. In particular, the inner contour structure of these microblind holes is often more difficult to measure than the outer contour structure. Despite the challenges involved, precisely measuring the inner contour structure of microblind holes is essential in many fields. With advancements in image processing and laser point cloud scanning technology, accurately detecting microblind holes is significant for improving manufacturing product quality [
6] and ensuring production consistency.
Machine vision and deep learning algorithms have been extensively studied in microblind hole recognition and detection. Li et al. [
7] proposed a focus measurement operator and an adaptive window fitting method to solve the geometric parameter measurement problem of millimeter-level cooling holes, with a standard deviation (SD) of contour error less than 0.018 mm. Berzal et al. [
8] proposed a new method for measuring the volume of arbitrary irregular micropores on rough surfaces. This method was used to calculate the void volume. The model effectiveness was verified by measuring six actual samples. Yuan et al. [
9] proposed an improved YOLOv5 network (ClearSight-RS) for remote sensing small target detection. Addressing issues such as complex backgrounds and weak target features, this network enhances the ability to perceive and localize small targets in complex scenarios by means of dynamic convolution and attention mechanisms, thereby providing an algorithmic reference for the recognition of typical small targets in complex backgrounds. Fang et al. [
10] proposed a measurement method for microhole profiles in automotive fuel injection nozzles, achieving accurate measurements of microhole diameter and roundness. The experimental results showed that the diameter of the measured microholes was 194.542, and the roundness was 2.551. Yang et al. [
11] proposed a new method for measuring the pore size of medicinal glass bottles based on vacuum testing technology. The results show that the proposed method can measure the pore size of medicinal glass bottles, and the indication error of the test results compared to the reference standard value is less than 0.1. Shen et al. [
12] proposed a machine vision-based method for detecting microholes in inkjet nozzles. The Canny operator was utilized to extract edge information, which was used to determine parameters such as the aperture size of the microholes. The deviation between the measured aperture size and the nominal aperture size obtained from this method was no more than ±3. Cao et al. [
13] proposed an improved two-dimensional detection method for micropores in glass ampoules based on GoogLeNet, achieving a network model accuracy of 99.15% in a self-built dataset.
In the aforementioned microblind hole detection tasks, recognizing and detecting microblind holes and calculating two-dimensional surface contour size ignores three-dimensional morphological information research on microblind holes or only the three-dimensional size information of microblind holes was directly calculated without recognizing and localizing microblind holes. Therefore, applying the abovementioned methods to rapidly detect microblind hole processing quality in practical production fields is difficult. In detecting the quality of microblind holes, laser point cloud scanning, which can provide high-precision three-dimensional contour data of microblind holes, is an ideal method for obtaining accurate and rapid three-dimensional size information under nondestructive conditions. However, in the images obtained after laser scanning conversion, the background texture with microblind holes is complex and variable. Additionally, the contours of the microblind holes are tiny and blurry with various shapes. Accurately recognizing and locating microblind holes with complex textured backgrounds and calculating the geometric three-dimensional morphologies of each microblind hole are difficult. Currently, there is almost no research on the rapid localization of microblind holes with different complex background textures and accurate calculations of three-dimensional hole morphology parameters in practical applications. In addition, high speed is required during the entire detection process efficiently and accurately achieving both the recognition, localization, and precise calculation of geometric three-dimensional morphologies of microblind holes under complex background textures simultaneously poses significant challenges.
With the continuous research on deep learning algorithms, object detection algorithms, which can quickly and accurately identify various objects in images or videos to meet real-time object detection needs, have been widely used in engineering [
14,
15] and other fields [
16,
17,
18,
19]. Chen et al. [
20] proposed a new tire detection method with improved YOLOv5, achieving a mean average precision (mAP) of 91.3%. Zhou et al. [
21] proposed the DSC-RTDETR model for concrete surface crack detection by improving RTDETR, with YOLOv11 as the backbone, DSConv and dual attention mechanisms integrated, achieving 1.8% higher accuracy and 2.1% higher recall than RTDETR while reducing computational complexity and parameters. Chen et al. [
22] proposed an improved single-lens multibox detector (SSD) to achieve rapid vehicle detection in traffic scenes, and the final model achieved mAPs of 82.59% and 84.83% on the BDD100K and KITTI datasets, respectively. Liu et al. [
23] proposed an enhanced YOLOv11 for autonomous driving road scene detection with the Roboflow-processed Udacity dataset, achieving 4.6% higher mAP@0.5, 7.6% higher mAP 0.5:0.95, and 6.4% higher recall than the baseline, effectively addressing the detection challenges of distant small targets and dense object clusters. Jiang et al. [
24] proposed an improved RetinaNet face detection model called IRNet to detect faces in real-time and achieved detection results of 89.26% and 76.59% on the medium and hard datasets, respectively. Li et al. [
25] proposed a real-time detection algorithm for small-object repair parts based on an improved YOLOv11, which improved the feature extraction ability of the network, with mAP@0.5:0.95 and APs@0.5:0.95 increasing by 1.7% and 3.3%, respectively. Aiming at the issues of low detecting precision and the slow processing rate that existed in the traditional target detection methods for aluminum ingot alloy dataset, Kong et al. [
15] proposed one for the solder paste similar defects and combined with phase modulation profile measurement technique and improve the YOLOX intelligent detection system. The experimental results show that the best 90.33% detection accuracy is obtained. Guo et al. [
26] proposed a small-object detection algorithm based on an improved YOLOv11 to solve problems such as misidentification and missed detection of small targets in object detection, and the mAP for small-object detection reached 94.88%.
This study proposes a comprehensive solution based on an improved YOLOv11 model for microblind hole recognition and detection to meet the demands of rapid identification and positioning of cigarette microblind holes in cigarette quality inspection lines, and the precise calculation of their three-dimensional morphological parameters. as Additionally, an algorithm for three-dimensional morphological parameter calculations to meet the real-time and accuracy requirements for quality inspection lines. This study focuses on the fast and accurate identification and positioning of microblind holes under complex textures and different backgrounds, and the precise calculation of their three-dimensional geometric morphology.
The main contributions of this paper are as follows:
We establish a comprehensive dataset containing 24,398 microblind hole samples across 14 complex texture backgrounds to address the scarcity of specialized training data for micro-scale features. This dataset incorporates diverse hole counts and varying textures to enhance the model’s robustness and generalizability against high-frequency industrial noise. We establish a comprehensive dataset containing 24,398 microblind hole samples across 14 complex texture backgrounds to address the scarcity of specialized training data for micro-scale features. This dataset incorporates diverse hole counts and varying textures to enhance the model’s robustness and generalizability against high-frequency industrial noise.
An improved YOLOv11 multiobject detection network is developed by integrating a VGG13_bn backbone and BiFPN mechanism to ensure precise localization of 0.1–0.2 mm targets. The architecture overcomes the “scale-aliasing” effect in complex backgrounds, achieving a high mAP@0.5 of 0.925 and an inference speed of 1.27 ms to meet real-time industrial requirements.
We propose a novel Area–Volume Computation (AVC) algorithm based on discrete integral estimation and curve-fitting for the precise 3D morphological analysis of irregular holes. This method effectively maintains relative errors below 4% for volume calculation, fulfilling the accuracy demands for on-site quality inspection under non-destructive conditions.
A complete 3D measurement system is integrated to provide a rapid and non-destructive solution for microblind hole quality inspection on cigarette filter tips. This study offers a scalable methodological reference for the automated detection and 3D parameter calculation of similar micro-objects in environments with complex surface textures.
4. Results
4.1. Implementing the Improved YOLOv11 Model
A 64-bit Windows 11 operating system was used as the experimental platform. The processor used was a 12th Gen Intel(R) Core(TM) i7-12700 CPU @ 2.10 GHz, accompanied by a 64 GB (32 GB × 2) RAM configuration. The system was equipped with an NVIDIA GeForce RTX 3080 graphics card with 10 GB of video memory. The experimental training was conducted within the PyTorch 1.13.1 deep learning framework based on the Python programming language. Python version 3.9 was used, and CUDA version 11.6 was utilized for GPU acceleration. Additionally, the training of the network model involved 150 iterations and 8 batches. The improved YOLOv11 network model was trained using the stochastic gradient descent (SGD) optimizer. After 150 training iterations, the network performance approached a stable state.
Four evaluation metrics for detection performance were adopted, precision (P), recall (R), mAP@0.5, and mAP@0.5:0.95, to evaluate the performance of the proposed improved YOLOv11 network model in terms of microblind hole contours. One evaluation metric for network parameters was adopted as the parameter. mAP@0.5 represents the average detection accuracy of the network model for all detected target categories when the IoU threshold is 0.5. mAP@0.5:0.95 represents the average detection accuracy of the network model under 10 IoU thresholds ranging from 0.5 to 0.95 with a step size of 0.05. The calculation formulas are shown in Equations (6)–(9).
TP (true positives) represents the number of correctly predicted positive samples, FP (false positives) represents the number of incorrectly predicted positive samples, FN (false negatives) represents the number of incorrectly predicted negative samples, and n represents the number of categories in the self-built microblind hole contour dataset.
Parameters represent the number of parameters in the network model, which is one of the important reference indicators for evaluating the size and performance of the network model.
The surface area (excluding the circular face) and volume of a hemisphere are calculated separately using Equations (10) and (11) to evaluate the accuracy of the proposed AVC algorithm. The relative error (RE), SD, and coefficient of variation
are used as evaluation metrics. The RE represents the relative error between the calculated values and the standard values of the hemisphere’s surface area and volume. SD and CV indicate the standard deviation and coefficient of variation, respectively, which are used to measure the variability in the data.
In Equations (13)–(17), R represents the radius of the hemisphere, Y denotes the measured value obtained from the AVC algorithm, L represents the calculated value based on Formulas (13) and (14), represents the measured value corresponding to an individual sample, is the average measured value obtained from 5 selected samples, and n indicates the number of samples extracted.
4.2. Results and Analysis
YOLOv11s and the improved YOLOv11 models were trained and tested on a self-built dataset of microblind hole profiles for 150 epochs. As shown in
Table 2, the detection precision, recall, mAP@0.5, and mAP@0.5:0.95 of the YOLOv11s model were 0.861, 0.893, 0.879 and 0.540, respectively. Compared with YOLOv11s, the improved YOLOv11 model significantly improved the contour detection performance of microblind holes. The improved detection precision, recall, mAP@0.5, and mAP@0.5:0.95 were 0.915, 0.948, 0.925, and 0.615, with increases of 5.4%, 5.5%, 4.6%, and 7.5%, respectively. These results validated the feasibility of the proposed method. Although the improved model had slightly more parameters than YOLOv11s, it was still efficient at recognizing and locating microblind hole profiles and reducing missed or false detection cases, which met the demands of real field detection.
Figure 13 shows an example of a detection performance comparison of YOLOv11s and the improved YOLOv11 model.
4.3. Ablation Experiment
4.3.1. Validation of Improvements on the Backbone Network
This section validates the feature extraction performance of a new backbone network on microblind hole contours. Ten different network models, including YOLOv11s, EfficientNet, ResNet50, DenseNet121, ShuffleNetV2, MobileNet, VGG11, VGG13, VGG16 and VGG13bn, were compared as backbone networks using a self-built dataset to recognize and locate microblind hole profiles. The experimental results in
Table 3 show the following:
The EfficientNet, ResNet50, DenseNet121, ShuffleNetV2, MobileNet, and VGG16 models were used as the backbone network for YOLOv11 to extract features of microblind hole profiles. VGG16 and ResNet50, as the backbone networks, achieved similar detection accuracies, but ResNet50 has more parameters and is more complex, which reduces the detection efficiency to some extent. However, VGG16, as the backbone network, has lower parameters while maintaining comparable detection performance, with a precision and mAP@0.5 of 0.895 and 0.912, respectively. Compared to YOLOv11s, there was a significant improvement in the detection precision and mAP@0.5, with increases of 3.4% and 3.3%, respectively; however, the number of network model parameters increased by 129.76%.
Comparing YOLOv11s-VGG11, YOLOv11s-VGG13, and YOLOv11s-VGG16, YOLOv11s-VGG13 and YOLOv11s-VGG16 were found to have similar detection accuracies, with differences of only 0.3% and 0.4% in precision and mAP@0.5, respectively. However, the number of parameters of YOLOv11s-VGG13 is reduced by 28.9% compared to that of YOLOv11s-VGG16, making the model more lightweight and improving the detection efficiency to some extent. Although YOLOv11s-VGG11 has the same parameters as YOLOv11s-VGG13, it has lower detection performance and does not meet practical detection needs. Therefore, YOLOv11s-VGG13 performs better overall.
Considering that gradient disappearance or explosion may occur during YOLOv11s-VGG13 backbone network training, a BN operation was added to the convolution block of VGG13 to form the YOLOv11s-VGG13bn network structure, which can accelerate the convergence speed of the network model (a comparison of loss functions before and after the improvement is shown in
Figure 14.) Compared to YOLOv11s-VGG13, the number of parameters of YOLOv11s-VGG13bn hardly changed; however, all the performance indicators further improved by 0.6%, 0.8%, 0.2%, and 0.4%, respectively. YOLOv11s-VGG13bn achieved the best performance among them.
4.3.2. Validation of Detection Head Improvements
Based on the improvement demonstrated in the previous section, this section validates the model’s performance by introducing a small-object detection head in the neck structure. The effect of the proposed enhancements is verified through comparison.
Table 4 shows that the model with the added small-object detection head significantly enhances the detection performance of microblind holes with tiny contours. This suggests that although the network model parameters are slightly increased with the addition of a high-resolution detection head, the information for tiny objects can be retained, effectively improving the ability of the model to detect and recognize small-object blind hole contours and reducing the problem of missed detection of small objects. The results also demonstrate the effectiveness of the proposed improvements in practical detection tasks and indicate that the position feature information of shallow feature maps has a good auxiliary effect on the detection of small objects. Compared with YOLOv11s-VGG13bn, mAP@0.5 is equivalent, with increases of 0.7%, 1.8%, and 1.3% in precision, recall, and mAP@0.5:0.95, respectively. The proposed model, YOLOv11s-VGG13bn-the P2, is named YOLOv11-VP.
4.3.3. Validation of the Improvements in Neck Feature Extraction
Based on the improvement demonstrated in the previous section, this subsection introduces an efficient BiFPN structure at the neck of the model. The ordinary convolutions are also replaced with the GhostConv module, which utilizes depthwise separable convolutions. The original C3k2 module is replaced with C3Ghost, and the performance of the improved model is validated to compare the advantages of the proposed modifications.
According to
Table 5, after introducing the BiFPN structure, the number of parameters remains largely unchanged. Through sufficient feature fusion, the detection precision and mAP@0.5: The 95% CIs of the models are generally more stable than those of the YOLOv11-VP model. The recall and mAP@0.5 slightly improved, and the inference speed also increased. Additionally, adopting GhostConv modules and C3Ghost blocks improved the detection performance of the model for microblind holes. All four performance evaluation metrics improved to varying degrees, with enhancements of 1.0%, 0.2%, 1.2%, and 1.0%, respectively. The final model achieves an inference speed of 1.27 ms and significantly reduces the number of model parameters. The compressed model parameters are reduced by 18.3% compared to the YOLOv11-VP-BiFPN model.
4.3.4. Comparison with Other Detection Methods
To ensure the rigor and comparability of the experiment, this study trained and tested the SSD [
29], Faster RCNN [
27], YOLOv3 [
36], RetinaNet [
37], YOLOv11s, YOLOv10b [
38], TOOD [
39], RT-DETR [
40] and improved YOLOv11 models on a self-built microblind hole contour dataset to verify the superiority and effectiveness of the improved YOLOv11 model.
As shown in
Table 6, the improved YOLOv11 shows the best overall performance on the self-built dataset compared with all tested models. Compared with YOLOv11s, the proposed improved YOLOv11 model achieves significant improvements in detection precision, recall, mAP@0.5, and mAP@0.5:0.95 for microblind hole contours, with increases of 5.4%, 5.5%, 4.6%, and 7.5%, respectively. Compared with TOOD [
39] and RT-DETR [
40], the improved YOLOv11 also outperforms them in all evaluation metrics while maintaining a more compact parameter quantity.
In conclusion, the proposed improved YOLOv11 model can efficiently and accurately accomplish the recognition and localization tasks of microblind hole contours in complex backgrounds.
4.3.5. Robustness Analysis Under Industrial Disturbances
To validate the reliability of the proposed system in harsh industrial environments, we conducted robustness tests simulating three common disturbances: illumination fluctuations, mechanical vibrations, and sensor contamination.
Illumination Sensitivity: We adjusted the brightness to −30 and applied gamma correction (gamma = 1.5) to simulate non-linear darkening. The improved YOLOv11 maintained a mAP@0.5 of 0.912, showing strong resilience to lighting shifts due to the VGG13_bn’s normalization layers. Typical detection results under illumination variations are shown in
Figure 15.
- 2.
Mechanical Vibration: To simulate the jitter of the cigarette clamping mechanism, a motion blur with kernel_size = 20 and near-vertical jitter (angle = 90°) was applied to the testing set. The detection precision only dropped by 2.3%, demonstrating the robustness of the BiFPN feature fusion in preserving structural edges. Typical detection results under mechanical vibration are shown in
Figure 16.
4.4. Qualitative Analysis of Failure Cases
Despite the significant performance improvements in the improved YOLOv11 model, a qualitative analysis of failure cases reveals specific environmental and geometric constraints that lead to detection inaccuracies. Analysis of the test set identifies three primary error patterns: Boundary Texture Mimicry, where complex background stripes overlap with the circular contours of the microblind holes; Specular Reflection Occlusion, caused by the cigarette’s material properties leading to local overexposure; and Extreme Geometry Distortion, where physical deformation of the cigarette filter alters the projected 2D shape of the holes. As quantified in
Table 7, the majority of False Positives (FP) are triggered by High-Contrast Texture Noise, while False Negatives (FN) are predominantly associated with Edge Occlusion. These failure modes suggest that while the network excels in standard complex backgrounds, its sensitivity to non-linear illumination changes remains a secondary challenge for future optimization.
4.5. Evaluation of Cross-Factory Generalization
A critical requirement for industrial deployment is the model’s ability to generalize across different factories. We conducted a cross-validation experiment using a “leave-one-factory-out” strategy. The model was trained on data from Factories I, II, and III, and subsequently tested on unseen samples from Factory IV.
As shown in
Table 8, the model achieved a mAP@0.5 of 0.896 on the unseen factory data, which is only a marginal decrease compared to the intra-factory testing results (0.925). The AVC algorithm also maintained a volume RE below 4.5% across different sites. This high generalization performance is attributed to the GhostConv-based neck architecture, which focuses on universal morphological features rather than overfitting to specific factory-dependent background textures. The results confirm that the proposed framework can be rapidly deployed across various manufacturing sites without extensive retraining.
4.6. Cross-Domain Generalization on Industrial Micro-Defects
To address the concern regarding the potential domain-specificity of the proposed model, a cross-domain generalization experiment was conducted. We evaluated the architecture on the HRIPCB dataset (released by the Intelligent Robot Open Laboratory, Peking University), focusing on the “missing_hole” defect category. Unlike cigarette filters, PCB surfaces exhibit rigid geometric patterns and diverse metallic reflections, providing a rigorous test for the model’s spatial feature invariance. The detailed recognition results are illustrated in
Figure 17.
As shown in
Table 9, the improved YOLOv11 model demonstrates superior transferability compared to the baseline models previously discussed in
Section 4.3.4. On the HRIPCB dataset, our model achieved a Precision of 0.987, a Recall of 0.976, and a mAP@0.5 of 0.982. This represents a significant performance leap over the standard YOLOv11s (Precision: 0.942) and Faster R-CNN (Precision: 0.915).
The exceptional precision (>98.5%) on the HRIPCB dataset is attributed to two factors:
- 1.
The P2 High-Resolution Head: The 160 × 160 feature map is particularly sensitive to the sharp circular edges of missing drill holes on PCB boards.
- 2.
BiFPN and Ghost-Modules: These ensure that the model captures the high-frequency contrast between the substrate and the missing hole without being distracted by the complex routing patterns (traces) of the PCB.
The results empirically confirm that the proposed framework is not merely a specialized tool for cigarette micro-blind holes but a robust solution for diverse industrial micro-scale feature detection.
4.7. Metrological Validation of the AVC Algorithm Using Certified Standards
To address the requirement for independent metrological validation, the proposed AVC algorithm was tested against two high-precision certified microblind hole standards. These standards feature rectangular geometries, which allow for a more rigorous evaluation of the algorithm’s geometric invariance compared to simple hemispherical models. The intensity map of the certified standards is shown in
Figure 18.
The dimensions of the standards are:
Standard S1: Depth 0.1 ± 0.005 mm, Width 1.0 ± 0.005 mm, Length 2.0 ± 0.005 mm (Theoretical Volume: 0.200 mm3; Inner Surface Area: 2.600 mm2).
Standard S2: Depth 0.2 ± 0.005 mm, Width 1.0 ± 0.005 mm, Length 2.8 ± 0.005 mm (Theoretical Volume: 0.300 mm3; Inner Surface Area: 3.800 mm2).
The measurement results are summarized in
Table 10. The relative errors (RE) for volume calculation were 3.45% for S1 and 3.79% for S2. These results demonstrate that the AVC algorithm maintains high precision across different scales and geometric profiles, effectively bridging the gap between computer vision localization and industrial metrological standards.
4.8. Ablation Study and Sensitivity Analysis of the AVC Algorithm
To address the individual contribution of each component within the AVC algorithm and validate the theoretical error model proposed in
Section 3.2.5, a systematic ablation study was conducted. We evaluated three key factors: the polynomial degree for curve fitting (
), the discrete integration resolution (
divisions), and the mapping scale precision. The analysis was performed using the certified standard S1 as the benchmark.
4.8.1. Effect of Curve-Fitting Order ()
The curve-fitting component is designed to smooth the discrete point cloud and minimize sensor noise. We compared the performance of linear, quadratic, and cubic (current) fitting models. As shown in
Table 8, linear fitting (Degree 1) fails to capture the subtle curvature of the microblind hole bottom, resulting in a significantly higher RE for volume (8.42%). Transitioning to cubic fitting (Degree 3) reduced the RE to 3.45%, confirming that higher-order polynomials effectively minimize the residual
as modeled in
Section 3.2.5.
4.8.2. Impact of Discrete Integration Step Size ()
The integration approximation error
is theoretically
. We varied the number of equal parts (
) for the fitting curve from 20 to 200. The results in
Table 8 indicate that while
leads to a coarse approximation with 7.15% RE, increasing
to 100 provides an optimal balance between accuracy (3.45% RE) and computational efficiency (latency < 52 ms). Further increasing
to 200 yielded negligible improvements (3.41% RE) but increased processing time by 45%.
4.8.3. Sensitivity to Mapping Precision ()
To evaluate the impact of the non-integer scaling mapping defined in Equations (1) and (2), we compared the proposed adaptive mapping with a fixed-integer rounding approach. The adaptive mapping reduced the surface area RE by 1.2% by preserving sub-pixel spatial relationships, validating the necessity of the precision mapping component.
The results in
Table 11 empirically demonstrate that the cubic fitting and the
integration step are the most critical components for maintaining high geometric accuracy. This experimental evidence aligns with the mathematical error bounds
and
established in the analytical modeling section, proving the robustness of the AVC framework for micro-scale morphology.
4.9. Comparative Analysis of AVC and Classical Mesh-Based Baselines
To further elucidate the novelty and superiority of the AVC algorithm, a comparative study was conducted against the standard Mesh-based Integration (MI) method [
41], which is a common baseline in 3D reconstruction. The MI method involves generating a water-tight mesh via Delaunay triangulation and summing the signed volumes of the tetrahedra. Both algorithms were tested using the S1 Certified Standard (Theoretical Volume: 0.200 mm
3; Surface Area: 2.600 mm
2) under identical hardware conditions.
As summarized in
Table 12, the AVC algorithm significantly outperformed the MI method in both accuracy and efficiency. While the MI method is highly dependent on the raw density and local quality of the point cloud, often leading to overestimation due to high-frequency surface noise (Relative Error of 7.24% for volume), the AVC algorithm achieves a lower volume RE of 3.45% through its cubic-fitting smoothing mechanism.
The results demonstrate that the AVC algorithm provides a superior balance between metrological precision and computational overhead, particularly for micro-scale objects where raw point cloud data may contain significant scanning artifacts.
4.10. Sensitivity Analysis and Error Propagation from Localization to 3D Quantification
To establish a rigorous methodological link between the upstream object detection and the downstream geometric calculation, a sensitivity analysis was performed to evaluate how localization inaccuracies propagate to the final surface area and volume estimations. In the proposed framework, the AVC algorithm utilizes the bounding box coordinates generated by the improved YOLOv11 as the spatial cropping window for 3D point cloud extraction. Consequently, a spatial jitter in the bounding box (defined by center coordinates x,y and dimensions w,h) directly alters the integration domain Ω for Equations (4) and (5).
To quantify this effect, we manually introduced controlled pixel-level perturbations to the optimal bounding boxes on a representative subset of the testing data. The perturbation magnitude ranged from ±2 to ±15 pixels, simulating the common localization fluctuations observed in complex backgrounds. The experimental results, as summarized in
Table 13, illustrate the correlation between Intersection over Union (IoU) degradation and the resultant Relative Error (RE) of 3D parameters. It is observed that the AVC algorithm exhibits a high degree of mathematical robustness when the localization offset is within a reasonable industrial tolerance. Specifically, a localization shift of ±5 pixels—which corresponds to a decrease in IoU to approximately 0.92—only leads to a marginal increase in the RE of surface area (from 5.236% to 5.612%) and volume (from 3.964% to 4.285%). This stability is attributed to the fact that the microblind hole contours are centrally distributed within the detected boxes, and the calculus-based curve fitting (CCF) within the AVC algorithm effectively smooths minor boundary noise introduced by slight window misalignments.
However, as the localization offset exceeds ±15 pixels (IoU < 0.8), the RE for volume calculation increases more sharply compared to the surface area. This phenomenon occurs because large spatial shifts cause the cropping window to truncate the deepest part of the hole or include significant background noise, thereby distorting the integral . Nevertheless, given that the improved YOLOv11 achieves a high mAP@0.5 of 0.925 and precise localization, the operational fluctuations remain well within the robust regime of the AVC algorithm. This error propagation analysis confirms that the proposed detection-to-calculation pipeline is not only accurate in its individual components but also highly resilient as an integrated system for industrial inspection.
4.11. Industrial Real-Time Performance and Latency Analysis
To further validate the “real-time” claims for industrial deployment, a comprehensive system-level latency analysis was conducted. The total processing time () for a single inspection cycle is decomposed into four stages: data acquisition (), image preprocessing (), YOLOv11 detection and localization (), and AVC-based 3D morphology calculation ().
As shown in
Table 14, the end-to-end latency on the primary testing platform (RTX 3080) is approximately 346.67 ms per image, which translates to an inspection speed of about 2.9 frames per second (FPS). The AVC algorithm, despite its calculus-based integration, maintains a relatively efficient latency of 51.4 ms due to the optimized curve-fitting logic.
Furthermore, to assess hardware sensitivity, the model was tested on a mid-range industrial embedded platform (NVIDIA Jetson AGX Orin). The total latency increased to 637.15 ms (corresponding to ~1.6 FPS), which still meets the basic industrial inspection criteria for low-to-medium speed production scenarios, demonstrating the robust deployment potential of the proposed framework across varying hardware scales.
5. Conclusions
In practical three-dimensional morphology of cigarette microblind hole detection tasks, efficiently recognizing and locating the contours of different microblind holes in complex backgrounds and accurately measuring their surface area and volume is difficult. This paper takes cigarette microblind holes (diameter of 0.1–0.2 mm, depth of approximately 35 µm) as the research object and focuses on solving two major challenges: the recognition and localization of microblind hole contours in complex texture backgrounds and the accurate calculation of the 3D geometric morphology of microblind holes. An improved YOLOv11 network model is proposed to recognize and locate the contours of different types of microblind holes. An AVC algorithm is also proposed to further calculate the surface area and volume of microblind holes in a three-dimensional morphology. The proposed detection method meets the actual detection requirements of industrial sites. This study achieves the following innovations:
A three-dimensional point cloud data acquisition platform for microblind holes was established, and 3D perforation data of 14 different cigarette brands with different perforation amounts ranging from 9 to 44 and different complex texture backgrounds were collected. A data preprocessing algorithm is researched to reduce the amount of parameter computation calculations. Considering the diversity of microblind hole contours and the complexity of backgrounds, 1213-point clouds were collected to establish a dataset of 24,398 microblind hole contour samples to better meet the microblind hole detection task and improve the model’s generalizability.
We propose an improved YOLOv11 network model with a new backbone, an improved feature fusion mode and added detection heads. VGG13bn serves as its new backbone network, and the extracted deep-level features can capture higher-level semantic information, significantly improving the microblind hole detection performance. A small target detection layer is introduced to improve the detection performance of smaller microblind hole contours without significantly increasing the model parameters. Moreover, to strengthen the feature extraction and fusion of the neck structure, a BiFPN structure is introduced to fuse more feature information without significantly increasing the model’s parameter quantity. Finally, the GhostConv and C3Ghost modules are introduced in the neck structure to replace the Conv and C3k2 modules, respectively, reducing the model’s parameter quantity while improving its detection precisionand efficiency. The improved YOLOv11 network model performs best at efficiently completing microblind hole contour recognition and location tasks under complex background textures.
The AVC algorithm was used to efficiently and accurately calculate the surface area and volume of irregular microblind holes. This approach solves the problem of high-precision measurements of irregular 3D microblind hole morphologies and meets the measurement requirements of industrial sites.
The detection precision, recall, mAP@0.5, mAP@0.5:0.95, parameter quantity, and detection time of the proposed improved YOLOv11 network model are 0.915, 0.948, 0.925, 0.615, 19,250,030, and 1.27 ms, respectively, ensuring detection precision and efficiency under the premise of not having a large number of model calculation parameters. The performance of the proposed method was validated, making it highly applicable to industrial sites.
However, this study has certain limitations. For microblind hole contours with overly complex backgrounds, the model may have a small number of missed detections, and the calculation accuracy of the AVC algorithm needs further improvement. Subsequent work should consider the following aspects:
Further optimizing the detection performance of the network model for detecting microblind hole contours in complex backgrounds with various textures and stripes.
The AVC algorithm is optimized to minimize measurement errors and ensure computational efficiency for microblind holes with poor regularity in 3D contour morphology.