Search Results (115)

Accurate acquisition of two-dimensional digital maps of disaster sites is crucial for rapid and effective emergency response. The construction of two-dimensional digital maps using unmanned aerial vehicle (UAV) aerial images is not affected by factors such as signal interference, terrain, or complex building structures, which are common issues with methods like single-soldier image transmission or satellite imagery. Therefore, this paper investigates a method for modeling two-dimensional digital maps based on UAV aerial images. The proposed Canny edge-enhanced Speeded-Up Robust Features (C-SURF) algorithm in this method is designed to enhance the number of feature extractions and the accuracy of image registration. Compared to the SIFT and SURF algorithms, the number of feature points increased by approximately 44%, and the registration accuracy improved by about 16%, laying a solid foundation for feature-based image stitching. Additionally, a novel image stitching method based on the novel energy function is introduced, effectively addressing issues such as color discrepancies, ghosting, and misalignment in the fused image sequences. Experimental results demonstrate that the signal-to-noise ratio (SNR) of the fused images based on the novel energy function can reach an average of 36 dB. Full article

This paper presents an approach for event recognition in sequential images using human body part features and their surrounding context. Key body points were approximated to track and monitor their presence in complex scenarios. Various feature descriptors, including MSER (Maximally Stable Extremal Regions), SURF (Speeded-Up Robust Features), distance transform, and DOF (Degrees of Freedom), were applied to skeleton points, while BRIEF (Binary Robust Independent Elementary Features), HOG (Histogram of Oriented Gradients), FAST (Features from Accelerated Segment Test), and Optical Flow were used on silhouettes or full-body points to capture both geometric and motion-based features. Feature fusion was employed to enhance the discriminative power of the extracted data and the physical parameters calculated by different feature extraction techniques. The system utilized a hybrid CNN (Convolutional Neural Network) + RNN (Recurrent Neural Network) classifier for event recognition, with Grey Wolf Optimization (GWO) for feature selection. Experimental results showed significant accuracy, achieving 98.5% on the UCF-101 dataset and 99.2% on the YouTube dataset. Compared to state-of-the-art methods, our approach achieved better performance in event recognition. Full article

To address the challenge of rapid geometric model development in the digital twin industry, this paper presents a comprehensive pipeline for constructing 3D models from images using monocular vision imaging principles. Firstly, a structure-from-motion (SFM) algorithm generates a 3D point cloud from photographs. The feature detection methods scale-invariant feature transform (SIFT), speeded-up robust features (SURF), and KAZE are compared across six datasets, with SIFT proving the most effective (matching rate higher than 0.12). Using K-nearest-neighbor matching and random sample consensus (RANSAC), refined feature point matching and 3D spatial representation are achieved via antipodal geometry. Then, the Poisson surface reconstruction algorithm converts the point cloud into a mesh model. Additionally, texture images are enhanced by leveraging a visual geometry group (VGG) network-based deep learning approach. Content images from a dataset provide geometric contours via higher-level VGG layers, while textures from style images are extracted using the lower-level layers. These are fused to create texture-transferred images, where the image quality assessment (IQA) metrics SSIM and PSNR are used to evaluate texture-enhanced images. Finally, texture mapping integrates the enhanced textures with the mesh model, improving the scene representation with enhanced texture. The method presented in this paper surpassed a LiDAR-based reconstruction approach by $20\%$ in terms of point cloud density and number of model facets, while the hardware cost was only $1\%$ of that associated with LiDAR. Full article

Subsurface structural distribution can be detected using Ground-Penetrating Radar (GPR). The distribution can be considered as road fingerprints for vehicle positioning. Similar to the principle of visual image matching for localization, the position coordinates of the vehicle can be calculated by matching real-time GPR images with pre-constructed reference GPR images. However, GPR images, due to their low resolution, cannot extract well-defined geometric features such as corners and lines. Thus, traditional visual image processing algorithms perform inadequately when applied to GPR image matching. To address this issue, this paper innovatively proposes a GPR image matching and localization method based on a novel feature descriptor, termed as central dense structure context (CDSC) features. The algorithm utilizes the strip-like elements in GPR images to improve the accuracy of GPR image matching. First, a CDSC feature descriptor is designed. By applying threshold segmentation and extremum point extraction to the GPR image, stratified strip-like elements and pseudo-corner points are obtained. The pseudo-corner points are treated as the centers, and the surrounding strip-like elements are described in context to form the GPR feature descriptors. Then, based on the feature description method, feature descriptors for both the real-time image and the reference image are calculated separately. By searching for the nearest matching point pairs and removing erroneous pairs, GPR image matching and localization are achieved. The proposed algorithm was evaluated on datasets collected from urban roads and railway tracks, achieving localization errors of 0.06 m (RMSE) and 1.22 m (RMSE), respectively. Compared to the traditional Speeded Up Robust Features (SURF) visual image matching algorithm, localization errors were reduced by 86.6% and 95.7% in urban road and railway track scenarios, respectively. Full article

For effective copyright protection of digital images, this paper proposes a zero-watermarking algorithm based on local image feature information. The feature matrix of the algorithm is derived from the keypoint set determined by the Speeded-Up Robust Features (SURF) algorithm, and it calculates both the gradient feature descriptors and the vortex-like texture feature (VTF) descriptors of the keypoint set. Unlike traditional texture feature descriptors, the vortex-like texture feature descriptors proposed in this paper contain richer information and exhibit better stability. The advantage of this algorithm lies in its ability to calculate the keypoints of the digital image and provide a stable vector description of the local features of these keypoints, thereby reducing the amount of erroneous information introduced during attacks. Analysis of experimental data shows that the algorithm has good effectiveness, distinguishability, security, and robustness. Full article

A cross-correlation algorithm to obtain the sub-aperture shifts that occur is a crucial aspect of scene-based SHWS (Shack–Hartmann wavefront sensing). However, when the sub-image is partially absent within the atmosphere, the traditional cross-correlation algorithm can easily obtain the wrong shift results. To overcome this drawback, we propose an algorithm based on SURFs (speeded-up-robust features) matching. In addition, to meet the speed required by wavefront sensing, CUDA parallel optimization of SURF matching is carried out using a GPU thread execution model and a programming model. The results show that the shift error can be reduced by more than two times, and the parallel algorithm can achieve nearly ten times the acceleration ratio. Full article

The aim and objective of the research are to develop an automated diagnosis system for the prediction of rheumatoid arthritis (RA) based on artificial intelligence (AI) and quantum computing for hand radiographs and thermal images. The hand radiographs and thermal images were segmented using a UNet++ model and color-based k-means clustering technique, respectively. The attributes from the segmented regions were generated using the Speeded-Up Robust Features (SURF) feature extractor and classification was performed using k-star and Hoeffding classifiers. For the ground truth and the predicted test image, the study utilizing UNet++ segmentation achieved a pixel-wise accuracy of 98.75%, an intersection over union (IoU) of 0.87, and a dice coefficient of 0.86, indicating a high level of similarity. The custom RA-X-ray thermal imaging (XTNet) surpassed all the models for the detection of RA with a classification accuracy of 90% and 93% for X-ray and thermal imaging modalities, respectively. Furthermore, the study employed quantum support vector machine (QSVM) as a quantum computing approach which yielded an accuracy of 93.75% and 87.5% for the detection of RA from hand X-ray and thermal images. In addition, vision transformer (ViT) was employed to classify RA which obtained an accuracy of 80% for hand X-rays and 90% for thermal images. Thus, depending on the performance measures, the RA-XTNet model can be used as an effective automated diagnostic method to diagnose RA accurately and rapidly in hand radiographs and thermal images. Full article

Vision-based techniques have become widely applied in structural displacement monitoring. However, heat haze poses a great threat to the precision of vision systems by creating distortions in the images. This paper proposes a vision-based bridge displacement measurement technique with heat haze mitigation capability. The properties of heat haze-induced errors are illustrated. A dual-tree complex wavelet transform (DT-CWT) is used to mitigate the heat haze in images, and the speeded-up robust features (SURF) algorithm is employed to extract the displacement. The proposed method is validated through indoor experiments on a bridge model. The designed vision system achieves high measurement accuracy in a heat haze-free condition. The proposed mitigation method successfully corrects 61.05% of heat haze-induced errors in static experiments and 95.31% in dynamic experiments. Full article

The condition and hazard monitoring of bridges play important roles in ensuring their service continuity not only throughout their entire lifespan but also under extreme conditions such as those of earthquakes. Advanced structural health monitoring (SHM) systems using vision-based technology, such as surveillance, traffic, or drone cameras, may assist in preventing future impacts due to structural deficiency and are critical to the emergence of sustainable and smart transportation infrastructure. This study evaluates several feature detection and tracking algorithms and implements them in the vision-based SHM of bridges along with their systematic procedures. The proposed procedures are implemented via a two-span accelerated bridge construction (ABC) system undergoing a large-scale shake-table test. The research objectives are to explore the effect of refined matching algorithms on blob-based features in improving their accuracies and to implement the proposed algorithms on large-scale bridges tested under seismic loads using vision-based SHM. The procedure begins by adopting blob-based feature detectors, i.e., the scale-invariant feature transform (SIFT), speeded-up robust features (SURF), and KAZE algorithms, and their stability is compared. The least medium square (LMEDS), least trimmed square (LTS), random sample consensus (RANSAC), and its generalization maximum sample consensus (MSAC) algorithms are applied for model fitting, and their sensitivity for removing outliers is analyzed. The raw data are corrected using mathematical models and scaled to generate displacement data. Finally, seismic vibrations of the bridge are generated, and the seismic responses are compared. The data are validated using target-tracking methods and mechanical sensors, i.e., string potentiometers. The results show a good agreement between the proposed blob feature detection and matching algorithms and target-tracking data and reference data obtained using mechanical sensors. Full article

The crack detection method based on image processing has been a new achievement in the field of civil engineering inspection in recent years. Column piers are generally used in bridge structures. When a digital camera collects cracks on the pier surface, the loss of crack dimension information leads to errors in crack detection results. In this paper, an image stitching method based on Speed-Up Robust Features (SURFs) is adopted to stitch the surface crack images captured from different angles into a complete crack image to improve the accuracy of the crack detection method based on image processing in curved structures. Based on the proposed method, simulated crack tests of vertical, inclined, and transverse cracks on five different structural surfaces were conducted. The results showed that the influence of structural curvature on the measurement results of vertical cracks is very small and can be ignored. Nevertheless, the loss of depth information at both ends of curved cracks will lead to errors in crack measurement outcomes, and the factors that affect the precision of crack detection include the curvature of the surface and the length of the crack. Compared with inclined cracks, the structural curvature significantly influences the measurement results of transverse cracks, especially the length measurement results of transverse cracks. The image stitching method can effectively reduce the errors caused by the structural curved surface, and the stitching effect of three images is better than that of two images. Full article

Computer vision technology is being applied at an unprecedented speed in various fields such as 3D scene reconstruction, object detection and recognition, video content tracking, pose estimation, and motion estimation. To address the issues of low accuracy and high time complexity in traditional image feature point matching, a fast image-matching algorithm based on nonlinear filtering is proposed. By applying nonlinear diffusion filtering to scene images, details and edge information can be effectively extracted. The feature descriptors of the feature points are transformed into binary form, occupying less storage space and thus reducing matching time. The adaptive RANSAC algorithm is utilized to eliminate mismatched feature points, thereby improving matching accuracy. Our experimental results on the Mikolajcyzk image dataset comparing the SIFT algorithm with SURF-, BRISK-, and ORB-improved algorithms based on the SIFT algorithm conclude that the fast image-matching algorithm based on nonlinear filtering reduces matching time by three-quarters, with an overall average accuracy of over 7% higher than other algorithms. These experiments demonstrate that the fast image-matching algorithm based on nonlinear filtering has better robustness and real-time performance. Full article

Computer vision in the structural health monitoring (SHM) field has become popular, especially for processing unmanned aerial vehicle (UAV) data, but still has limitations both in experimental testing and in practical applications. Prior works have focused on UAV challenges and opportunities for the vibration-based SHM of buildings or bridges, but practical and methodological gaps exist specifically for linear infrastructure systems such as pipelines. Since they are critical for the transportation of products and the transmission of energy, a feasibility study of UAV-based SHM for linear infrastructures is essential to ensuring their service continuity through an advanced SHM system. Thus, this study proposes a single UAV for the seismic monitoring and safety assessment of linear infrastructures along with their computer vision-aided procedures. The proposed procedures were implemented in a full-scale shake-table test of a natural gas pipeline assembly. The objectives were to explore the UAV potential for the seismic vibration monitoring of linear infrastructures with the aid of several computer vision algorithms and to investigate the impact of parameter selection for each algorithm on the matching accuracy. The procedure starts by adopting the Maximally Stable Extremal Region (MSER) method to extract covariant regions that remain similar through a certain threshold of image series. The feature of interest is then detected, extracted, and matched using the Speeded-Up Robust Features (SURF) and K-nearest Neighbor (KNN) algorithms. The Maximum Sample Consensus (MSAC) algorithm is applied for model fitting by maximizing the likelihood of the solution. The output of each algorithm is examined for correctness in matching pairs and accuracy, which is a highlight of this procedure, as no studies have ever investigated these properties. The raw data are corrected and scaled to generate displacement data. Finally, a structural safety assessment was performed using several system identification models. These procedures were first validated using an aluminum bar placed on an actuator and tested in three harmonic tests, and then an implementation case study on the pipeline shake-table tests was analyzed. The validation tests show good agreement between the UAV data and reference data. The shake-table test results also generate reasonable seismic performance and assess the pipeline seismic safety, demonstrating the feasibility of the proposed procedure and the prospect of UAV-based SHM for linear infrastructure monitoring. Full article

Automated guided vehicles (AGVs) have become prevalent over the last decade. However, numerous challenges remain, including path planning, security, and the capacity to operate safely in unstructured environments. This study proposes an obstacle avoidance system that leverages deep action learning (DAL) to address these challenges and meet the requirements of Industry 4.0 for AGVs, such as speed, accuracy, and robustness. In the proposed approach, the DAL is integrated into an AGV platform to enhance its visual navigation, object recognition, localization, and decision-making capabilities. Then DAL itself was introduced to combine the work of You Only Look Once (YOLOv4), speeded-up robust features (SURF), and k-nearest neighbor (kNN) and AGV control in indoor visual navigation. The DAL system triggers SURF to differentiate two navigation images, and kNN is used to verify visual distance in real time to avoid obstacles on the floor while searching for the home position. The testing findings show that the suggested system is reliable and fits the needs of advanced AGV operations. Full article

In the field of airborne aerial imaging, image stitching is often used to expand the field of view. Registration is the foundation of aerial image stitching and directly affects its success and quality. This article develops a fast binary image registration method based on the characteristics of airborne aerial imaging. This method first integrates aircraft parameters and calculates the ground range of the image for coarse registration. Then, based on the characteristics of FAST (Features from Accelerated Segment Test), a new sampling method, named Weighted Angular Diffusion Radial Sampling (WADRS), and matching method are designed. The method proposed in this article can achieve fast registration while ensuring registration accuracy, with a running speed that is approximately four times faster than SURF (Speed Up Robust Features). Additionally, there is no need to manually select any control points before registration. The results indicate that the proposed method can effectively complete remote sensing image registration from different perspectives. Full article

Rollers, integral to road construction, are undergoing rapid advancements in unmanned functionality. To address the specific challenge of unmanned compaction within tunnels, we propose a vision-based odometry system for unmanned rollers. This system solves the problem of tunnel localization under conditions of low texture and high noise. We evaluate and compare the performance of various feature extraction and matching methods, followed by the application of random sample consensus (RANSAC) to eliminate false matches. Subsequently, Perspective-n-Points (PnP) was employed to establish a minimal-error analysis for pose estimation and trajectory analysis. The findings reveal that binary robust invariant scalable key points (BRISK) exhibits larger errors due to fewer correctly matched feature points, while scale invariant feature transform (SIFT) falls short of real-time requirements. Compared to Oriented FAST and Rotated BRIEF (ORB) and the direct method, the maximum relative error and the median error between the compaction trajectory estimated by speed-up robust features (SURF) and the actual trajectory were the smallest. Consequently, the unmanned rollers employing SURF + PnP improved the accuracy and robustness. This research contributes valuable insights to the development of autonomous road construction equipment, particularly in challenging tunnels. Full article