Search Results (13)

Background: Fluorescence visualization of pathologies, primarily neoplasms in human internal cavities, is one of the most popular forms of diagnostics during endoscopic examination in medical practice. Currently, visualization can be performed in the augmented reality mode, which allows to observe areas of increased fluorescence directly on top of a usual color image. Another no less informative form of endoscopic visualization in the future can be mapping (creating a mosaic) of the acquired image sequence into a single map covering the area under study. The originality of the present contribution lies in the development of a new 3D bimodal experimental bladder model and its validation as an appropriate phantom for testing the combination of bimodal cystoscopy and image mosaicking. Methods: An original 3D real bladder-based phantom (physical model) including cancer-like fluorescent foci was developed and used to validate the combination of (i) a simultaneous white light and fluorescence cystoscopy imager with augmented reality mode and (ii) an image mosaicking algorithm superimposing both information. Results: Simultaneous registration and real-time visualization of a color image as a reference and a black-and-white fluorescence image with an overlay of the two images was made possible. The panoramic image build allowed to precisely visualize the relative location of the five fluorescent foci along the trajectory of the endoscope tip. Conclusions: The method has broad prospects and opportunities for further developments in bimodal endoscopy instrumentation and automatic image mosaicking. Full article

Corrosion is one of the critical factors leading to the failure of steel structures. Ultrasonic C-scans are widely used to identify corrosion damage. Limited by the range of C-scans, multiple C-scans are usually required to cover the whole component. Thus, stitching multiple C-scans into a panoramic image of the area under detection is necessary for interpreting non-destructive testing (NDT) data. In this paper, an image mosaic method for ultrasonic C-scan based on scale invariant feature transform (SIFT) is proposed. Firstly, to improve the success rate of registration, the difference in the probe starting position in two scans is used to filter the matching pairs of feature points obtained by SIFT. Secondly, dynamic programming methods are used to search for the optimal seam path. Finally, the pixels in the overlapping area are fused by fade-in and fade-out fusion along the seam line. The improved method has a higher success rate of registration and lower image distortion than the conventional method in the mosaic of ultrasonic C-scan images. Experimental results show that the proposed method can stitch multiple C-scan images of a testing block containing artificial defects into a panorama image effectively. Full article

Background and Objectives: The purpose of this study was to develop and evaluate a deep learning model capable of autonomously detecting and segmenting radiolucent lesions in the lower jaw by utilizing You Only Look Once (YOLO) v8. Materials and Methods: This study involved the analysis of 226 lesions present in panoramic radiographs captured between 2013 and 2023 at the Clinical Hospital Dubrava and the School of Dental Medicine, University of Zagreb. Panoramic radiographs included radiolucent lesions such as radicular cysts, ameloblastomas, odontogenic keratocysts (OKC), dentigerous cysts and residual cysts. To enhance the database, we applied techniques such as translation, scaling, rotation, horizontal flipping and mosaic effects. We have employed the deep neural network to tackle our detection and segmentation objectives. Also, to improve our model’s generalization capabilities, we conducted five-fold cross-validation. The assessment of the model’s performance was carried out through metrics like Intersection over Union (IoU), precision, recall and mean average precision (mAP)@50 and mAP@50-95. Results: In the detection task, the precision, recall, mAP@50 and mAP@50-95 scores without augmentation were recorded at 91.8%, 57.1%, 75.8% and 47.3%, while, with augmentation, were 95.2%, 94.4%, 97.5% and 68.7%, respectively. Similarly, in the segmentation task, the precision, recall, mAP@50 and mAP@50-95 values achieved without augmentation were 76%, 75.5%, 75.1% and 48.3%, respectively. Augmentation techniques led to an improvement of these scores to 100%, 94.5%, 96.6% and 72.2%. Conclusions: Our study confirmed that the model developed using the advanced YOLOv8 has the remarkable capability to automatically detect and segment radiolucent lesions in the mandible. With its continual evolution and integration into various medical fields, the deep learning model holds the potential to revolutionize patient care. Full article

Due to a lack of geographical reference information, complex panoramic camera models, and intricate distortions, including radiation, geometric, and land cover changes, it can be challenging to effectively apply the large number (800,000+) of high-resolution Corona KH-4B panoramic images from the 1960s and 1970s for surveying-related tasks. This limitation hampers their significant potential in the remote sensing of the environment, urban planning, and other applications. This study proposes a method called 2OC for the automatic and accurate orientation and orthorectification of Corona KH-4B images, which is based on generalized control information from reference images such as Google Earth orthophoto. (1) For the Corona KH-4B panoramic camera, we propose an adaptive focal length variation model that ensures accuracy and consistency. (2) We introduce a robust multi-source remote sensing image matching algorithm, which includes an accurate primary orientation estimation method, a multi-threshold matching enhancement strategy based on scale, orientation, and texture (MTE), and a model-guided matching strategy. These techniques are employed to extract high-accuracy generalized control information for Corona images with significant geometric distortions and numerous weak texture areas. (3) A time-iterative Corona panoramic digital differential correction method is proposed. The orientation and orthorectification results of KH-4B images from multiple regions, including the United States, Russia, Austria, Burkina Faso, Beijing, Chongqing, Gansu, and the Qinghai–Tibet Plateau in China, demonstrate that 2OC not only achieves automation but also attains a state-of-the-art level of generality and accuracy. Specifically, the standard deviation of the orientation is less than 2 pixels, the mosaic error of orthorectified images is approximately 1 pixel, and the standard deviation of ground checkpoints is better than 4 m. In addition, 2OC can provide a longer time series analysis of data from 1962 to 1972, benefiting various fields such as environmental remote sensing and archaeology. Full article

The low-altitude technology of unmanned airborne infrared detection system is used to effectively monitor the temperature segregation in the paving stage and realize the temperature uniformity control of asphalt pavement construction. The image mosaic method can splice two images with overlapping areas together to form a panoramic image. In order to solve the problems of long time-consuming and low accuracy of aerial image mosaic algorithm, the low-temperature area of the whole pavement can be obtained quickly and accurately. In this paper, threshold segmentation technology is introduced to convert the image captured by the unmanned aerial vehicle (UAV) into a binary greyscale image so as to compensate for the mosaic error caused by temperature difference. In order to improve the efficiency and accuracy of splicing, a reference plate is used, which can provide enough feature points for splicing. Finally, the image mosaic method proposed in this paper can quickly obtain the image of the whole low-temperature area of the newly paved asphalt pavement, which has practical value and positive significance for the quality control of asphalt pavement. Full article

Damaged edges of bone tag images contain external factors such as impurities and damage, which affect the stitching process and lead to repair errors. Therefore, this paper proposes a stitching method based on image edge position feature matching. The objective is to improve the accuracy of image stitching by matching feature points based on the position of the image edge pixel so as to solve the accurate stitching of broken edge contour. In the first step of this method, the image containing the broken edge is preprocessed by edge detection, and the location of the broken edge pixel is proposed. Secondly, the feature descriptors were calculated to extract the shape and texture information of the feature points on the fracture edge. Finally, the feature points are optimized by minimum correction and image mosaic is carried out. In terms of image stitching, pre-registration is performed by finding the feature descriptors that are most similar to the edge of the optimum fracture surface profile. The matching operator is added to the overlapping region to obtain the corrected image, and the panoramic image mosaic of the image fracture surface is performed. The experimental results show that feature descriptor matching can ensure the integrity of the fracture, improve the matching accuracy, optimize the uneven deformation of the fracture, ensure the quality of image stitching, and reduce the degree of image distortion. Full article

The use of UAV (unmanned aerial vehicle) technology has allowed for advances in the area of robotics in control processes and application development. Such is the case of image processing, in which, by the use of aerial photographs taken by these aircrafts, it is possible to perform surveillance and monitoring tasks. As an example, we can mention the use of aerial photographs for the generation of panoramic images through the process of stitching images without losing image resolution. Some applications are photogrammetry and mapping, where the main problems to be solved are image alignment and ghosting images, for which different stitching techniques can be applied. These methodologies can be categorized into direct methods or feature-based methods. This paper aims to show an overview of the most frequently applied mosaicing techniques in UAVs by providing an introduction to those interested in developing in this area. For this purpose, a summary of the most applied techniques and their applications is given, showing the trend of the research field and the contribution of different countries over time. Full article

The purpose of this paper was to study the influence of cartographic scale and flight design on data acquisition using unmanned aerial systems (UASs) to create augmented reality 3D geovisualization of geosites. The relationship between geographical and cartographic scales, the spatial resolution of UAS-acquired images, along with their relationship with the produced 3D models of geosites, were investigated. Additionally, the lighting of the produced 3D models was examined as a key visual variable in the 3D space. Furthermore, the adaptation of the 360° panoramas as environmental lighting parameters was considered. The geosite selected as a case study was the gorge of the river Voulgaris in the western part of the island of Lesvos, which is located in the northeastern part of the Aegean Sea in Greece. The methodology applied consisted of four pillars: (i) scale-variant flight planning, (ii) data acquisition, (iii) data processing, (iv) AR, 3D geovisualization. Based on the geographic and cartographic scales, the flight design calculates the most appropriate flight parameters (height, speed, and image overlaps) to achieve the desired spatial resolution (3 cm) capable of illustrating all the scale-variant details of the geosite when mapped in 3D. High-resolution oblique aerial images and 360° panoramic aerial images were acquired using scale-variant flight plans. The data were processed using image processing algorithms to produce 3D models and create mosaic panoramas. The 3D geovisualization of the geosite selected was created using the textured 3D model produced from the aerial images. The panoramic images were converted to high-dynamic-range image (HDRI) panoramas and used as a background to the 3D model. The geovisualization was transferred and displayed in the virtual space where the panoramas were used as a light source, thus enlightening the model. Data acquisition and flight planning were crucial scale-variant steps in the 3D geovisualization. These two processes comprised the most important factors in 3D geovisualization creation embedded in the virtual space as they designated the geometry of the 3D model. The use of panoramas as the illumination parameter of an outdoor 3D scene of a geosite contributed significantly to its photorealistic performance into the 3D augmented reality and virtual space. Full article

In order to obtain panoramic images in a low contrast underwater environment, an underwater panoramic image mosaic algorithm based on image enhancement and improved image registration (IIR) was proposed. Firstly, mixed filtering and sigma filtering are used to enhance the contrast of the original image and de-noise the image. Secondly, scale-invariant feature transform (SIFT) is used to detect image feature points. Then, the proposed IIR algorithm is applied to image registration to improve the matching accuracy and reduce the matching time. Finally, the weighted smoothing method is used for image fusion to avoid image seams. The results show that IIR algorithm can effectively improve the registration accuracy, shorten the registration time, and improve the image fusion effect. In the field of cruise research, instruments equipped with imaging systems, such as television capture and deep-drag camera systems, can produce a large number of image or video recordings. This algorithm provides support for fast and accurate underwater image mosaic and has important practical significance. Full article

With the rapid development of the virtual reality industry, one of the bottlenecks is the scarcity of video resources. How to capture high-definition panoramic video with depth information and real-time stereo display has become a key technical problem to be solved. In this paper, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed. Combined with the real-time processing algorithm of multi detector mosaic panoramic stereo imaging image, a panoramic stereo real-time imaging system is developed. Firstly, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed, and the space coordinate calibration platform of ultra-high precision panoramic camera based on theodolite angle compensation function is constructed. The projection matrix of adjacent cameras is obtained by solving the imaging principle of binocular stereo vision. Then, a real-time registration algorithm of multi-detector mosaic image and Lucas-Kanade optical flow method based on image segmentation are proposed to realize stereo matching and depth information estimation of panoramic imaging, and the estimation results are analyzed effectively. Experimental results show that the stereo matching time of panoramic imaging is 30 ms, the registration accuracy is 0.1 pixel, the edge information of depth map is clearer, and it can meet the imaging requirements of different lighting conditions. Full article

This paper introduces a robust method for panoramic unmanned aerial vehicle (UAV) image mosaic. In the traditional automatic panoramic image stitching method (Autostitch), it assumes that the camera rotates about its optical centre and the group of transformations the source images may undergo is a special group of homographies. It is rare to get such ideal data in reality. In particular, remote sensing images obtained by UAV do not satisfy such an ideal situation, where the images may not be on a plane yet and even may suffer from nonrigid changes, leading to poor mosaic results. To overcome the above mentioned challenges, in this paper a nonrigid matching algorithm is introduced to the mosaic system to generate accurate feature matching on remote sensing images. We also propose a new strategy for bundle adjustment to make the mosaic system suitable for the UAV image panoramic mosaic effect. Experimental results show that our method outperforms the traditional method and some of the latest methods in terms of visual effect. Full article

Ghosting and seams are two major challenges in creating unmanned aerial vehicle (UAV) image mosaic. In response to these problems, this paper proposes an improved method for UAV image seam-line searching. First, an image matching algorithm is used to extract and match the features of adjacent images, so that they can be transformed into the same coordinate system. Then, the gray scale difference, the gradient minimum, and the optical flow value of pixels in adjacent image overlapped area in a neighborhood are calculated, which can be applied to creating an energy function for seam-line searching. Based on that, an improved dynamic programming algorithm is proposed to search the optimal seam-lines to complete the UAV image mosaic. This algorithm adopts a more adaptive energy aggregation and traversal strategy, which can find a more ideal splicing path for adjacent UAV images and avoid the ground objects better. The experimental results show that the proposed method can effectively solve the problems of ghosting and seams in the panoramic UAV images. Full article

This paper presents a unique approach for panoramic mosaics based on Moon surface images from the Chang’E-3 (CE-3) mission, with consideration of the exposure time and external illumination changes in CE-3 Panoramic Camera (PCAM) imaging. The engineering implementation involves algorithms of image feature points extraction by using Speed-Up Robust Features (SURF), and a newly defined measure is used to obtain the corresponding points in feature matching. Then, the transformation matrix is calculated and optimized between adjacent images by the Levenberg–Marquardt algorithm. Finally, an image is reconstructed by using a fade-in-fade-out method based on linear interpolation to achieve a seamless mosaic. The developed algorithm has been tested with CE-3 PCAM images at Point A (one of the rover sites where the rover is separated from the lander). This approach has produced accurate mosaics from CE-3 PCAM images, as is indicated by the value of the Peak Signal to Noise Ratio (PSNR), which is greater than 31 dB between the overlapped region of the images before and after fusion. Full article