Next Article in Journal
Automated Machine Learning for High-Resolution Daily and Hourly Methane Emission Mapping for Rice Paddies over South Korea: Integrating MODIS, ERA5-Land, and Soil Data
Next Article in Special Issue
Siamese-ViT: A Local–Global Feature Fusion Method for Real-Time Visual Navigation of UAVs in Real-World Environments
Previous Article in Journal
A Hybrid RTM-Informed Machine Learning Framework with Crop-Specific Canopy Structural Parameterization for Crop Fractional Vegetation Cover Estimation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Multimodal Feature Fusion Framework for UAV Positioning in Weak GNSS Environments Using a Priori High-Resolution Satellite Imagery

1
School of Resources and Civil Engineering, Northeastern University, Shenyang 110819, China
2
School of Civil Engineering, Shenyang Urban Construction University, Shenyang 110167, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2026, 18(5), 752; https://doi.org/10.3390/rs18050752
Submission received: 22 January 2026 / Revised: 25 February 2026 / Accepted: 26 February 2026 / Published: 2 March 2026

Highlights

What are the main findings?
  • This paper proposes a real-time UAV positioning framework for weak GNSS environments, which establishes high-precision cross-modal alignment between drone and satellite imagery via a “Multimodal features + LightGlue” strategy.
  • A synergistic point-line-plane feature fusion module is designed to provide robust geometric constraints, effectively mitigating the feature sparsity and matching failures common in low-texture and high-dynamic scenarios.
What are the implications of the main findings?
  • The shift from GNSS-dependency to a robust multimodal geometric fusion paradigm offers a mission-critical solution for UAV autonomy, ensuring high-precision positioning continuity and operational security in GNSS-denied environments.
  • The systematic analysis of how altitude, scale, and seasonal dynamics influence performance reveals that future robust positioning architectures should prioritize adaptive feature selection to ensure operational stability under variable deployment conditions.

Abstract

To address the challenges of unmanned aerial vehicle (UAV) navigation in weak global navigation satellite system (GNSS) environments, this study proposes a novel multimodal feature fusion framework for real-time positioning using a priori high-resolution satellite imagery. This framework utilizes georeferenced satellite images as matching sources and employs a “Multimodal features + LightGlue” algorithm to achieve high-precision cross-modal matching. By combining point, line, and plane features for enhanced robustness in low-texture scenarios, the system further integrates LightGlue’s lightweight confidence classifier to accelerate inference while maintaining high accuracy on challenging image pairs. Consequently, the proposed method outperforms LoFTR, RoMa, SuperPoint + SuperGlue, and SuperPoint + LightGlue in matching performance. Experimental results demonstrate that at a flight altitude of 80 m, the average real-time positioning error is 0.73 m, which increases to 6.24 m at 480 m. Factors such as ground object type, seasonal changes, flight altitude, and satellite image scale significantly influence accuracy. This research demonstrates that the visual navigation system meets practical operational needs for real-time UAV positioning in GNSS-deprived environments.

1. Introduction

UAVs have a long history of technological development, evolving from their initial roles as training aids and target drones to versatile platforms capable of tasks such as target search, information reconnaissance, and disaster relief [1,2]. Therefore, the autonomous positioning and navigation system, as one of the most important components of UAVs, has gradually become the focus topic in this research field. At present, the main navigation technologies of UAVs include the global navigation satellite system (GNSS), inertial navigation system (INS), computer vision navigation system, etc. [3,4]. However, in weak GNSS environments, such as mountain terrain occlusion, geomagnetic interference, and even fierce electronic warfare or electromagnetic interference, the GNSS signal that UAV navigation mainly depends on is interfered with, which may lead to large deviations in UAV self-positioning, making UAVs inoperable or unstable, and even threatening the safety of operators and other people’s lives and property [5,6]. The inertial navigation system has high short-term accuracy, but errors will gradually accumulate over time, which cannot meet the flight mission of UAVs with highly dynamic and long-time flight [7,8,9].
In order to ensure the navigation and positioning accuracy of UAVs in weak GNSS environments, visual navigation schemes might fill the gaps in GNSS and improve the navigation accuracy of UAVs [10,11,12,13,14]. Computer vision navigation is a navigation technology that uses visual sensors to perceive external environmental information as the basis for drone flight [15,16,17].
In 2007, Trawny et al. proposed an estimation algorithm that integrated inertial and visual measurements to study the pose estimation of spacecraft during planetary surface descent in order to achieve fixed-point landing [18]. In 2009, Conte et al. proposed a drone navigation system based on aerial image registration to explore the possibility of using geographic reference satellite images or aerial images to assist drone navigation and positioning in the event of GNSS failure [19]. In 2012, Lee et al. replaced the inertial navigation system with a monocular vision system and proposed a vision-based TRN system [20]. They estimated relative plane motion using ground features and combined the translation information obtained by the vision system with the measured terrain height to achieve a vision-based autonomous navigation system for UAVs. In 2015, Dumble et al. proposed an effective terrain-assisted navigation method, which also matched the terrain information in the drone view with existing terrain databases to achieve drone positioning [21]. In 2021, Mughal used drone onboard cameras and pre-stored geographic reference images for drone localization, proposing a deep learning framework to extract features from drone images. These features were matched with pre-prepared images with geographic markers to complete the drone localization work [22]. In 2022, Sui et al. proposed a fast two-stage matching method without detectors to improve the visual positioning algorithm of low-altitude drones. They used feature point matching and perspective transformation modules in both coarse and fine matching stages to improve the visual positioning accuracy of low-altitude drones. The average positioning accuracy of this method was 2.24 m [23]. In 2023, Wu et al. proposed a new hierarchical visual localization method based on graph neural networks to learn the intrinsic connections of feature points and improve matching accuracy. Finally, the absolute coordinates of the drone were calculated, with an average localization error of 10.8 m [24]. In 2024, Liu et al. proposed a deep learning-based framework for airport runway line detection and the fusion of visual information with IMU data to achieve robust UAV landing localization [25]. In 2025, Tong et al. introduced a robust top-view absolute positioning method (RTAPM) that integrated point-line feature matching with visual-inertial joint optimization to ensure reliable UAV navigation in GNSS-denied environments [26].
However, high precision UAV visual navigation is still challenging due to low matching accuracy, high time complexity, and poor performance, especially in large-scale, low-texture areas in the field, where the matching effect cannot meet the needs of a wide range of drone applications [27]. It should be noted that the ‘time complexity’ mentioned here primarily refers to the online inference performance during flight rather than the offline training phase. Therefore, high-accuracy and fast image matching algorithms are crucial for vision-based autonomous navigation of UAVs.
Common feature matching algorithms include scale-invariant feature transform (SIFT) [28], speeded-up robust feature (SURF) [29], features from accelerated segment test (FAST) [30], oriented FAST and rotating BRIEF (ORB) [31], binary robust invariant scalable keypoints (BRISK) [32], etc. Although these classic feature extraction methods have strong interpretability in theory, their robustness is not strong and they are easily affected by uncertain factors, such as sun lighting and occlusion. For matching between images with excessive perspective changes, incorrect matching often occurs due to large differences between images. With the advancement of computer computing power and the emergence of large, labeled datasets, deep learning has gradually become an increasingly mainstream means of solving problems in the field of computer vision.
The SuperPoint algorithm proposed in 2018 trained a network for extracting image features and feature descriptors using self-supervision, but its performance in actual matching was not satisfactory, which also reflects the shortcomings of SuperPoint in self-supervised training [33]. In 2020, based on the SuperPoint algorithm, the SuperGlue algorithm was proposed. SuperGlue is a feature matching algorithm based on graph convolutional neural networks, which uses key point encoding, a multi-head attention mechanism, optimal transmission optimization allocation, and other main technologies to construct a learnable feature matching machine. The key points and descriptors are calculated using SuperPoint, and the best matching key points are obtained through this matching machine [34]. Compared with traditional feature matching algorithms, it solves the problem of insufficient texture features or local features not being representative, which leads to ineffective feature matching. The LoFTR algorithm proposed in 2021 uses a self-attention layer and cross-attention layer in the transformer to obtain feature descriptors based on two images, enabling the algorithm to generate dense matching in low-texture areas [35]. In 2024, RoMa was developed by Parskatt, which is an open-source dense feature matching algorithm that performs pixel-level dense feature matching, estimates dense transformations between image pairs, and provides reliable matching confidence [36]. In 2023, LightGlue improved upon SuperGlue by retaining its multi-head attention mechanism and introducing a lightweight confidence classifier that achieved faster inference speed and lower computational complexity on easily matched image pairs, while still maintaining high accuracy on challenging image pairs [37]. In 2025, Wang et al. demonstrated that the combination of SuperPoint and LightGlue achieved optimal performance in challenging large-angle scenarios, yielding approximately ten times more matches than traditional SIFT through its adaptive pruning and robust matching mechanisms [38].
Despite recent advancements, existing UAV visual positioning methods still face several limitations: (1) a high reliance on single-point features, which often leads to matching failures in low-texture or repetitive urban environments; (2) significant modal gaps and perspective differences between UAV and satellite imagery that traditional descriptors struggle to bridge; and (3) the inefficient utilization of structural geometric information, such as lines and planes, which are abundant in urban scenes.
To address these issues, the innovations of this study are as follows:
(1) A synergistic point-line-plane feature fusion strategy is proposed to provide multi-level geometric constraints, significantly enhancing matching robustness in complex environments.
(2) A high-precision cross-modal alignment method is developed by optimizing the LightGlue framework, leveraging its graph-based attention mechanism to handle the domain gap between drone and satellite imagery.
(3) A robust UAV positioning framework specifically for weak GNSS environments is established, achieving reliable absolute localization through the integration of multimodal features and prior satellite information.
Building upon these improvements, we propose a novel multimodal features fusion framework that integrates point, line, and plane features for real-time UAV positioning in weak GNSS environments. The framework utilizes geo-referenced high-resolution satellite imagery as the database. During operation, UAV images are captured via an onboard monocular camera and a multimodal feature-based LightGlue algorithm is employed for robust cross-modal matching. Finally, the drone’s absolute coordinates are determined through a dedicated positioning algorithm to ensure reliable navigation in GNSS-denied scenarios.

2. Methodology

In this study, satellite orthorectified optical images containing geographic information are matched with real-time optical images collected by drones to calculate the real-time position of the drones. Therefore, the matching effect greatly affects the accuracy of the calculated drone coordinates. We use the LightGlue image matching algorithm based on multimodal features method to complete the most important image matching work. The algorithm flow for real-time UAV positioning is shown in Figure 1. First, the input images are preprocessed, including orthorectified, radiometric, and georegistered satellite optical images, as well as orthorectified and radiometric corrected drone images. Then, the images to be matched are input and the SuperPoint algorithm is used to extract the feature points and descriptors of the images to be matched. Compared with other feature extraction algorithms, the SuperPoint algorithm uses a shared encoder that adopts a network structure similar to VGG to reduce the size of the input image. This not only calculates pixel-level feature points and feature descriptors simultaneously in one forward propagation but also greatly improves model efficiency and performance by reducing image dimensionality. In addition, feature lines are extracted via a Line Segment Detector (LSD), and feature planes are delineated through edge detection and closed-contour analysis. Crucially, the descriptors for these feature lines and planes are calculated following the SuperPoint paradigm. By leveraging the shared convolutional backbone, all multimodal primitives are derived from a common semantic basis—specifically, the dense feature tensor generated before the final spatial sampling. This ensures that complex geometric structures are effectively converted into high-dimensional semantic tokens. Through a standardized pipeline of bicubic interpolation and L2 normalization, these multimodal features are homogenized into unit-length vectors, achieving intrinsic mathematical alignment.
Next, the extracted multimodal features and descriptors are input into the LightGlue network. The LightGlue network proposes a self-attention mechanism and a cross-attention mechanism to extract fusion information between feature points within the same image and visual correlation information between feature points between two images. By actively searching for context, the feature point specificity is increased, which can eliminate some singular matches and ultimately obtain the matching relationship of image features. In addition, LightGlue has added a lightweight confidence classifier to help determine whether to stop the inference process. If only a few points have high confidence, the inference process continues to the next layer, but unmatched points with low confidence are removed. This approach can achieve faster inference speed on easily matched image pairs while still maintaining accuracy on challenging image pairs. Finally, coordinate calculation is performed to obtain the affine transformation matrix of the two images in two-dimensional space through the correspondence between the same named points of the two images to be matched. Because the drone image is captured vertically by the drone, the center position of the drone-captured image is the location of the drone. By using satellite images with geographic information and affine transformation matrices to calculate the center position of the drone image, the plane coordinates of the drone can be obtained.

2.1. SuperPoint Network

SuperPoint is a self-supervised training network framework for extracting feature points and computing descriptors, which does not require manual labeling of data but continuously improves performance through self-iteration. Compared with traditional neural networks, SuperPoint uses a fully convolutional model to process full-size images, and the feature point and descriptor extraction part uses a shared encoder, which can simultaneously calculate pixel-level feature points and feature descriptors in one forward propagation, improving model efficiency and performance. The SuperPoint network structure diagram is shown in Figure 2.

2.1.1. Share Encoder

Previous methods typically required two feedforward propagations, with feature points and descriptors calculated separately and lacking sharing. However, SuperPoint networks solved this problem by using a shared encoder. The SuperPoint network first uses a VGG-style encoder to reduce the dimensionality of the image and extract features in order to reduce the computational complexity of the subsequent network and improve performance.

2.1.2. Feature Points Detector

The feature point detection network essentially calculates the probability of each pixel becoming a feature point. Among them, a Dustbin channel is added to the input network for output when there are no feature points in the local area. The Dustbin channel can avoid generating a relatively large-value output in the 64-dimensional features of Softmax when there are no feature points in the image, forming noise points that affect the final result.

2.1.3. Point Descriptor Detector

The extraction of feature descriptors is similar to feature point extraction, which also inputs the image output from the encoder. The feature map output through convolution is then subjected to the Bi Cubic Interpolation and L2 Normalization algorithms to obtain descriptors of unit length.

2.1.4. Loss Function

The final loss is the sum of two intermediate losses, one is feature point detection and the other is descriptor computation, which can optimize both losses of a pair of images simultaneously.
L X , X , D , D ; Y , Y , S = L p X , Y + L p X , Y + λ L d D , D , S
The final inputs are X ,   X ,   D ,   D ,   Y ,   Y ,   a n d   S , where X is the input feature point, Y is the feature point label, D is the output feature descriptor, and S is the correspondence of feature points. In addition, λ is used here to balance the loss relationship between the feature point detection network and the descriptor computing network.
The feature point correlation loss L p defines a cross-entropy loss:
L p X , Y = 1 H c W c h = 1 w = 1 H c , W c l p x h w ; y h w
wherein
l p x h w ; y h w = log exp x h w k = 1 65 exp x h w
Among them, H c = H / 8 , W c = W / 8 , where y h w is the true value, that is, the pixel in the 8 × 8 grid that is the feature point; and x h w is a feature vector with a length of 65, and each value of the vector represents the response value of the corresponding feature point on the pixel.
The eigenvector related loss L d is defined as a hinge loss:
L d D , D , S = 1 H c W c 2 h = 1 w = 1 H c , W c h = 1 w = 1 H c , W c l d d h w , d h w ; s h w h w
wherein
l d d h w , d h w ; s h w h w = λ d × s × m a x 0 , m p d T d + 1 s × m a x 0 , d T d m n
Among them, λ d is the defined weight, and s   (representing s h w h w ) is a function that determines whether it is the same feature point through homography matrix correlation:
s h w h w = 1 ,   i f H p h w ^ p h w 8 0 ,   o t h e r w i s e
where p h w is the center point of an 8 × 8 grid. When the distance between H p h w ^ and p h w is less than 8 pixels, the matching is considered successful. In addition, when the matching is successful, a penalty will be imposed when the similarity d T d is greater than the positive sample threshold m p . When matching fails, a penalty will be imposed when the similarity d T d is less than the negative sample threshold m p . So, when matching is successful, the similarity should be high, and when matching fails, the similarity should be low.

2.2. Feature Line Extraction

Feature line extraction accurately extracts representative line or edge features from images and is widely used in target recognition, image registration, 3D reconstruction, motion analysis, and industrial quality inspection scenarios. Line features provide long-range geometric constraints in weakly textured areas of an image by detecting continuous edge structures such as building contours and road boundaries. The line feature extraction method used in this paper is mainly based on LSD (Line Segment Detector).

2.2.1. Line Segment Detector

Line Segment Detector (LSD) is a line segment detection algorithm used in computer vision. It is a method for extracting lines and segments from images that is characterized by high efficiency, robustness, and scalability. The core idea of the LSD method is to merge pixels with similar gradient directions to form line features. Firstly, Gaussian filtering is used to smooth the input image and remove the influence of noise. The gradient magnitude and level-line angle of each pixel are then calculated to capture the local orientation and intensity variations. Subsequently, by integrating similar pixels in the image gradient field, line support regions (LSRs) are formed. For each line segment support domain, there may be a feature line inside. By calculating whether the main direction and gradient direction of pixels in the support domain meet the set threshold angle, it is determined whether there is a feature line based on the proportion of pixels in the domain that meet the threshold condition. Finally, the possible line features detected are pixel-merged to obtain the line feature detection result.
The LSD algorithm is an excellent method for extracting line segments, which can provide feature descriptions for weakly textured areas in images by adding LSD-extracted line features. However, in practical use, LSD extraction of line segments is prone to detecting many outliers, resulting in a large number of invalid short line features. Invalid short lines have little reference value for subsequent image matching, and a large number of short lines will increase computational costs and affect the real-time performance of the algorithm. In addition, some feature lines may be the same straight line.
In response to the problems of excessive ineffective short lines and broken lines in LSD, this paper adopts a strategy of length constraint and short line merging on the original line features extracted by LSD. For the line features extracted by LSD, the normalized coordinates corresponding to endpoints l A and l B are l A = ( x 1 , y 1 ) and l B = ( x 2 , y 2 ) , respectively. The length is calculated using the distance formula.
By setting a threshold, line segments with a length less than the threshold are removed. After length constraint, invalid short lines are removed, but there are cases where feature lines are broken. By merging these broken line features into long line features, more effective line features can be extracted and algorithm accuracy can be improved.
In response to the limitation of the LSD algorithm, two short lines that are judged to be the same line are merged by using the minimum distance and angle between two line segments as the criteria for judgment. First, the angle difference is calculated between two line segments and line segment pairs with angle differences less than the threshold are retained. Then, the horizontal and vertical distances of the retained line segment combinations are calculated. The line segment pairs with distances that meet the threshold are merged, and merged line segments with better quality are included in subsequent matching to improve the reliability of matching. For the two extracted line segments l 1 and l 2 , its endpoints are S 1 = x 1 , y 1 ,   E 1 = x 2 , y 2 and   S 2 = x 3 , y 3 , E 2 = ( x 4 , y 4 ) , respectively, and the shorter of the two line segments is set to its length d . The angles of line segments l 1 and l 2 relative to the vertical direction are calculated as θ 1 and θ 2 , respectively. When the angle difference Δ θ between two line segments is less than the threshold M , further judgment needs to be made by the distance between the two line segments to remove line segments that are parallel but too far apart. For line segments l 1 and l 2 , their horizontal distance is denoted as S h and vertical distance is denoted as S v . Only when S h and S v are less than d / 2 , will l 1 and l 2 be merged. The calculation formulas for the horizontal distance between two line segments, denoted as S h , and the vertical distance, denoted as S v , are as follows:
S h = m i n x 1 x 3 , x 2 x 3 x 1 x 4 , x 2 x 4
S v = m i n y 1 y 3 , y 2 y 3 y 1 y 4 , y 2 y 4
The comparison before and after post-processing of line features is shown in Figure 3. It can be clearly seen from the figure that a large number of discrete line segments are merged into complete structural lines, while reducing cluttered short lines and reducing the number of line segments by 67%.

2.2.2. Line Descriptor Detector

The descriptor calculation for feature lines is designed to be consistent with point-based encoding to facilitate seamless multimodal integration. Initially, the image is processed through a shared convolutional encoder to produce a dense feature tensor generated before the final spatial sampling, which encapsulates fundamental semantic attributes such as spatial, textural, and spectral information. For each detected and merged line segment, a spatial search is conducted on this dense tensor within a 5-pixel proximity of the line’s geometric path. The descriptors of pixels exhibiting the highest saliency response strengths along the segment are sampled through bicubic interpolation and L2 normalization and are subsequently utilized as representative semantic tokens for the feature line in the matching stage. This strategy effectively transforms geometric line structures into high-dimensional tokens that are mathematically aligned with point features.

2.3. Feature Plane Extraction

A feature plane is a closed region with significant semantic or structural features extracted through algorithms in the fields of computer vision and image processing. Its principle is based on techniques such as edge detection, morphological optimization, connected component analysis, and geometric constraint screening. The feature plane utilizes region segmentation techniques to capture the overall structural information of the scene (such as water bodies and vegetation coverage areas), and together with feature points and lines, performs multi-level feature expression on the image. This article extracts feature planes by first using gradient detection methods such as Canny operator to generate edge maps and then using a contour search algorithm to convert continuous edges into closed contours. Then, a morphological closure operation is used to connect broken edges and fill voids, combined with an erosion dilation operation to eliminate noise. Finally, effective regions are selected through connected region labeling and geometric features such as area and perimeter.

2.3.1. Closed Contour Detection

In this paper, the Suzuki algorithm was utilized to detect the closed contour, which can efficiently extract the contours of objects from binary images and determine the nested relationships between these contours. It is widely used in fields such as computer vision and image processing for tasks such as object detection and image segmentation. The algorithm first scans the binary image line by line, starting from the top left corner of the image and traversing each pixel in order from left to right and top to bottom. When encountering an unmarked pixel with a foreground value, it is used as the starting point for a new contour. Let the image be I ( x , y ) , where x is the column coordinate and y is the row coordinate. If I ( x , y )   0 and has not been marked as visited before, then ( x , y ) can be used as the starting point.
Starting from the starting point, the next boundary point is searched according to a certain neighborhood rule. Taking the 8-neighborhood as an example, for the current point x n , y n , the coordinates of its 8-neighborhood points are x n + i , y n + j , where i , j 1,0 , 1 and i , j 0,0 . During the tracking process, the next boundary point is determined by checking whether the neighboring points are non-zero pixels and have not been visited. Assuming the current point is P n = x n , y n , and the next point P n + 1 = x n + 1 , y n + 1 , the search rule can be expressed as follows:
I x n + 1 , y n + 1 0 Point x n + 1 , y n + 1   is   not   visited
When the tracking returns to the starting point, the tracking of a contour ends. When P m = x m , y m satisfies x m = x 0 and y m = y 0 (where x 0 , y 0 is the starting point), a contour extraction is completed.
During the process of tracking contours, passing pixels are marked to avoid duplicate tracking. Meanwhile, a unique identifier is assigned to each contour. In addition, the Suzuki algorithm constructs a hierarchical structure based on the nested relationships between contours. If a contour is completely contained within another contour, the internal contour is called a child contour, and the external contour is called a parent contour. By maintaining a tree structure to represent this hierarchical relationship, each node contains information about the contour as well as pointers to its parent node, child nodes, previous contour, and next contour. The above process is continuously repeated to scan the image until all foreground pixels have been marked or tracked, thereby extracting all contours and their hierarchical structures from the image.

2.3.2. Morphological Post-Processing

Mathematical morphology is a tool for analyzing and processing images based on morphological structural elements. Its basic idea is to use structural elements to explore images, see if the elements of the structure can be well filled into the image, and verify the effectiveness of the method. There are four basic operations in mathematical morphology: dilation, erosion, opening, and closing. When processing binary and grayscale images, they play different roles based on the characteristics of the image.
Post-processing is a key step in feature plane extraction, aimed at eliminating noise interference and enhancing contour integrity. The core process includes morphological operations and connected region analysis. Firstly, the extracted contour lines are closed to close disconnected contours caused by occlusion or other reasons. Then, the closed areas are filled to form a preliminary feature plane, as shown in Figure 4. From the figure, it can be seen that the extracted feature plane contains many small noise points and cluttered edge lines. Using the 8-neighborhood Connected Components Labeling (CCL) algorithm, the binary image is segmented into independent regions. Let the labeled image be L x , y , the area A k of each connected region C k is calculated as follows:
A k = ( x , y ) C k L x , y
The effective area is filtered through threshold A m i n , components with an area greater than the threshold are retained, small noise areas are effectively removed, and the semantic integrity of the feature plane is improved.
The feature plane extraction results are shown in Figure 4. Post-processing combines morphological operations with connected region analysis, significantly improving the integrity and noise resistance of the feature plane.
To maintain cross-modal consistency, the feature plane descriptors are extracted using the same shared encoder and the dense feature tensor generated before the final spatial sampling. Based on the segmented plane masks, the framework performs a targeted filtering within the closed boundaries of each plane. Specifically, the descriptors corresponding to pixels with peak saliency scores within mask regions are selected as representative surface tokens. By undergoing the same normalization and interpolation pipeline as the point and line modalities, these surface-based descriptors are projected into the unified semantic space, ensuring that area-level structural information is mathematically aligned and seamlessly integrated with point and line primitives.

2.4. LightGlue Network

LightGlue is a deep learning-based local feature matching method that combines attention mechanisms with adaptive features based on SuperGlue. It can be flexibly adjusted according to the difficulty of the matching problem, achieving faster inference speed on easily matched image pairs while maintaining accuracy on challenging image pairs. It should be noted that while the offline training of graph-based architectures is computationally intensive, the LightGlue framework is specifically optimized for online inference efficiency. By incorporating an adaptive depth mechanism and dynamic sparse message passing to prune unreliable features, the model adaptively adjusts its computational load based on the difficulty of the match, thereby fulfilling the strict real-time requirements for onboard UAV processing. Crucially, the inputs to this network are the homogenized multimodal tokens (points, lines, and surfaces) sampled from the dense feature tensor. This ensures that geometric structures are integrated into the matcher as semantically aligned 256-dimensional vectors. The algorithm principle of LightGlue is shown in Figure 5. The main body is composed of a pile of N identical layers, which jointly process two sets of keypoints and descriptors. Each layer consists of self-attention units and cross-attention units that update the representation of each point. Among them, the classifier decides whether to stop reasoning at each layer to avoid unnecessary calculations. Finally, the lightweight matchmaker combines the similarity score and the matchability score to determine whether two points match.

2.4.1. Transformer Backbone

Key points and descriptors from two images are input, with each layer consisting of one self-attention unit and one cross-attention unit, totaling N layers.
  • Self-attention: Each point focuses on all points in the same image. For each point i , two-dimensional point position p i normalized by the image size and descriptor d i are initialized by descriptor d i to obtain state x i . Current state x i is decomposed into key vector k i and query vector q i through a linear transformation. Rotational encoder R is used to define attention score a i j between points i and j in order to capture their relative positions:
    a i j = q i Τ R p j p i k i
    By dividing the space into 1/2 2 D subspaces and rotating and projecting them onto learnable basis vectors, position encoding is achieved. Rotational encoding enables the model to retrieve points j with learned relative positions. This encoding is the same in all layers and is only computed once and cached. In our multimodal framework, the self-attention mechanism explicitly models the intra-modal spatial dependencies and geometric topology within each image. Specifically, it characterizes the structural constraints that line and surface primitives impose on the spatial distribution of nearby point features, thereby enhancing the geometric consistency of the local descriptors before matching.
  • Cross-attention: Each point in image I will focus on all points in another image S . This layer facilitates the dynamic weighted fusion between the UAV and satellite feature sets. By calculating affinity scores across different modalities, the cross-attention mechanism adaptively adjusts the importance of each token based on the environmental context. k i is set for each point, and the cross-attention score is expressed as follows:
    a i j I S = k i I   Τ k j S   = ! a j i S I

2.4.2. Correspondence Prediction

A lightweight head was designed to predict feature matching based on updated states at any level.
  • Assignment scores: First, the pairwise similarity score matrix S R m × n is calculated:
    S i j = L i n e a r x i I Τ L i n e a r x j S
    Among them, L i n e a r · is a learning linear transformation with bias. This score encodes the affinity corresponding to each pair of points. In addition, the matching score σ i for each point is also calculated:
    σ i = S i g m o i d L i n e a r x i
    The matching score σ i indicates the likelihood of having corresponding points.
  • Correspondences: The similarity score and the matching score are combined to form a Soft partial assignment matrix:
    P i j = σ i I σ j S S o f t m a x S k j i S o f t m a x S i k j
    A point pair i , j will only have a corresponding relationship if and only if both points are predicted to be compatible and their similarity is higher than any other point in the two images.

2.4.3. Adaptive Depth and Width

A lightweight confidence classifier was designed to predict the allocation of update states for any given layer. The confidence classifier helps determine whether to stop the inference process. If there are a few points with high confidence, the inference process continues to the next layer, but unmatched points with low confidence will be deleted.
  • Confidence classifier: LightGlue’s backbone enhances the visual descriptors of input through context. When image pairs are easy to match, the prediction results of the early layers are the same as those of the later layers and have high confidence. These predicted results can be output and reasoning can be stopped. At the end of each layer, LightGlue uses a compact multilayer perceptron (MLP) to infer the confidence level of each point prediction assignment:
    c i = S i g m o i d M L P x i 0,1
    Compact MLP only adds minimal overhead in inference time and typically saves more time.
  • Exit criterion: For a given layer l , if c i > λ l , the point is considered trustworthy. If a sufficient proportion of points are reliable, reasoning can be stopped.
  • Point pruning: When the stopping criterion is not met, points predicted as both reliable and unmatched are likely to not be helpful for matching other points in subsequent levels. These points are usually located in areas that are clearly invisible in the image. Therefore, these points are discarded at each level and only the remaining points are passed to the next level. This significantly reduces computational complexity, taking into account the quadratic complexity of attention, and does not affect accuracy.

2.5. Absolute Positioning Algorithm for Drones

Because the width of the satellite image is too large, the satellite image is trimmed to a width similar to that of the UAV image, and the geographical coordinates of the upper left corner and the lower right corner of each satellite image are input. After image matching, the affine transformation matrix of the two images in two-dimensional space is obtained through the corresponding relationship of the same name points of the two images to be matched. Because the UAV image is taken vertically by the UAV, the central position of the UAV image is where the UAV is located. Then, the central position of the UAV image is calculated through the satellite image with geographic information and the affine transformation matrix, and the plane coordinates of the UAV can be obtained.

3. Experimental Data

3.1. Data Source Introduction

The satellite data used in this article were Google Earth image level 20 data with a spatial resolution of 0.15 m. Specifically, to ensure the model possessed both universal feature representation and task-specific adaptability, the training process was conducted on the public COCO 2017 dataset, supplemented by a representative selection of paired UAV and satellite images. The research scope was selected within the Nanhu Campus of Northeastern University, which has different ground environments, such as buildings, grasslands, gardens, and forests, meeting the needs of real-time positioning of drones in complex environments. In addition, in order to prove the progressiveness of the algorithm in this paper in weakly textured areas, the green space near the Yunlong Lake Bridge in the suburb of Yuhong District, Shenyang City was selected as the research scope. Aerial imagery was collected using a DJI M300 RTK drone integrated with a DJI P1 photogrammetric camera (DJI, Shenzhen, China). The camera system was equipped with a 35 mm fixed-focus lens and a high-resolution 45-megapixel sensor, ensuring high-fidelity image capture and precise geometric feature extraction. Images were collected at heights of 80 m, 130 m, 180 m, 230 m, 280 m, 330 m, 380 m, 430 m, and 480 m to conduct positioning experiments and analyze accuracy.

3.2. Image Preprocessing

The preprocessing of remote sensing images included orthorectification and geographic registration. Through orthorectification of remote sensing images, significant geometric errors, such as translation, scaling, and rotation, were largely eliminated. However, for real-time positioning of UAV, more accurate geographic coordinates are required. Therefore, further registration between remote sensing images or between remote sensing images and a fixed reference frame is required, also known as remote sensing image registration. We used the network RTK technique to measure the coordinates of control points, and then used these control points and some matching points in the image to obtain a geometric correction model, and used this model to correct the image. Finally, the Google Earth image was cropped to a width similar to that of the drone image to improve image registration efficiency.

4. Results

4.1. Comparison of Different Matching Algorithms

In order to achieve better matching results in weakly textured areas and improve the stability of the matching algorithm, this study improves the original matching algorithm by adding line features and plane features on the basis of the original algorithm. Both are input together with the point features extracted by SuperPoint into the LightGlue matching algorithm to complete image matching.
The Multimodal features + LightGlue image matching algorithm significantly enhances the matching stability of weakly textured regions by introducing a multimodal features collaboration mechanism while maintaining the original lightweight and efficient advantages of the SuperPoint + LightGlue framework. The core of this improvement strategy lies in constructing a complementary fusion system of geometric and semantic features: line features provide long-range geometric constraints by detecting continuous edge structures in the image, while plane features use region segmentation techniques to capture the overall structural information of the scene, forming a hierarchical feature expression with traditional point features.
The experimental results shown in Figure 6 indicate that the newly added line plane features contribute a large number of effective matching points in complex scenes with drastic changes in brightness and uneven texture distribution, especially in low-contrast grassland and forest areas commonly seen in drone images, where the density of matching points is significantly increased. Although the average error has slightly increased, the mismatch rate has been reduced and the geometric consistency of the overall matching results has been significantly improved through the verification of regional consistency of plane features and directional constraints of line features.
Regarding computational efficiency, the proposed multimodal framework adheres to a sparse matching paradigm, which is inherently more optimized than dense pixel-level regression methods like LoFTR and RoMa. While the integration of line and plane features introduces a marginal preprocessing overhead, these structural primitives provide robust geometric priors that facilitate faster convergence within the transformer-based LightGlue engine. By leveraging the adaptive “early-exit” mechanism of the matcher, the framework can dynamically terminate computation once confident correspondences are established, often requiring fewer attention layers than single-feature approaches to resolve ambiguities. Consequently, this architectural design ensures that the enhanced matching stability does not come at the cost of prohibitive latency, fulfilling the requirements for near-real-time UAV positioning tasks.
By using feature matching algorithms to match drone images with previous satellite images, real-time localization of drones can be achieved, and the matching results directly affect the accuracy of localization. To rigorously evaluate the performance of the proposed framework, four state-of-the-art image matching algorithms—SuperPoint + SuperGlue [33,34], LoFTR [35], RoMa [36], and SuperPoint + LightGlue [33,37]—were selected as baselines for a comprehensive comparative analysis. Thirty images collected by a drone at an altitude of 80 m in the internal area of the school were selected and matched with satellite images. In addition, experiments were conducted at a flight altitude of 380 m in weakly textured areas (including forests, farmland, etc.) to verify the advantages of our algorithm in weakly textured areas. The matching results are shown in Table 1.
Based on a comprehensive analysis of Table 1 and Figure 7 and Figure 8, it can be seen that in the internal area of the school, due to the presence of numerous buildings, roads, etc., the texture features are rich. The positioning error of the “SuperPoint + SuperGlue” algorithm is 0.86 m, the positioning error of the “SuperPoint + LightGlue” algorithm is 0.72 m, and the positioning error of the “Multimodal features + LightGlue” algorithm proposed in this article is 0.73 m. By comparison, the positioning error of the “LoFTR” algorithm is 4.18 m, and the positioning error of the “RoMa” algorithm is 2.48 m. This indicates that in texture-rich areas, the matching strategy based on the LightGlue algorithm performs better, thanks to the adaptive nature of the LightGlue algorithm. In addition, thanks to the accuracy of SuperPoint feature point extraction, the matching strategy using the SuperPoint algorithm also performs well. The algorithm proposed in this paper, which uses point features, line features, and plane features simultaneously, also has high positioning accuracy.
In the weakly textured area, the positioning error of the “LoFTR” algorithm is 4.74 m, the positioning error of the “RoMa” algorithm is as high as 8.09 m, the positioning error of the “SuperPoint + SuperGlue” algorithm is 7.21 m, the positioning error of the “SuperPoint + LightGlue” algorithm is 5.89 m, and the positioning error of the “Multimodal features + LightGlue” algorithm is 4.62 m.
It can be seen that the positioning errors of various algorithms generally increase in weakly textured areas, but the “Multimodal features + LightGlue” algorithm proposed in this paper has a relatively small positioning error in this area, demonstrating certain advantages. This is because the introduction of multimodal features integrates multiple feature information, making up for the shortcomings of single features in weak texture areas. Combined with the adaptive reasoning ability of the LightGlue algorithm, it can better adapt to the complex situation of weakly textured areas, improving matching accuracy and thereby reducing positioning errors.
Based on the results of two sets of experiments, the “Multimodal features + LightGlue” algorithm demonstrated good performance in different scenarios, maintaining relatively low positioning errors in both texture-rich and weakly textured areas. This verifies the effectiveness and superiority of the algorithm in complex scenarios, providing more reliable technical support for real-time positioning of drones.

4.2. Accuracy Analysis

Without using GNSS, the real-time position of the UAV is calculated based on the SuperPoint + LightGlue algorithm. Experiments were carried out at heights of 80 m, 130 m, 180 m, 230 m, 280 m, 330 m, 380 m, 430 m, and 480 m relative to the ground height. The UAV position at the time of image acquisition was calculated. The horizontal distance between the actual position of UAV and the calculated position was used to evaluate the accuracy.
The real-time positioning results of the UAV are shown in Figure 9. It can be seen that there is a significant difference in scale and rotation between the drone images and satellite images, but they also have good matching effects. The SuperPoint + LightGlue algorithm performs well in terms of scale invariance, rotation invariance, and detection robustness.
The error of each point of the UAV at different heights is shown in Figure 10 and Table 2. When the heights are 80 m, 130 m, 180 m, 230 m, 280 m, 330 m, 380 m, 430 m, and 480 m, the average errors of UAV real-time positioning are 0.73 m, 0.95 m, 1.21 m, 0.88 m, 1.83 m, 3.32 m, 3.43 m, 5.51 m, and 6.24 m, respectively. The highest accuracy is 0.25 m, and the worst is 13.47 m. Additionally, 84% of the points are less than 5 m, 54% are less than 2 m, and 32% are less than 1 m.
The comparison between the real trajectory and the calculated trajectory of the drone is shown in Figure 11. This trajectory is the trajectory of the drone flying at an altitude of 80 m. It can be seen from the figure that the calculated trajectory is highly consistent with the real trajectory.

5. Discussion

5.1. Effect of the Type of Ground Objects and the Change in Season on Matching Results

In Figure 10, it can be observed that at the same flight altitude, the accuracy fluctuates significantly and is relatively low for some points. To address this, we conducted an analysis from two aspects: the type of ground objects and the change in season.
Figure 12 demonstrates the impact of differences in ground object type on positioning accuracy, where Figure 12a,b indicate that the matching result between the drone and satellite images is located in areas with relatively high tree and grassland coverage. From the local magnification of the matching points, it can be seen that there is a deviation in the matching points, which undoubtedly affects the accuracy of positioning. The drone flight altitude at this point is 180 m, and the positioning errors of drones over grasslands and forests are 1.81 m and 1.78 m, respectively, which belongs to the point with a large error at a flight altitude of 180 m. When the drone is above the building, as shown in Figure 12c, the positioning error is 0.32 m. This is mainly because images with more buildings have more distinct texture features and more selectable feature points, resulting in better matching effects and higher accuracy.
Another reason for the large error is that the drone images and satellite images were taken at different time periods, and vegetation and other ground objects change greatly with time and season, where these differences can be observed in Figure 13, directly affecting the image matching effect and leading to the low positioning accuracy of UAVs. To verify this result, we selected drone images from winter and summer and satellite images from summer for matching.
Thirty images taken at a height of 80 m were selected for accuracy comparison. The positioning error of drone images taken in winter is 1.34 m, and the positioning error of drone images taken in summer is 0.73 m. The experiment also proved that the positioning accuracy will be affected when the UAV flies over a large area of trees and grass. As shown in Figure 14, the Google image was collected on 31 March 2024, and the drone image was collected on 22 March 2025. In agricultural areas, not only are there fewer texture features, but human activities such as spring sowing and autumn harvesting greatly change their texture features.

5.2. Effect of Height and the Scale of Satellite Imagery on Matching Results

In order to verify the universality of the matching algorithm in the low airspace of UAVs and meet the application needs of UAVs in a complex environment, UAV positioning experiments were carried out at 80 m, 130 m, 180 m, 230 m, 280 m, 330 m, 380 m, 430 m, and 480 m away from the ground. The positioning results are shown in Table 3. Overall, as the height increases, the spatial resolution of drone images decreases and the positioning accuracy gradually decreases.
As the UAV rises in height, the spatial resolution of the UAV image is also lower. As shown in Table 3, when the flight altitude is 80 m, the spatial resolution of the image is 0.94 cm, and when the flight altitude is 480 m, the spatial resolution of the image is 6 cm. The spatial resolution of UAV images taken 80 m from the ground is more than 6 times that of UAV images taken 480 m from the ground. In addition, since the image taken by the UAV is orthophoto, the plane coordinate of the central position of the UAV image is determined to be the real-time coordinate of the UAV. However, factors such as flight attitude fluctuations, wind-induced jitter, and gimbal angular bias introduce an offset angle ( θ ), causing the calculated coordinates to deviate from the true position. This deviation causes the calculated image center to shift away from the true horizontal position of the UAV, serving as the primary source of positioning error. Quantitatively, this geometric displacement ( E ) is governed by the relationship E = H tan ( θ ) . Consequently, the positioning error exhibits a progressive increase as a function of altitude, as the same angular perturbation is amplified over greater vertical distances. To further quantify this sensitivity, the theoretical horizontal errors associated with angular deviations of 1 , 0.1 , and 0.01 across the experimental altitudes are detailed in Table 4.
It is known that for a UAV shooting at different heights, the field of view of UAV images is different, as shown in Figure 15. The coverage area of UAV images taken 480 m above the ground is about 161,021 m 2 and the coverage area of UAV images taken 80 m above the ground is about 3952 m 2 . The coverage area of the UAV image taken at a height of 480 m from the ground is about 40 times that of a UAV image taken 80 m from the ground. The larger the field of vision, the more features in the image, which means that more feature points can be detected and more image pairs can be matched. This is also the reason why the positioning error becomes lower when the drone flies at an altitude of 230 m.
In addition, the scale of satellite imagery also affects the accuracy of drone positioning. Given that the ground sampling distance (GSD) of UAV imagery varies with flight altitude, we introduced the side-length ratio ( R ) to quantitatively define the satellite image scale   R = L s a t / L u a v , where L s a t and L u a v represent the actual ground side lengths covered by the satellite reference image and the UAV real-time image, respectively. We believe this dimensionless ratio provides a more scale-adaptive metric for multi-altitude operations, ensuring a consistent geometric relationship regardless of variations in spatial resolution.
Taking a set of images collected by a drone at 180 m as an example, the impact of satellite image scale is verified by comparing the UAV images with satellite imagery at four different side-length ratios of approximately 1, 1.5, 4, and 8 (corresponding to scale levels 1 to 4 in Figure 16). Figure 16 shows the matching results across these varying field-of-view ranges. The experimental observations indicate that the optimal matching effect is achieved at scale level 2, where the ratio is approximately 1.5.
This performance gain may stem from the relative scale of identical features between the UAV and satellite images at this specific ratio being inherently more suitable for the matching algorithm’s operational requirements. Additionally, the 1.5 ratio provides a contextual buffer; compared to the 1.0 ratio, it likely offers the necessary surrounding structural information for feature descriptors. In our test, this is accompanied by an 18% increase in the number of successfully matched feature pairs. However, when the ratio increases to 4 or 8, the successful matching rate tends to decrease. This trend may be attributed to the expanded search area introducing excessive irrelevant textures or repetitive patterns. Furthermore, it is also possible that the increased ambiguity or blurring of feature structures within a broader search space leads to a decrease in the successful matching rate.

6. Conclusions

In response to the problem of GNSS signal interference or GNSS signal loss in weak GNSS environments, we propose the Multimodal features + LightGlue image matching algorithm, which matches the real-time collected images of a drone with previous satellite images and then calculates the real-time position of the drone. To verify the advancement of the proposed algorithm, it is compared with four advanced image matching methods, that is LoFTR, RoMa, SuperPoint + SuperGlue, and SuperPoint + LightGlue. The results indicate that the Multimodal features + LightGlue image matching algorithm proposed in this paper is more suitable for matching drone images with satellite images and has better matching accuracy in areas with strong and weak texture features. The experimental results show that the positioning accuracy gradually decreases with increasing altitude from 80 m to 480 m, while the average error of real-time positioning of drones increases from 0.73 m to 6.24 m. From the analysis of the experimental results, it can be seen that the positioning accuracy of drones is mainly affected by the type of ground objects, seasonal changes, the altitude of drone flight, and the scale of satellite images. Overall, this study provides both a theoretical basis and practical solutions for drone localization in complex scenarios, holding significant potential for engineering applications.

Author Contributions

Conceptualization, L.H.; methodology, L.H.; software, Z.Z.; validation, Z.Q.; formal analysis, L.H.; investigation, L.H., R.H., Y.Z. (Yu Zhang), H.L. and Y.Z. (Yadong Zhu); resources, L.H.; data curation, L.H.; writing—original draft preparation, L.H.; writing—review and editing, L.H. and Z.Z.; visualization, L.H.; supervision, L.H.; project administration, L.H.; funding acquisition, L.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (grant number 42474038) and the Fundamental Research Funds for the Central Universities (grant number N2401008). The APC was funded by Liming He.

Data Availability Statement

The data presented in this study are available upon request from the corresponding author. The data are not publicly available due to the ongoing nature of the research project.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Wei, Z.Q.; Zhu, M.Y.; Zhang, N.; Wang, L.; Zou, Y.Y.; Meng, Z.Y.; Wu, H.C.; Feng, Z.Y. UAV-Assisted Data Collection for Internet of Things: A Survey. IEEE Internet Things J. 2022, 9, 15460–15483. [Google Scholar] [CrossRef]
  2. Arafat, M.Y.; Moh, S. Localization and Clustering Based on Swarm Intelligence in UAV Networks for Emergency Communications. IEEE Internet Things J. 2019, 6, 8958–8976. [Google Scholar] [CrossRef]
  3. Lu, Y.C.; Xue, Z.C.; Xia, G.S.; Zhang, L.P. A survey on vision-based UAV navigation. Geo-Spat. Inf. Sci. 2018, 21, 21–32. [Google Scholar] [CrossRef]
  4. Nemra, A.; Aouf, N. Robust INS/GPS Sensor Fusion for UAV Localization Using SDRE Nonlinear Filtering. IEEE Sens. J. 2010, 10, 789–798. [Google Scholar] [CrossRef]
  5. Gu, N.Z.; Xing, F.; You, Z. GNSS Spoofing Detection Based on Coupled Visual/Inertial/GNSS Navigation System. Sensors 2021, 21, 6769. [Google Scholar] [CrossRef] [PubMed]
  6. Zhang, W.Z.; Zhang, W. An Efficient UAV Localization Technique Based on Particle Swarm Optimization. IEEE Trans. Veh. Technol. 2022, 71, 9544–9557. [Google Scholar] [CrossRef]
  7. Lee, Y.D.; Kim, L.W.; Lee, H.K. A tightly-coupled compressed-state constraint Kalman Filter for integrated visual-inertial-Global Navigation Satellite System navigation in GNSS-Degraded environments. IET Radar Sonar Navig. 2022, 16, 1344–1363. [Google Scholar] [CrossRef]
  8. Sandamini, C.; Maduranga, M.W.P.; Tilwari, V.; Yahaya, J.; Qamar, F.; Nguyen, Q.N.; Ibrahim, S.R.A. A Review of Indoor Positioning Systems for UAV Localization with Machine Learning Algorithms. Electronics 2023, 12, 1533. [Google Scholar] [CrossRef]
  9. Zhuang, L.C.; Zhong, X.R.; Xu, L.J.; Tian, C.B.; Yu, W.S. Visual SLAM for Unmanned Aerial Vehicles: Localization and Perception. Sensors 2024, 24, 2980. [Google Scholar] [CrossRef]
  10. Zuo, Z.Y.; Yang, B.; Li, Z.; Zhang, T.H. A GNSS/IMU/Vision Ultra-Tightly Integrated Navigation System for Low Altitude Aircraft. IEEE Sens. J. 2022, 22, 11857–11864. [Google Scholar] [CrossRef]
  11. Wang, Y.; Li, H.G.; Li, X.J.; Wang, Z.P.; Zhang, B.C. UAV image target localization method based on outlier filter and frame buffer. Chin. J. Aeronaut. 2024, 37, 375–390. [Google Scholar] [CrossRef]
  12. Wang, X.Z.; Kealy, A.; Li, W.C.; Jelfs, B.; Gilliam, C.; Le May, S.; Moran, B. Toward Autonomous UAV Localization via Aerial Image Registration. Electronics 2021, 10, 435. [Google Scholar] [CrossRef]
  13. Wan, X.; Liu, J.G.; Yan, H.S.; Morgan, G.L.K. Illumination-invariant image matching for autonomous UAV localisation based on optical sensing. ISPRS J. Photogramm. Remote Sens. 2016, 119, 198–213. [Google Scholar] [CrossRef]
  14. Qiu, X.; Yang, D.F.; Liao, S.Y.; Wang, S.C.; Li, Y.F. Image moment extraction based aerial photo selection for UAV high-precision geolocation without GPS. Measurement 2024, 226, 114141. [Google Scholar] [CrossRef]
  15. Chen, J.H.; Zheng, E.H.; Dai, M.; Chen, Y.F.; Lu, Y.S. OS-FPI: A Coarse-to-Fine One-Stream Network for UAV Geolocalization. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2024, 17, 7852–7866. [Google Scholar] [CrossRef]
  16. Cao, Y.Q.; Ren, K.; Chen, Q. Template matching based on convolution neural network for UAV visual localization. Optik 2023, 283, 170920. [Google Scholar] [CrossRef]
  17. Xue, B.Y.; Yang, Z.; Liao, L.W.; Zhang, C.; Xu, H.; Zhang, Q.Y. High precision visual localization method of UAV based on feature matching. Front. Comput. Neurosci. 2022, 16, 1037623. [Google Scholar] [CrossRef]
  18. Trawny, N.; Mourikis, A.I.; Roumeliotis, S.I.; Johnson, A.E.; Montgomery, J.F. Vision-aided inertial navigation for pin-point landing using observations of mapped landmarks. J. Field Robot. 2007, 24, 357–378. [Google Scholar] [CrossRef]
  19. Conte, G.; Doherty, P. Vision-Based Unmanned Aerial Vehicle Navigation Using Geo-Referenced Information. EURASIP J. Adv. Signal Process. 2009, 2009, 387308. [Google Scholar] [CrossRef]
  20. Lee, D.; Kim, Y.; Bang, H. Vision-based Terrain Referenced Navigation for Unmanned Aerial Vehicles using Homography Relationship. J. Intell. Robot. Syst. 2013, 69, 489–497. [Google Scholar] [CrossRef]
  21. Dumble, S.J.; Gibbens, P.W. Airborne Vision-Aided Navigation Using Road Intersection Features. J. Intell. Robot. Syst. 2015, 78, 185–204. [Google Scholar] [CrossRef]
  22. Mughal, M.H.; Khokhar, M.J.; Shahzad, M. Assisting UAV Localization Via Deep Contextual Image Matching. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2021, 14, 2445–2457. [Google Scholar] [CrossRef]
  23. Sui, H.G.; Li, J.J.; Lei, J.F.; Liu, C.; Gou, G.H. A Fast and Robust Heterologous Image Matching Method for Visual Geo-Localization of Low-Altitude UAVs. Remote Sens. 2022, 14, 5879. [Google Scholar] [CrossRef]
  24. Zhao, C.H.; Wu, D.W.; He, J.; Dai, C.J. A Visual Positioning Method of UAV in a Large-Scale Outdoor Environment. Sensors 2023, 23, 6941. [Google Scholar] [CrossRef] [PubMed]
  25. Liu, X.X.; Xue, W.H.; Xu, X.L.; Zhao, M.K.; Qin, B. Research on Unmanned Aerial Vehicle (UAV) Visual Landing Guidance and Positioning Algorithms. Drones 2024, 8, 257. [Google Scholar] [CrossRef]
  26. Tong, P.F.; Yang, X.R.; Peng, X.Z.; Wang, L.F. RTAPM: A Robust Top-View Absolute Positioning Method with Visual-Inertial Assisted Joint Optimization. Drones 2025, 9, 37. [Google Scholar] [CrossRef]
  27. Carrillo, L.R.G.; López, A.E.D.; Lozano, R.; Pégard, C. Combining Stereo Vision and Inertial Navigation System for a Quad-Rotor UAV. J. Intell. Robot. Syst. 2012, 65, 373–387. [Google Scholar] [CrossRef]
  28. Lowe, D.G. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 2004, 60, 91–110. [Google Scholar] [CrossRef]
  29. Bay, H.; Tuytelaars, T.; Van Gool, L. SURF: Speeded up robust features. In Computer Vision—ECCV 2006, Pt 1, Proceedings; Leonardis, A., Bischof, H., Pinz, A., Eds.; Springer: Berlin/Heidelberg, Germany, 2006; pp. 404–417. [Google Scholar] [CrossRef]
  30. Ghahremani, M.; Liu, Y.H.; Tiddeman, B. FFD: Fast Feature Detector. IEEE Trans. Image Process. 2021, 30, 1153–1168. [Google Scholar] [CrossRef]
  31. Rublee, E.; Rabaud, V.; Konolige, K.; Bradski, G. ORB: An efficient alternative to SIFT or SURF. In 2011 International Conference on Computer Vision (ICCV); IEEE: New York, NY, USA, 2011; pp. 2564–2571. [Google Scholar] [CrossRef]
  32. Leutenegger, S.; Chli, M.; Siegwart, R.Y. BRISK: Binary Robust Invariant Scalable Keypoints. In 2011 International Conference on Computer Vision (ICCV); IEEE: New York, NY, USA, 2011; pp. 2548–2555. [Google Scholar] [CrossRef]
  33. DeTone, D.; Malisiewicz, T.; Rabinovich, A. SuperPoint: Self-Supervised Interest Point Detection and Description. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW); IEEE: New York, NY, USA, 2018; pp. 337–349. [Google Scholar] [CrossRef]
  34. Sarlin, P.E.; DeTone, D.; Malisiewicz, T.; Rabinovich, A. SuperGlue: Learning Feature Matching with Graph Neural Networks. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2020; pp. 4937–4946. [Google Scholar] [CrossRef]
  35. Sun, J.M.; Shen, Z.H.; Wang, Y.A.; Bao, H.J.; Zhou, X.W. LoFTR: Detector-Free Local Feature Matching with Transformers. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2021; pp. 8918–8927. [Google Scholar] [CrossRef]
  36. Edstedt, J.; Sun, Q.; Bökman, G.; Wadenbäck, M.; Felsberg, M. RoMa: Robust Dense Feature Matching. In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2024; pp. 19790–19800. [Google Scholar] [CrossRef]
  37. Lindenberger, P.; Sarlin, P.E.; Pollefeys, M. LightGlue: Local Feature Matching at Light Speed. In 2023 IEEE/CVF International Conference on Computer Vision (ICCV); IEEE: New York, NY, USA, 2023; pp. 17581–17592. [Google Scholar] [CrossRef]
  38. Wang, H.; Yu, J.X.; Jiang, S.; Zhang, D.J.; Li, Q.Q. Aerial-Terrestrial Image Feature Matching: An Evaluation of Recent Deep Learning Methods. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2025, 18, 15688–15706. [Google Scholar] [CrossRef]
Figure 1. The flowchart of the proposed algorithm. Divided into four parts: input data, image processing, image matching, and coordinate calculation.
Figure 1. The flowchart of the proposed algorithm. Divided into four parts: input data, image processing, image matching, and coordinate calculation.
Remotesensing 18 00752 g001
Figure 2. Network structure diagram of SuperPoint. The input image is convolved into one-eighth of the original image through a shared encoder, and then feature points and descriptors are output through the feature points detector and descriptor detector, respectively.
Figure 2. Network structure diagram of SuperPoint. The input image is convolved into one-eighth of the original image through a shared encoder, and then feature points and descriptors are output through the feature points detector and descriptor detector, respectively.
Remotesensing 18 00752 g002
Figure 3. Comparison of line features before and after post-processing. (a) Feature lines before processing; (b) feature lines after processing.
Figure 3. Comparison of line features before and after post-processing. (a) Feature lines before processing; (b) feature lines after processing.
Remotesensing 18 00752 g003
Figure 4. The post-processing process of feature planes. The upper left is the initially extracted feature plane, the upper right is the post-processing feature plane, and the following figure shows the final extracted feature plane.
Figure 4. The post-processing process of feature planes. The upper left is the initially extracted feature plane, the upper right is the post-processing feature plane, and the following figure shows the final extracted feature plane.
Remotesensing 18 00752 g004
Figure 5. LightGlue network structure. The input feature points and descriptors are matched through an attention network, and point pruning is used to remove unmatched points. Then, the matching result is output through corresponding prediction. Here, # denotes the sequence number of the iterative layers.
Figure 5. LightGlue network structure. The input feature points and descriptors are matched through an attention network, and point pruning is used to remove unmatched points. Then, the matching result is output through corresponding prediction. Here, # denotes the sequence number of the iterative layers.
Remotesensing 18 00752 g005
Figure 6. Matching results of the Multimodal features + LightGlue algorithm. The colors of the lines, from blue, green, yellow, orange, to red, represent the variation in matching reliability from low to high.
Figure 6. Matching results of the Multimodal features + LightGlue algorithm. The colors of the lines, from blue, green, yellow, orange, to red, represent the variation in matching reliability from low to high.
Remotesensing 18 00752 g006
Figure 7. Matching results of five image matching algorithms. (a) LoFTR; (b) RoMa; (c) SuperPoint + SuperGlue; (d) SuperPoint + LightGlue; (e) Multimodal features + LightGlue.
Figure 7. Matching results of five image matching algorithms. (a) LoFTR; (b) RoMa; (c) SuperPoint + SuperGlue; (d) SuperPoint + LightGlue; (e) Multimodal features + LightGlue.
Remotesensing 18 00752 g007
Figure 8. Matching results of five image matching algorithms in weak texture regions (a) LoFTR; (b) RoMa; (c) SuperPoint + SuperGlue; (d) SuperPoint + LightGlue; (e) Multimodal features + LightGlue.
Figure 8. Matching results of five image matching algorithms in weak texture regions (a) LoFTR; (b) RoMa; (c) SuperPoint + SuperGlue; (d) SuperPoint + LightGlue; (e) Multimodal features + LightGlue.
Remotesensing 18 00752 g008
Figure 9. Real-time positioning results of the UAV. The (left) side is the UAV image, the (right) side is the satellite image, the white box is the position of the left UAV image in the satellite image, and the white circle is the real-time position of the UAV. The colors of the lines, from blue, green, yellow, orange, to red, represent the variation in matching reliability from low to high.
Figure 9. Real-time positioning results of the UAV. The (left) side is the UAV image, the (right) side is the satellite image, the white box is the position of the left UAV image in the satellite image, and the white circle is the real-time position of the UAV. The colors of the lines, from blue, green, yellow, orange, to red, represent the variation in matching reliability from low to high.
Remotesensing 18 00752 g009
Figure 10. Statistical analysis of UAV positioning errors. The above nine graphs are error line charts for 30 points at nine different heights, with the horizontal axis representing drone points and the vertical axis representing errors. Below are box plots of nine types of height point errors.
Figure 10. Statistical analysis of UAV positioning errors. The above nine graphs are error line charts for 30 points at nine different heights, with the horizontal axis representing drone points and the vertical axis representing errors. Below are box plots of nine types of height point errors.
Remotesensing 18 00752 g010
Figure 11. Comparison of real trajectory and calculated trajectory of drones. The blue line represents the calculated trajectory, and the yellow line represents the actual trajectory.
Figure 11. Comparison of real trajectory and calculated trajectory of drones. The blue line represents the calculated trajectory, and the yellow line represents the actual trajectory.
Remotesensing 18 00752 g011
Figure 12. Matching results for different ground object types: (a) trees; (b) grassland; (c) building. In the enlarged partial images, points with the same color represent the same corresponding points and matching box colors denote the same geographical area.
Figure 12. Matching results for different ground object types: (a) trees; (b) grassland; (c) building. In the enlarged partial images, points with the same color represent the same corresponding points and matching box colors denote the same geographical area.
Remotesensing 18 00752 g012
Figure 13. Drone and satellite images captured at different times. (a) Drone image captured in winter; (b) satellite image captured in summer; (c) drone image captured in summer.
Figure 13. Drone and satellite images captured at different times. (a) Drone image captured in winter; (b) satellite image captured in summer; (c) drone image captured in summer.
Remotesensing 18 00752 g013
Figure 14. (a) Google images of farmland areas and (b) images captured by drones.
Figure 14. (a) Google images of farmland areas and (b) images captured by drones.
Remotesensing 18 00752 g014
Figure 15. UAV images acquired at different altitudes. The figure only shows five heights: 80 m, 180 m, 280 m, 380 m, and 480 m.
Figure 15. UAV images acquired at different altitudes. The figure only shows five heights: 80 m, 180 m, 280 m, 380 m, and 480 m.
Remotesensing 18 00752 g015
Figure 16. Matching results of drone images (left) and satellite images (right) with scales gradually increasing from (a) to (d). (a) Scale level 1; (b) scale level 2; (c) scale level 3; (d) scale level 4.
Figure 16. Matching results of drone images (left) and satellite images (right) with scales gradually increasing from (a) to (d). (a) Scale level 1; (b) scale level 2; (c) scale level 3; (d) scale level 4.
Remotesensing 18 00752 g016
Table 1. Comparison of matching results of five image matching algorithms.
Table 1. Comparison of matching results of five image matching algorithms.
AlgorithmPosition Error (m)
Within the SchoolWeak Texture Area
LoFTR4.184.74
RoMa2.488.09
SuperPoint + SuperGlue0.867.21
SuperPoint + LightGlue0.725.89
Multimodal features + LightGlue0.734.62
The positioning error in the table is the average positioning error of the 30 drone images. There are many buildings, roads, etc. in the internal area of the school, with strong texture features. The weakly textured areas mainly include areas with unclear texture features such as forests, farmland, and grasslands.
Table 2. Statistical analysis of UAV positioning errors.
Table 2. Statistical analysis of UAV positioning errors.
Height (m)Mean Error (m)Max Error (m)Min Error
(m)
Error Less Than 1 mError Less Than 5 mError Less Than 10 mNumber of Images
800.731.020.22100%--30
1300.951.310.3557%100%-30
1801.211.780.3437%100%-30
2300.881.330.3670%100%-30
2801.832.420.4413%100%-30
3303.324.420.573%100%-30
3803.435.211.590%87%100%30
4305.516.431.580%40%100%30
4806.2412.540.523%33%77%30
Table 3. Image parameters of UAV flying at different altitudes.
Table 3. Image parameters of UAV flying at different altitudes.
Height (m)Spatial Resolution (cm)Coverage Area (m2)Mean Error (m)
800.9439520.73
1301.6311,8830.95
1802.2622,8451.21
2302.8937,3570.88
2803.5255,4201.83
3304.1476,6623.32
3804.77101,7693.43
4305.40130,4275.51
4806.00161,0216.24
Table 4. Theoretical horizontal positioning errors induced by different angular deviations across various flight altitudes.
Table 4. Theoretical horizontal positioning errors induced by different angular deviations across various flight altitudes.
Flight Altitude (m) 1 Error (m) 0.1 Error (m) 0.01 Error (m)
801.400.140.014
1302.270.230.023
1803.140.310.031
2304.010.400.040
2804.890.490.049
3305.760.580.058
3806.630.660.066
4307.510.750.075
4808.380.840.084
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

He, L.; Zhao, Z.; Qu, Z.; He, R.; Zhang, Y.; Li, H.; Zhu, Y. A Multimodal Feature Fusion Framework for UAV Positioning in Weak GNSS Environments Using a Priori High-Resolution Satellite Imagery. Remote Sens. 2026, 18, 752. https://doi.org/10.3390/rs18050752

AMA Style

He L, Zhao Z, Qu Z, He R, Zhang Y, Li H, Zhu Y. A Multimodal Feature Fusion Framework for UAV Positioning in Weak GNSS Environments Using a Priori High-Resolution Satellite Imagery. Remote Sensing. 2026; 18(5):752. https://doi.org/10.3390/rs18050752

Chicago/Turabian Style

He, Liming, Zhengqi Zhao, Zhenglin Qu, Ronghua He, Yu Zhang, Haoran Li, and Yadong Zhu. 2026. "A Multimodal Feature Fusion Framework for UAV Positioning in Weak GNSS Environments Using a Priori High-Resolution Satellite Imagery" Remote Sensing 18, no. 5: 752. https://doi.org/10.3390/rs18050752

APA Style

He, L., Zhao, Z., Qu, Z., He, R., Zhang, Y., Li, H., & Zhu, Y. (2026). A Multimodal Feature Fusion Framework for UAV Positioning in Weak GNSS Environments Using a Priori High-Resolution Satellite Imagery. Remote Sensing, 18(5), 752. https://doi.org/10.3390/rs18050752

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop