Next Article in Journal
Time-Series Analysis on Persistent Scatter-Interferometric Synthetic Aperture Radar (PS-InSAR) Derived Displacements of the Hong Kong–Zhuhai–Macao Bridge (HZMB) from Sentinel-1A Observations
Next Article in Special Issue
Feature-Aided RTK/LiDAR/INS Integrated Positioning System with Parallel Filters in the Ambiguity-Position-Joint Domain for Urban Environments
Previous Article in Journal
Forest Changes by Precipitation Zones in Northern China after the Three-North Shelterbelt Forest Program in China
Previous Article in Special Issue
Joint Delay-Doppler Estimation Performance in a Dual Source Context
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

GNSS RUMS: GNSS Realistic Urban Multiagent Simulator for Collaborative Positioning Research

1
Interdisciplinary Division of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, Kowloon, Hong Kong, China
2
Research Institute for Sustainable Urban Development, The Hong Kong Polytechnic University, Kowloon, Hong Kong, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2021, 13(4), 544; https://doi.org/10.3390/rs13040544
Submission received: 24 December 2020 / Revised: 26 January 2021 / Accepted: 29 January 2021 / Published: 3 February 2021
(This article belongs to the Special Issue GNSS for Urban Transport Applications)

Abstract

:
Accurate localization of road agents (GNSS receivers) is the basis of intelligent transportation systems, which is still difficult to achieve for GNSS positioning in urban areas due to the signal interferences from buildings. Various collaborative positioning techniques were recently developed to improve the positioning performance by the aid from neighboring agents. However, it is still challenging to study their performances comprehensively. The GNSS measurement error behavior is complicated in urban areas and unable to be represented by naive models. On the other hand, real experiments requiring numbers of devices are difficult to conduct, especially for a large-scale test. Therefore, a GNSS realistic urban measurement simulator is developed to provide measurements for collaborative positioning studies. The proposed simulator employs a ray-tracing technique searching for all possible interferences in the urban area. Then, it categorizes them into direct, reflected, diffracted, and multipath signal to simulate the pseudorange, C / N 0 , and Doppler shift measurements correspondingly. The performance of the proposed simulator is validated through real experimental comparisons with different scenarios based on commercial-grade receivers. The proposed simulator is also applied with different positioning algorithms, which verifies it is sophisticated enough for the collaborative positioning studies in the urban area.

Graphical Abstract

1. Introduction

The development of intelligent transportation is one of the essential objectives of building a smart city, namely smart mobility [1]. The intelligent transportation system (ITS) aims to alleviate traffic jams and enhance traffic efficiency with sufficient assistance and planning. However, as the foundation of ITS, the precise navigation of transportation participants can hardly be achieved, especially in the dense urban area [2]. Most of the navigation algorithms rely on the global navigation satellite system (GNSS) for functionality or initialization, since it is the primary sensor directly providing the absolute positioning solution. Besides the systematic interferences that can be adequately modeled (e.g., atmospheric delay and ephemeris error), the GNSS measurement can be degraded by other effects related to the environment, resulting in an enormous positioning error unqualified for ITS [2,3]. On the other hand, the GNSS precise point positioning (PPP) [4,5] or real-time kinematic (RTK) [6] technique employing the carrier phase measurement can achieve submeter level accuracy. However, the visibility limitation and cycle-slip phenomenon in the urban area will significantly degrade their reliability [7,8]. Although various approaches, such as the integration of GNSS with INS, camera [9], or LiDAR-based simultaneous localization and mapping (SLAM) [10,11], are capable of achieving better positioning accuracy, they still require an accurate absolute positioning solution from GNSS for initialization. It is inevitable to improve the GNSS positioning accuracy in the urban area prior to ITS development.
Due to the rapid development of vehicle-to-everything (V2X) communication technology [12], the collaboration of transportation participants to achieve accurate positioning solution becomes possible, namely the collaborative positioning (CP). In most CP techniques, the neighboring road agents (GNSS receivers) measure and share the interagent ranges as well as their positioning solutions, in order to optimize the overall positioning solution of each involving agents. By making use of the additional interagent information, the CP can achieve higher positioning accuracy compared with conventional standalone solution [13,14,15]. Another straight-forward benefit of employing CP is to reduce the common noise by involving more road agents during positioning [16]. Moreover, CP can make use of the network geometry formed by road agents to improve the overall positioning optimization [17]. Unlike the transponder-based CP approach using DSRC or UWB, the GNSS-based CP can maintain the collaboration even when there exist obstacles between agents [18]. Among various GNSS-based CP methods, a popular approach is to apply double difference (DD) on the pseudorange measurements from neighboring road agents to eliminate the systematic error during relative positioning, such as atmospheric delay and ephemeris error [19,20]. Besides, based on the angular geometry between satellites and agents, the interagent range can be estimated for CP even when some of the satellite signals are blocked by buildings [21]. However, these methods can be significantly degraded by the multipath and NLOS reception error. Recently, the 3D mapping aided (3DMA) GNSS technique has been developed, using the 3D building model to predict and mitigate those errors in the urban area. Two representative approaches are the 3DMA GNSS shadow matching based on the satellite visibility prediction [22] and the 3DMA GNSS ray-tracing based on the LOS/NLOS pseudorange prediction [23]. Then, the CP algorithms are extended by the 3DMA GNSS to achieve better performance in the urban area. The predicted satellite visibilities of neighboring road agents from the 3D building model are collaborated to achieve better position estimation [24,25]. Moreover, a complementary integration of the 3DMA GNSS ray-tracing technique and the DD based GNSS CP is developed to eliminate the systematic error and mitigate the uncorrelated NLOS error simultaneously [26]. The integration of 3DMA GNSS and CP has excellent potential to achieve satisfactory positioning accuracy in the urban area.
However, most of the CP algorithms are validated through naive simulated measurements, which behave very differently from the real experiments. A popular approach is to test the algorithm with additional simulated errors based on statistical models [20,27,28]. Although the normal distribution can model many of the measurement noises, the GNSS measurement error in the urban environment is dominated by the enormous signal delay due to building reflection. This delay is uniquely related to the geometry between satellites, GNSS receiver, and the reflecting surface, which may differ between each road agent. Hence, it is inappropriate to validate the CP algorithm with the GNSS measurement error simulated by the normal distribution or other statistical distribution models. Some studies directly use real measurements collected from multiple receivers for validation [19,26], whereas the agent amount is limited to a few. It is tough to test large-scale performance with large numbers of agents or study the influence of network size. Therefore, it is necessary to develop a realistic GNSS measurement simulator to study the CP performance in the urban area comprehensively.
There exist various types of GNSS measurement simulators, from tracking-level to measurement-level. The MUltipath Simulator Taking into Account Reflection and Diffraction (MUSTARD) developed by the Jet Propulsion Laboratory (JPL) is a famous GNSS measurement simulator [29], considering the signal reflection and diffraction effect based on the ray-tracing algorithm. The Satellite Navigation Radio Channel Signal Simulator (SNACKS) from the German Aerospace Center (DLR) further considers the multipath channel effect during simulation [30]. Moreover, the commercial GNSS simulator SimGEN® + SE-NAV developed by the Spirent Communication not only uses ray-tracing to track all valid reflection or diffraction signals, but also considers the interaction between those traced signals [31]. To reduce the simulation complexity, another approach is developed, which simulates the tracking-level measurements in urban based on reference data collected from software defined receiver (SDR) [32]. The above simulators employ complicated algorithms to simulate the GNSS tracking-level measurements, whereas most CP studies only employ GNSS measurement-level data. For simplification, other GNSS simulators focusing on measurement-level data have been developed, such as the GNSS carrier-to-noise ratio ( C / N 0 ) simulation for positioning aiding [33], the GNSS LOS/NLOS pseudorange simulation by ray-tracing [23], or the Doppler shift modeling under multipath effect [34,35]. However, many of them are not sophisticated enough with comprehensive error and noise modeling, for example, neglecting the multipath interaction error on pseudorange, or the tracking loop noise related to C / N 0 . Moreover, those GNSS simulators are designed for one specific kind of measurement of a single receiver. It is also necessary to develop a simulator supporting multiagent full GNSS raw measurement simulation for CP studies.
In this study, a realistic GNSS measurement simulator is developed for multiple agents in the urban environment. Based on the satellite ephemeris, 3D building model, and the location of different road agents, the GNSS measurement-level data corresponding to each agent is simulated through the ray-tracing algorithm, including pseudorange, C / N 0 , and Doppler frequency. To make the simulator suitable for CP studies, the locations of road agents are generated based on the dynamics and transportation mobility of road agents by SUMO (Simulation of Urban MObility) [36]. By considering the direct, reflected, diffracted, and multipath GNSS signal through ray-tracing, the measurement-level GNSS data with sophisticated modeling noises are simulated for multiple road agents in the urban area, in order to supply realistic large scale data for CP research. The contributions of this study are summarized as follows:
(1)
Providing multiagent GNSS simulation for ITS and CP applications considering the transportation mobility from SUMO. By applying with different advanced positioning methods, the simulated measurements are capable of reflecting the positioning difficulties in the dense urban area.
(2)
Holistically organizing and combing the important findings related to GNSS simulation from the related works and providing a complete GNSS simulator structure with detailed steps. A realistic measurement-level GNSS simulator is developed based on comprehensive error models without referencing RF data from SDR.
(3)
A sophisticated GNSS simulator is developed for the GPS/BDS measurements in an urban scenario, in which the effects of signal reflection, diffraction and the interferences in-between are considered. The detailed modeling of those interferences on the pseudorange, C / N 0 , and Doppler frequency measurements is presented and verified by comparing with real measurements.
The rest of the paper is structured as follows: the overall structure of the proposed realistic multiagent urban GNSS simulator is demonstrated in Section 2. The detailed procedures of ray-tracing simulation on direct, reflected, and diffracted GNSS signals are explained in Section 3. In Section 4, the GNSS measurement simulation will be elaborated based on different cases, including direct propagation, reflection, diffraction, and multipath. The modeling of GNSS measurement systematic error and noise are also explained in this section. Then, the performance of the proposed simulation is validated through different real experimental data and the positioning result based on popular positioning algorithms in Section 5. After discussing results and the future works in Section 6, the conclusion is drawn in Section 7.

2. Simulator Structure

The overall structure of the proposed GNSS realistic urban multiagent simulator (RUMS) is shown in Figure 1. Table 1 shows the key models and their corresponding references being employed in the simulator developed in this paper. First, the locations or trajectories of all the involving road agents require to be generated before GNSS measurement simulation. For large scale CP studies, the transportation environment could influence the traffic flow and the available collaborator in a specific range. Therefore, it would be more realistic to evaluate the CP performance based on the simulated measurement considering the traffic condition. SUMO is an urban transportation simulator generating the trajectories of multiple road agents based on the transportation environment and facilities in a certain area. The traffic flow, road agent type (pedestrian or automobile), and other advanced settings can also be customized. In this study, we employ the simulated position x R and velocity v R of each road agent on GPS time from SUMO, namely the Road Agent PVT Data, to consider the urban mobility effect during the GNSS measurement simulation. Besides the information of road agents, the satellite positions x S V from ephemeris and the 3D building model with building corner positions x B are also required before simulation. The last required information is the Receiver Parameter/Model representing the hardware characteristic of the GNSS receiver in the simulation, which will be interpreted with details in Section 4.6.
For each road agent, the ray-tracing simulation is firstly employed based on the agent and satellite position as well as the 3D building model, in order to search all valid GNSS signal rays via direct propagation, diffraction or reflection from each satellite. Based on the ray-tracing result, the measurement of each satellite will be categorized into four types following different simulation strategies:
(1)
LOS only: only the line-of-sight (LOS) signal propagation path is available and unobstructed;
(2)
Single diffraction: only one diffraction path is available;
(3)
Single reflection: only one reflection path is available; and
(4)
Multipath: more than one propagation path is available, including any combination of the three cases above.
For the case of LOS only, the C / N 0 is simulated from an elevation-based open-sky C / N 0 regression model. The ranging measurement is the direct distance between satellite and agent without delay. The Doppler shift measurement is simulated from the Doppler effect model based on the location and velocity of the satellite and receiver.
For the single diffraction case, the C / N 0 measurement is simulated by the open-sky model and the uniform geometrical theory of diffraction (UTD) model [38]. The corresponding ranging measurement is the summation of the direct range and the extra delay due to diffraction. The diffracted Doppler shift is modeled by the Doppler effect with an intermediate point [34].
For the single reflection case, the C / N 0 is simulated based on the open-sky model with an attenuation factor from the GNSS reflectometer (GNSS-R) model [42,52]. The ranging measurement is modeled by adding the reflection delay on the direct distance. Similar to diffraction, the Doppler shift measurement of a reflected signal is simulated by the Doppler effect with an intermediate point.
For the case of multipath, the C / N 0 is simulated based on the superposition of fields from each valid signal, considering the interaction due to the differences in phase and amplitude. The corresponding ranging measurement is simulated by the multipath noise envelope based on the strength and delay of each signal, which takes the interferences in-between into account. The multipath Doppler shift is simulated based on the dominating signal path with the highest C / N 0 among all available paths.
Finally, the measurement systematic error and noise are simulated on top of the preceding C / N 0 , ranging and Doppler shift simulation result based on the GNSS receiver characteristics. The C / N 0 measurement noise is simulated based on the standard deviation of the narrow-to-wide power ratio evaluation method [45]. The pseudorange measurement is simulated by incorporating the receiver clock bias, tropospheric delay, ionospheric delay, ephemeris error, satellite clock error, and a normally distributed noise based on the pseudorange error budget [44] for the above terms. Moreover, the C / N 0 -related delay lock loop (DLL) noise is considered during the pseudorange simulation. The frequency lock loop (FLL) noise is also added on the preceding simulated Doppler shift. The simulated GNSS measurements of different agents are collected along GPS time and used for the CP algorithm test.

3. GNSS Ray-Tracing Simulation

In an urban scenario, the GNSS measurement is mainly degraded due to three effects, the signal blockage by buildings, the diffraction effect when the direct signal path is close to the building edge, and the reception of reflected signals from buildings. Therefore, three types of satellite signals can be received: the LOS signal, the diffracted signal, and the reflected signal, as shown in Figure 2, respectively. Based on the ray-tracing technique [53], all three types of signal can be traced with the geometrical relationship between buildings, satellite, and receiver.

3.1. LOS GNSS Signal

Assuming the GNSS signal propagation follows a straight line, the GNSS LOS signal of a specific satellite can be directly traced as a line from the satellite position to the receiver position, as Figure 2a shows. Since the buildings in an urban area may obstruct the GNSS signal, only the LOS signal without any intersection with the building surfaces from the 3D building model will be considered as the valid LOS signal.

3.2. Diffracted GNSS Signal

The GNSS signal is an electromagnetic wave broadcasting from the satellite to ground. The propagation of waves towards a specific receiver may be bent when its straight transmitting path is slightly obstructed by the building, namely the diffraction effect. More specifically, the GNSS diffraction can also be regarded as the reception of the secondary wave emitted from the building edge. A detailed explanation of the GNSS diffraction phenomenon can be found in [40].
Based on the UTD [39], the GNSS diffraction can be modeled as an effect dominated by a specific diffracted signal, as Figure 2b, where the signal propagates along a bent path via the point of diffraction on the building edge. A valid diffraction path follows the Fermat’s principle that the angle α between incidence and the building edge is equal to the angle α between the diffracted ray and the edge [37]. By searching the point x d i f f r a c t i o n on the edges of the 3D building model that fulfill such geometrical relationship between satellite and receiver, the ray-tracing technique can be extended to trace all valid paths of the GNSS diffracted signal. In this study, we only consider the single diffraction effect and the diffracted signal being obstructed by other buildings is invalid.

3.3. Reflected GNSS Signal

Besides direct propagation and diffraction, the GNSS signal can also be reflected by the building surface and then received by the road agent, as Figure 2c shows. The reflected signal follows the Fermat’s principle that the incident angle β is equal to the reflected angle β . Based on this geometrical relationship, the ray-tracing technique finds the reflected signal path by searching for valid point of reflection x r e f l e c t i o n on all the surfaces in the 3D building model.
In detail, the receiver (road agent) location is firstly mirrored with respect to a specific building surface and denoted as x m i r r o r . The point of reflection satisfying the geometrical relationship is located at the intersection between that surface and the line from the satellite to the mirrored location. If the point of reflection is within that mirroring surface and there is no obstruction from other building surfaces along the path, the corresponding path from the satellite passing the point of reflection to the receiver is a valid reflected signal. By applying this searching process to all the surfaces determined by the corner locations in the 3D building model, all valid reflected GNSS signal paths can be traced.

4. GNSS Measurement Simulation

After searching all the valid direct, diffracted, and reflected GNSS signals from the ray-tracing, the measurement status of each satellite is categorized into four types: LOS only, single reflection, single diffraction, and multipath. Different strategies are employed during the GNSS C / N 0 , pseudorange, and Doppler frequency measurement simulation based on the measurement status. Finally, additional measurement error and noise based on comprehensive models are added on top of the preceding simulation result to make the final simulated measurement realistic.

4.1. Overall GNSS Measurement Simulation

To simulate the GNSS measurement realistically, all the error components need to be considered with appropriate models. For the C / N 0 measurement, besides the simulated value based on the signal strength, its hardware-related estimation noise also needs to be considered. The final simulated GNSS C / N 0 measurement is obtained by
C / N 0 , s i m = 10 log 10 ( 10 C / N 0 , t y p e 10 + η c / n 0 )
where C / N 0 , t y p e is the simulated C / N 0 corresponding to the signal type and t y p e { L O S , d i f f r a c t i o n , r e f l e c t i o n , m u l t i p a t h } . η c / n 0 ~ N ( 0 , σ c / n 0 2 ) is a random variable following Gaussian distribution (denoted by N ) with zero bias and the C / N 0 estimation variance σ c / n 0 2 .
The final simulated GNSS pseudorange measurement is given by
ρ s i m = s t y p e c d t S + c d t r + ϵ i o n o + ϵ t r o p o + η D L L + η m o d e l s
where s t y p e is the simulated GNSS ranging measurement corresponding to different signal type, c is the speed of light, d t S is the satellite clock bias, d t r is the receiver clock bias. ϵ i o n o and ϵ t r o p o are the ionospheric delay and the tropospheric delay, respectively. η D L L ~ N ( 0 , σ D L L 2 ) and η m o d e l s ~ N ( 0 , σ m o d e l s 2 ) are random variables with the variance from the DLL tracking loop noise and the systematic error model noise, respectively. The final simulated Doppler shift measurement is obtained by
f s i m = f t y p e + η F L L
where f t y p e is the simulated GNSS Doppler shift corresponding to different signal types, and η F L L is a random variable that η F L L ~ N ( 0 , σ F L L 2 ) with the variance from the FLL tracking loop noise. Then, all three kinds of popular-used GNSS measurements are simulated and ready to be applied with different algorithms for evaluation.
The following Section 4.2, Section 4.3, Section 4.4, Section 4.5 demonstrate the procedures of obtaining the signal-type-related measurement error terms, corresponding to the cases of LOS-only, single diffraction, single reflection, and multipath. Section 4.6 introduces other systematic error terms related to the atmosphere, the hardware characteristics, etc.

4.2. LOS Only Case

The GNSS C / N 0 measurement relates to the strength of the signal, where a higher C / N 0 usually represents the signal being healthy with less interference. In an open-sky scenario without obstructions between a satellite and a receiver, the C / N 0 corresponding to a satellite signal is closely related to its elevation angle [54]. Therefore, the   C / N 0 of an unobstructed signal can be simulated based on a GNSS elevation- C / N 0 regression model from long period open-sky data [33]. In this study, the   C / N 0 from GPS satellite, Beidou satellite on geosynchronous equatorial orbit (GEO), on inclined geosynchronous orbit (IGSO), and on medium Earth orbit (MEO) are simulated with different open-sky models as Figure 3 shows, in order to consider the behavior varies between different systems and operating orbits. First-order polynomial fitting is employed between the elevation angle and the C / N 0 with the unit of Hz before applying logarithm.
The GNSS pseudorange measurement of the LOS only case is the direct range between satellite and road agent as follows
s L O S = x a g e n t x S V
The Doppler frequency measurement of the LOS only case can be simulated based on the Doppler effect between two dynamic objects [34], using
f L O S = ( v a g e n t · a v S V · a c · t ˙ a g e n t ) / λ
where v a g e n t and v S V are the velocity of the road agent and the satellite, respectively. a is the line-of-sight unit vector from the road agent to the satellite. c is the speed of light and λ is the wavelength of the corresponding satellite signal. t ˙ a g e n t is the receiver clock drift as a tuning parameter of the simulation.

4.3. Single Diffraction Case

For the satellite with only one diffracted signal path valid from the ray-tracing, the corresponding C / N 0 , pseudorange, and Doppler measurements are simulated based on its geometrical behavior. Firstly, the C / N 0 is simulated based on the UTD, which describes the signal attenuation by the geometrical parameters of the diffracted signal and the building surfaces causing diffraction. The diffraction coefficient with respect to the strength of the LOS signal can be obtained from
D U T D = D R R s D e j k s D
D R R = u d u i D u d u i D 2
where D R R is the attenuation factor between the right-hand circular polarization (RHCP) electric field before and after diffraction on the point of diffraction.   D and D are the soft and hard diffraction coefficients of a linear polarized field derived from the geometrical parameter of the diffracted signal and the building.   u i and u i denote the orthogonal components of the GNSS signal electric field parallel and perpendicular to the incident plane, respectively. Equation (7) extends the UTD from the linear polarized field to the RHCP field appropriate for the GNSS signal. s D is the distance between the point of diffraction and the receiver, k is the GNSS signal wavenumber, and j is the imaginary unit. 1 / s D and e j k s D denote the spreading factor and the phase shift of the signal emitted from the point of diffraction, respectively. The detailed procedures of computing the diffraction coefficient from the geometrical parameters can be found in [40]. Then, the C / N 0 of the diffracted signal can be obtained using
C / N 0 , d i f f r a c t i o n = C / N 0 , L O S + 20 log | D U T D |
which is derived based on the relationships between the signal-to-noise ratio (SNR) with the diffraction coefficient and C / N 0 [55] as follows
S N R d i f f r a c t i o n S N R L O S = | D U T D | 2
C / N 0 = 10 l o g S N R + f BW
where S N R L O S and S N R d i f f r a c t i o n denote the SNR peak power of the LOS and the diffracted signals, respectively. Equation (10) describes the relationship between C / N 0 (in the unit of dB-Hz) and SNR. f BW is the receiver front-end bandwidth which will be eliminated when considering only the power ratio between the LOS and diffracted signal. However, the C / N 0 of the original unobstructed LOS signal is difficult to obtain based on the receiver parameter that varies from different antennas. A convenient approach is to estimate the C / N 0 , L O S from an open-sky regression model, as the preceding LOS only case.
After obtaining the C / N 0 of the diffracted signal, the corresponding GNSS ranging measurement can be simulated by its total traveling distance using
s d i f f r a c t i o n = s D + s D = x d i f f r a c t i o n x S V + x a g e n t x d i f f r a c t i o n
where s D is the distance between the satellite and the point of diffraction. The pseudorange error due to diffraction can be denoted as ϵ D = s d i f f r a c t i o n s L O S . Finally, the Doppler frequency of the diffracted signal can be derived based on the Doppler shift model extended with an intermediate point [34], using
f d i f f r a c t i o n = [ ( 1 v S V · a D c ) v a g e n t · a D v S V · a D c · t ˙ a g e n t ] / λ ( v a g e n t · a D v S V · a D c · t ˙ a g e n t ) / λ
where a D is the line-of-sight unit vector from the point of diffraction x d i f f r a c t i o n to the satellite and a D is the unit vector from the road agent to the point of diffraction. Based on the position and velocity of the road agent and the satellite as well as the location of the point of diffraction, the Doppler frequency of the GNSS signal with a specific wavelength can be simulated correspondingly.

4.4. Single Reflection Case

The GNSS-R has been widely employed for geodetic survey application, which estimates the geometrical parameter during reflection based on the reflected C / N 0 measurement. The mechanism of GNSS-R can be, in turn, used to simulate the GNSS C / N 0 measurement based on the geometrical parameters during reflection. The C / N 0 relationship between the LOS signal and the reflected signal can be derived by
C / N 0 , r e f l e c t i o n = C / N 0 , L O S + 20 l o g ( s L O S s R + s R | L R | )
based on Equation (10) and the relationship that
S N R r e f l e c t i o n S N R L O S = s L O S 2 ( s R + s R ) 2 | L R | 2
where s R is the distance between the satellite and the point of reflection and s R is the distance between the point of reflection and the receiver (road agent). Equation (13) is derived by Equations (10) and (14), which describe the reflected/LOS SNR peak power ratio [56] and the conversion from C / N 0 (in the unit of dB-Hz) to SNR, respectively. Therefore, the C / N 0 of a reflected signal can be represented by its LOS C / N 0 attenuated by a spreading factor and a reflection coefficient L R . Note that the GNSS signal is RHCP, whereas the reflected GNSS signal may be inverted into left-hand circular polarization (LHCP). By considering the polarization interference, the reflection coefficient L R from RHCP to LHCP can be written as the combination of the reflection coefficient on horizontal and vertical polarization [41,57], as follows
L R = 1 2 ( v v h h )
where h h and v v are the Fresnel reflection coefficient of the horizontal and vertical linear polarization component with respect to the reflecting surface, derived from
h h = cos β ε sin 2 β cos β + ε sin 2 β
v v = ε cos β ε sin 2 β ε cos β + ε sin 2 β
ε = ε 2 / ε 1
β is the incident angle of the reflected signal,   ε 1 is the dielectric constant of the air, and ε 2 is the dielectric constant of the reflecting surface. In this study, the dielectric constant of glass ( ε 2 = 4.7 ) is used for the reflector, and the conduction due to the lossy medium is neglected. Note that some articles denote h h by and v v by as the linear polarized component perpendicular and parallel to the incident plane (the plane determined by the incident and reflected signals), which are also representing the soft and hard reflections, respectively. Based on the geometrical parameter, including the incident angle θ and the distances between satellite, road agent, and the point of reflection, the C / N 0 of the corresponding reflected GNSS signal can be simulated from its unobstructed C / N 0 , L O S by the open-sky model.
The ranging measurement of single reflected GNSS signal can be simulated by the total travelling distance on the reflection path, as follows.
s r e f l e c t i o n = s R + s R = x r e f l e c t i o n x S V + x a g e n t x r e f l e c t i o n
The corresponding pseudorange delay due to reflection can be written as
ϵ R = s r e f l e c t i o n s L O S
The Doppler frequency of the reflected signal can be derived based on the Doppler shift model extended with an intermediate point [34], using
f r e f l e c t i o n = [ ( 1 v S V · a R c ) v a g e n t · a R v S V · a R c · t ˙ a g e n t ] / λ ( v a g e n t · a R v S V · a R c · t ˙ a g e n t ) / λ
where a R is the line-of-sight unit vector from the point of reflection x r e f l e c t i o n to the satellite, and a R is the unit vector from the road agent to the point of reflection. Based on the position and velocity of the road agent and the satellite as well as the location of the point of reflection, the Doppler frequency of the GNSS signal with a specific wavelength can be simulated correspondingly.

4.5. Multipath Case

Besides the reception of a single GNSS signal from LOS, reflection, or diffraction, the GNSS receiver can also receive multiple signals simultaneously, if available, namely the multipath case. The corresponding measurement will be degraded due to the interferences between each signal. In this study, we only consider the interaction between the shortest two signals with the attenuation less than a heuristically designed threshold of 20 dB-Hz. Other available signals with larger delay or lower strength have fewer effects and they are neglected. Therefore, the multipath case contains the signal combination of: LOS and reflection, LOS and diffraction, reflection and diffraction, double reflections, and double diffractions.
Based on the expression of individual fields, the expression of the joint signal field with interferences between signals can be derived through the superposition of fields. The detailed derivation with different signal combination cases is demonstrated in Appendix A. Then, the strength ratio between the multipath joint field and the unobstructed field on the road agent location can be expressed by
Γ m u l t i p a t h = Γ a + Γ b
Γ a , b = { 1 , a , b L O S D R R s D e j k ϵ D , a , b d i f f r a c t i o n L R e j k ϵ R , a , b r e f l e c t i o n
where Γ a and Γ b represent the stand-alone signal strength ratio compared to the unobstructed signal for different cases, ϵ D and ϵ R denote the extra traveling distance compared to the unobstructed signal for the diffracted signal or the reflected signal, respectively. Analogous to the single reflection case or single diffraction case with the approximation the extra delay due to building interference is negligible compared to the total range from satellite to receiver, the C / N 0 simulation of the multipath case can be obtained from
C / N 0 , m u l t i p a t h = C / N 0 , L O S + 20 l o g | Γ m u l t i p a t h |
On the other hand, the GNSS pseudorange measurement under the multipath case is also affected by the interaction between signals. The code pseudorange error due to this interaction needs to be evaluated by the multipath noise envelope model with the amplitude ratio and the delay between two signals. Based on the multipath noise envelope for the early-minus-late power discriminator [43], the multipath error on the pseudorange can be simulated by
ϵ m u l t i p a t h = F m u l t i p a t h   n o i s e   e n v e l o p e ( α , β , τ , d )
α = 10 C / N 0 , b C / N 0 , a 20
β = 2 π λ s
τ = s / L c h i p
where F m u l t i p a t h   n o i s e   e n v e l o p e denotes the multipath error estimation function based on the multipath noise envelope demonstrated in Figure 4. α denotes the signal amplitude ratio ( α 1 for this case), β denotes the carrier phase offset and between two signals. d is the time spacing between early and late correlator. s and τ are the multipath time and distance delay in-between, respectively. L c h i p is the code chip width. In this study, the carrier phase shift induced by the reflector is neglected.
Then, the GNSS code pseudorange measurement can be obtained by
s m u l t i p a t h = s L O S + ϵ m u l t i p a t h
For the Doppler effect, it is assumed to be dominated by the strongest signal [35], which has the highest C / N 0 . Hence, the Doppler shift for the multipath case can be simulated by the dominated signal through Equations (5), (12), or (21), as follows.
f m u l t i p a t h = { f L O S , L O S   s i g n a l   d o m i n a t e d f d i f f r a c t i o n , d i f f r a c t e d   s i g n a l   d o m i n a t e d f r e f l e c t i o n , r e f l e c t e d   s i g n a l   d o m i n a t e d

4.6. General Measurement Error and Noise

To ensure the GNSS measurement simulation is realistic, other measurement errors and noises need to be considered besides the preceding building-related errors. In this study, sophisticated models are employed to simulate different kinds of error and noise generally appearing in GNSS measurements, including the tracking loop noise, C / N 0 estimation noise, satellite clock bias, receiver clock error, ionospheric delay, tropospheric delay, and pseudorange error modeling noise.

4.6.1. Tracking Loop Noise

The pseudorange measurement noise from DLL consists of the thermal noise and the dynamic stress [44]. The thermal noise is related to the signal C / N 0 and the receiver parameters, whereas the dynamic stress is related to the loop order and bandwidth. This paper follows [44] to generate the tracking loop noise. Since the dynamic stress can be almost removed via the carrier aided code technique, it is neglected during the DLL noise simulation. As a result, the 1-sigma DLL noise of C/A code under BPSK-R modulation is obtained by
σ D L L σ t D L L { B c o d e 2 C / N 0 d [ 1 + 2 T i C / N 0 ( 2 d ) ] , d π R c B f e B c o d e 2 C / N 0 [ 1 B f e T c + B f e T c π 1 ( d e l 1 B f e T c ) 2 ] × [ 1 + 2 T i C / N 0 ( 2 d ) ] , R c B f e < d < π R c B f e B c o d e 2 C / N 0 ( 1 B f e T c ) [ 1 + 1 T i C / N 0 ] , d R c B f e
where σ t D L L is the 1-sigma thermal noise code tracing jitter, d is the early-to-late correlator spacing (unit of chip),   B f e is the front-end bandwidth, R c is the chip rate, B c o d e is the code loop noise bandwidth, T i is the predetection integration time, and T c is the chip period. The 1-sigma Doppler measurement noise σ F L L from a 2nd order FLL consists of the thermal noise frequency jitter σ t F L L and the dynamic stress term f e [44], which can be estimated as follows (in the unit of Hz).
σ F L L = σ t F L L + f e 3
σ t P L L = 1 2 π T i 4 F B c a r r i e r C / N 0 ( 1 + 1 T i C / N 0 )
f e = d 3 R / d t 3 360 ω 0 3
where F equals 1 for high C / N 0 and equals 2 for the C / N 0 close to the threshold 1 / ( 12 T i ) . ω 0 = B c a r r i e r / 0.53 is the loop filter natural radian frequency.
Figure 5 shows an example of the 1-sigma noise distribution with respect to the C / N 0 value on measurements corresponding to DLL and FLL tracking loop. Normally, a high C / N 0 indicates the signal is healthy, whereas a low C / N 0 indicates the signal has larger noise during the tracking loop. Therefore, the tracking loop noises on the GNSS pseudorange and Doppler shift measurement are modeled by the random variables following zero-bias Gaussian distribution with the corresponding standard deviation.

4.6.2. C / N 0 Estimation Noise

For real cases, the GNSS C / N 0 could also be noisy due to interferences or weak signal power. During the narrow-to-wide power method, a popular approach for C / N 0 estimation, the C / N 0 measurement noise can be evaluated statistically in the form of standard deviation [45].
σ c / n 0 1 T c o h M 1 ( M P ¯ N / W ) 2 σ ( P N / P W ) K
where the variables K and M denote that the prompt I and Q are divided into K intervals with M samples in each interval for the C / N 0 estimation. T c o h is the coherent integration time, P ¯ N / W and σ ( P N / P W ) are the averaged value and standard deviation of the narrow and wide power measurements ratio on K intervals, respectively. However, P ¯ N / W and σ ( P N / P W ) are obtained from the tracking-level measurements not available in the proposed simulator. An alternative approach is to model these two parameters by curve fitting models with large amounts of data in urban scenarios. In this study, based on the c / n 0 value (which is the C / N 0 with the unit of Hz), a rational fitting model is employed for P ¯ N / W , whereas an exponential fitting model is employed for σ ( P N / P W ) , as Figure 6 shows. Then, P ¯ N / W and σ ( P N / P W ) can be modeled based on the simulated C / N 0 value, and further combined with the receiver parameter T c o h , M and K to simulate the noise on the C / N 0 measurement.

4.6.3. Satellite Clock Bias

The actual GNSS pseudorange measurement contains the satellite clock error due to imperfect synchronization with the corresponding system time. The correction for this error is estimated by the control segment and broadcast to users through the navigation message from satellite. Therefore, this error term can be obtained for the pseudorange simulation based on the correction parameters from the satellite ephemeris [44,58], as follows.
d t S =   a f 0 + a f 1 ( t   t e p h )   + a f 2 ( t   t e p h ) 2   +   t r
t r = F e A s i n E k
where t is the receiver current time, t e p h is the ephemeris reference time, and t r is the relativistic correction term. a f 0 , a f 1 , a f 2 , e , and A are the clock bias, clock drift, frequency drift, satellite orbital eccentricity, and orbit semimajor axis obtained from the ephemeris data, respectively. F = 4.442807633 × 10 10 ( s / m 1 / 2 ) is the constant and E k is the satellite orbit eccentric anomaly.

4.6.4. Receiver Clock Bias

Besides the satellite clock bias, the other term making the GNSS ranging measurement ‘pseudo-range’, is the receiver clock bias, which is usually an unknown variable needed to be estimated during positioning. In a real case, the receiver clock bias is not stable and drifts variously, related to the referencing oscillator of the receiver. A practical approach to simulate the receiver clock bias d t r with drift is through a 1st order linear approximation model based on the receiver parameters [46,47], as follows.
d t r =   d t r , t 0 + d t r ( t   t 0 )
d t r = f 0 + ε R W F M + ε F F M + ε W F M f 0
where d t r , t 0 is the initial clock bias of the receiver on time t 0 , t is the receiver current time. d t r is the frequency offset determined by the initial frequency offset f 0 , random walk frequency modulation noise ε R W F M , flicker frequency modulation noise ε F F M , white frequency modulation noise ε W F M , and the local oscillator frequency f 0 . Figure 7 shows an example of the clock errors from ε R W F M , ε F F M , and ε W F M based on the TCXO parameters from [48].

4.6.5. Ionospheric Delay

The real GNSS pseudorange measurement contains the error due to ionospheric delay, which is usually corrected by the Klobuchar model with detailed procedures in [49], and summarized as below.
ϵ i o n o = F [ 5 × 10 9 + ( n = 0 3 α n Φ m n ) ( 1 x 2 2 + x 4 24 ) ]
x = 2 π ( t 50400 ) n = 0 3 β n Φ m n  
where F is an elevation-related slant factor, α n and β n are the ionospheric parameters from ephemeris data, Φ m n is the geomagnetic latitude, t is the local time. Based on the receiver latitude and longitude, satellite elevation and azimuth angles, receiver time, and the ionospheric parameters from the ephemeris, the corresponding ionospheric delay can be simulated via the Klobuchar model correspondingly.

4.6.6. Tropospheric Delay

Another error term always contained in the pseudorange measurements is the delay due to tropospheric refraction, described by the Saastamoinen model [50], as follows.
ϵ t r o p o = 0.002277 s e c ( e l ) [ p t + ( 1255 T a b s + 0.05 ) p w v B t a n 2 e l ]
where e l is the satellite elevation angle. p t , p w v , T a b s , and B are the total barometer pressure, the partial pressure of water vapor, absolute temperature (in Kelvin), and the coefficient term related to the ellipsoid height of the receiver. Based on the satellite elevation angle and the receiver ellipsoid height, the corresponding tropospheric delay ϵ t r o p o can be simulated correspondingly.

4.6.7. Pseudorange Error Modeling Noise

Besides the exact value of errors from different models, each error term may also have a certain variation during real operation. These variations of errors are caused by various unknown factors, which are difficult to model. A practical way to simulate these variations is according to the GNSS user-equivalent-range-error (UERE) budget from [44]. The nominal 1-sigma error of the satellite clock σ S C is given as 1.1 m. The 1-sigma ephemeris prediction error σ e p h on pseudorange is given as 0.8 m. The noise on the relativistic effect error is negligible. The 1-sigma error on ionospheric delay σ i o n o is given by a higher bound as 7.0 m, which is reduced in half in this study by assuming a good ionospheric correction. The 1-sigma error on tropospheric delay is obtained from an elevation-angle-related model [51], as follows.
σ t r o p o = 0.12 1.001 0.002001 + sin 2 e l
As a result, all the error noise above can be combined into a total error noise factor, as the error modeling noise σ m o d e l s shown below.
σ m o d e l s = σ S C 2 + σ e p h 2 + σ i o n o 2 + σ t r o p o 2
Then, the total modeling noise on the pseudorange measurements is simulated by a random variable from zero-bias Gaussian distribution with the standard deviation of σ m o d e l s .

5. Simulation Performance Verification

In this section, the proposed realistic GNSS measurement simulator for multiple agents in the urban area is verified by two approaches. On the one hand, the simulated GNSS measurements of C / N 0 , pseudorange and Doppler frequency are compared with the real experimental measurements collected from a commercial-grade receiver in different scenarios to verify whether different interferences can be appropriately simulated. On the other hand, the simulated GNSS measurements of different agents will be applied with conventional positioning algorithms and collaborative positioning algorithms, aiming to verify that simulated measurements can reproduce realistic performances of current positioning algorithms.

5.1. Experimental Verification

5.1.1. Experiment Setup

The experimental verification of the proposed simulator consists of three scenarios: (1) one-hour static experiment on the intersection of the urban area; (2) dynamic vehicular experiment in the urban area; (3) static experiment with multiagent in different environments. For the verification using the one-hour static data, the experiment locations and the corresponding sky-plots with buildings are shown in Figure 8. The GNSS measurement on this location is expected to be severely degraded by reflection, diffraction, or multipath. For the dynamic experiment, the trajectory is shown in Figure 9, where the vehicle is moving from the open-sky area to the urban area, and then back to the starting point. The receiver locations and sky-plots during the multiagent static experiment are shown in Figure 10 with a summary of the surrounding environment of each receiver in Table 2.
During all the experiments, the commercial-grade GNSS receiver ublox EVK-M8T with patch antenna is employed to collect GNSS (GPS and Beidou) raw measurements. The receiver true location of each static experiment is obtained based on the landmark on Google Earth, which has the accuracy within 1–2 m from our experience. The receiver true location during the dynamic experiment is obtained based on the GNSS/INS integrated solution from the Novatel SPAN-CPT capable of RTK positioning. The value of receiver parameters used in the proposed GNSS simulator are listed in Table 3. During the simulation, unlike the C / N 0 and Doppler frequency, the pseudorange measurement always contains the receiver clock bias, which is a receiver-related unknown. It is hard and unnecessary to simulate this bias exactly the same as the real measurement, since it is also estimated in the solution during positioning. Therefore, instead of comparing with the bias-contained pseudorange, we directly compare the pseudorange error between real measurement and simulation for verification. The pseudorange error in real measurement is labeled by applying the double different technique with the measurement from a nearby reference station [59]. Similarly, the real Doppler frequency measurement also contains a receiver clock drift that is difficult to exactly simulate. Therefore, we apply the single difference approach to estimate the Doppler shift error for the consistency evaluation between real measurement and simulation. The Doppler shift error of the i t h satellite is estimated by
ε f i = ( f a g e n t i f a g e n t m ) ( f L O S i f L O S m )
where the superscript m denotes the Doppler shift of the selected master satellite (with the highest elevation angle). The subscript a g e n t denotes the Doppler shift from measurement or simulation. The subscript L O S denotes the true Doppler shift labeled using the user velocity, satellite velocity, and the satellite line-of-sight vector. By applying the single difference on the Doppler shift between the target satellite and the master satellite, the shared receiver clock drift can be eliminated, which provides a clearer consistency evaluation between the real received and the simulated Doppler shift.

5.1.2. One-Hour Static Experiment Performance Verification

During the static experiment on the urban intersection, the GNSS measurements from each satellite are simulated by the proposed simulator (please see Supplementary Materials) and compared with the real received measurement. Figure 11 shows the simulation result of C / N 0 , pseudorange error, and Doppler shift error from the B4 satellite, which is classified as a LOS satellite during the whole simulation. The simulated C / N 0 measurement is consistent with the real measurement, verifying the proposed open-sky regression model can be used to simulate the C / N 0 from the LOS satellites. For the pseudorange measurement, the simulation result is also consistent with the real measurement, which is a typical LOS measurement without large errors. Although the real measurement has less fluctuation compared to the simulation due to some filtering technique in receivers, both simulated and real measurements have a similar magnitude of noise, representing the behavior of the LOS measurement. For the Doppler shift, the error from simulation has a slightly higher noise compared to that from the real measurement, but both of them are in a similar level.
The simulation results from the G20 satellite experiencing all four measurement status are compared with the real measurements in Figure 12. In the first 350 s, only one valid reflected signal path is found by the ray-tracing, which corresponds to the single reflection case in the simulator. The C / N 0 is simulated with a large attenuation to around 28 dB-Hz, whereas the pseudorange measurement is simulated with around 30 m delay. In this period, the real received measurement is consistent with the simulation, containing a similar C / N 0 attenuation and pseudorange delay. In the later period, the proposed simulator only finds one valid diffracted signal while the previous reflection becomes invalid, which turns the measurement status to single diffraction case. The C / N 0 is gradually increased, since the satellite elevation angle rises towards the building edge with a decreasing signal strength attenuation coefficient. On the other hand, the pseudorange errors in real measurement and simulation both are reduced since the diffraction delay is normally negligible comparing to other noise. After the 500 epoch, the satellite is raised from the building boundary and becomes visible to the receiver, making both diffracted and direct signal path valid to the receiver in the simulation. Therefore, the measurement is simulated with the multipath case. Consistent with the real measurement, the C / N 0 is continually increasing while the simulated pseudorange error fluctuates around zero. After the 1300 epoch, the diffracted signal path becomes invalid for the receiver, and only the direct signal remains. Similar to the real measurement, the C / N 0 is maintained in a high value and the simulated pseudorange error is dominated by zero-biased random noises. In the ending period, the real C / N 0 is attenuated compared to the simulation, but no large constant delay is found in the pseudorange error. This could possibly be due to the signal interferences from those miss-detected reflections.
For the satellite G29 with large pseudorange errors probably due to reflection, the corresponding simulated and real received measurements are shown in Figure 13. During the experiment, its real received C / N 0 measurement is fluctuated with a large amplitude. This is a typical consequence of the multipath effect, where the phase shift between two signal paths is rapidly switching between in-phase and out-of-phase due to the satellite movement. Moreover, the pseudorange error in the real received measurement also has a large fluctuation but contains an enormous bias from zero. This is also another line of evidence of the multipath effect occurring, or more specifically, the multipath effect with a dominating reflected signal and no valid direct signal. The proposed simulator traces multiple valid propagation paths and correctly simulates the occurrence of multipath effect in the beginning (except the first 50 epochs) and ending period. Both the overall biases and the fluctuations in the pseudorange error are simulated consistent with the real measurement in these periods. However, during the period around 850–3200 epoch, the simulator cannot find another valid signal other than the dominating reflecting signal from ray-tracing. Therefore, only the enormous delay in the pseudorange is simulated, but the large fluctuation is missed. Despite this, the proposed simulator can still mimic the dominating pseudorange error due to reflection, which has the most impact on the positioning performance in the urban area.
As the measurements have the greatest impact on the positioning performance, the GNSS C / N 0 and pseudorange simulation results for other satellites are shown in Figure 14 and Figure 15, respectively. Table 4 shows the difference in the mean value and the standard deviation (in bracket) of the GNSS measurement parameters ( C / N 0 , pseudorange error, and Doppler shift error) between simulation and real collected data. The difference in mean value may indicate the performance on simulating the overall bias behavior, while the difference in standard deviation may indicate the performance on simulating the noise behavior. For most of the satellites, the simulated C / N 0 measurements are consistent with the real measurements, especially many of them appropriately simulate the attenuation on signal strength due to reflection or diffraction. On the other hand, the simulated pseudorange error is consistent with the real measurement in most epochs, even for those satellites with enormous delay due to reflection. However, for some of the satellites, the simulated C / N 0 and pseudorange are stable and healthy, while the real measurement is biased or noisy with fluctuations. This is probably due to the limitation of the ray-tracing technique, only considering the level-of-detail one (LoD-1) building model. The ray-tracing technique cannot trace those valid reflection or diffraction paths relate to the detailed structure of the building. As a result, the corresponding interferences are missed during the simulation. Despite this, those missed interferences are relatively small compared to those interferences introduced by severe reflections or diffractions, which are properly simulated. Moreover, the real measurement has a more stochastic behavior involving complicated noises and interferences, while the simulated measurement is dominated by a model-based deterministic effect that is more repeatable during the test. In general, the proposed simulator is able to simulate the measurement behavior of each satellite in the urban area in a realistic manner.
The least squares positioning results using the simulated measurements are shown in Figure 16, compared with the positioning result using real measurements. Although the positioning result based on the real measurement has a larger variance than the simulation-based solutions, both the positioning solutions have a similar error distribution mainly along the road direction. The corresponding positioning errors during the experiment are shown in Figure 17 with respect to East–West (E-W) and North–South (N-S) direction. The positioning errors from simulation have the same trend with the positioning errors from real measurements, excluding few epochs that the large errors are unable to simulate. This is probably due to the limitation of the ray-tracing and the model accuracy. In summary, the proposed simulator can realistically simulate the GNSS measurement and corresponding positioning error behavior in the urban area during the long-period static experiment.

5.1.3. Dynamic Experimental Verification

During the dynamic experiment, the GNSS measurements from each satellite available in the ephemeris are simulated by the proposed simulator (please see Supplementary Materials). The simulation result of the B1 satellite is shown in Figure 18, compared to the real received measurements. Most of the time, the satellite elevation angle is higher than the building boundary. The proposed simulator appropriately categorizes it as LOS or multipath dominated by the direct signal, and only a small pseudorange error is simulated, which matches the real measurement in the experiment. Besides, during the epoch around 430 and 700, the proposed simulation can appropriately simulate the attenuation of C / N 0 due to multipath (interference between two diffracted signals) and reflection. The slight increment of pseudorange error during 660–780 epoch due to reflection from the simulation is also consistent with the real measurements. Notice that the real received C / N 0 has additional attenuation compared to the simulation in some epochs. This could possibly be due to the interferences from the signal transporting along an unexpected path that miss-detect by the ray-tracing algorithm. For example, during the first 170 epochs, the vehicle is nearby a tall building still under construction without a proper model. The interferences related to that building cannot be simulated correctly. In general, the simulated GNSS measurement show good consistency with real measurements.
On the other hand, the simulation results of the satellite B6 are demonstrated in Figure 19. The GNSS measurement status is frequently changing between four cases during the simulation since the surrounding environment is rapidly changing during the experiment. Similar to the preceding result, the simulated measurement of C / N 0 and pseudorange error from this satellite are consistent with the real measurement, including the signal attenuation/delay due to the multipath effect. For the Doppler shift, the proposed simulator can simulate the error with a level and trend consistent with the real measurement under a rapidly changing environment. Notice that there may still be few epochs that the real measurement has greater degradation than simulation, due to the receptions of unexpected interfered signals. From a simulation point of view, the proposed simulator can instantly determine the measurement status based on the surrounding environment. The measurement behavior for each status is comprehensively simulated with reasonable magnitude and fluctuation. The rapid change of measurement behavior also reflects the unstable measurement status and the surrounding environment during the dynamic operation. It is much more realistic than the statistical noise model that is normally used to validate the GNSS positioning algorithms in the urban area.
The overall positioning solutions and corresponding errors from simulation and real measurements are shown in Figure 20. The proposed simulator appropriately simulates the increment of positioning error when entering a dense urban area, and the recovery of positioning accuracy when back to an open-sky environment. The positioning performance based on simulation behaves similar to that based on real measurements, except the beginning and ending periods. As mentioned before, the vehicle is nearby a constructing building without a model in the beginning period. Hence, the measurement errors from that building are underestimated, leading to a much smaller positioning error from the simulation. The second inconsistent period is probably because the vehicle is nearby the building with a complicated (ship-like) structure. The ray-tracing algorithm based on the LoD-1 building model cannot comprehensively predict all the valid interfered signals related to this building. As a result, the corresponding GNSS measurement error and the positioning error are underestimated. In summary, the proposed simulator can realistically simulate the GNSS measurement and positioning behavior of a vehicular agent in the urban area.

5.1.4. Multiagent Performance Verification

During the multiagent experimental verification, six receivers are set up at the designed locations (Figure 10) and collect the GNSS simultaneously. On the other hand, the proposed simulator simulates the GNSS measurements of those receivers during the same period based on the receiver locations, satellite ephemeris, and 3D building model (please see Supplementary Materials). After that, the GNSS positioning behavior from the simulator is compared with that from real collected measurements to verify the performance of the proposed simulator.
The GNSS least squares positioning results of each agent based on real measurements and simulator are shown in Figure 21. The corresponding positioning 2D errors are shown in Figure 22 and summarized in terms of RMSE in Table 5. For Agent 1 and Agent 2 located in the open-sky scenario, the proposed simulator classifies most of the measurements as healthy. Only small errors are simulated in the measurements, which provides accurate positioning solutions consistent with the real measurement performance. Note that the positioning result from simulation contains higher noise than the real measurements. This could possibly be because of the measurement filtering technique that is usually embedded in the commercial GNSS receiver. For the agents other than Agents 1 and 2, the positioning error distribution from the proposed simulation is very similar to that from the real measurement. Especially for Agent 4, the increment of positioning error is also simulated at the epoch consistent with the real measurement. In summary, the proposed simulator can simultaneously simulate the GNSS measurements of multiple agents with realistic error behaviors in the urban area.

5.2. Simulation Performance for Positioning

5.2.1. Simulation Setup

Besides validating the consistency between the proposed simulator and the real measurements, it is also important to evaluate the positioning performance after applying different algorithms. Many algorithms are developed based on a certain assumption; for example, the measurement error follows the normal distribution. If only the naive errors are simulated in the measurements, these errors can be easily mitigated by applying advanced positioning algorithms, resulting in an unrealistic outstanding performance. A realistic simulator needs to generate the measurements that maintain the difficulties in urban GNSS positioning, which can be employed to appropriately evaluate or improve the performance of various positioning algorithms.
To evaluate the positioning performance based on the measurements from the proposed simulator, a realistic multiagent positioning scenario in the urban area is generated from SUMO [36] beforehand. The trajectory of each agent from SUMO considering urban transportation behaviors is shown in Figure 23. Five road agents are simulated, including one pedestrian in the open-sky area (Agent 1), one pedestrian in the dense urban area (Agent 2), and three vehicular agents operating with changing environments (Agents 3–5). After simulating the GNSS measurements corresponding to each agent trajectory by the proposed simulator, the simulated measurements are applied with six different urban GNSS positioning algorithms as follows:
(1)
LS: conventional least squares positioning for a single agent;
(2)
CC: least squares positioning with consistency check for a single agent [60];
(3)
RT: 3DMA GNSS ray-tracing positioning for a single agent [23];
(4)
RT-CP: 3DMA GNSS ray-tracing based collaborative positioning with factor graph optimization [26].

5.2.2. Positioning Performance

The solutions of each agent by applying the above four different GNSS positioning algorithms to the simulated measurements are demonstrated in Figure 24. The corresponding 2D positioning error distributions and RMSEs of each agent are shown in Figure 25 and Table 6, respectively. For Agent 1 in the open-sky area, all four positioning algorithms have similar accurate performances, since most of the measurements are simulated without interferences from buildings.
For Agent 2 in the urban area, the least-squares positioning RMSE is close to 30 m, which is reasonable for a low-cost GNSS receiver sensitive with the reflection interferences from buildings. In this scenario, the agent moves along one side of the buildings, and most of the reflected signals are probably from the opposite buildings 70 m away. Moreover, the sky-view of Agent 2 is very limited due to building blockage, which makes the multipath effect containing the direct signal less likely to occur. Hence, besides the healthy LOS measurements, the rest are more likely to be the reflected measurements with enormous delay. In this case, those degraded measurements are very inconsistent with other measurements. Therefore, the consistency check method can easily detect and isolate those outliers, achieving excellent positioning performance. On the other hand, the occurrence of multipath effect with two reflected signals is possible for this scenario, which reaches the limitation of the current ray-tracing positioning technique only considers one dominating signal. As a result, not much improvement is achieved by applying the ray-tracing positioning algorithm. Similarly, the ray-tracing based collaborative positioning only slightly improves the positioning accuracy by the aid from neighboring agents.
For vehicular Agent 3 and Agent 4, the surrounding environment is constantly changing, which has a higher chance of experiencing the scenario with complicated measurement error behavior, for example, the intersection with complicated multipath effects or the narrow street with very limited measurement number. Therefore, the consistency check only achieves limited improvements. On the other hand, the ray-tracing algorithm corrects the reflected measurement, which guarantees a sufficient amount of reliable measurement for better positioning accuracy. The ray-tracing based collaborative positioning method further employs the measurements from neighboring agents to eliminate the systematic errors, resulting in a slightly better performance.
For Agent 5 that is always in a narrow street, many of the measurements contain enormous errors, which makes both the LS method and CC method significantly degraded. The ray-tracing method is only capable of correcting the single reflection delay, which limits the positioning improvement. Its extension with collaborative positioning (RT-CP) can only reduce the RMSE to 18.6 m.
In summary, the performances of different positioning algorithms applied to our simulated measurements are reasonable and consistent with the real performance of the low-cost GNSS receiver in the urban area. Therefore, the proposed simulator is capable of providing realistic GNSS measurements of multiple agents in the urban scenario for the study and analysis of collaborative positioning algorithms.

6. Discussion

The results from the proposed simulator show great consistency with the real GNSS measurement in the urban area, which validates its capability to provide realistic GNSS measurements for various urban positioning algorithm evaluations or developments. The proposed simulator is developed based on sophisticated models, covering most of the interferences in the urban area. As the results in Table 6, by applying different advanced positioning algorithms, the remaining positioning errors are consistent with the real experimental performances reported in [23,26,60]. Therefore, the proposed simulator can appropriately reflect the challenges of urban GNSS positioning for future studies, especially the potential algorithms that it is hard to conduct experimental verification on, such as the large-scale collaborative positioning algorithms.
Compared to other existing algorithms, the proposed simulator is much less complicated, but still maintains a sufficient verisimilitude level. Besides the measurement availability prediction achieved by the simulator from UCL [61], our simulation further simulates all the basic GNSS raw measurements employed for positioning. Both the conventional GNSS raw measurement simulators, MUSTARD [29] and SNACS [30], simulate the interferences most likely from the ground, whereas our simulator focuses on a more complex urban scenario considering severe interferences coming from buildings. Instead of constructing a virtual environment, our simulator directly uses the 3D building model to simulate the GNSS measurements reflecting the error behavior on a specific site. Another advanced GNSS simulator, SimGEN@+SE-NAV [31], also employs the ray-tracing algorithm and sophisticated models for the interferences simulation in the urban area. However, it involves complicated radio channel modeling, which may not be useful for verifying the algorithms only using measurement-level data. Moreover, the detailed procedures of interference modeling in [31] are not explained. A recent study employs a reference RF data to simplify the channel modeling during GNSS measurement simulation, but still requires SDR for simulation. Different from the above approaches, our proposed simulator avoids the complicated channel modeling by using an open-sky C / N 0 model for reference, and directly simulates measurement-level GNSS data, which is convenient and adequate to verify various positioning algorithms. Each step of the GNSS measurement simulation is introduced in detail, providing a clear and complete guideline for developing a GNSS simulator. Moreover, the modeling of different interferences, including reflection, diffraction, and multipath, is explained comprehensively, which can be extracted for individual study or evaluation by other scholars. The simulator in the current study is developed for the GNSS constellation of GPS and BDS. Its support to GLONASS and GALILEO measurements will be developed with a similar approach in the future.
Besides providing realistic GNSS data, the proposed simulator can, in turn, improve the existing 3DMA GNSS positioning algorithms. Most of the 3DMA GNSS positioning algorithms determine the agent position by searching for a candidate location with the predicted measurement that best matches the real measurement. However, the current methods only conduct matching on the satellite visibility or the direct/reflected pseudorange [22,23]. The diffraction and multipath models in this study can be used to extend the 3DMA GNSS positioning algorithm by considering the matching on the C / N 0 involving diffraction or multipath. The 3DMA GNSS considering the diffraction will be our future work.
However, the proposed simulator still has three limitations. Firstly, the measurement simulation is highly relying on the ray-tracing technique, which is still unable to consider all the interferences from buildings comprehensively. An advanced ray-tracing technique needs to be developed with the consideration of detailed building models and material effects in the future. Moreover, the proposed simulator only provides the measurements based on individual epoch, which neglects the GNSS receiver dynamics during the operation. Therefore, different filtering techniques need to be considered to model the measurement dynamics over time in the future. Finally, the current simulator always produces continuous measurements, even when the satellite may only be barely tracked by the real receiver. The modeling of the signal loss-of-lock and acquisition behavior and the latency caused by the filters in the receiver tracking loops are worth investigating for the proposed simulator in the future to make the measurements more realistic. By involving the tracking-level models in the future, the simulator can be extended to support the realistic modeling of the carrier phase measurement with cycle slip effects in an urban area.

7. Conclusions

In this study, a realistic GNSS measurement simulator for multiple agents in the urban area is developed, considering the measurement degradation due to surrounding buildings. Four types of GNSS measurements, including LOS, reflection, diffraction, and multipath, are considered during simulation, covering most of the interferences in the urban area. From each measurement point of view, both the one-hour static and vehicular dynamic experiments validate that the measurement from the proposed simulator has a consistent and reasonable error behavior compared to the real collected measurement. From the overall performance point of view, the multiagent experiment validates that the positioning results based on the measurement from the proposed simulator can realistically reflect the GNSS positioning error behavior in the urban area. Moreover, the proposed simulator is integrated with SUMO to simulate the GNSS measurement of multiple agents considering the transportation behaviors. The simulated measurements are further applied with advanced positioning algorithms, which verifies that the proposed simulator can appropriately express the current difficulties of precise positioning as well as the bottleneck of different positioning algorithms. Therefore, the proposed simulator can provide realistic GNSS measurements of multiple agents to study and improve the state-of-art GNSS collaborative positioning algorithms in the urban area.

Supplementary Materials

This paper provides three examples of the GNSS observation data in the format of the RINEX 3.02. The ground truth of the data is also included. Please note that the GNSS ephemeris data (RINEX nav file) is not included since the data can be easily downloaded online. Please follow the Readme.txt for the detail information on downloading the ephemeris data via HK SatRef (https://www.geodetic.gov.hk/en/satref/satref.htm).

Author Contributions

Conceptualization, G.Z. and L.-T.H.; methodology, G.Z. and B.X.; software, G.Z. and H.-F.N.; formal analysis, G.Z., B.X., H.-F.N.; data collection, G.Z., B.X. and H.-F.N.; writing—original draft preparation, G.Z.; writing—review and editing, G.Z., B.X., H.-F.N. and L.-T.H.; supervision, L.-T.H. All authors have read and agreed to the published version of the manuscript.

Funding

This work is supported by the Emerging Frontier Areas (EFA) scheme by Research Institute for Sustainable Urban Development, The Hong Kong Polytechnic University—BBWK “Resilient Urban PNT Infrastructure to Support Safety of UAV Remote Sensing in Urban Region”.

Data Availability Statement

The GNSS simulation data used for verification can be accessed at https://www.polyu-ipn-lab.com/collaborative-positioning-for-iot-i.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Multipath Signal Strength Estimation

To simulate the C / N 0 measurement under the joint effect of two signals, the strength of each signal and the interference between two signals are required to be estimated. This interference is also related to the phase difference between two signals. A natural approach to evaluate such joint effect is through the superposition of those two electric fields E a and E b , as follows.
E j o i n t = E a + E b
E a , b = { E r e f · A ( s r e f ) · e j k s r e f , a , b L O S E D 1 · A ( s D ) · e j k s D , a , b d i f f r a c t i o n E R 1 · A ( s R ) · e j k s R , a , b r e f l e c t i o n
where E a and E b represent the electric field of a direct LOS signal, reflected signal, or diffracted signal. E r e f represents the reference electric field on a specific location along the direct propagation path with a distance s r e f to the receiver location. E D 1 = E D 0 · D R R represents the diffracted field on the point of diffraction, which can be written as the multiplication of the incident field E D 0 on the point of diffraction and the diffraction coefficient D R R . s D is the transmission distance between the point of diffraction and the receiver. Similarly, E R 1 = E R 0 · L R represents the reflected electric field on the point of reflection, which can be written as the multiplication of the incident field E R 0 on the point of reflection and the reflection coefficient L R . s R is the transmission distance between the point of reflection and the receiver. A ( s ) denotes the spreading factor of the electric field related to the propagation distance. The term e j k s accounts for the phase shift during the propagation. For convenience, the preceding expression can be written concerning the same reference field, the electric field on the road agent location.
According to the modern geometrical optics (GO) theory [39], the LOS electric field on the road agent location during the direct propagation with a spherical wavefront can be expressed as
E L O S = E r e f · A ( s r e f ) · e j k s r e f = E r e f · s r e f · s r e f ( s r e f + s r e f ) ( s r e f + s r e f ) · e j k s r e f = E a g e n t
where s r e f denotes the distance between the satellite and the reference field. A ( s r e f ) = s r e f · s r e f / ( s r e f + s r e f ) ( s r e f + s r e f ) is the spreading factor of a spherical wave during free propagation. Then, the electric field of a diffracted signal during the transmission can be expressed via the reference field on the road agent location as follows based on UTD and Equation (A3).
E d i f f r a c t i o n = E D 0 · D R R · A ( s D ) · e j k s D = E D 0 · D R R · 1 s D · e j k s D = E a g e n t A ( s L O S s D ) · e j k ( s L O S s D ) · D R R · 1 s D · e j k s D = E a g e n t s D s D [ s D + ( s L O S s D ) ] [ s D + ( s L O S s D ) ] · e j k ( s L O S s D ) · D R R · 1 s D · e j k s D E a g e n t · D R R s D · e j k ( s D + s D s L O S ) = E a g e n t · D R R s D · e j k ϵ D
As Figure 2 shows, s D is the distance between the satellite and the point of diffraction. The electric field at the point of diffraction and at the road agent (receiver) location has the relationship E a g e n t = E D 0 · A ( s L O S s D ) · e j k ( s L O S s D ) . A ( s L O S s D ) = s D s D / [ s D + ( s L O S s D ) ] [ s D + ( s L O S s D ) ] is the spreading factor from the field equivalent to the point of diffraction to the receiver under free propagation.   A ( s D ) = 1 / s D is the spreading factor of the diffracted field to the receiver. Since the satellite is much further away compared to the referencing point for the receiver, A ( s L O S s D ) is reduced to unity. Similarly, the reflected electric field on the road agent location can be written as follows.
E r e f l e c t i o n = E R 0 · L R · A ( s R ) · e j k s R = E R 0 · L R · 𝓅 R 1 𝓅 R 2 ( 𝓅 R 1 + s R ) ( 𝓅 R 2 + s R ) · e j k s R = E a g e n t A ( s L O S s R ) · e j k ( s L O S s R ) · L R · 𝓅 R 1 𝓅 R 2 ( 𝓅 R 1 + s R ) ( 𝓅 R 2 + s R ) · e j k s R = E a g e n t s R s R [ s R + ( s L O S s R ) ] [ s R + ( s L O S s R ) ] · e j k ( s L O S s R ) · L R · 𝓅 R 1 𝓅 R 2 ( 𝓅 R 1 + s R ) ( 𝓅 R 2 + s R ) · e j k s R E a g e n t · L R · e j k ( s R + s R s L O S ) = E a g e n t · L R · e j k ϵ R
where A ( s R ) = 𝓅 R 1 𝓅 R 2 / ( 𝓅 R 1 + s R ) ( 𝓅 R 2 + s R ) is the spreading factor of the reflected field to the receiver. 𝓅 R 1 and 𝓅 R 2 denote the principal radii of the reflected wavefront at the point of reflection. Since the satellite is much further away from the receiver than the referencing point and the point of reflection, both A ( s L O S s R ) and A ( s R ) are reduced to unity, as the near-zone observation [39].
Therefore, the strength ratio between the multipath joint field and the unobstructed field on the road agent location can be expressed by
Γ m u l t i p a t h = E j o i n t E a g e n t = Γ a + Γ b
where Γ a and Γ b represent the stand-alone strength ratio with respect to the unobstructed field for different cases from Equation (23).

References

  1. The Government of the Hong Kong Special Administrative Region. Hong Kong Smart City Blueprint; The Government of the Hong Kong: Hong Kong, China, 2017.
  2. Gikas, V.; Retscher, G.; Kealy, A. Chapter 15—Collaborative Positioning for Urban Intelligent Transportation Systems (ITS) and Personal Mobility (PM): Challenges and Perspectives. In Mobility Patterns, Big Data and Transport Analytics; Antoniou, C., Dimitriou, L., Pereira, F., Eds.; Elsevier: Amsterdam, The Netherlands, 2019; pp. 381–414. [Google Scholar]
  3. 3GPP TR 22.872. Study on Positioning Use Cases; Stage 1. 3rd Generation Partnership Project: Valbonne, France, 2018. [Google Scholar]
  4. Zumberge, J.F.; Heflin, M.B.; Jefferson, D.C.; Watkins, M.M.; Webb, F.H. Precise point positioning for the efficient and robust analysis of GPS data from large networks. J. Geophys. Res. Space Phys. 1997, 102, 5005–5017. [Google Scholar] [CrossRef] [Green Version]
  5. El-Diasty, M. Integrity Analysis of Real-Time PPP Technique with Igs-Rts Service for Maritime Navigation. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2017, 42, 61–66. [Google Scholar] [CrossRef] [Green Version]
  6. Langley, R.B. Rtk GPS. GPS World 1998, 9, 70–76. [Google Scholar]
  7. El-Mowafy, A.; Kubo, N. Integrity monitoring of vehicle positioning in urban environment using RTK-GNSS, IMU and speedometer. Meas. Sci. Technol. 2017, 28, 055102. [Google Scholar] [CrossRef]
  8. Alçay, S.; Yigit, C.O. Network based performance of GPS-only and combined GPS/GLONASS positioning under different sky view conditions. Acta Geod. Geophys. 2016, 52, 345–356. [Google Scholar] [CrossRef]
  9. Li, T.; Zhang, H.; Gao, Z.; Niu, X.; El-Sheimy, N. Tight Fusion of a Monocular Camera, MEMS-IMU, and Single-Frequency Multi-GNSS RTK for Precise Navigation in GNSS-Challenged Environments. Remote Sens. 2019, 11, 610. [Google Scholar] [CrossRef] [Green Version]
  10. Van Brummelen, J.; O’Brien, M.; Gruyer, D.; Najjaran, H. Autonomous vehicle perception: The technology of today and tomorrow. Transp. Res. Part C Emerg. Technol. 2018, 89, 384–406. [Google Scholar] [CrossRef]
  11. Chang, L.; Niu, X.; Liu, T.; Tang, J.; Qian, C. GNSS/INS/LiDAR-SLAM Integrated Navigation System Based on Graph Optimization. Remote Sens. 2019, 11, 1009. [Google Scholar] [CrossRef] [Green Version]
  12. Weiβ, C. V2X communication in Europe—From research projects towards standardization and field testing of vehicle communication technology. Comput. Networks 2011, 55, 3103–3119. [Google Scholar] [CrossRef]
  13. Howard, A.; Matark, M.; Sukhatme, G.S. Localization for mobile robot teams using maximum likelihood estimation. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and System (IROS 2003), Las Vegas, NV, USA, 27–31 October 2003; Volume 1, pp. 434–439. [Google Scholar]
  14. Conti, A.; Guerra, M.; Dardari, D.; DeCarli, N.; Win, M.Z. Network Experimentation for Cooperative Localization. IEEE J. Sel. Areas Commun. 2012, 30, 467–475. [Google Scholar] [CrossRef]
  15. Qian, C.; Zhang, H.; Li, W.; Tang, J.; Liu, H.; Li, B. Cooperative GNSS-RTK Ambiguity Resolution with GNSS, INS, and LiDAR Data for Connected Vehicles. Remote. Sens. 2020, 12, 949. [Google Scholar] [CrossRef] [Green Version]
  16. Pirani, M.; Hashemi, E.; Khajepour, A.; Fidan, B.; Litkouhi, B.; Chen, S.-K.; Sundaram, S. Cooperative Vehicle Speed Fault Diagnosis and Correction. IEEE Trans. Intell. Transp. Syst. 2018, 20, 783–789. [Google Scholar] [CrossRef]
  17. Heng, L.; Gao, G.X. Accuracy of Range-Based Cooperative Positioning: A Lower Bound Analysis. IEEE Trans. Aerosp. Electron. Syst. 2017, 53, 2304–2316. [Google Scholar] [CrossRef]
  18. Müller, F.D.P. Survey on Ranging Sensors and Cooperative Techniques for Relative Positioning of Vehicles. Sensors 2017, 17, 271. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Alam, N.; Balaei, A.T.; Dempster, A.G. Relative Positioning Enhancement in VANETs: A Tight Integration Approach. IEEE Trans. Intell. Transp. Syst. 2013, 14, 47–55. [Google Scholar] [CrossRef]
  20. Liu, K.; Lim, H.B.; Frazzoli, E.; Ji, H.; Lee, V.C.S. Improving Positioning Accuracy Using GPS Pseudorange Measurements for Cooperative Vehicular Localization. IEEE Trans. Veh. Technol. 2014, 63, 2544–2556. [Google Scholar] [CrossRef]
  21. Minetto, A.; Nardin, A.; Dovis, F. Tight Integration of GNSS Measurements and GNSS-based Collaborative Virtual Ranging. In Proceedings of the 31st International Technical Meeting of The Satellite Division of the Institute of Navigation (ION GNSS+ 2018), Miami, FL, USA, 24–28 September 2018; pp. 2399–2413. [Google Scholar]
  22. Wang, L.; Groves, P.D.; Ziebart, M.K. Smartphone Shadow Matching for Better Cross-street GNSS Positioning in Urban Environments. J. Navig. 2014, 68, 411–433. [Google Scholar] [CrossRef] [Green Version]
  23. Hsu, L.-T.; Gu, Y.; Kamijo, S. 3D building model-based pedestrian positioning method using GPS/GLONASS/QZSS and its reliability calculation. GPS Solut. 2015, 20, 413–428. [Google Scholar] [CrossRef]
  24. Zhang, G.; Wen, W.; Hsu, L.-T. Rectification of GNSS-based collaborative positioning using 3D building models in urban areas. GPS Solut. 2019, 23, 83. [Google Scholar] [CrossRef]
  25. Tanwar, S.; Gao, G.X. Decentralized Collaborative Localization in Urban Environments using 3D-Mapping-Aided (3DMA) GNSS and Inter-Agent Ranging. In Proceedings of the 31st International Technical Meeting of The Satellite Division of the Institute of Navigation (ION GNSS+ 2018), Miami, FL, USA, 24–28 September 2018; pp. 2352–2363. [Google Scholar]
  26. Zhang, G.; Ng, H.-F.; Wen, W.; Hsu, L.-T. 3D Mapping Database Aided GNSS Based Collaborative Positioning Using Factor Graph Optimization. IEEE Trans. Intell. Transp. Syst. 2020, 1–13. [Google Scholar] [CrossRef]
  27. Soatti, G.; Nicoli, M.; Garcia, N.; Denis, B.; Raulefs, R.; Wymeersch, H. Implicit Cooperative Positioning in Vehicular Networks. IEEE Trans. Intell. Transp. Syst. 2018, 19, 3964–3980. [Google Scholar] [CrossRef] [Green Version]
  28. Fascista, A.; Ciccarese, G.; Coluccia, A.; Ricci, G. Angle of Arrival-Based Cooperative Positioning for Smart Vehicles. IEEE Trans. Intell. Transp. Syst. 2017, 19, 2880–2892. [Google Scholar] [CrossRef]
  29. Byun, S.H.; Hajj, G.A.; Young, L.E. Development and application of GPS signal multipath simulator. Radio Sci. 2002, 37, 1–10. [Google Scholar] [CrossRef] [Green Version]
  30. Schubert, F.; Prieto-Cerdeira, R.; Robertson, P.; Fleury, B.H. SNACS—The satellite navigation radio channel signal simulator. In Proceedings of the ION GNSS+ Institute of Navigation, Savannah, GA, USA, 22–25 September 2009. [Google Scholar]
  31. Panicciari, T.; Soliman, M.A. Evaluation of a GNSS Receiver Performance in Different Multipath Environments with a Novel Real-time Multipath Simulation System. In Proceedings of the 30th International Technical Meeting of The Satellite Division of the Institute of Navigation (ION GNSS+ 2017), Portland, OR, USA, 25–29 September 2017; pp. 427–435. [Google Scholar]
  32. Xu, B.; Hsu, L.-T.; Suzuki, T. Intermediate Frequency Level GPS Multipath/NLOS Simulator based on Vector Tracking and Ray Tracing. In Proceedings of the 2020 International Technical Meeting of The Institute of Navigation, San Diego, CA, USA, 21–24 January 2020; pp. 249–258. [Google Scholar]
  33. Suzuki, T.; Kubo, N. GNSS positioning with multipath simulation using 3D surface model in urban canyon. In Proceedings of the 25th International Technical Meeting of The Satellite Division of the Institute of Navigation (ION GNSS 2012), Nashville, TN, USA, 17–21 September 2012; pp. 438–447. [Google Scholar]
  34. Xie, P.; Petovello, M.G. Measuring GNSS Multipath Distributions in Urban Canyon Environments. IEEE Trans. Instrum. Meas. 2014, 64, 366–377. [Google Scholar] [CrossRef]
  35. Xu, L.; Rife, J. Modeling Multipath Effects on Frequency Locked Loops. In Proceedings of the 2020 International Technical Meeting of The Institute of Navigation, San Diego, CA, USA, 21–24 January 2020; pp. 698–712. [Google Scholar]
  36. Lopez, P.A.; Wiessner, E.; Behrisch, M.; Bieker-Walz, L.; Erdmann, J.; Flotterod, Y.-P.; Hilbrich, R.; Lucken, L.; Rummel, J.; Wagner, P. Microscopic Traffic Simulation using SUMO. In Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA, 4–7 November 2018; pp. 2575–2582. [Google Scholar]
  37. Keller, J.B. Geometrical theory of diffraction. J. Opt. Soc. Am. 1962, 52, 116–130. [Google Scholar] [CrossRef]
  38. Kouyoumjian, R.; Pathak, P. A uniform geometrical theory of diffraction for an edge in a perfectly conducting surface. Proc. IEEE 1974, 62, 1448–1461. [Google Scholar] [CrossRef] [Green Version]
  39. McNamara, D.; Pistorius, C.; Malherbe, J. The Uniform Geometrical Theory of Diffraction; Artech House: London, UK, 1990. [Google Scholar]
  40. Zhang, G.; Hsu, L.-T. Performance Assessment of GNSS Diffraction Models in Urban Areas. Navig. J. Inst. Navig. 2020. under review. [Google Scholar]
  41. Zavorotny, V.U.; Voronovich, A.G. Scattering of GPS signals from the ocean with wind remote sensing application. IEEE Trans. Geosci. Remote. Sens. 2000, 38, 951–964. [Google Scholar] [CrossRef] [Green Version]
  42. Jia, Y.; Pei, Y. Remote Sensing in Land Applications by Using GNSS-Reflectometry. In Recent Advances and Applications in Remote Sensing; IntechOpen: London, UK, 2018. [Google Scholar]
  43. Liu, L.; Amin, M.G. Tracking performance and average error analysis of GPS discriminators in multipath. Signal Process. 2009, 89, 1224–1239. [Google Scholar] [CrossRef]
  44. Kaplan, E.; Hegarty, C. Understanding GPS: Principles and Applications; Artech House: London, UK, 2005. [Google Scholar]
  45. Groves, P.D. GPS Signal-to-Noise Measurement in Weak Signal and High-Interference Environments. Navigation 2005, 52, 83–94. [Google Scholar] [CrossRef]
  46. Kasdin, N.; Walter, T. Discrete simulation of power law noise (for oscillator stability evaluation). In Proceedings of the 1992 IEEE Frequency Control Symposium, Hershey, PA, USA, 27–29 May 1992; pp. 274–283. [Google Scholar]
  47. Xu, B.; Dou, L. GNSS IF Signal Simulation Considering Oscillator Phase Noise. J. Navig. 2018, 71, 805–820. [Google Scholar] [CrossRef]
  48. Misra, P.; Enge, P. Global Positioning System: Signals, Measurements and Performance, 2nd ed.; Ganga-Jamuna Press: Lincoln, MA, USA, 2006. [Google Scholar]
  49. Klobuchar, J.A. Ionospheric Time-Delay Algorithm for Single-Frequency GPS Users. IEEE Trans. Aerosp. Electron. Syst. 1987, 23, 325–331. [Google Scholar] [CrossRef]
  50. Saastamoinen, J. Atmospheric Correction for the Troposphere and Stratosphere in Radio Ranging Satellites. Hydrogeol. Chem. Weather. Soil Form. 2013, 15, 247–251. [Google Scholar] [CrossRef]
  51. Blanch, J.; Walker, T.; Enge, P.K.; Lee, Y.; Pervan, B.; Rippl, M.; Spletter, A.; Kropp, V. Baseline advanced RAIM user algorithm and possible improvements. IEEE Trans. Aerosp. Electron. Syst. 2015, 51, 713–732. [Google Scholar] [CrossRef]
  52. Carreno-Luengo, H.; Amèzaga, A.; Vidal, D.; Olivé, R.; Munoz, J.F.; Camps, A. First Polarimetric GNSS-R Measurements from a Stratospheric Flight over Boreal Forests. Remote Sens. 2015, 7, 13120–13138. [Google Scholar] [CrossRef] [Green Version]
  53. Lau, L.; Cross, P. Development and testing of a new ray-tracing approach to GNSS carrier-phase multipath modelling. J. Geod. 2007, 81, 713–732. [Google Scholar] [CrossRef]
  54. Tsui, J.B.-Y. Fundamentals of Global Positioning System Receivers: A Software Approach; John Wiley & Sons: Hoboken, NJ, USA, 2005. [Google Scholar]
  55. Joseph, A. Measuring GNSS signal strength. Inside GNSS 2010, 5, 20–25. [Google Scholar]
  56. Jia, Y.; Savi, P.; Canone, D.; Notarpietro, R. Estimation of Surface Characteristics Using GNSS LH-Reflected Signals: Land Versus Water. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2016, 9, 4752–4758. [Google Scholar] [CrossRef]
  57. Stutzman, W.L. Polarization in Electromagnetic Systems; Artech House: London, UK, 1993. [Google Scholar]
  58. Realini, E.; Reguzzoni, M. goGPS: Open source software for enhancing the accuracy of low-cost receivers by single-frequency relative kinematic positioning. Meas. Sci. Technol. 2013, 24, 115010. [Google Scholar] [CrossRef]
  59. Xu, B.; Jia, Q.; Luo, Y.; Hsu, L.-T. Intelligent GPS L1 LOS/Multipath/NLOS Classifiers Based on Correlator-, RINEX- and NMEA-Level Measurements. Remote Sens. 2019, 11, 1851. [Google Scholar] [CrossRef] [Green Version]
  60. Hsu, L.-T.; Tokura, H.; Kubo, N.; Gu, Y.; Kamijo, S. Multiple Faulty GNSS Measurement Exclusion Based on Consistency Check in Urban Canyons. IEEE Sens. J. 2017, 17, 1909–1917. [Google Scholar] [CrossRef] [Green Version]
  61. Bradbury, J. Prediction of urban GNSS availability and signal degradation using virtual reality city models. In Proceedings of the 20th International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS 2007), Fort Worth, TX, USA, 25–28 September 2007; pp. 2696–2706. [Google Scholar]
Figure 1. The flowchart of the proposed global navigation satellite system (GNSS) realistic urban multiagent simulator, GNSS RUMS.
Figure 1. The flowchart of the proposed global navigation satellite system (GNSS) realistic urban multiagent simulator, GNSS RUMS.
Remotesensing 13 00544 g001
Figure 2. The valid GNSS signal tracked by ray-tracing algorithm, including: (a) the LOS signal; (b) the diffracted signal; (c) the reflected signal.
Figure 2. The valid GNSS signal tracked by ray-tracing algorithm, including: (a) the LOS signal; (b) the diffracted signal; (c) the reflected signal.
Remotesensing 13 00544 g002
Figure 3. The open-sky elevation- C / N 0 regression model for satellites from different systems or orbits, including: (a) GPS satellites; (b) Beidou GEO satellites; (c) Beidou IGSO satellites; (d) Beidou MEO satellites. The green marker in each subfigure denotes the collected data from different satellites used for curve fitting. The black curve denotes the 1st order polynomial fitting model obtained from the C / N 0 data with the unit of Hz and visualized with the unit of dB-Hz. The green dots denote the C / N 0 data collected from a commercial grade receiver (Ublox EVK M8T) with a patch antenna in the open-sky environment.
Figure 3. The open-sky elevation- C / N 0 regression model for satellites from different systems or orbits, including: (a) GPS satellites; (b) Beidou GEO satellites; (c) Beidou IGSO satellites; (d) Beidou MEO satellites. The green marker in each subfigure denotes the collected data from different satellites used for curve fitting. The black curve denotes the 1st order polynomial fitting model obtained from the C / N 0 data with the unit of Hz and visualized with the unit of dB-Hz. The green dots denote the C / N 0 data collected from a commercial grade receiver (Ublox EVK M8T) with a patch antenna in the open-sky environment.
Remotesensing 13 00544 g003
Figure 4. The demonstration of the multipath noise envelope when d = 1 (chip) and the delayed signal has half amplitude attenuation compared to the early signal.
Figure 4. The demonstration of the multipath noise envelope when d = 1 (chip) and the delayed signal has half amplitude attenuation compared to the early signal.
Remotesensing 13 00544 g004
Figure 5. The 1-sigma measurement noise on DLL and FLL corresponding to the C / N 0 value.
Figure 5. The 1-sigma measurement noise on DLL and FLL corresponding to the C / N 0 value.
Remotesensing 13 00544 g005
Figure 6. The curve fitting model for C / N 0 noise simulation based on large amount data in the urban scenario: (a) P ¯ N / W fitted by a rational model; (b) σ ( P N / P W ) fitted by an exponential model.
Figure 6. The curve fitting model for C / N 0 noise simulation based on large amount data in the urban scenario: (a) P ¯ N / W fitted by a rational model; (b) σ ( P N / P W ) fitted by an exponential model.
Remotesensing 13 00544 g006
Figure 7. An example of the simulated values of random walk frequency modulation noise ε R W F M , flicker frequency modulation noise ε F F M , and white frequency modulation noise ε W F M based on the receiver parameters with TCXO from [48].
Figure 7. An example of the simulated values of random walk frequency modulation noise ε R W F M , flicker frequency modulation noise ε F F M , and white frequency modulation noise ε W F M based on the receiver parameters with TCXO from [48].
Remotesensing 13 00544 g007
Figure 8. The location and the corresponding sky-plot with building boundaries for the one-hour static experiment on an intersection in an urban area. The right sky-plot demonstrates the satellite distribution and the building blockage (shaded area) on the experiment location (red marker).
Figure 8. The location and the corresponding sky-plot with building boundaries for the one-hour static experiment on an intersection in an urban area. The right sky-plot demonstrates the satellite distribution and the building blockage (shaded area) on the experiment location (red marker).
Remotesensing 13 00544 g008
Figure 9. The trajectory during the dynamic vehicular experiment.
Figure 9. The trajectory during the dynamic vehicular experiment.
Remotesensing 13 00544 g009
Figure 10. The receiver locations and the sky-plots during the multiagent static experiment. The sub-figures (1)–(6) are corresponding to the sky-plots with buildings and satellites for Agent 1–6.
Figure 10. The receiver locations and the sky-plots during the multiagent static experiment. The sub-figures (1)–(6) are corresponding to the sky-plots with buildings and satellites for Agent 1–6.
Remotesensing 13 00544 g010
Figure 11. The comparison of the simulated and actual received GNSS measurements from B4 satellite during the one-hour static experiment, including: (a) C / N 0 ; (b) pseudorange error; (c) single-differenced Doppler shift error. The black marker and red marker denote the real and simulated measurement, respectively. The green background denotes the measurement type as LOS during the simulation.
Figure 11. The comparison of the simulated and actual received GNSS measurements from B4 satellite during the one-hour static experiment, including: (a) C / N 0 ; (b) pseudorange error; (c) single-differenced Doppler shift error. The black marker and red marker denote the real and simulated measurement, respectively. The green background denotes the measurement type as LOS during the simulation.
Remotesensing 13 00544 g011
Figure 12. The comparison of the simulated and actual received GNSS measurements from G20 satellite during the one-hour static experiment, including: (a) C / N 0 ; (b) pseudorange error; (c) Doppler shift error. The colored background denotes the measurement status being categorized during the simulation, including: LOS, single reflection, single diffraction, and multipath.
Figure 12. The comparison of the simulated and actual received GNSS measurements from G20 satellite during the one-hour static experiment, including: (a) C / N 0 ; (b) pseudorange error; (c) Doppler shift error. The colored background denotes the measurement status being categorized during the simulation, including: LOS, single reflection, single diffraction, and multipath.
Remotesensing 13 00544 g012
Figure 13. The comparison of the simulated and actual received GNSS measurements from G29 satellite during the long-period static experiment, including: (a) C / N 0 ; (b) pseudorange error; (c) Doppler shift error. The colored background denotes the measurement status being categorized during the simulation, including: LOS, single reflection, single diffraction, and multipath.
Figure 13. The comparison of the simulated and actual received GNSS measurements from G29 satellite during the long-period static experiment, including: (a) C / N 0 ; (b) pseudorange error; (c) Doppler shift error. The colored background denotes the measurement status being categorized during the simulation, including: LOS, single reflection, single diffraction, and multipath.
Remotesensing 13 00544 g013
Figure 14. The simulated C / N 0 and corresponding real measurements from each satellite during the long-period static experiment. The notation below each subfigure denotes the index of each satellite from different constellation, where ‘G’ —GPS; ‘B’—Beidou.
Figure 14. The simulated C / N 0 and corresponding real measurements from each satellite during the long-period static experiment. The notation below each subfigure denotes the index of each satellite from different constellation, where ‘G’ —GPS; ‘B’—Beidou.
Remotesensing 13 00544 g014
Figure 15. The simulated pseudorange error and corresponding labeled value in real measurements for each satellite during the long-period static experiment.
Figure 15. The simulated pseudorange error and corresponding labeled value in real measurements for each satellite during the long-period static experiment.
Remotesensing 13 00544 g015
Figure 16. The least squares positioning solution based on (a) real received GNSS measurement; (b) simulated GNSS measurement from the proposed simulator. The corresponding 2D positioning root-mean-square errors (RMSEs) are shown within subfigures.
Figure 16. The least squares positioning solution based on (a) real received GNSS measurement; (b) simulated GNSS measurement from the proposed simulator. The corresponding 2D positioning root-mean-square errors (RMSEs) are shown within subfigures.
Remotesensing 13 00544 g016
Figure 17. The least squares positioning error from the real measurements and simulated measurements during the one-hour static experiment.
Figure 17. The least squares positioning error from the real measurements and simulated measurements during the one-hour static experiment.
Remotesensing 13 00544 g017
Figure 18. The comparison of the simulated and actual received GNSS measurements from B1 satellite during the dynamic vehicular experiment, including: (a) C / N 0 ; (b) pseudorange error; (c) Doppler shift error; (d) the elevation angles of the satellite and the building boundary on the satellite’s azimuth direction. The colored background denotes the measurement status being categorized during the simulation, including: LOS, single reflection, single diffraction, and multipath.
Figure 18. The comparison of the simulated and actual received GNSS measurements from B1 satellite during the dynamic vehicular experiment, including: (a) C / N 0 ; (b) pseudorange error; (c) Doppler shift error; (d) the elevation angles of the satellite and the building boundary on the satellite’s azimuth direction. The colored background denotes the measurement status being categorized during the simulation, including: LOS, single reflection, single diffraction, and multipath.
Remotesensing 13 00544 g018
Figure 19. The comparison of the simulated and actual received GNSS measurements from B6 satellite during the dynamic vehicular experiment, including: (a) C / N 0 ; (b) pseudorange error; (c) Doppler shift error; (d) the elevation angles of the satellite and the building boundary on the satellite’s azimuth direction.
Figure 19. The comparison of the simulated and actual received GNSS measurements from B6 satellite during the dynamic vehicular experiment, including: (a) C / N 0 ; (b) pseudorange error; (c) Doppler shift error; (d) the elevation angles of the satellite and the building boundary on the satellite’s azimuth direction.
Remotesensing 13 00544 g019
Figure 20. (a) The positioning solutions from real measurements (blue) and simulated measurements (red) during the dynamic experiment; (b) the corresponding least squares positioning 2D errors and the overall RMSE from the simulation and real measurements.
Figure 20. (a) The positioning solutions from real measurements (blue) and simulated measurements (red) during the dynamic experiment; (b) the corresponding least squares positioning 2D errors and the overall RMSE from the simulation and real measurements.
Remotesensing 13 00544 g020
Figure 21. The positioning solutions of different agents based on real measurements (blue) and simulated measurements (red) during the multiagent experiment. The number denotes the agent index corresponding to Figure 10.
Figure 21. The positioning solutions of different agents based on real measurements (blue) and simulated measurements (red) during the multiagent experiment. The number denotes the agent index corresponding to Figure 10.
Remotesensing 13 00544 g021
Figure 22. The least squares positioning 2D errors of different agents based on the simulated and real measurements during the multiagent experiment. The number is corresponding to the agent index in Figure 21.
Figure 22. The least squares positioning 2D errors of different agents based on the simulated and real measurements during the multiagent experiment. The number is corresponding to the agent index in Figure 21.
Remotesensing 13 00544 g022
Figure 23. The trajectory of each agent simulated from SUMO [36] for the proposed multiagent GNSS measurement simulation and positioning performance evaluation. Agents 1 and 2 are simulated as pedestrians while Agents 3–5 are simulated as vehicles. The arrow on the trajectory denotes the moving direction.
Figure 23. The trajectory of each agent simulated from SUMO [36] for the proposed multiagent GNSS measurement simulation and positioning performance evaluation. Agents 1 and 2 are simulated as pedestrians while Agents 3–5 are simulated as vehicles. The arrow on the trajectory denotes the moving direction.
Remotesensing 13 00544 g023
Figure 24. The solutions of different positioning algorithms applied on the GNSS measurements from the proposed simulator on different scenarios, including the least squares positioning method (LS), the least squares method with consistency check (CC), the 3DMA GNSS ray-tracing positioning method (RT), and the 3DMA GNSS ray-tracing based collaborative positioning with factor graph optimization (RT-CP). The sub-figures (1)–(5) are corresponding to the positioning solutions for Agent 1–5 in Figure 23.
Figure 24. The solutions of different positioning algorithms applied on the GNSS measurements from the proposed simulator on different scenarios, including the least squares positioning method (LS), the least squares method with consistency check (CC), the 3DMA GNSS ray-tracing positioning method (RT), and the 3DMA GNSS ray-tracing based collaborative positioning with factor graph optimization (RT-CP). The sub-figures (1)–(5) are corresponding to the positioning solutions for Agent 1–5 in Figure 23.
Remotesensing 13 00544 g024
Figure 25. The 2D positioning error of different algorithms corresponding to each agent during the multiagent simulation performance verification. The numbers (1)–(5) are corresponding to Agent 1–5 in Figure 23.
Figure 25. The 2D positioning error of different algorithms corresponding to each agent during the multiagent simulation performance verification. The numbers (1)–(5) are corresponding to Agent 1–5 in Figure 23.
Remotesensing 13 00544 g025
Table 1. The employed models and the corresponding references in the proposed simulator.
Table 1. The employed models and the corresponding references in the proposed simulator.
ModelSubsection in This PaperReference
Ray-tracing for the diffracted signalSection 3.2[37]
Ray-tracing for the reflected signalSection 3.3[23]
Open-sky C / N 0 regression modelSection 4.2[33]
UTD modelSection 4.3[38,39,40]
GNSS-R modelSection 4.4[41,42]
Multipath noise envelopeSection 4.5[43]
Doppler shift model with intermediate pointSection 4.3 and Section 4.4[34]
Tracking loop noise model (DLL and FLL)Section 4.6.1[44]
C / N 0 estimation noise (narrow-to-wide power method)Section 4.6.2[45]
Satellite clock bias modelSection 4.6.3[44]
Receiver clock bias model (TCXO)Section 4.6.4[46,47,48]
Ionospheric delay (Klobuchar model)Section 4.6.5[49]
Tropospheric delay (Saastamoinen model)Section 4.6.6[50]
Elevation-based tropospheric delay variance modelSection 4.6.7[51]
Pseudorange user-equivalent-range-error budgetSection 4.6.7[44]
Table 2. Surrounding environment of each receiver during the multiagent experiment.
Table 2. Surrounding environment of each receiver during the multiagent experiment.
ReceiverEnvironment
1Open-sky
2Open-sky
3Light urban area
4Urban intersection
5Dense urban area
6Light urban area with one-side of building
Table 3. The value of receiver-related parameters during simulation.
Table 3. The value of receiver-related parameters during simulation.
NotationParameterValueNotationParameterValue
B c a r r i e r Carrier loop noise bandwidth15 (Hz) T c o h Coherent integration time0.02 (s)
B c o d e Code loop noise bandwidth0.2 (Hz) T i Predetection integration time0.02 (s)
B f e Front-end bandwidth2.046 (MHz) σ A Allan deviation of the reference oscillator 1 × 10 10
d Early-to-late correlator spacing1 (chip) Γ t h r e s h o l d Signal strength attenuation threshold20 (dB)
K Intervals of prompt I and Q during C / N 0 estimation10 d 3 R / d t 3 Maximum LOS jerk dynamics98 ( m / s 3 )
M Samples in each interval K 5---
Table 4. The difference in mean value (standard deviation) between simulation and real data.
Table 4. The difference in mean value (standard deviation) between simulation and real data.
PRNDifference on
Mean (Standard Deviation) Value
PRNDifference on
Mean (Standard Deviation) Value
C / N 0 ( dB - Hz ) Pseudorange
Error
(meter)
Doppler
Shift Error
(Hz)
C / N 0 ( dB - Hz ) Pseudorange
Error
(meter)
Doppler
Shift Error
(Hz)
G020.6 (0.0)2.5 (1.4)0.0 (8.2)B065.8 (1.4)0.5 (1.9)0.1 (0.7)
G054.9 (1.2)20.1 (8.5)0.1 (1.0)B070.8 (0.8)27.2 (16.4)0.1 (1.1)
G135.9 (1.8)4.5 (3.5)0.2 (0.2)B089.0 (2.9)0.9 (0.9)0.1 (0.3)
G159.8 (2.1)2.6 (3.3)0.3 (0.4)B094.8 (2.0)0.3 (1.6)0.0 (0.7)
G189.9 (3.4)0.3 (4.0)0.2 (0.4)B133.8 (1.5)0.3 (1.9)0.0 (0.7)
G203.3 (0.4)1.5 (3.2)0.2 (0.2)B163.2 (1.6)0.9 (1.7)0.1 (0.7)
G245.5 (0.6)2.4 (2.6)0.3 (0.1)B190.0 (6.4)37.1 (11.8)0.3 (0.8)
G296.3 (4.5)16.4 (5.8)0.0 (1.3)B208.0 (5.6)5.5 (8.4)0.0 (0.2)
B016.8 (1.3)4.7 (1.0)0.2 (3.4)B235.1 (2.3)15.4 (13.1)0.0 (1.0)
B022.1 (1.0)11.5 (3.7)2.2 (38.2)B275.8 (0.0)45.8 (46.9)0.3 (0.1)
B034.8 (1.2)1.6 (1.6)0.0 (0.5)B295.4 (3.1)43.4 (32.3)0.0 (0.5)
B040.6 (1.0)11.5 (3.7)2.2 (38.2)B305.9 (3.4)4.5 (4.7)0.1 (0.9)
All4.2 (0.5)5.9 (8.7)0.1 (6.3)
Table 5. The 2D positioning RMSE (in meter) from the simulated and real measurements of different agents during the multiagent experiment.
Table 5. The 2D positioning RMSE (in meter) from the simulated and real measurements of different agents during the multiagent experiment.
Agent123456
RMSEReal measurement2.21.035.432.417.923.3
Simulated measurement3.33.534.220.89.122.0
Table 6. The root-mean-square error (in meter) of different GNSS positioning algorithms applied on the simulated measurements.
Table 6. The root-mean-square error (in meter) of different GNSS positioning algorithms applied on the simulated measurements.
Agent12345Expected Performance in a Dense Urban Area
LS7.829.220.217.730.6May be over 30 m
CC7.210.612.815.241.7Around 20 m [60]
RT7.820.010.69.124.0Around 10–20 m [23]
RT-CP6.517.17.910.718.6Around 10 m [26]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zhang, G.; Xu, B.; Ng, H.-F.; Hsu, L.-T. GNSS RUMS: GNSS Realistic Urban Multiagent Simulator for Collaborative Positioning Research. Remote Sens. 2021, 13, 544. https://doi.org/10.3390/rs13040544

AMA Style

Zhang G, Xu B, Ng H-F, Hsu L-T. GNSS RUMS: GNSS Realistic Urban Multiagent Simulator for Collaborative Positioning Research. Remote Sensing. 2021; 13(4):544. https://doi.org/10.3390/rs13040544

Chicago/Turabian Style

Zhang, Guohao, Bing Xu, Hoi-Fung Ng, and Li-Ta Hsu. 2021. "GNSS RUMS: GNSS Realistic Urban Multiagent Simulator for Collaborative Positioning Research" Remote Sensing 13, no. 4: 544. https://doi.org/10.3390/rs13040544

APA Style

Zhang, G., Xu, B., Ng, H. -F., & Hsu, L. -T. (2021). GNSS RUMS: GNSS Realistic Urban Multiagent Simulator for Collaborative Positioning Research. Remote Sensing, 13(4), 544. https://doi.org/10.3390/rs13040544

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop