1. Introduction
The automation of agricultural field operations based on GNSS technology requires centimeter-level positioning accuracy of the PD due to the need for production cost reduction and accurate alignments of machines and equipment with crop rows. This accuracy must be maintained in every pass and subsequent operations when planting, fertilizing, weeding, pest controlling, and harvesting to minimize negative yield impact and grain loss as well as to reduce environmental risks of nutrient and chemical runoff. Although the adoption of the RTK positioning technique has enabled high-accuracy automation of field operations using the AGS, there have been concerns by end users about the accuracy of different systems on the market. This is because most of the GNSS PD manufacturers report the accuracy of their products using stationary test data; meanwhile, the AGS is used under dynamic conditions when conducting mobile field operations.
Consequently, many attempts have been made to evaluate the dynamic performance of both geodetic grade and low-cost GNSS PDs. The evaluations were made by performing on-vehicle testing [
1,
2,
3] or fixture testing [
4,
5,
6], which involves instrumenting the test PDs on a carrier vehicle or a mechanical fixture such as a rotational device or the rail system, respectively, and driving them through predefined paths. These proposed testing methods for evaluating the dynamic performance of satellite-based positioning devices were standardized by Stombaugh et al. [
5] to develop the ISO 12188-1 standard [
7]. Other efforts were made to evaluate the accuracy of different AGSs on straight lines by driving a tractor instrumented with the device on agricultural fields [
8] and a test track [
9] while using an RTK receiver and a visual sensor, respectively, as the ground truth tracking sensor. The ISO 12118-2 standard [
10] for testing the AGS during straight and level travel was developed based on these studies. Some attempts after ISO 12118 were also made to improve the method for testing the GNSS PDs [
11] using a total station as the reference tracking sensor to determine the ground truth of the test GNSS receiver and include the direction error in addition to the position and speed errors measured by the test PDs fixed on a turntable [
12]. Furthermore, autonomous tractors were used to demonstrate the high tracking accuracy of the AGS on a straight line [
13] and to perform the guidance accuracy testing for providing details on the relative cross-track error calculation, which is not described in ISO 12118-2 [
14].
However, there is no existing literature to date that reports both the dynamic positioning accuracy and stability of multi-frequency, multi-GNSS PDs, especially in the case of low-cost ones. In addition, it is necessary to evaluate the dynamic performance of the PDs while they are traveling within agricultural fields and on roads with tree canopy obstruction as well as the guidance accuracy of the AGSs during the real field operations performed by an autonomous agricultural vehicle. Therefore, the aim of this study was to perform the overall dynamic evaluation of a typical low-cost multi-frequency multi-GNSS device for positioning and navigation in agriculture. Dynamic evaluation metrics were the RTK-fixed reacquisition time after a loss of GNSS signals (RTK-TTRF), the RTK-fix availability, the RTK positioning accuracy, including the vehicle heading and position, and the GNSS-based vehicle guidance accuracy. The evaluation for different multi-frequency multi-GNSS PDs including the low-cost PDs paired from ZED-F9P receiver (u-blox) and low-cost antennae (ANN-MB-00, u-blox and JCA228, Zhejiang JC) and the legacy PDs was conducted, partly in accordance with the ISO 12188 standard to compare their dynamic positioning accuracy and stability and verify the adaptability of the low-cost PD to the AGS of agricultural vehicles. The dynamic testing, including the horizontal positioning tests and the GNSS signal reacquisition tests, was conducted within and around agricultural fields to determine the dynamic positioning accuracy along a straight segment, U-turn segment, and after signal loss. The reacquisition time measurement method, which is not provided in detail by ISO 12118-1, was described in this study. In addition, a moving base application (MBA), as summarized in the ZED-F9P Application note [
15], was conducted with a set of two low-cost PDs to confirm their ability to determine the heading angle of a moving object, which is a required parameter for vehicle navigation. Finally, the test PDs were used as a positioning sensor in an AGS of an autonomous tractor to carry out automatic soil tillage and direct soybean seeding. Performance was evaluated to determine the lateral deviation of the representative vehicle point (RVP) from the desired path. This study provided some additional test techniques when using an autonomous agricultural tractor for the overall dynamic performance evaluation of the GNSS-based auto-guidance system.
2. Materials and Methods
2.1. Test Positioning Devices
The main specification of the receivers and antennae used in this study are reported in
Table 1. More details about the test devices were reported in the previous publication of the author [
16]. The low-cost antennae ANN-MB-00 and JCA228 were paired with a u-blox ZED-F9P receiver for the MBA, and the dynamic measurements of RTK time to re-fix (TTRF) and RTK positioning accuracy, respectively. The mid-range PD P326/A52 was used for comparing the dynamic RTK positioning accuracy and guidance accuracy to the low-cost PD ZED-F9P/JCA228. The high-end PD A325 was used as the tracking sensor to determine the actual travel course of the test PDs or of the RVP.
Furthermore, a Hemisphere compass V113 used in the GNSS AGS of the carrier vehicle was used as the true heading of the test vehicle for evaluating the heading output of the low-cost PDs during the MBA. The errors included within the RTK positionings of A325 and V113 were omitted in the dynamic testing and all navigation data recorded were assumed to be the ground truths. In addition to the high-end PD of SPS855/Zephyr2 used for the local fixed base station (FBS), another SPS855/Zephyr2 instrumented on the carrier vehicle as a positioning sensor of the legacy AGS. GNSS data for measuring the evaluation metrics were logged at the rate of 10 Hz facilitated by the test PDs in accordance with the NMEA (National Marine Electronics Association) 0183 standards and u-blox standards and included the date, time, position, elevation, geoidal separation, heading, speed, number of satellites, correction status, and satellite constellation configuration.
2.2. Carrier and Instrumentation of the Test PDs
An autonomous tractor developed by the Institute of Agricultural Machinery, Japan [
16], was used as the carrier vehicle to test PDs during dynamic testing. Since the tractor is used with a three-point hitch-mounted implement, a point on the ground directly between the rear wheels of the tractor was defined as the RVP to represent the location of the carrier vehicle, which was used to automatically guide the autonomous tractor when operating in automatic steering mode.
The antennae of test PDs were rigidly mounted on the cabin roof of the carrier vehicle (
Figure 1) to record GNSS data for calculating the evaluation metrics as well as information about conditions of dynamic testing, including the date and time for each test run, number of used satellites in view with the corresponding horizontal position, and an indication of any phenomena that may reduce the quality of GNSS performance, such as buildings or tree rows around the test courses. The two ANN-MB-00 antennae were instrumented with two baselines of 20.0 cm and 92.5 cm during the MBA to determine the heading of the carrier vehicle.
2.3. Testing Courses
The test site for the dynamic testing was the experimental agricultural fields of NARO (
Figure 2). The test travel courses were designed within the fields and on the asphalt road around the fields for the measurements of the dynamic RTK-TTRF and the vehicle heading, while only travel courses within the agricultural fields were planned for evaluating the accuracy of RTK positioning and the performance of the GNSS-based AGS (
Figure 2 and
Figure 3). Some segments of the asphalt course, along with roadside tree lines and buildings, which are a typical headland situation of agricultural fields, were used to examine their effects on the RTK-TTRF and the heading accuracy of the low-cost PDs.
All the test courses were level and repeatable routes of travel, including 3 or more straight segments, which were at least 80 m long and were oriented approximately 41° or 49° from true north. In the case of test courses within agricultural fields, the straight segments were directly connected at either end of one or more U-turn segments, which traversed 180° at a constant radius of turn between 0.9 m and 6 m. For the autonomous driving courses, the test path was automatically planned by the autonomous control system of the carrier vehicle based on the requirement of the performance evaluation at the headland U-turn, the working width of the rotary tiller (2.4 m) and the soybean seeder (1.5 m), the overlap between two adjacent passes of the tractor, the mounting dimension between the implement and the tractor, and the location of the field entrance.
The speed of the autonomous tractor when performing automatic tilling and seeding was set following the speed requirement of each field task. The experimental settings for different evaluation metrics are shown in
Table 2, which include different RTK correction sources, driving modes, test courses, and traveling speeds. The dynamic RTK positionings were performed with two RTCM correction services provided by the FBS at a short baseline (SBL) within 500 m and the real reference system (RRS) at the medium baseline (MBL) of 9 km. The RTK correction for A325 was provided only by FBS to obtain the most accurate positioning performance of the tracking sensor.
Each test run was replicated three times in the same location along the test courses A1, A2, and C. In the case of the soil tillage and soybean seeding conducted at the test courses A3 and B, respectively, the field operations were automatically completed along the predefined target paths only once.
2.4. Measurement of Dynamic RTK-TTRF
RTK-TTRF of the low-cost PD ZED-F9P/JCA228 in motion was measured by simulating GNSS signal loss on the road with one side of tree rows or high buildings and at the edge of agricultural fields with tree windbreaks. A signal loss of the test PD was simulated by using a radio frequency relay (ARD10012, Panasonic) to disconnect/connect the signal cable between the test antennae and receivers. The RTK-TTRF measurements after a 3-s GNSS signal loss on the test courses C and A1 were conducted at manual driving speeds of approximately 2.0 m/s, respectively (
Table 2). The method to derive the RTK-TTRF of GNSS PDs is described in detail by Nguyen et al. [
17]. Besides, the dynamic RTK-TTRF of the test PD at the field headland was measured at an autonomous driving speed of approximately 0.4 m/s following test course A2. The signal loss that occurred due to the tree windbreaks was simulated during the entire 180° U-turn segments of the test course A2 by disconnecting the signal cable for approximately 24 s.
The test runs on all travel courses for the RTK-TTRF measurements were carried out with both short and medium baseline corrections provided by FBS and RRS, respectively. Each test run for the same measurement conditions was replicated three times and completed within a 30-min period. The dynamic RTK-TTRF was calculated by subtracting the time when the test PDs started to transmit the first RTK navigation record after the GNSS signal loss from the time at which signals were removed from the test receiver and the total time of signal loss, which was 3 and 24 s for C and A1 courses, and A2 courses, respectively. The acquisition timeout was 15 s to determine the number of timeouts in all the RTK-TTRF measurements.
2.5. Measurement of Heading Accuracy of the Low-Cost PD
The heading of the carrier vehicle is the horizontally projected direction of travel measured clockwise from true north as defined by NMEA 0183. In dynamic testing, the heading was measured by the MBA with ZED-F9P/ANN-MB-00 units and was compared with the true heading obtained by the compass V113 of the legacy AGS. The heading error was calculated separately for each straight segment. The heading measurements on the test courses C were conducted at autonomous driving speeds of approximately 1.0 m/s (
Table 2). The heading of the carrier vehicle was measured by the MBA with two baseline lengths of 20.0 cm and 92.5 cm, which may be suitable for the heading determination of aerial vehicles and ground vehicles, respectively.
In the MBA, the heading output was provided by the ZED-F9P receiver in the UBX-NAV-RELPOSNED message, which provides the RTK heading and distance between the two antennae ANN-MB-00 of the base and rover receivers. Since the baseline of these antennae was perpendicular to the centerline of the carrier vehicle and the rover antenna was mounted on the right side of the vehicle, a heading bias of −90° was added to the output of the MBA, which was logged by a custom application built in Python. The accuracy of the vehicle heading measured by the low-cost PDs was represented by the mean plus the standard deviation of heading error of all valid UBX-NAV-RELPOSNED messages output by the MBA.
2.6. Measurement of RTK-Fix Availability and Dynamic RTK Positioning Accuracy
A GNSS quality indicator for position fix in the logged GGA message was used to compute RTK-fix availability, which is the percentage of the total observation time that a test receiver spent in the RTK fixed integer. The horizontal positioning accuracy of the low-cost and the mid-range PDs was calculated from the off-track error (OTE) in accordance with ISO 12188-1 (
Figure 4). In the manual driving course A1, the actual travel course of the tested PDs was calculated from the reference navigation data output by A325 (positioning) and the compass V133 (heading), and the horizontal distance between A325 and the antenna of each test PD (
Figure 4a). In the autonomous driving course A2, the RVP of the carrier vehicle was used as the navigation point to guide the vehicle following the pre-determined paths using the legacy AGS. Therefore, the actual travel course of the RVP was not the planned path but was calculated from the reference navigation data of A325 and V113 and the horizontal distance of A325 to the RVP (
Figure 4b) to exclude the navigation errors caused by the legacy AGS, the path tracking algorithm, the kinematics of the carrier vehicle, and the field conditions. The horizontal positioning output of the test PDs on course A2 was projected to the RVP using heading data of V113 and the horizontal distance of the test antennae to the RVP to calculate the travel courses of the test PDs. The actual travel course of the RVP in each test run was synchronized with the projected travel course to calculate the OTE.
The horizontal positioning accuracy of the test PDs was represented by cross-track accuracy (XTA), which is the square root of two times the mean plus the standard deviation of OTEs of all navigation data that fall along the centermost of the 50-m portion of the straight segments of the travel courses. The U-turn accuracy (UTA), which is the dynamic performance determined from OTEs occurring during the traverse of a 180° turn, was represented by the square root of two times the mean plus the standard deviation of all OTEs that occur along the U-turn segments and the first 20 m of the straight segment following the turns (ISO, 2010).
2.7. Measurement of Auto-Guidance Accuracy
The main performance criterion for an AGS is the lateral deviation of a representative point on the vehicle from a desired trajectory for that point (cross-track error, XTE). This performance criterion integrates the uncertainties associated with the performance of all components of the vehicle guidance system, including positioning devices, automated steering components, and vehicle mechanisms and dynamics (ISO, 2012). The dynamic testing, which was conducted while performing soil tillage and direct soybean seeding on straight paths over a level surface of agricultural fields (test courses A3 and B), focused on the steady-state tracking performance of the AGSs combined from the compass V113 and the low-cost and mid-range PDs.
The method for determining the XTE of the test PDs for different RTK corrections during the evaluation of the automatic guidance accuracy is shown in
Figure 5a. Since the test PDs navigated the RVP of the autonomous tractor following the pre-planned paths (desired trajectory) and the actual travel path of the RVP was projected from the travel path of A325, the XTE of the test PDs was the lateral deviation between these two travel paths. Furthermore, the seeding accuracy was also verified by measuring the distance between soybean rows of two adjacent seeding paths after the emergence of young seedlings (
Figure 5b).
4. Conclusions
Based on the results of the dynamic testing conducted in this study, some main conclusions could be drawn as follows:
(1) The multi-frequency multi-GNSS PDs paired from the low-cost receiver ZED-F9P and the low-cost antennae had stable positioning performance with 100% RTK positioning availability in both the field open sky and canopy obstruction environments. It also took less than 3 s and 7 s to quickly reacquire the RTK solution after the short-time GNSS signal losses of 3 s and 24 s, respectively, at both short and medium RTK positioning baselines.
(2) The low-cost PD had similar accuracy for dynamic positioning and guidance in an agricultural environment compared with the legacy mid-range PD when it could continuously measure the horizontal position of the RVP of the carrier vehicle with 3 cm-level accuracy for the straight segments and 4 cm-level accuracy for the U-turn segments both at the short and medium RTK positioning baselines. The low-cost PD could also accurately measure the heading angle in the open-sky environment with a sub-degree-level error compared with the output of the high-end GNSS compass.
(3) This study indicated that the low-cost multi-frequency multi-GNSS positioning device could be used on the AGS of an autonomous tractor and significantly reduce the total equipment cost of the system without a penalty in the guidance performance.
(4) The techniques and test results from this study could be used to provide additional guidelines for determining the overall dynamic performance of the GNSS-based PDs and AGSs.