Assessing the Impact of Surface and Upper-Air Observations on the Forecast Skill of the ACCESS Numerical Weather Prediction Model over Australia

The impact of the Australian Bureau of Meteorology’s in situ observations (land and sea surface observations, upper air observations by radiosondes, pilot balloons, wind profilers, and aircraft observations) on the short-term forecast skill provided by the ACCESS (Australian Community Climate and Earth-System Simulator) global numerical weather prediction (NWP) system is evaluated using an adjoint-based method. This technique makes use of the adjoint perturbation forecast model utilized within the 4D-Var assimilation system, and is able to calculate the individual impact of each assimilated observation in a cycling NWP system. The results obtained show that synoptic observations account for about 60% of the 24-h forecast error reduction, with the remainder accounted for by aircraft (12.8%), radiosondes (10.5%), wind profilers (3.9%), pilot balloons (2.8%), buoys (1.7%) and ships (1.2%). In contrast, the largest impact per observation is from buoys and aircraft. Overall, all observation types have a positive impact on the 24-h forecast skill. Such results help to support the decision-making process regarding the evolution of the observing network, particularly at the national level. Consequently, this 4D-Var-based approach has great potential as a tool to assist the design and running of an efficient and effective observing network.


Introduction
Numerical weather prediction (NWP) models are critically reliant on a large number of appropriate quality in situ and remotely sensed observations. These observations provide the data that are needed to accurately define the forecast initial conditions, via the process of data assimilation. Hence, the forecast skill of NWP is substantially influenced by the observations.
To both improve the analysis and increase the forecast skill of NWP systems such as ACCESS [1], the national observing network needs to be regularly evaluated in terms of design and observational types. The significant investment by national meteorological services like the Bureau of Meteorology (from hereon, the Bureau) in national observing networks, and the constant evolution of observational technologies, requires an ongoing assessment of the value of the network components. NWP is one of the major mechanisms for converting observed data into information and services, so an objective measure of the impact of each observation on the quality of short-term forecasts can potentially guide decisions related to network efficiency and effectiveness.
Traditionally, the impact of an observation system, type, or individual instrument on the forecast skill of an NWP system that assimilates it, is assessed by performing an Observing System Experiment (OSE), usually called a Data Denial Experiment (DDE). In an OSE, the forecast skill of two separate runs are compared-one with all observations assimilated and the other with a given observation type denote the 24 h forecasts from an analysis and the background used in the analysis by x fa t and x fb t , respectively, where x fb t is identical to a 30 h forecast from the previous cycle of analysis. Let x a t be the verifying analysis at time t. In the incremental 4D-Var system used in ACCESS, the adjoint PF model-which has a coarser grid and simpler moist physics than the full field forecast model-is applied. Thus, the forecast errors are calculated with these simplifications. Let S be the operator that reduces the set of cloud moisture variables and interpolates model variables into lower resolution [20]: where δw fa t is the error of the forecast started from the analysis; δw fb t is the error of the forecast started from the background; δw t is the forecast difference.
This technique requires the choice of a suitable metric to measure the change in forecast error. As is standard in the UK Met Office FSO suite (and most others), this metric is the total energy norm calculated as an inner product on the latitude (φ)-longitude (λ) spherical grid [20]: where M D is the mass of the atmosphere in the integration domain D; r is the radial distance; u, v are the zonal and meridional wind components, respectively; θ is the potential temperature, p is pressure; q is the specific humidity; c p is the heat capacity at constant pressure; L is the latent heat of water vapor condensation; g is the acceleration of gravity; ρ is the air density; c is the speed of sound; N 2 is the square of the Brunt-Väisälä frequency. The primed variables denote PF model state vector components and the unprimed variables linearization state vector elements. Assuming ε = 0 we obtain the dry total energy norm. In the PF model ε = 1 meaning that the water vapor can condense releasing its latent heat.
The model provides an option to limit the integration domain in (4), which allows the energy norm to be calculated for the Australian region as well as the global domain. Formally, this option is expressed in the matrix equations by a projection P that is equal to 1 in the domain of interest and zero outside of this domain. The expression for the change in energy norm in the limited domain can be written as follows [20]: Here M 0→t is the PF model used to calculate perturbation forecast from the initial time 0 to time t; K is the gain matrix calculated by incremental 4D-Var scheme; δy = y o − H x b are the observation innovations, where y o is the observation vector, H is the observation operator, and x b is the background model state. A superscript T denotes the transpose operation. Therefore, K T and M T 0→t represent the adjoint data assimilation scheme and the adjoint PF model, respectively.
Note that (δe/δy) is the vector of finite observation sensitivities, the components of which correspond to forecast sensitivity with respect to each observation in δy. The influence of kth observation type on the forecast is given by δe k ≈ δy k (δe/δy) k in units of J·kg −1 . The calculation of FSO is represented schematically in Figure 1.

Experimental Design
The Bureau's operational global NWP system within the overall APS-2 (Australian Parallel Suite version 2) NWP suite, is used for these calculations [24]. The horizontal resolution of the nonlinear forecast model is N512 (1024 × 769 grid points along longitude and latitude, respectively, with the average distance between grid points about 25 km), with 70 vertical levels up to ~80 km altitude. The linear PF includes simplified moist physics and has the same vertical resolution as the nonlinear model with a horizontal resolution of N216 (about 60 km). The analyses (initial conditions for the NWP model) are generated by means of the 4D-Var system with a 6-h assimilation window. Observation impacts represent an estimate of the change in a 24-h forecast error as a consequence of the assimilation of observations. Forecast error is measured in terms of a moist energy norm calculated from the surface to the 150 hPa level over the Australian region (see Figure 2). The adjoint-based observation impacts are calculated from 00Z 1 September 2015 to 00Z 31 December 2016 in 6-h intervals. The experiment details are summarized in Table 1. For each analysis time, the adjoint FSO system produces an ASCII output file that contains the information on all the observations including satellite and in situ, non-satellite observation types (see Table 2). The following information is contained in the FSO output file: -Sequential number of observation; - The observation value; - The value of innovation (the difference between observation and background values); -Sensitivity of the forecast to observation; -Latitude and longitude of observation;

Experimental Design
The Bureau's operational global NWP system within the overall APS-2 (Australian Parallel Suite version 2) NWP suite, is used for these calculations [24]. The horizontal resolution of the nonlinear forecast model is N512 (1024 × 769 grid points along longitude and latitude, respectively, with the average distance between grid points about 25 km), with 70 vertical levels up to~80 km altitude. The linear PF includes simplified moist physics and has the same vertical resolution as the nonlinear model with a horizontal resolution of N216 (about 60 km). The analyses (initial conditions for the NWP model) are generated by means of the 4D-Var system with a 6-h assimilation window. Observation impacts represent an estimate of the change in a 24-h forecast error as a consequence of the assimilation of observations. Forecast error is measured in terms of a moist energy norm calculated from the surface to the 150 hPa level over the Australian region (see Figure 2). The adjoint-based observation impacts are calculated from 00Z 1 September 2015 to 00Z 31 December 2016 in 6-h intervals. The experiment details are summarized in Table 1.

. Experimental Design
The Bureau's operational global NWP system within the overall APS-2 (Australian Parallel Sui rsion 2) NWP suite, is used for these calculations [24]. The horizontal resolution of the nonlinea recast model is N512 (1024 × 769 grid points along longitude and latitude, respectively, with th erage distance between grid points about 25 km), with 70 vertical levels up to ~80 km altitud e linear PF includes simplified moist physics and has the same vertical resolution as the nonlinea odel with a horizontal resolution of N216 (about 60 km). The analyses (initial conditions for th WP model) are generated by means of the 4D-Var system with a 6-h assimilation window servation impacts represent an estimate of the change in a 24-h forecast error as a consequence e assimilation of observations. Forecast error is measured in terms of a moist energy norm lculated from the surface to the 150 hPa level over the Australian region (see Figure 2 e adjoint-based observation impacts are calculated from 00Z 1 September 2015 to 00Z 31 Decembe 16 in 6-h intervals. The experiment details are summarized in Table 1. For each analysis time, the adjoint FSO system produces an ASCII output file that contains th formation on all the observations including satellite and in situ, non-satellite observation types (se ble 2). The following information is contained in the FSO output file: Sequential number of observation;  For each analysis time, the adjoint FSO system produces an ASCII output file that contains the information on all the observations including satellite and in situ, non-satellite observation types (see Table 2). The following information is contained in the FSO output file:

NWP System
Operational version of the Bureau of Meteorology NWP system, APS-2, with the resolution of N512 for the forecasting model and N216 for the inner loop of 4D-Var, in horizontal, and 70 levels in vertical. The adjoint of PF includes the moist physics. Calculation of the observation impact is a multi-step process. At each analysis time, the FSO output file is processed into a set of JSON (Java Script Object Notation) files, from which a set of Python-based tools aggregate the individual forecast sensitivities on the basis of observation type and/or station and statistically analyze and visualize the results.

Observation Impacts of the Australian Sonde Network
Of particular interest to this study, is the relative value of the radiosonde stations located at Maquarie Island, Cocos Island and the three Antarctic stations (Mawson, Casey and Davis), since the operation of these stations requires considerable resources.
There are 34 upper air-observing stations in the Australian network ( Figure 3). The contribution of each of these radiosonde stations to the reduction of the forecast error is shown in Table 3. The most Atmosphere 2018, 9, 23 6 of 16 significant contribution to the forecast quality is provided by the more remote stations Casey, Davis and Mawson in the Antarctic, and Macquarie Island. These stations are shown in red in Figure 3. Upper air stations with the least impact on forecast skill are Moree, Townsville, Cobar, Williamstown, Mount Gambier, Rockhampton, Ceduna, Wagga Wagga and Sydney. These stations are displayed in blue in Figure 3. The analysis of spatial distribution of impacts on the mainland shows that remoter stations are more influential on forecast skill than others. It is also worth noting the high relative impact of remote stations which sample the Southern Ocean (e.g., the Antarctic stations) in comparison to the remote Indian Ocean station on the Cocos Islands. We interpret this as indicating that assimilated information from upstream stations is more likely to propagate into the verification region and beneficially impact the forecast and is consistent with the spatial distribution of impacts from drifting buoys reported in Section 3.4.

Observation Impacts of Australian Wind Profilers
Wind profilers are radar weather observing instruments that continually measure wind speed and direction in the upper air at different levels above the ground using radio waves.
During the study period, the Australian wind profiler network included 11 operational profilers ( Figure 4) supplied by ATRAD Pty. Ltd. (Adelaide, Australia) [25]. Eight profilers are boundary-layer measurement devices and three profilers measure wind in the troposphere and lower stratosphere. The new profilers in Longreach and Mackay are also tropospheric-stratospheric profilers, however, they were not yet operational during the study period. The profilers at Launceston and Carnarvon were not assimilated during the bulk of the study period due to quality control settings supplied by the Met Office and are thus not included here. All Australian operational profilers operate at a frequency of 55 MHz, providing winds from 500 m to 20 km (Stratospheric-Tropospheric profilers), and from 300 m to 7 km (Boundary Layer profilers). Operational profilers produce a wind estimate every 2-6 min, depending on mode of operation. These data are then quality controlled and averaged to produce wind estimates every 30 min. The wind profile data are then sent to the Bureau in BUFR (Binary Universal Form for the Representation of meteorological data) format [26]. Figure 5 shows the total impacts and the impact per observation calculated for the Australian summer (December 2015-February 2016). The results calculated for the Australian winter (June-August 2016) are shown in Figure 6. In these figures stations are ranked in descending order of their impact on the 24 h forecast skill. Observations from wind profilers located at Halls Creek, Tennant Creek, Ceduna and Cairns yield the largest contributions to the forecast error reduction. Contributions of these wind profilers differ only slightly. In contrast, observations from wind profilers located at Canberra, Sydney and East Sale contribute 3-4 times less to the forecast error reduction.
In general, profilers located in northern Australia have a greater impact (in terms of the forecast error reduction) than profilers situated in the southern part of the Australian continent. This north-south difference may arise from the fact that the number of observations from the northern profilers is considerably larger than the number of observations from the southern profilers (Figure 7)-the southern (older) stations report observations less frequently than the northern stations. This also may explain why the observation data in the layer between 850 and 500 hPa pressure levels contribute the most to the reduction of the forecast error (Figures 5a and 6a). In contrast, the impact per observation is more uniform across the pressure levels (Figures 5b and 6b) and consequently, data from all levels have a similar impact per observation on the forecast quality.
In general, profilers located in northern Australia have a greater impact (in terms of the forecast error reduction) than profilers situated in the southern part of the Australian continent. This northsouth difference may arise from the fact that the number of observations from the northern profilers is considerably larger than the number of observations from the southern profilers (Figure 7)-the southern (older) stations report observations less frequently than the northern stations. This also may explain why the observation data in the layer between 850 and 500 hPa pressure levels contribute the most to the reduction of the forecast error (Figures 5a and 6a). In contrast, the impact per observation is more uniform across the pressure levels (Figures 5b and 6b) and consequently, data from all levels have a similar impact per observation on the forecast quality.

Observation Impacts of Australian Synoptic Observations
Surface weather data are obtained from different types of observing stations around Australia, on offshore islands, and in the Antarctic. They include Bureau-staffed observer stations and Bureauowned automatic weather stations, cooperative observer stations at which manual readings are made. Surface weather observations used in the ACCESS data assimilation system are taken at 756 manned and automated weather stations. However, only 70 percent of them (525 stations) are standard automatic weather stations (AWS) managed by the Bureau. The remaining 231 stations are

Observation Impacts of Australian Synoptic Observations
Surface weather data are obtained from different types of observing stations around Australia, on offshore islands, and in the Antarctic. They include Bureau-staffed observer stations and Bureau-owned automatic weather stations, cooperative observer stations at which manual readings are made. Surface weather observations used in the ACCESS data assimilation system are taken at 756 manned and automated weather stations. However, only 70 percent of them (525 stations) are standard automatic weather stations (AWS) managed by the Bureau. The remaining 231 stations are cooperative stations that are funded by the Bureau but operated by contractors-all but a few of these stations provide only manual readings. Station locations are chosen based on a range of different requirements and constraints, including: The spatial distribution of synoptic stations is not even across the country. The observing network is densest in the most highly populated areas in the country (Sydney, Melbourne, Canberra, Adelaide, Perth, Brisbane, Hobart and Darwin). Generally, the southeastern quadrant of Australia has the densest synoptic observing network. At the majority of locations, AWS send synoptic send data to the Bureau on an hourly basis (although one-minute data is transmitted every minute for core Bureau products and services). However, synoptic observation reports prepared by cooperative stations are typically sent to the Bureau one to two times per day.
The total impacts of synoptic observations from the AWS and cooperative stations for the periods of December 2015-February 2016 and June-August 2016 calculated for four NWP analysis times are illustrated in Figure 8. This figure shows that the impact of observations from AWS exceed the impact of observations from cooperative stations by at least an order of magnitude. This is because the number of observations is considerably different between AWS and cooperative stations. In the Australian summer (December-February) the total impacts for all four analysis times are less than the impact for the Australian winter (June-August). This difference is most likely due to the fact that the moisture contributes about 33 percent of the total energy [20]. Moisture content in the atmosphere fluctuates from season to season. Typically, an Australian summer season is drier than a winter season, thus, the moisture contribution to the total energy norm is larger in winter than in summer. The difference between summer and winter impacts may also be the consequence of the adjoint model properties and limitations (e.g., [27]). Adjoint models are linear models and, therefore, their results are most applicable when the tangent linear approximation is valid. Due to the effects of In the Australian summer (December-February) the total impacts for all four analysis times are less than the impact for the Australian winter (June-August). This difference is most likely due to the fact that the moisture contributes about 33 percent of the total energy [20]. Moisture content in the atmosphere fluctuates from season to season. Typically, an Australian summer season is drier than a winter season, thus, the moisture contribution to the total energy norm is larger in winter than in summer. The difference between summer and winter impacts may also be the consequence of the adjoint model properties and limitations (e.g., [27]). Adjoint models are linear models and, therefore, their results are most applicable when the tangent linear approximation is valid. Due to the effects of baroclinic instability, weather fluctuates more intensively in winter than in summer seasons. Therefore, winter trajectories generated by the (nonlinear) NWP model are more oscillating than summer trajectories and, therefore, more sensitive to the initial conditions. In addition, error growth in the adjoint model may be dominated by highly nonlinear moist physics. As a result, observation sensitivities calculated by the adjoint model for a winter season may be slightly larger than for the summer season. Figure 9 shows the impact of each AWS and cooperative station on the reduction of the forecast error calculated for the southern hemisphere winter season (June-August 2016). The winter season is taken as an example because the effect is the same in summer. In Figure 9 stations are divided into three categories: stations that have on average a positive effect on the forecast quality (δe < 0), stations with on average a negative effect (δe > 0) on the forecast skill, and "neutral" stations (δe = 0). Weather observations, obtained from about 78 percent of both AWS and cooperative stations, are beneficial. Observations taken at about 7 percent of AWS and 17 percent of cooperative stations are neutral. Observations obtained from about 15 percent of AWS and 5 percent of cooperative stations are not beneficial, at least within the framework of the adjoint-based method discussed in Section 2. It appears that the denser the network the lower the impact of individual stations and vice versa. This is consistent with the upper air results.
The reason that some stations have, on average, detrimental impact on forecast skill will be a topic of further investigation. For now, we note that most such stations are only weakly detrimental and that those that are more detrimental tend to be inland and remote. Given that these results are only for two seasons (summer and winter), this suggests that exploring the seasonal variation of surface station impacts, and the possible influence of particular synoptic regimes on observational representativeness errors, may be a useful line of enquiry. Stations that are persistently detrimental can also be investigated for quality control issues.

Observation Impacts from Buoys
A significant source of surface observations in ACCESS are moored and drifting ocean buoys and ships that collect weather data. The latter two sources of data come from both Bureau funded and internationally funded programs. Such marine surface observations are especially important in the Southern Hemisphere, which is geographically dominated by ocean. Figure 10 shows the average impact per observation for each of the buoys assimilated during the period September to December 2015, for the Australian region error norm; impacts are plotted at the average position of the buoy during the period. Benefical impact is dominated by drifting buoys in the southern Indian Ocean (upstream from the Australian region in the prevailing westerlies), the Southern Ocean and the moored buoys in the western equatorial region of the Pacific Ocean. The substantial impact of buoys far from Australia should be interpreted with caution: only average position is shown and some such buoys will have drifted considerably during the period. In contrast, buoy impacts derived from the global error norm (not shown) are much more evenly distributed across the globe.

Observation Impacts from Buoys
A significant source of surface observations in ACCESS are moored and drifting ocean buoys and ships that collect weather data. The latter two sources of data come from both Bureau funded and internationally funded programs. Such marine surface observations are especially important in the Southern Hemisphere, which is geographically dominated by ocean. Figure 10 shows the average impact per observation for each of the buoys assimilated during the period September to December 2015, for the Australian region error norm; impacts are plotted at the average position of the buoy during the period. Benefical impact is dominated by drifting buoys in the southern Indian Ocean (upstream from the Australian region in the prevailing westerlies), the Southern Ocean and the moored buoys in the western equatorial region of the Pacific Ocean. The substantial impact of buoys far from Australia should be interpreted with caution: only average position is shown and some such buoys will have drifted considerably during the period. In contrast, buoy impacts derived from the global error norm (not shown) are much more evenly distributed across the globe.

Comparison of Observation Impacts of Each In Situ Observation Type
The total average observation impact per day in the ACCESS system, aggregated by observation type, and the impact per observation for each in situ observation type (Table 2) are shown in Figure  11. Observations of all types reduce the forecast error on average during both winter and summer periods. Synoptic observations from AWS stations yield the largest contribution to the forecast error reduction (Figure 11a). Aircraft and radiosondes rank second and third, respectively, followed by

Comparison of Observation Impacts of Each In Situ Observation Type
The total average observation impact per day in the ACCESS system, aggregated by observation type, and the impact per observation for each in situ observation type (Table 2) are shown in Figure 11. Observations of all types reduce the forecast error on average during both winter and summer periods. Synoptic observations from AWS stations yield the largest contribution to the forecast error reduction (Figure 11a). Aircraft and radiosondes rank second and third, respectively, followed by wind profilers and pilot balloons. Recall that these results are obtained for the Australian moist energy norm. For the moist energy norm calculated over the globe, synoptic observations are usually not the major in situ observation type contributors in the forecast error reduction. Typically, radiosondes and aircrafts demonstrate the largest contributions (e.g., [19,20]). In contrast, the impact per observation is the largest for buoys (Figure 11b), which is consistent with other studies (e.g., [19]). This is because buoys are the main source of information at the marine boundary layer. Aircraft and synoptic observations rank second and third, followed by ships, radiosondes, pilot balloons and wind profilers.

Comparison of Observation Impacts of Each In Situ Observation Type
The total average observation impact per day in the ACCESS system, aggregated by observation type, and the impact per observation for each in situ observation type (Table 2) are shown in Figure  11. Observations of all types reduce the forecast error on average during both winter and summer periods. Synoptic observations from AWS stations yield the largest contribution to the forecast error reduction (Figure 11a). Aircraft and radiosondes rank second and third, respectively, followed by wind profilers and pilot balloons. Recall that these results are obtained for the Australian moist energy norm. For the moist energy norm calculated over the globe, synoptic observations are usually not the major in situ observation type contributors in the forecast error reduction. Typically, radiosondes and aircrafts demonstrate the largest contributions (e.g., [19,20]). In contrast, the impact per observation is the largest for buoys (Figure 11b), which is consistent with other studies (e.g., [19]). This is because buoys are the main source of information at the marine boundary layer. Aircraft and synoptic observations rank second and third, followed by ships, radiosondes, pilot balloons and wind profilers.

Discussion and Conclusions
In this paper, we evaluated impacts of in situ observations (ground and ocean-based synoptic and ship observations, wind profiler information, radiosonde and wind balloon upper air

Discussion and Conclusions
In this paper, we evaluated impacts of in situ observations (ground and ocean-based synoptic and ship observations, wind profiler information, radiosonde and wind balloon upper air observations, and aircraft data) on 24-h weather forecast error reduction using the adjoint-based FSO approach developed by the Met Office run in conjunction with the operational ACCESS global NWP system. The impact is measured by the reduction in the 24-h forecast error expressed as a moist energy norm calculated in the Australian domain. Results show that synoptic observations account for about 60% of the 24-h forecast error reduction, with the remainder accounted for by aircraft (12.8%), radiosondes (10.5%), wind profilers (3.9%), pilot balloons (2.8%), buoys (1.7%) and ships (1.2%). In contrast, the largest impact per observation is from buoys and aircraft. The large impact per observation from buoys concurs with other published studies and results from their provision of data from the otherwise poorly sampled surface ocean. Unsurprisingly, the drifting buoys closer to Australia have the larger impact on forecast skill, with buoys in the eastern Indian Ocean and off the southern Australian coast yielding the highest impacts. Indian ocean buoy observations are thus especially valuable for NWP forecast skill over the Australian continent. In terms of total impact per day, data from surface automatic weather stations have the largest impact on the forecast quality over the Australian region, a result that contrasts with global error norm calculations, which show that radiosondes are the most impactful in situ observations. This contrast reflects the much shorter forecast error length scales at the surface as compared to the mid-troposphere in typical data assimilation systems [28].
Previous work on quantifying the impact of Australian region rawinsonde observations in the then Bureau global NWP system [29,30] was reported by Seaman [31] using an analysis impact method described earlier [32]. In this, workstations were ranked according to how often they appeared in the top ten of the most influential Australian stations (in the sense of reducing forecast error) over a period from 1994 to 2007. As might be expected, remote stations were found to have more impact than those in the denser parts of the Australian network: in particular stations located in the tropical and sub-tropical north west of the continent were found to have the most impact. The results obtained in this paper show that there does not seem to be a significant dependence of impact on latitude, in contrast with an earlier study by Seaman [32]. This contrast is most likely due to the significant improvements in NWP data assimilation methods in the last two decades. A similar effect has been noted in most data assimilation systems, where short range forecast error variances now only have a weak latitudinal dependence-a much different situation to 10 or 20 years ago. The results obtained allow us to rank the Australian upper air stations with respect to their impacts on the forecast skill and to identify the most influential observations. Upper air radiosonde stations in more remote locations (e.g., Macquarie Island, Antarctic sites) have a greater impact on forecast skill than stations on the mainland.
Similarly, the more densely distributed synoptic sites have less of an impact on forecast skill compared to the more remote locations. Remote stations also tend to be upwind of substantial parts of the Australian mainland which may enhance their impact. In general, wind profilers located in northern Australia have a greater impact (in terms of the forecast error reduction) than profilers situated in the southern part of the Australian continent, a difference attributable to both to the larger number of observations from the northern stations and their remoteness.
Overall, all observation types have a positive impact on the 24-h forecast skill. Such results help to support the decision-making process regarding the evolution of the observing network, particularly at the national level. Consequently, this 4D-Var-based approach can be considered to be a tool for guiding the design and running of an efficient and effective observing network. The results obtained indicate great potential for FSO impact data to guide and inform the planning, assessment and development of Bureau observing networks. Future studies will explore further the seasonal and inter-annual variability of these impacts and also address the impact of satellite observations assimilated by the ACCESS NWP global system.