Next Article in Journal
Extremely Sensitive Microwave Sensor for Evaluation of Dielectric Characteristics of Low-Permittivity Materials
Previous Article in Journal
Gaze Tracking and Point Estimation Using Low-Cost Head-Mounted Devices
Previous Article in Special Issue
Chemical Gas Sensors Studied at SENSOR Lab, Brescia (Italy): From Conventional to Energy-Efficient and Biocompatible Composite Structures
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Long-Term Performance Assessment of Low-Cost Atmospheric Sensors in the Arctic Environment

1
Institute of BioEconomy, National Research Council of Italy (CNR IBE), 50019 Sesto Fiorentino (FI), Italy
2
Institute of Polar Sciences, National Research Council of Italy (CNR ISP), 40129 Bologna (BO), Italy
3
Chemistry Department, University of Florence, 50019 Sesto Fiorentino (FI), Italy
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(7), 1919; https://doi.org/10.3390/s20071919
Submission received: 12 March 2020 / Revised: 27 March 2020 / Accepted: 28 March 2020 / Published: 30 March 2020
(This article belongs to the Special Issue State-of-the-Art Sensors Technology in Italy 2019-2020)

Abstract

:
The Arctic is an important natural laboratory that is extremely sensitive to climatic changes and its monitoring is, therefore, of great importance. Due to the environmental extremes it is often hard to deploy sensors and observations are limited to a few sparse observation points limiting the spatial and temporal coverage of the Arctic measurement. Given these constraints the possibility of deploying a rugged network of low-cost sensors remains an interesting and convenient option. The present work validates for the first time a low-cost sensor array (AIRQino) for monitoring basic meteorological parameters and atmospheric composition in the Arctic (air temperature, relative humidity, particulate matter, and CO2). AIRQino was deployed for one year in the Svalbard archipelago and its outputs compared with reference sensors. Results show good agreement with the reference meteorological parameters (air temperature (T) and relative humidity (RH)) with correlation coefficients above 0.8 and small absolute errors (≈1 °C for temperature and ≈6% for RH). Particulate matter (PM) low-cost sensors show a good linearity (r2 ≈ 0.8) and small absolute errors for both PM2.5 and PM10 (≈1 µg m−3 for PM2.5 and ≈3 µg m−3 for PM10), while overall accuracy is impacted both by the unknown composition of the local aerosol, and by high humidity conditions likely generating hygroscopic effects. CO2 exhibits a satisfying agreement with r2 around 0.70 and an absolute error of ≈23 mg m−3. Overall these results, coupled with an excellent data coverage and scarce need of maintenance make the AIRQino or similar devices integrations an interesting tool for future extended sensor networks also in the Arctic environment.

1. Introduction

The impact of climate change in the Arctic poses great environmental concern since temperature in Polar Regions is rising faster than in lower latitude areas [1,2,3,4], with increasing occurrence of warming events [5]. The faster warming at the poles is primarily due to the ice-albedo positive feedback, where a temperature increase induces melting of ice caps, glaciers, and sea ice, thus, reducing surface albedo and increasing surface temperature of the region [3,6,7]. Another important positive feedback due to warming is the permafrost reduction and melting, with associated greenhouse gas (GHG) emissions to the atmosphere [8]. The sensitivity of this environment may represent a tipping point for the global climate, making it an extremely important natural laboratory that requires appropriate monitoring.
Experimental campaigns in the Artic regions are often deployed in the summer, with relatively warm temperatures and high biospheric activity. Nevertheless, year-round measurements extended to the winter season have been demonstrated to be important to fill knowledge gaps [9,10] and specific instrumental setup have been developed and assessed for Polar Regions winter measurements [11].
Given the extreme environmental conditions of the region, few atmospheric and meteorological high-quality data are available. Since single point observations are unable to capture climate dynamics at a wider spatial scale, multiple polar stations would be needed. However, the high cost for observatories building and maintenance, and the low accessibility to the area pose serious challenges to increasing the number of observation points.
In this context, the possibility of deploying low-cost sensors as auxiliary observations integrating high-cost reference observatories may result highly interesting and convenient. The deployment of low-cost sensor networks for atmospheric chemistry composition (especially air pollution) has recently known a relatively large diffusion as showed by scientific literature [12,13,14,15] and international actions (such as the European Cooperation in Science and Technology (COST) action EuNetAir) boosting innovation and technology development. The reduced cost, power consumption, and low maintenance needs make them useful tools under several environmental conditions [13,16]. In the Arctic, there are still very few cases where these kinds of sensors have been deployed for specific studies on oceans [17], animals [18], and greenhouse gas emissions from soils [19]. Despite the fact that low-cost sensors can provide useful information, the lower sensitivity compared with high-cost references make them less able to capture small variations in atmospheric parameters. Assessment studies on the behavior and performance of low-cost atmospheric sensors in harsh environment combined with low atmospheric concentrations are lacking, and needed to instruct the deployment of measurement sensor networks. Based on such assessment, the trade-off between increasing the number of measurement points (e.g. more points at lower accuracy) or increasing the sensor accuracy in a network (e.g. less points at higher accuracy), at the same total cost, could be better optimized.
Here, we presented the results achieved from the first long-term deployment of low-cost sensors to measure atmospheric parameters, namely air temperature and humidity, size resolved particles, and CO2 concentration.
In this work, we: (i) evaluated the performances of the low-cost sensor array AIRQino against reference measurements from high-quality instrumentation and (ii) assessed the suitability and endurance of the low-cost sensors at detecting atmospheric and meteorological data in the Arctic environment.

2. Materials and Methods

2.1. Study Area and Reference Stations

Data from both the low cost and the reference stations used in this work were acquired in the Brogger Peninsula and the Kongsfjord, in the Svalbard archipelago (Figure 1). Following the Köppen–Geiger climate classification, Svalbard are considered ET (Polar-Tundra) with average temperature of warmest month between 0 and 10 °C [20]. Climate normals (1961–1990) for Ny- Ålesund (obtained from the Norwegian Meteorological Institute, www.eklima.met.no) show a minimum monthly average temperature in February (−14.6 °C) and a maximum in July (4.9 °C). Minimum average monthly precipitation is in May and June (16.5 mm) and the maximum in September (44 mm).
Two reference stations are used in this study:
(1) The Amundsen-Nobile Climate Change Tower (CCT) is a 34 m high tower located about 1 km west of the Ny-Ålesund Research Station. It is equipped with conventional meteorological and micro-meteorological instruments, radiometers, and sensors for snow and soil measurements and it is focused to the characterization of the lower troposphere processes [21].
(2) The Gruvebadet Atmospheric Laboratory (GAL) is an instrumented shelter about 1 km south of Ny-Ålesund. On the basis of prevailing winds, its position allows to avoid or minimize contamination from anthropogenic sources. The main aim of this laboratory is, in fact, the monitoring of background atmospheric composition, mainly aerosols [22].

2.2. AIRQino Low-Cost Sensor

The low-cost station AIRQino is a custom printed circuit board (PCB) developed by the Institute of Bioeconomy (IBE) of the National Research Council of Italy (CNR) that is able to integrate a set of low-cost sensors and transmit their data to a standard Arduino microcontroller by acting as an Arduino shield [23]. The board integrates sensors for air temperature (T) and relative humidity (RH) (AM2315 Adafruit, New York City, NY, USA), and a set of atmospheric components sensing elements including CO2 (S8, SenseAir, Delsbo, Sweden) and particulate matter (PM2.5 and PM10 (SDS011, Nova Fitness, Jinan, China). The sensor board, the microcontroller unit, the data storage and the sensing elements are enclosed in a rugged, waterproof enclosure. Air circulation is obtained with two Ingress protection (IP) 33 ventilation devices (mod. 3540631, Fibox Inc., Glen Burnie, MD, USA) and a MC20080V1 brushless fan (Sunon Inc., Brea, CA, USA) with a nominal flow-rate of 2.7 m3 h−1 (Figure 2). The CO2 sensor returns mixing ratio of the gas in ppm. The PM laser-scattering optical particle counter has a separate inlet and an internal fan able to provide continuous air recirculation at 0.75 m3 h−1 and return densities in (µg m−3). The only but relevant practical difference with the standard AIRQino described in [23] is the addition of a 5 W ceramic heating element and a metallic cage for snow protection of the T and RH external sensor, aimed at increasing the performance in harsh environments. A small metallic net was added around the inlet for the PM sensor to provide protection from the snow to the particulate matter sensor as well. Also, the AIRQino box was insulated with a single layer of a ceramic tissue for increased protection to thermal stresses. A low-cost GPS module was included to timestamp data in coordinated universal time (UTC) format. Data from the sensor board were sent every 5 seconds to a laptop via a serial RS-232 interface and saved as daily text files. During the sampling the AIRQino was powered at 12V DC with an AC–DC transformer connected directly to the 220V AC grid power of the GAL.

2.3. Reference Sensors at the CCT and GAL

The CCT mounts multiple “slow” (1 min. acquisition rate) instruments at various levels, between 2 and 33 m, including Vaisala HMP45AC (Vaisala Corporation, Helsinki, Finland) thermo-hygrometers for air temperature and relative humidity. At a 20-m height the tower also hosts a “fast” (20 Hz acquisition rate) Campbell-Scientific EC150 eddy-covariance system for measuring fluxes of water vapor and CO2 (Campbell-Scientific Inc., UT, USA). The temperature and relative humidity at 2 m from the ground, as well as the CO2 values were used for comparison with the AIRQino. A full list of the CCT sensors can be found in [21].
The GAL is equipped with various aerosol sampling equipment [22,24] and in particular a scanning mobility particle sizer (SMPS) model TSI 3034 and an aerodynamic particle sizer (APS) model TSI 3321 (TSI incorporated, MN, USA). The 54 channel SMPS detects nanometric particles with electrical mobility diameter between 10 and 487 nm, while the 52 channels APS detects micrometric particles with an aerodynamic equivalent diameter between 523 nm and 20.54 µm [24,25]. The two instruments are connected to a common inlet following the European Supersites for Atmospheric Aerosol Research-European Research Infrastructure for the observation of Aerosol, Clouds and Trace Gases (EUSAAR-ACTRIS) protocol and measure aerosol size distribution [25]. PM10 aerosol was also collected by a TECORA Skypost inertial sampler on 47 mm diameter polytetrafluoroethylene (PTFE) filters at daily resolution. Both collection of PM10 on filters and determination of PM10 mass were accomplished according to the European Standard procedure EN12341:2014 guideline (Ambient air—Standard gravimetric measurement method for the determination of the PM10 or PM2.5 mass concentration of suspended particulate matter). The sampler operated at a nominal flow rate of 2.30 m3 h−1, over a nominal sampling period of 24 h. PM10 was then determined by gravimetric analysis. Measurement results were expressed as densities (µg m−3), where the air volume is that at ambient conditions near the inlet at the time of sampling. The gravimetric method represents the reference method for measuring PM concentrations, since there are no standardized techniques for near real-time observations. PM gravimetric samplers can yield accurate measurements, considering a 10% variation of mean concentration [26].
GAL and Gravimetric PM10 measurements from GAL (GAL-GRAV) were not operational during the winter resulting in a lack of data between 2 October, 2017 and 21 February, 2018 for GAL and between 25 September, 2017 and 23 February, 2018 for GAL-GRAV.

2.4. Data Processing

All raw data from AIRQino, CCT, and GAL were de-spiked following an interquartile range-based algorithm. Outliers were defined when values were below (above) the first (third) quartile minus (plus) three times the interquartile range (i.e. the range between the first and the third quartile of the whole time series). For the reference sensors (CCT and GAL), given the higher confidence in the measurements, the small gaps generated by the de-spiking procedure were filled via linear interpolation to maximize data coverage. In addition, CO2 concentration from the CCT was further smoothed by a Gaussian filter with a 20 data-points window to reduce noise.
After de-spiking, all atmospheric (PM and CO2) and meteorological (air temperature and RH) data from AIRQino, GAL, and CCT were averaged at daily time resolution.
AIRQino CO2 measurements (in ppm) were converted to density (in mg m−3) to be compared with the CCT, using air temperature and pressure (P) derived from the CCT itself.
Differential logarithmic aerosol volume size distributions from GAL (dV/dlogD, in µm3 cm−3) were multiplied by a density of 1.5 g cm−3 following previous studies in the Boreal environment [27,28,29] and summed over the appropriate diameter range to obtain mass densities (in µg m−3) that are comparable with the AIRQino output. The density correction of the volume size distributions is explained by the following dimensional analysis (1):
g c m 3 μ m 3 c m 3 = g 10 6 m 3 10 18 m 3 10 6 m 3 = g 10 6 m 3 = μ g m 3
Gravimetric PM10 measurements from GAL were natively referred to 24 hours intervals, therefore, no further processing was made.
To evaluate the effect of RH fluctuations on PM concentrations, root mean square errors (RMSEs) between AIRQino and GAL PM were computed on hourly data over 5%-wide RH bins.
Basic descriptive statistics, bias and normalized bias were calculated between the AIRQino and the reference sensors to characterize the performance and accuracy. Bias was calculated as:
B i a s = i = 1 n ( A i R i ) n
where A is the AIRQino recorded values, R is the reference instrument values, and n the size of the sample (i.e.: the total number of matching daily observations during the measurement period). Bias is normalized on the basis of the averages of the two samples in order to obtain a percentage of over (under) estimation as:
N o r m a l i z e d   B i a s = ( B i a s A ¯ R ¯ ) 100

3. Results

Air temperature measured by the AIRQino showed a very good agreement with the CCT reference sensor (r2 = 0.97, RMSE = 1.17 °C, Figure 3a). The AIRQino exhibited overall a small overestimation (bias of 0.48 °C, normalized bias 0.18%). Seasonal temperature trends were closely followed by both AIRQino and CCT (Figure 4a) with highest values in summer (5.61 ± 1.90 °C for AIRQino and 4.26 ± 1.85 °C for CCT) and lowest in spring (−6.96 ± 5.20 °C for AIRQino and −7.89 ± 4.50 °C for CCT). Relative humidity was also in good agreement between AIRQino and CCT (r2 = 0.82, RMSE = 6.04 %, Figure 3b) and the seasonal trend closely mirrored air temperature (Figure 4b). Also in this case AIRQino slightly overestimated the reference sensor (bias of 2.32% and normalized bias of 3.21%) as it can be observed by the positive intercept of the linear correlation.
Highest seasonal relative humidity was in summer (79.41 ± 9.04 % for AIRQino and 80.27 ± 7.59% for CCT) and lowest in spring (61.69 ± 12.45% for AIRQino and 63.23 ± 13.50% for CCT).
CO2 data showed a significant agreement between AIRQino and CCT albeit to a lesser degree compared with meteorological data (r2 = 0.68 RMSE = 23.13 mg m−3, Figure 3c). The AIRQino overestimated the reference sensor by 12.15 mg m−3, but when the bias is normalized on the sensors’ averages this resulted in only a small relative overestimation (normalized bias of 1.53%). Seasonal trends for AIRQino exhibited a minimum in summer (770.29 ± 15.04 mg m−3) and a maximum in spring (836.20 ± 32.45 mg m−3), while the minimum for CCT was in autumn (765.84 ± 12.63 mg m−3) and the maximum for the CCT was also in spring (822.41 ± 16.62 mg m−3), while incomplete data coverage didn’t allow to assess an average winter concentration.
PM2.5 showed a relatively high correlation between AIRQino and GAL (r2 = 0.75, RMSE = 1.27 µg m−3, Figure 3d) but a consistent underestimation by the AIRQino (Figure 4d, bias of -0.77 µg m−3, and normalized bias of −42.40%).
Similarly, AIRQino and GAL PM10 trends were in agreement (r2 = 0.78, RMSE = 3.06 µg m−3, Figure 3e), but AIRQino was generally underestimating PM10 concentrations (Figure 4e, bias of −2.40 µg m−3 and normalized bias of −73.42%).
AIRQino and GAL-GRAV PM10 trend data also showed a relatively good agreement, albeit lower than with the optical instrument (r2 = 0.57, RMSE = 1.04 µg m−3, Figure 3f). AIRQino concentrations were closer to gravimetric data than to the optical one, yielding lower errors and a slight underestimation (bias = −0.31 µg m−3 and normalized bias = −13.24%).
Neither PM2.5 nor PM10 showed a marked seasonal trend even if it must be considered that incomplete data coverage didn’t allow to evaluate an average winter value for the reference instruments.
Time series of daily averages of particulate matter were in agreement between AIRQino, GAL and GAL-GRAV when all the devices were operational (Figure 5a,b).
Independently from seasonal patterns, the RMSE between AIRQino and GAL particulate matter showed a dependence from RH as it’s seen from Figure 6.
Table 1 summarizes the results for the whole year of comparison of daily averages of AIRQino and reference sensors for the various variables.

4. Discussion

The AIRQino meteorological sensor showed an overall agreement with the reference sensors both in terms of trends and magnitudes. Air temperature in Svalbard is known to increase in summer well above zero, and even if less intensively, relative humidity is also known to increase in the warmer months [30] due to a general acceleration of the water cycle. Seasonal fluctuations in computed r2 and RMSE for AIRQino T and RH were present, but they did not impact the overall sensor performances (Table 1) and were not due to sensor drift effects (as seen by computing the same statistics over a 10-days sliding window). CO2 emissions in the Arctic environment depend on snowmelt and soil and vegetation respiration [31], with a net CO2 absorption in the summer rather than in winter [9]. While CO2 concentrations are not a direct measurement of the emissions, the two entities are linked (given that surface flux contributes to drive atmospheric concentration at large spatial scales, see [32]) and the AIRQino, in fact, showed higher average seasonal concentrations in winter compared with summer. Overall, the AIRQino CO2 sensor tended to be closer to the CCT in the lowest values and overestimate higher ones (Table 1). This could also explain the seasonal differences seen in autumn in Figure 4c, where the CCT detects a seasonal minimum that is not detected by the AIRQino. Given the long stretches of missing data due to the CCT datalogger failures, though, it is hard to discuss if this is actually a shortcoming of the low-cost sensor itself rather than an effect of the data shortage. In order to compare AIRQino and GAL PM concentrations it was necessary to assign a particle density to the GAL data in order to derive a mass concentration from an aerosol volume size distribution. The density value was assigned following the available literature reporting particulate matter density in boreal areas, but studies done on airborne particulate matter in Svalbard show a large variability in the composition of PM in all size ranges [24,33]. This difference in composition, arisen from a high variability in dominant sources as function of the season [22,34] and ranging between chlorides to metal oxides and other species [33], would suggest that particles of different densities have been measured by the GAL and also by AIRQino. Overall, this is a limitation of optical methods that is worth to address here: unknown chemical composition, or variable composition, pose challenges to the conversion from optical to quantitative variables, and this applies to both GAL and AIRQino. Assuming that the chosen density is representative for the Arctic environment, though, the AIRQino was able to capture the day-to-day variability of both PM2.5 and PM10, as it is confirmed by the high r2 values (0.75 and 0.78, respectively), low RMSE (1.27 and 3.06 µg m−3, respectively) and the low bias (−0.77 and −2.40 µg m−3, respectively). Gravimetric concentrations (GAL-GRAV) are generally lower than those measured optically (GAL). In fact, while the trends between PM10 GAL and PM10 GAL-GRAV are similar, with an r2 of 0.65 (p < 0.05) and an RMSE of 2.48 µg m−3, the GAL tends to overestimate the gravimetric concentration (normalized bias = 56.51 %). This suggests that the literature reported density for aerosol in the Arctic environment is in the ballpark, but not exactly the one found in Ny-Ålesund. In fact, by comparing AIRQino and GAL with GAL-GRAV it is possible to derive approximate particle density at least for PM10. Fitting a zero-intercept linear model between AIRQino and GAL-GRAV yielded that AIRQino measurements should be corrected by a factor of 1.13 in order to match gravimetric ones. This factor is not a real density given that it takes into account both the between-sensors differences and the actual analog-to-digital conversion in the SDS011 between laser scattering and output measurement, but since it is close to 1, it suggests that the SDS011 is quite close to the actual particle density. Fitting a similar model to the aerosol volume size distributions from GAL (dV/dlogD, in µm3 cm−3), instead, yielded an effective density for PM10 of 0.85 g cm−3. This is in accordance with the results of Table 1 which shows how the GAL (using the literature density of 1.5 g cm−3) returned higher values when compared with AIRQino and GAL-GRAV. It is clear that more research is needed to address this topic in the Arctic environment, especially in view of deploying a low-cost sensor network in the future.
Even if this is the first evaluation in the Arctic environment, the SDS011 sensor was tested in the northern city of Oslo (Norway) and showed similarly high correlations coefficients with a reference sensor for PM2.5 ranging from 0.55 to 0.71, an RMSE < 6 µg m−3 and accuracies >80% [35]. The good linearity of the SDS011 sensor for PM2.5 integrated in the AIRQino were evaluated both in the field and in the laboratory: in the field correlations of up to 0.9 where found with reference sensors when the SDS011 was deployed in different urban environments such as Thessaloniki (Greece) and Wrocław (Poland) [36,37]. Similarly, high coefficients (>0.9) were also found in the laboratory when the sensor was tested in an aerosol chamber [38]. The AIRQino itself was tested in a similarly temperate urban environment in Florence (Italy) obtaining raw correlation coefficients >0.8 when compared with reference stations [23]. Nevertheless, in the Arctic deployment, while the SDS011 showed low absolute errors, the high negative relative bias (>−40%) demonstrated a consistent underestimation of the reference PM that wasn’t seen, for example, in the deployment of the AIRQino in Florence (where the normalized mean bias was around 5% for both PM2.5 and PM10, [23]). The main difference between the Arctic deployment and the other literature studies on SDS011 is the dynamic range of PM experienced by the sensor and the aerosol chemical composition. While in urban contexts the sensor experiences a range of PM from close to zero up to tens of micrograms per cubic meter (even above 100 µg m−3 in [37], while [39] have found PM10 concentrations around 40 µg m−3 in urban sites in Tuscany), in Ny-Ålesund the range measured by the GAL (GAL-GRAV) does not go above 15 (13) µg m−3 for PM10 and not above 10 µg m−3 for PM2.5. In fact, [37] saw increases in relative errors when PM2.5 concentrations were below or equal 20 µg m−3. Another factor affecting the accuracy of the SDS011 is humidity resulting in a drop in performance (i.e.: increased RMSE) at increasing RH for both PM2.5 and PM10, especially at values >50% (Figure 6). This is likely related to hygroscopic effects: as average RH increase, the local occurrence of condensation of small water droplets in the inlet system also increases, generating particles of different size distribution and optical properties with respect to the aerosol of that air parcel, impacting significantly the measurement accuracy. In fact, [40] noted a humidity-related scattering enhancement that can go up to 3.14 for Arctic aerosols. Similar effects are also reported in the literature for the same sensor: both [35] and [37] also shown an increased discrepancy between the SDS011 and reference sensor for PM2.5 when RH increased above 80%. Reduced correlations between reference and low-cost sensor at high humidity were also seen by [41] on PM2.5 during the deployment of a similar low-cost sensor (SDS019, Nova Fitness, Jinan, China) on a high-elevation mountain.
During the one year of deployment, the AIRQino sensor dropped only 0.19 % of the transmitted data packages and kept running without the necessity of any maintenance, proving to be well-suited to work in polar environments. While in the present application the data were streamed to a PC via a serial interface, AIRQino has the capability to integrate a wide range of wireless connectivity options (e.g., cellular, Bluetooth, and WiFi) and also an SD card reader to work in a standalone mode even when no kind of connectivity is present or radio communications are limited due to frequency restrictions (such as in Ny-Ålesund, for example, http://nysmac.npolar.no/practical/radio-silent-area.html). In this configuration, data are written to a comma delimited text file and, due to the small size of each individual data message (roughly 180 bytes), they can be accumulated for long periods of time (10.6 years considering one message per minute and a 128 GB SD card). Deploying the AIRQino on the roof of the GAL observatory allowed to have a continuous supply of power from the grid, but a deployment of a sensor network in fully remote areas would face the issue of powering up the sensors without grid access. The AIRQino power draw without the heating element is of 200 mAh−1 @ 12 VDC of which 150 mAh−1 @ 5 VDC are used by the sensor array. The total consumption of the AIRQino is ≈ 2.5 Wh−1, 30% of which is used by the sensor array [23]. Given the modest power draw, the sensor could be powered through a relatively small solar panel (between 10–25 W) in boreal areas where Sun is consistently present during summer. During the polar night, the AIRQino could receive power with different solutions such as small wind turbines in combination with lithium-ion batteries or fuel cells [42,43]. Another possibility to reduce power draw may come from the usage of newer generation of sensors designed specifically for low-powered applications [44,45]. Powering a sensor network in remote Arctic areas remains a complex logistic issue that will require further investigation and engineering innovation.

5. Conclusions

In this work a low-cost sensor for atmospheric composition (AIRQino) was tested in the Arctic environment for one year alongside some high-cost reference sensors. Even in such an extreme environment, with often low concentrations of certain atmospheric components (such as CO2 and particulate matter), the AIRQino was in general agreement with the reference sensors. The performance assessment of meteorological data (T and RH), CO2, PM2.5, and PM10 was presented, using long-running reference sensors in close proximity with AIRQino, but future work will need to focus on the other onboard sensors of the AIRQino (CO, O3, and NO2) in order to fully characterize the polar performances of this low-cost station. Further work would be needed also to better characterize PM2.5 and PM10 magnitude and behavior, given the lack of an in-depth study of particle density in Svalbard. In fact, the analysis of gravimetric measurements highlighted that the particle density reported by other literature studies on Arctic aerosol brings to an overestimation of the gravimetric concentration by the optical instruments. High humidity conditions were observed to decrease the particles measurement accuracy. To overcome this limitation, solutions aimed at preventing condensation in the inlet could be investigated (e.g., heating the inlet), keeping in mind the trade-off between desirable increase in accuracy and undesirable increase in power drain, system complexity, and cost. Given the proven reliability and the low power drain of the AIRQino station, deployment of a sensor network to spatially characterize atmospheric composition in even more remote Arctic areas appears feasible. With no grid power available, further energy production optimization would be required to provide AIRQino with constant power throughout the year and the polar night.

Author Contributions

Conceptualization, F.C., L.B., B.G., and A.Z.; methodology, F.C., B.G., G.G., M.M., M.S., and R.T.; software, F.C.; validation, F.C., L.B., B.G., M.M., M.S., and R.T.; formal analysis, F.C., B.G., M.M., M.S., and R.T.; investigation, F.C., M.M., M.S., R.T., and A.Z.; resources, M.M., A.P.V., V.V., M.S., R.T., and A.Z.; data curation, F.C., M.M., A.P.V., V.V., M.S., R.T., and A.Z.; writing—original draft preparation, F.C.; writing—review and editing, L.B., B.G., G.G., M.M., C.V., M.S., and R.T.; visualization, F.C.; supervision, B.G. and A.Z.; project administration, C.V. and A.Z.; funding acquisition, M.M., M.S., R.T., and A.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Regione Toscana (Progetto SMART, bando FAR-FAS 2014)

Acknowledgments

The results reported in this article were obtained also thanks to the interdisciplinary research activities based at the Arctic Station ‘‘Dirigibile Italia’’, coordinated by the ‘‘Department of Earth System Sciences and Environmental Technologies’’ of the National Research Council of Italy.

Conflicts of Interest

The authors declare no conflict of interest and the funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Holland, M.M.; Finnis, J.; Barrett, A.P.; Serreze, M.C. Projected changes in Arctic Ocean freshwater budgets. J. Geophys. Res. Space Phys. 2007, 112. [Google Scholar] [CrossRef]
  2. Serreze, M.C.; Barrett, A.P.; Stroeve, J.C.; Kindig, D.N.; Holland, M.M. The emergence of surface-based Arctic amplification. Cryosphere 2009, 3, 11–19. [Google Scholar] [CrossRef] [Green Version]
  3. Francis, J.; Skific, N. Evidence linking rapid Arctic warming to mid-latitude weather patterns. Philos. Trans. R. Soc. A Math. Phys. Eng. Sci. 2015, 373, 20140170. [Google Scholar] [CrossRef] [PubMed]
  4. Allen, M.R.; Dube, O.P.; Solecki, W.; Aragón-Durand, F.; Cramer, W.; Humphreys, S.; Kainuma, M.; Kala, J.; Mahowald, N.; Mulugetta, Y.; et al. In Global Warming of 1.5°C. 2018. Available online: https://www.ipcc.ch/sr15/download/ (accessed on 11 March 2020).
  5. Moore, G.W.K. The December 2015 North Pole Warming Event and the Increasing Occurrence of Such Events. Sci. Rep. 2016, 6, 39084. [Google Scholar] [CrossRef] [PubMed]
  6. Screen, J.; Simmonds, I.H. The central role of diminishing sea ice in recent Arctic temperature amplification. Nature 2010, 464, 1334–1337. [Google Scholar] [CrossRef] [Green Version]
  7. Cohen, J.; Screen, J.; Furtado, J.C.; Barlow, M.; Whittleston, D.; Coumou, D.; Francis, J.; Dethloff, K.; Entekhabi, D.; Overland, J.; et al. Recent Arctic amplification and extreme mid-latitude weather. Nat. Geosci. 2014, 7, 627–637. [Google Scholar] [CrossRef] [Green Version]
  8. Schuur, E.A.G.; McGuire, A.D.; Schadel, C.; Grosse, G.; Harden, J.; Hayes, D.J.; Hugelius, G.; Koven, C.D.; Kuhry, P.; Lawrence, D.M.; et al. Climate change and the permafrost carbon feedback. Nature 2015, 520, 171–179. [Google Scholar] [CrossRef]
  9. Oechel, W.; Laskowski, C.A.; Burba, G.; Gioli, B.; Kalhori, A.A.M. Annual patterns and budget of CO2flux in an Arctic tussock tundra ecosystem. J. Geophys. Res. Biogeosciences 2014, 119, 323–339. [Google Scholar] [CrossRef] [Green Version]
  10. Zona, D.; Gioli, B.; Commane, R.; Lindaas, J.; Wofsy, S.C.; Miller, C.E.; Dinardo, S.J.; Dengel, S.; Sweeney, C.; Karion, A.; et al. Cold season emissions dominate the Arctic tundra methane budget. Proc. Natl. Acad. Sci. 2015, 113, 40–45. [Google Scholar] [CrossRef] [Green Version]
  11. Goodrich, J.; Oechel, W.; Gioli, B.; Moreaux, V.; Murphy, P.C.; Burba, G.; Zona, D. Impact of different eddy covariance sensors, site set-up, and maintenance on the annual balance of CO2 and CH4 in the harsh Arctic environment. Agric. For. Meteorol. 2016, 228, 239–251. [Google Scholar] [CrossRef] [Green Version]
  12. Chong, C.-Y.; Kumar, S. Sensor networks: Evolution, opportunities, and challenges. Proc. IEEE 2003, 91, 1247–1256. [Google Scholar] [CrossRef] [Green Version]
  13. Kumar, P.; Morawska, L.; Martani, C.; Biskos, G.; Neophytou, M.K.-A.; Di Sabatino, S.; Bell, M.; Norford, L.; Britter, R. The rise of low-cost sensing for managing air pollution in cities. Environ. Int. 2015, 75, 199–205. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Schneider, P.; Castell, N.; Vogt, M.; Dauge, F.R.; Lahoz, W.A.; Bartonova, A. Mapping urban air quality in near real-time using observations from low-cost sensors and model information. Environ. Int. 2017, 106, 234–247. [Google Scholar] [CrossRef] [PubMed]
  15. Motlagh, N.H.; Petaja, T.; Kulmala, M.; Trachoma, S.; Lagerspetz, E.; Nurmi, P.; Li, X.; Varjonen, S.; Mineraud, J.; Siekkinen, M.; et al. Toward Massive Scale Air Quality Monitoring. IEEE Commun. Mag. 2020, 58, 54–59. [Google Scholar] [CrossRef]
  16. Snyder, E.G.; Watkins, T.H.; Solomon, P.A.; Thoma, E.D.; Williams, R.W.; Hagler, G.; Shelow, D.; Hindin, D.A.; Kilaru, V.; Preuss, P.W. The Changing Paradigm of Air Pollution Monitoring. Environ. Sci. Technol. 2013, 47, 11369–11377. [Google Scholar] [CrossRef] [PubMed]
  17. Piermattei, V.; Madonia, A.; Bonamano, S.; Martellucci, R.; Bruzzone, G.; Ferretti, R.; Odetti, A.; Azzaro, M.; Zappalà, G.; Marcelli, M. Cost-Effective Technologies to Study the Arctic Ocean Environment. Sensors 2018, 18, 2257. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Pasquali, V.; D’Alessandro, G.; Gualtieri, R.; Leccese, F. A new data logger based on Raspberry-Pi for Arctic Notostraca locomotion investigations. Measurement 2017, 110, 249–256. [Google Scholar] [CrossRef]
  19. Gagnon, S.; L’Hérault, E.; Lemay, M.; Allard, M. New low-cost automated system of closed chambers to measure greenhouse gas emissions from the tundra. Agric. For. Meteorol. 2016, 228, 29–41. [Google Scholar] [CrossRef]
  20. Kottek, M.; Grieser, J.; Beck, C.; Rudolf, B.; Rubel, F. World Map of the Köppen-Geiger climate classification updated. Meteorol. Z. 2006, 15, 259–263. [Google Scholar] [CrossRef]
  21. Mazzola, M.; Viola, A.P.; Lanconelli, C.; Vitale, V. Atmospheric observations at the Amundsen-Nobile Climate Change Tower in Ny-Ålesund, Svalbard. RENDICONTI Lince- 2016, 27, 7–18. [Google Scholar] [CrossRef]
  22. Udisti, R.; Bazzano, A.; Becagli, S.; Bolzacchini, E.; Caiazzo, L.; Cappelletti, D.; Ferrero, L.; Frosini, D.; Giardi, F.; Grotti, M.; et al. Sulfate source apportionment in the Ny-Ålesund (Svalbard Islands) Arctic aerosol. RENDICONTI Lince- 2016, 27, 85–94. [Google Scholar] [CrossRef]
  23. Cavaliere, A.; Carotenuto, F.; Di Gennaro, S.F.; Gioli, B.; Gualtieri, G.; Martelli, F.; Matese, A.; Toscano, P.; Vagnoli, C.; Zaldei, A.; et al. Development of Low-Cost Air Quality Stations for Next Generation Monitoring Networks: Calibration and Validation of PM2.5 and PM10 Sensors. Sensors 2018, 18, 2843. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Giardi, F.; Becagli, S.; Traversi, R.; Frosini, D.; Severi, M.; Caiazzo, L.; Ancillotti, C.; Cappelletti, D.; Moroni, B.; Grotti, M.; et al. Size distribution and ion composition of aerosol collected at Ny-Ålesund in the spring–summer field campaign 2013. RENDICONTI Lince- 2016, 27, 47–58. [Google Scholar] [CrossRef] [Green Version]
  25. Lupi, A.; Busetto, M.; Becagli, S.; Giardi, F.; Lanconelli, C.; Mazzola, M.; Udisti, R.; Hansson, H.-C.; Henning, T.; Petkov, B.; et al. Multi-seasonal ultrafine aerosol particle number concentration measurements at the Gruvebadet observatory, Ny-Ålesund, Svalbard Islands. RENDICONTI Lince- 2016, 27, 59–71. [Google Scholar] [CrossRef]
  26. Yanosky, J.D.; Maclntosh, D.L. A Comparison of Four Gravimetric Fine Particle Sampling Methods. J. Air Waste Manag. Assoc. 2001, 51, 878–884. [Google Scholar] [CrossRef] [Green Version]
  27. Saarikoski, S.; Mäkelä, T.; Hillamo, R.M.; Aalto, P.P.; Kerminen, V.-M.; Kulmala, M. Physico-chemical characterization and mass closure of size-segregated atmospheric aerosols in Hyytiälä, Finland. Boreal Env. Res. 2005, 10, 385–400. [Google Scholar]
  28. Viskari, T.; Asmi, E.; Virkkula, A.; Kolmonen, P.; Petäjä, T.; Järvinen, H. Estimation of aerosol particle number distribution with Kalman Filtering – Part 2: Simultaneous use of DMPS, APS and nephelometer measurements. Atmospheric Chem. Phys. Discuss. 2012, 12, 11781–11793. [Google Scholar] [CrossRef] [Green Version]
  29. Asmi, E.; Kondratyev, V.; Brus, D.; Laurila, T.; Lihavainen, H.; Backman, J.; Vakkari, V.; Aurela, M.; Hatakka, J.; Viisanen, Y.; et al. Aerosol size distribution seasonal characteristics measured in Tiksi, Russian Arctic. Atmospheric Chem. Phys. Discuss. 2016, 16, 1271–1287. [Google Scholar] [CrossRef] [Green Version]
  30. Maturilli, M.; Herber, A.; König-Langlo, G. Climatology and time series of surface meteorology in Ny-Ålesund, Svalbard. Earth Syst. Sci. Data 2013, 5, 155–163. [Google Scholar] [CrossRef] [Green Version]
  31. Lloyd, C.R. On the physical controls of the carbon dioxide balance at a high Arctic site in Svalbard. Theor. Appl. Clim. 2001, 70, 167–182. [Google Scholar] [CrossRef]
  32. Ciais, P.; Sabine, C.; Bala, G.; Bopp, L.; Brovkin, V.; Canadell, J.; Chhabra, A.; DeFries, R.; Galloway, J.; Heimann, M.; et al. Carbon and Other Biogeochemical Cycles. In Climate Change 2013: The Physical Science Basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change; Stocker, T.F., Qin, D., Plattner, G.-K., Tignor, M., Allen, S.K., Boschung, J., Nauels, A., Xia, Y., Bex, V., Midgley, P.M., Eds.; Cambridge University Press: Cambridge, UK; New York, NY, USA, 2013; pp. 465–470. [Google Scholar]
  33. Moroni, B.; Becagli, S.; Bolzacchini, E.; Busetto, M.; Cappelletti, D.; Crocchianti, S.; Ferrero, L.; Frosini, D.; Lanconelli, C.; Lupi, A.; et al. Vertical Profiles and Chemical Properties of Aerosol Particles upon Ny-Ålesund (Svalbard Islands). Adv. Meteorol. 2015, 2015, 1–11. [Google Scholar] [CrossRef]
  34. Becagli, S.; Lazzara, L.; Marchese, C.; Dayan, U.; Ascanius, S.; Cacciani, M.; Caiazzo, L.; DiBiagio, C.; Di Iorio, T.; Di Sarra, A.; et al. Relationships linking primary production, sea ice melting, and biogenic aerosol in the Arctic. Atmospheric Environ. 2016, 136, 1–15. [Google Scholar] [CrossRef] [Green Version]
  35. Liu, H.-Y.; Schneider, P.; Haugen, R.; Vogt, M. Performance Assessment of a Low-Cost PM2.5 Sensor for a near Four-Month Period in Oslo, Norway. Atmosphere 2019, 10, 41. [Google Scholar] [CrossRef] [Green Version]
  36. Ioakimidis, C.S.; Galatoulas, N.-F.; Dallas, P.I.; Ibarra, L.M.C.; Margaritis, D.; Ioakimidis, C.S. Development and On-Field Testing of Low-Cost Portable System for Monitoring PM2.5 Concentrations. Sensors 2018, 18, 1056. [Google Scholar]
  37. Badura, M.; Batog, P.; Drzeniecka-Osiadacz, A.; Modzel, P. Evaluation of Low-Cost Sensors for Ambient PM2.5 Monitoring. J. Sensors 2018, 2018, 1–16. [Google Scholar] [CrossRef] [Green Version]
  38. Hapidin, D.A.; Saputra, C.; Maulana, D.S.; Munir, M.M.; Khairurrijal, K. Aerosol Chamber Characterization for Commercial Particulate Matter (PM) Sensor Evaluation. Aerosol Air Qual. Res. 2019, 19, 181–194. [Google Scholar] [CrossRef] [Green Version]
  39. Nava, S.; Lucarelli, F.; Amato, F.; Becagli, S.; Calzolai, G.; Chiari, M.; Giannoni, M.; Traversi, R.; Udisti, R. Biomass burning contributions estimated by synergistic coupling of daily and hourly aerosol composition records. Sci. Total. Environ. 2015, 511, 11–20. [Google Scholar] [CrossRef]
  40. Zieger, P.; Fierz-Schmidhauser, R.; Weingartner, E.; Baltensperger, U. Effects of relative humidity on aerosol light scattering: results from different European sites. Atmospheric Chem. Phys. Discuss. 2013, 13, 10609–10631. [Google Scholar] [CrossRef] [Green Version]
  41. Li, H.; Zhu, Y.; Zhao, Y.; Chen, T.; Jiang, Y.; Shan, Y.; Liu, Y.; Mu, J.; Yin, X.; Wu, D.; et al. Evaluation of the Performance of Low-Cost Air Quality Sensors at a High Mountain Station with Complex Meteorological Conditions. Atmosphere 2020, 11, 212. [Google Scholar] [CrossRef] [Green Version]
  42. Knepp, T.N.; Bottenheim, J.; Carlsén, M.; Carlson, D.; Donohoue, D.; Friederich, G.; Matrai, P.A.; Netcheva, S.; Perovich, D.K.; Santini, R.; et al. Development of an autonomous sea ice tethered buoy for the study of ocean-atmosphere-sea ice-snow pack interactions: the O-buoy. Atmospheric Meas. Tech. 2010, 3, 249–261. [Google Scholar] [CrossRef] [Green Version]
  43. Ishibashi, S.; Aoki, T.; Tsukioka, S.; Yoshida, H.; Inada, T.; Kabeno, T.; Maeda, T.; Hirokawa, K.; Yokoyama, K.; Tani, T.; et al. An ocean going autonomous underwater vehicle “URASHIMA” equipped with a fuel cell. In Proceedings of the 2004 International Symposium on Underwater Technology (IEEE Cat. No.04EX869), Taipei, Taiwan, 20–23 April 2004; pp. 209–214. [Google Scholar]
  44. Dai, Z.; Xu, L.; Duan, G.; Li, T.; Zhang, H.; Li, Y.; Wang, Y.; Wang, Y.; Cai, W. Fast-Response, Sensitivitive and Low-Powered Chemosensors by Fusing Nanostructured Porous Thin Film and IDEs-Microheater Chip. Sci. Rep. 2013, 3, 1669. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Dai, Z.; Liang, T.; Lee, J.-H. Gas sensors using ordered macroporous oxide nanostructures. Nanoscale Adv. 2019, 1, 1626–1639. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Map of the sampling area. The red marks indicate the location of the Climate Change Tower (CCT), the Gruvebadet Atmospheric Laboratory (GAL), and the Ny-Ålesund research village. The inset shows the Svalbard archipelago with a red rectangle highlighting the Brogger peninsula and the Kongsfjorden where the sampling stations are located.
Figure 1. Map of the sampling area. The red marks indicate the location of the Climate Change Tower (CCT), the Gruvebadet Atmospheric Laboratory (GAL), and the Ny-Ålesund research village. The inset shows the Svalbard archipelago with a red rectangle highlighting the Brogger peninsula and the Kongsfjorden where the sampling stations are located.
Sensors 20 01919 g001
Figure 2. Positioning of the low-cost sensor array (AIRQino) on the roof of the Gruvebadet Atmospheric Laboratory (GAL) and interiors of the rugged enclosure highlighting the temperature (T) and relative humidity (RH) sensor (1), the CO2 sensor (2), and the particulate matter (PM) sensor (3). The snow protection cage is visible in the small red box on the right on top of the AIRQino.
Figure 2. Positioning of the low-cost sensor array (AIRQino) on the roof of the Gruvebadet Atmospheric Laboratory (GAL) and interiors of the rugged enclosure highlighting the temperature (T) and relative humidity (RH) sensor (1), the CO2 sensor (2), and the particulate matter (PM) sensor (3). The snow protection cage is visible in the small red box on the right on top of the AIRQino.
Sensors 20 01919 g002
Figure 3. Scatterplots of AIRQino daily-averaged data versus reference sensor data (either CCT, GAL, or GAL-GRAV). Black solid lines show the lines of fit, while blue solid lines the 1:1 reference line. Each subplot is referred to a different variable: T (a), RH (b), CO2 (c), PM2.5 (d), PM10 (e), and gravimetric PM10 (f). The title of each subplot shows the calculated r2.
Figure 3. Scatterplots of AIRQino daily-averaged data versus reference sensor data (either CCT, GAL, or GAL-GRAV). Black solid lines show the lines of fit, while blue solid lines the 1:1 reference line. Each subplot is referred to a different variable: T (a), RH (b), CO2 (c), PM2.5 (d), PM10 (e), and gravimetric PM10 (f). The title of each subplot shows the calculated r2.
Sensors 20 01919 g003
Figure 4. Seasonal trends of air temperature (a), relative humidity (b), CO2 (c), PM2.5 (d), and PM10 (e) for AIRQino (blue), CCT/GAL (orange), and GAL-GRAV (yellow). Shaded areas represent standard deviation.
Figure 4. Seasonal trends of air temperature (a), relative humidity (b), CO2 (c), PM2.5 (d), and PM10 (e) for AIRQino (blue), CCT/GAL (orange), and GAL-GRAV (yellow). Shaded areas represent standard deviation.
Sensors 20 01919 g004
Figure 5. Time trends of PM2.5 (a) and PM10 (b) for AIRQino sensor (blue), GAL (orange line), and GAL-GRAV (yellow line). Dashed black lines delimitate the winter period of inactivity of the GAL.
Figure 5. Time trends of PM2.5 (a) and PM10 (b) for AIRQino sensor (blue), GAL (orange line), and GAL-GRAV (yellow line). Dashed black lines delimitate the winter period of inactivity of the GAL.
Sensors 20 01919 g005
Figure 6. Root mean square errors (RMSE) between the AIRQino PM2.5 (blue line, left y-axis), AIRQino PM10 (orange line, right y-axis), and GAL. Hourly PM data were binned on the basis of 5%-wide RH bins (x-axis) and RMSE was computed over such bins.
Figure 6. Root mean square errors (RMSE) between the AIRQino PM2.5 (blue line, left y-axis), AIRQino PM10 (orange line, right y-axis), and GAL. Hourly PM data were binned on the basis of 5%-wide RH bins (x-axis) and RMSE was computed over such bins.
Sensors 20 01919 g006
Table 1. Metrics and statistics between the AIRQino and the reference sensors. For GAL-GRAV the statistics are referred to the comparison AIRQino.
Table 1. Metrics and statistics between the AIRQino and the reference sensors. For GAL-GRAV the statistics are referred to the comparison AIRQino.
VariableUnitsInstrumentMinimumAverageMaximumComparison Statistics
r2 (p)RMSEBiasNorm. Bias
T°CAIRQino−16.22−1.509.520.97 (<0.05)1.170.480.18 %
CCT−16.55−1.749.91
RH%AIRQino38.4773.1698.250.82 (<0.05)6.042.323.21 %
CCT30.9671.3595.38
CO2mg m−3AIRQino735.85803.44911.290.68 (<0.05)23.1312.151.53 %
CCT739.35789.90847.82
PM2.5µg m−3AIRQino1.001.484.730.75 (<0.05)1.27-0.77−42.40 %
GAL0.332.319.46
PM10µg m−3AIRQino1.002.378.140.78 (<0.05)3.06-2.40−73.42 %
GAL0.594.8114.82
GAL-GRAV0.272.59 12.950.57 (<0.05)1.04-0.31−13.24%

Share and Cite

MDPI and ACS Style

Carotenuto, F.; Brilli, L.; Gioli, B.; Gualtieri, G.; Vagnoli, C.; Mazzola, M.; Viola, A.P.; Vitale, V.; Severi, M.; Traversi, R.; et al. Long-Term Performance Assessment of Low-Cost Atmospheric Sensors in the Arctic Environment. Sensors 2020, 20, 1919. https://doi.org/10.3390/s20071919

AMA Style

Carotenuto F, Brilli L, Gioli B, Gualtieri G, Vagnoli C, Mazzola M, Viola AP, Vitale V, Severi M, Traversi R, et al. Long-Term Performance Assessment of Low-Cost Atmospheric Sensors in the Arctic Environment. Sensors. 2020; 20(7):1919. https://doi.org/10.3390/s20071919

Chicago/Turabian Style

Carotenuto, Federico, Lorenzo Brilli, Beniamino Gioli, Giovanni Gualtieri, Carolina Vagnoli, Mauro Mazzola, Angelo Pietro Viola, Vito Vitale, Mirko Severi, Rita Traversi, and et al. 2020. "Long-Term Performance Assessment of Low-Cost Atmospheric Sensors in the Arctic Environment" Sensors 20, no. 7: 1919. https://doi.org/10.3390/s20071919

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop