Next Article in Journal
Predicting SARS-CoV-2 Weather-Induced Seasonal Virulence from Atmospheric Air Enthalpy
Next Article in Special Issue
PM2.5 Pollution Strongly Predicted COVID-19 Incidence in Four High-Polluted Urbanized Italian Cities during the Pre-Lockdown and Lockdown Periods
Previous Article in Journal
Factors Predicting Treatment of World Trade Center-Related Lung Injury: A Longitudinal Cohort Study
Previous Article in Special Issue
Associations between Household-Level Exposures and All-Cause Diarrhea and Pathogen-Specific Enteric Infections in Children Enrolled in Five Sentinel Surveillance Studies
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Association between the New COVID-19 Cases and Air Pollution with Meteorological Elements in Nine Counties of New York State

1
Department of Probability and Statistics, IIMAS, Universidad Nacional Autónoma de México, Mexico City 04510, Mexico
2
Department of Mathematics and IMAC, Universitat Jaume I, Castellón, 12006 Castellón, Spain
3
Department of Mathematics, Universitat Jaume I, 12006 Castellón, Spain
4
Research Group on Statistics, Econometrics and Health (GRECS), University of Girona, 17003 Girona, Spain
5
CIBER of Epidemiology and Public Health (CIBERESP), 28029 Madrid, Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(23), 9055; https://doi.org/10.3390/ijerph17239055
Submission received: 27 October 2020 / Revised: 26 November 2020 / Accepted: 2 December 2020 / Published: 4 December 2020

Abstract

:
The principal objective of this article is to assess the possible association between the number of COVID-19 infected cases and the concentrations of fine particulate matter (PM2.5) and ozone (O3), atmospheric pollutants related to people’s mobility in urban areas, taking also into account the effect of meteorological conditions. We fit a generalized linear mixed model which includes spatial and temporal terms in order to detect the effect of the meteorological elements and COVID-19 infected cases on the pollutant concentrations. We consider nine counties of the state of New York which registered the highest number of COVID-19 infected cases. We implemented a Bayesian method using integrated nested Laplace approximation (INLA) with a stochastic partial differential equation (SPDE). The results emphasize that all the components used in designing the model contribute to improving the predicted values and can be included in designing similar real-world data (RWD) models. We found only a weak association between PM2.5 and ozone concentrations with COVID-19 infected cases. Records of COVID-19 infected cases and other covariates data from March to May 2020 were collected from electronic health records (EHRs) and standard RWD sources.
Keywords:
COVID-19; INLA; RWD; PM2.5; O3; New York

1. Introduction

In recent months, a series of studies related to the pandemic caused by the new SARS-CoV-2 pathogen have been conducted around the world. Most of those studies have focused on epidemiological and molecular biology aspects aiming to learn as fast as possible about the characteristics of the virus and its epidemic spread. One aspect of the pandemic that has been mentioned in the press and other media is the effect that epidemic control measures like nationwide lockdown and the associated reduction in human activities had on environmental issues such as air pollution. There are several published studies regarding the effect that reduction of human activities due to the current pandemic has had on air pollution levels. A recent study conducted during two distinct phases of lockdown over the Yangtze River Delta Region applied Weather Research and Forecasting and Comprehensive Air Quality Model with Extensions (WRF-CAMx) modeling system with monitoring data to investigate the impact of human activity pattern changes on air quality [1]. The result shows a notable reduction in the concentrations of PM2.5, NO2, and SO2 during Level I and Level II lockdown periods compared with 2019. However, ozone did not show any indicative reduction. Similar research work with air quality data (2017–2020) in 22 cities of India analyzes the effect of restricted human mobility and reports 43%, 31%, 10%, and 18% decreases in the concentration of PM2.5, PM10, CO, and NO2 in the study cities during lockdown period compared to previous years [2]. In the same note, Zambrano-Monserrate et al. show significant association between contingency measures and improvement in air quality revolve around the reduction of PM2.5 and NO2 concentrations in China, France, Germany, Spain, and Italy during the lockdown phases in the study countries [3]. Another interesting study analyzed recent data released by National Aeronautics and Space Administration (NASA) and European Space Agency (ESA) and indicated that concentrations of NO2 in some of the epicenters of COVID-19 such as Wuhan, Italy, Spain, and USA has reduced up to 30% during the different stages of nationwide lockdowns [4].
As air pollution is related to climatic and human factors, modeling the dynamics of their concentration in space and in time is a complex task. However, with a significant reduction in human activities in many countries, the presence of the COVID-19 pandemic provides a unique opportunity to analyze, at least partially, the effect of human activities on air pollution levels. Studies focusing on the effect of restricted human activities due to the COVID-19 pandemic on air quality show comparisons of air pollution levels for a series of days in 2019 and compare with pollution levels for the same days in 2020 [5]. Selvam et al. in a recent study [6] compared pollution levels based on time trends along 2020 before and after the lockdown. In the same context, Adams in his study [7] compared pollution levels during the weeks of lockdown with pollution levels observed in the same time period in 2019. Goldberg [8] showed the existence of drops in NO2 levels in several US cities using transport and satellite data. Krecl et al. in their recent study [9] have reported similar findings for the city of Sao Paulo, and identical patterns were found by Wang [10] in six sites in China. Some studies focused on the spatiotemporal dynamics of the disease including environmental effects, socioeconomic factors, health service resources, and demographic conditions that vary from different counties in the United States [11].
The social behavior and working habits of people show spatial variation although they are difficult to measure. To assess adequately the changes in pollution levels due to the COVID-19 pandemic in the study region, it is essential to have access to reliable data sources. This leads us to rely on real-world data (RWD) that comes from diverse sources other than traditional randomized controlled trials (RCTs) [12]. In a recent report by the U.S. Food and Drug Administration (FDA) on Real-World Evidence (RWE) program under Section 505F(b) FD&C Act, RWD is defined as the data relating to patient health status and/or the delivery of health care routinely collected from a variety of sources (Cornell Law School web (https://www.law.cornell.edu/uscode/text/21/355)). After the 21st-Century Cures Act, passed in 2016, the health care community with the guidelines from the FDA is using RWD to develop guidelines and decision support tools for use in clinical practice and healthcare issues. RWD can be obtained from observational studies or from existing digital sources such as healthcare databases including electronic health records, pharmacies, and health insurance databases, etc. Data gathered from product and disease registries in mobile devices, patient-generated data including in home-use settings or, internet-based websites and applications that enable users to create and share in social networking mediums also considered as RWD and facilitates modern RWE research [13]. In the current study, we emphasized on the EHRs that contribute as an important source of RWD. We used the number of confirmed COVID-19 cases reported in nine counties in the state of New York, USA. Details of the RWD data source and concerned stakeholders are reported in Section 2.1.
According to a current COVID-19 pandemic report by the Centers for Disease Control and Prevention (CDC), USA, New York is the worst affected state in the United States of America [14]. Out of 62 counties of New York, counties having major cities with a high population are being affected the most [15]. In connection to this, the present study was conducted in the southern-most nine counties of New York namely, Bronx, Kings, Nassau, New York, Queens, Richmond, Rockland, Suffolk, and Westchester as shown in Figure 1. These counties are all in the vicinity of the New York city and have reported the highest number of deaths and confirmed cases of the virus during the COVID-19 pandemic [16].
Air pollution levels are suspected to be associated with the number of COVID-19 infected cases. Some studies claimed that prolonged exposure to air pollution may increase the vulnerability and mortality rates due to COVID-19, although the relative role of air pollution and aerosols in the spread of the virus and mortality rates is still under debate [17,18]. On the other hand, in most countries, once the number of cases has passed a given threshold value, social changes such as nationwide lockdown, work from home have resulted in a significant decrease in the traffic and transport needs for people, thus reducing automotive traffic as well as industrial pollution. The inclusion of time in the analysis has also been considered due to the time correlation in the data used in our analysis [19].
In this paper, we present the results of the analysis of the association between the number of COVID-19 cases with some variables related to meteorology and air pollution. Our analysis is based on fitting generalized linear mixed models (GLMM) using the air pollution variables (PM2.5 and O3) where the number of COVID-19 infected cases and meteorological variables are used as covariates for nine counties in the state of New York currently affected by the SARS-CoV-2 pandemic. Like other studies of this nature, we used the integrated nested Laplace approximation (INLA) methodology [20,21] and compared the results before and after the COVID-19 pandemic [22,23]. Most of the studies related to COVID-19 incidence and air pollution are based on comparisons between pollution levels the weeks before lockdown and during the lockdown. Others compare the air pollution levels during the COVID-19 lockdown with pollution levels the same days of lockdown but in previous years. Although such studies reported drops in pollution levels during the COVID-19 pandemic, their results cannot tell whether such reductions are the result of a long time trend due to pollution control measures or if they are the result of local climatic conditions during the COVID-19 lockdown in the city under study. In this context, it is noteworthy to mention about a recent study [24] analyzing the effects of the lockdown on air pollution in Athens, Greece during pre-, post-, and lockdown periods, as well as with respect to previous years in conjunction with meteorological parameters. Another interesting research work studied the ambiguous phenomena of severe haze pollution that occurred in northern China during the lockdown despite the abrupt decreases in gaseous emissions caused by record-low anthropogenic activities. The study shows in context to surface meteorology, that the severe air pollution episode over the study area coincided with the abnormally low planetary boundary layer (PBL) height, which triggered strong aerosol–PBL interactions [25].
In the current study, we present the results of the analysis of the association between air pollution levels as a response variable, with COVID-19 incidence and several meteorological factors as explanatory covariates. We fit a generalized linear mixed model (GLMM) which includes a spatial and a temporal term. The structure of this model allows to filter out the effect of meteorological variables as well as spatial variation and local time trends from the association between air pollution and COVID-19 incidence, providing a statistically more powerful test to the hypothesis of no association between the response and the covariates in our study.
Our goal is to assess the effect of changes in traffic density and industrial activities on air pollution measurements after filtering the effect of meteorological variables. We use the number of COVID-19 cases as a proxy for a reduction in automotive traffic and a decrease in industrial activities. Some recent studies [26,27] have shown a strong association (R2 > 0.89) between COVID-19 incidence and mobility. These authors showed that the higher the mobility the higher the number of contagions. Thus, due to the unavailability of mobility data for our study, we found it reasonable to use the number of new COVID-19 cases as a proxy for human mobility. Our analysis includes geographic space as a random effect [28].

2. Methods

2.1. Data Settings

The meteorological data for the study site were retrieved from the online Applied Climate Information System (ACIS) developed and maintained by the National Oceanic and Atmospheric Administration (NOAA) Regional Climate Centers (RCCs), USA [29]. ACIS is a joint project of the RCCs, the National Centers for Environmental Information (NCEI), and the National Weather Service. The accessed data set is based on the average (median) of several stations in the counties. It provides average daily records of five meteorological components like dew point (in degree Fahrenheit), humidity (in percent), precipitation (in inches), temperature (in degree Fahrenheit), and wind speed (in miles per hour).
The meteorological variables show variations per day as expected, and except for the temperature, there is no apparent trend in the time window of this study, which suggests that they may be assumed to be second order stationary. Figure 2 and Figure 3 show the temporal variation for the dew point and daily average temperature. Similar plots for all the current study counties are reported in the Appendix A, Figure A1, Figure A2 and Figure A3. The air quality dataset for the study area was collected from the open-portal Air Quality System (AQS) of the Environmental Protection Agency (EPA) of the United States of America [30]. Both air quality and meteorological data set are from 2 March 2020 to 2 May 2020. Except for Nassau County, the other counties have daily average records of two major air quality components such as particulate matter, fine particles with an aerodynamic diameter of 2.5 μm or less (PM2.5) in µg/m3, and ozone (O3) in mg/m3. O3 records were not available for Nassau County. Figure 4 and Figure 5 depict the temporal variation of the two air quality parameters expressed in logarithmic values in each county of the study region.
In context to the EHRs data source for RWD, the number of COVID-19 daily infected records were retrieved from the official website of the Department of Health, New York state [31], and verified from the open data repository of CDC [32]. Data for infected cases for all the counties were available from 2 March 2020 to 2 May 2020 as reported in Figure 6 for individual counties. All datasets used in the current study were collected from sources without restrictions and that have open access.

2.2. Statistical Methodology

Hierarchical Mixed Linear Model for COVID-19 Mortality

For Bayesian analysis, the association between PM2.5 and ozone with the number of new cases of COVID-19, we considered a set of different explanatory variables, besides the number of cases of COVID-19, namely temperature, dew point, humidity, wind speed, and precipitation. The environmental covariates are well known to affect air pollutant concentrations as well as human activities since for example, blizzards tend to make people stay at home and reduce automotive traffic. Our goal is not to compare the pollutant concentrations before and during the COVID-19 pandemic but to evaluate whether or not the observed changes in PM2.5 and ozone are directly linked to mobility reductions in human mobility in the study area, using the number of new COVID-19 cases as a proxy for human mobility.
In our context, spatiotemporal data can be idealized as realizations of a stochastic process indexed by a space and a time dimension.
Y ( s , t ) { y ( s , t ) | ( s , t ) D × T R 2 × R }
where D is a (fixed) subset of R 2 and T is a subset of R . The data can then be represented by a collection of observations y = { y ( s 1 , t 1 ) , , y ( s n , t n ) } , where the set ( s 1 , , s n ) indicates the spatial locations where the measurements are recorded, and ( t 1 , , t n ) are the corresponding time points. In this study the data came aggregated on a daily time basis, so t represents days. Our aim is to study the association between air pollution components (PM2.5, O3) as the response variables with the number of cases of COVID-19 and some meteorological factors as covariates, using hierarchical Bayesian analysis. We assumed that Y ( s t ) follows a log-normal distribution, this is, l n [ Y ( s , t ) ] N ( μ s , t , σ 2 ) . For the hierarchical modeling process, we use the canonical link function,
η s , t = g ( μ s , t ) = l n [ Y ( s , t ) ]
We assume a linear association of the response variable with the covariates of the form,
η s t = β 0 + M m = 1 β m z m , s t + L l = 1 f l ( ν l , s t )
where β = ( β 0 , β 1 , , β M ) are the coefficients that quantify the effect of covariates zj = (z1j, …, zMj) on the response, and f = {f1(.), …, fL(.)} is a collection of functions defined in terms of a set of covariates ν = (ν1, …, νL). From this definition, varying the form of the functions fl(.) we can estimate different kinds of models, from standard and hierarchical regression, to spatial and spatiotemporal models (Rue et al. 2009). The vector of parameters is represented by θ = {β0, β, fl}.
In our particular case we propose the model,
η s t = l n ( μ s t ) = β 0 + M m = 1 β m z m , s t + U s + γ t
where β j represents the heterogeneity, in segment j and time t, z α , i t are the covariates, β α the coefficients associated with covariates, U s is a two dimensional random field capturing the spatial dependence effect, and γ t is a one dimensional random process to capture the temporal effect. The term M m = 1 β m z m , s t represents the part of the overall trend in the response explained by the covariates. γ t is assumed to follow a random walk structure of order 1, thus accounting for local variation in time. This structure has the advantage of being able to capture trends and seasonality not accounted for by the covariates [33].
Using the covariates available, the full model takes the form
η s t = β 0 + β 1 z t e m p , s t + β 2 z w i n d , s t + β 3 z , s t + β 4 z r h , s t + β 5 z d e w , s t + β 6 z C O V I D 19 , s t + U s + γ t
We assumed Gaussian priors for the intercept and the coefficients for fixed effects with zero means and precisions equal to 0.001. The assumed prior for the precision τ = (1/σ2) of the spatial and temporal terms were Gamma with parameters 1 and 0.00005.
For the spatial covariance structure, we used the Matérn family, which specifies the covariance function as Σ i j = C o v ( θ i t , θ j u ) = σ C 2 M ( s i , s j ν , κ ) where σ C 2 > 0 is the variance component and
M ( ν , κ ) = 2 1 ν Γ ( ν ) ( κ h ) ν K ν ( κ h )
Controls the spatial correlation at distance h = s i s j . Here, Κ ν is a modified Bessel function of the second kind, κ > 0 is a spatial scale parameter and the smoothness parameter is ν > 0 . When ν + d 2 is an integer, a computationally efficient piecewise linear representation can be constructed by using a different representation of the Matérn field S ( j ) , namely as the stationary solution to the stochastic partial differential equation (SPDE) [34],
( κ 2 Δ ) α 2 s ( j ) = W ( s )
where α = ν + d / 2 is an integer, Δ = i = 1 d 2 s i 2 is the Laplacian operator and W ( s ) is spatial white noise.
The main idea of the SPDE approach consists in defining the continuously indexed Matérn GF X(s) as a discrete indexed GMRF by means of a basis function representation defined on a triangulation of the domain D,
S ( j ) = l = 1 n φ l ( s ) ω l
where n is the total number of vertices in the triangulation, { φ l ( s ) } is the set of basis function and { ω l } are zero-mean Gaussian distributed weights. Figure 7 shows two ways to build the triangulation needed to approximate a continuous Gaussian random field using the INLA-SPDE method [35]. The mesh on the left shows the triangulation when we ignore the boundary of the polygon of the study area D and instead use the convex hull defined by the coordinates of the data points. The plot on the right side of Figure 7 shows the triangulation obtained when we use the polygon defining the boundary of D.
The basis functions ϕ l ( s ) are not random, but rather were chosen to be piecewise linear on each triangle,
φ l ( s ) = { 1   a t   v e r t i c e   l   a n d   0   e l s e w h e r e }
The key step is to calculate { ω l } , which reports on the value of the spatial field at each vertex of the triangle. The values inside the triangle will be determined by linear interpolation [34].
Thus, expression (6) is an explicit link between the Gaussian field S(j) and the Gaussian Markov random field and defined by the Gaussian weights { ω l } that can be given by a Markovian structure.
The temporal dependence (on t) is assumed smoothed functions, in particular random walks of order 1 [36]. Thus, the random walk model of order 1 (RW1) for the Gaussian vector γ = ( γ 1 , , γ t ) is constructed assuming independent increments:
γ t γ t 1   N ( γ t 1 , τ t 1 )
For the spatial effect in models is used SPDE. In Figure 7, some of the possibilities are presented.
Once the models have been obtained, they can be compared using the deviance information criterion (DIC) [37], which is a Bayesian model comparison criterion given by
D I C = g o o d n e s s   o f   f i t + c o m p l e x i t y = D ( θ _ ) + 2 p D
where D ( θ _ ) is the deviance evaluated at the posterior mean of the parameters and p D denotes the effective number of parameters, which measures the complexity of the model. When the model is true, D ( θ _ ) should be approximately equal to the effective degrees of freedom, n p D , and DIC may under-penalise complex models with many random effects.
On the other hand, the conditional predictive ordinate (CPO) [38] is also analyzed. This expresses the posterior probability of observing the value (or set of values) when the model is fitted to all the data except y i
C P O = π ( y i o b s | y i )
Here, y i denotes the observations y with the ith component removed. This facilitates computation of the cross-validated logscore [39] for model choice ( ( m e a n ( l n ( C P O ) ) ) ) .
Therefore, the lowest values of DIC and ( ( m e a n ( l n ( C P O ) ) ) ) suggest the model with the best fit. A large number of parameters means more complexity. The best models are those with a high level of complexity and a high goodness-of-fit.

3. Results

Figure 8 shows the scatter plots of the number of daily COVID-19 new cases against pollutant concentrations for two selected counties (Bronx and Suffolk). Similar plots for all the current study counties are reported in the Appendix A, Figure A4 and Figure A5. For Bronx only, daily data for PM2.5 and ozone were available. The selected plots suggest the existence of a slight association of the PM2.5 and ozone concentrations with the appearance of new cases of COVID-19. It appears to be a positive association between ozone and COVID-19 new cases and a decreasing association with PM2.5 and CO. Pearson correlation between pollutant concentration and the number of new cases of COVID-19 in the different counties was also low, corroborating the presence of a weak association. A state of emergency for the State of New York was declared on 7 March 2020. In compliance with this declaration, all nonessential activities were shut down. This included the closing of businesses, offices, and schools at all levels, and banned the gathering of public events and meetings with more than 50 people. It also included a stay at home order to the population, but it was not mandatory nor enforced by law officers. People thus had some mobility to go to grocery stores, visit hospitals and doctors’ offices, walk their dogs, and go to laundromats. People could even go to enjoy the outdoors and do other activities in open spaces (https://www.theguardian.com/us-news/2020/mar/20/new-york-90-day-stay-home-order-what-it-means). Although traffic and transport were reduced, the “nonmandatory” stay at home order makes it difficult to predict if the variation of pollutant levels during the pre- and lockdown phases were the result of traffic reduction associated with the lockdown.
The results for the hierarchical models fitted for each pollutant by county are reported in Table 1 and Table 2. In total, 11 models were fitted, where the rows correspond to the fitted model number, and the columns to the covariates available for inclusion in the different models. The white color cells depict the covariates actually included in each model as well as the significant coefficient estimates obtained in boldface. Some models included only the COVID-19 new cases, the number of confirmatory tests performed in the study area, and space and time variation terms, other models included only the meteorological covariates, and the rest included some combination of both groups of covariates. This obeyed the presence of collinearity in the covariates, which resulted in changes in the regression coefficient signs depending on the covariates included in the different models. As the number of covariates was relatively high and because there are no automatic variable selection algorithms implemented in the INLA method, we only tested some combinations of covariates that in our perception were of interest. Table 3 and Table 4 show the test statistics for the models fitted for PM2.5 and ozone, respectively. The tables show the DIC and CPO values which are the most commonly used diagnostics for model quality [40]. From the values in Table 3 we see that the best model is model 11, which includes meteorological covariates, affected, plus spatial and time dependence of PM2.5 concentrations. The effect of daily new COVID-19 positive cases is significant, but the coefficient for this covariate is substantially small. For the rest of the models fitted to PM2.5, some covariates were statistically different from zero, but these are not the same effect in model 11 in terms of the diagnostic statistics.
Figure 9 shows the plots of observed vs. fitted PM2.5 values obtained from models 9 (left plot) and 11 (right plot). Figure 10 depicts the plots of observed vs. fitted O3 values (in mg/m3) for models 9 (left plot) and 11 (right plot). Besides the DIC and CPO values, the plots also support the conclusion that the models provide an acceptable fit to the data and that despite the observed patterns in Figure 8, the spatial and temporal variation observed in PM2.5 is not strongly associated with the appearance of new cases of COVID-19. This lack of association may be the result of the absence of strong measures against the COVID-19 pandemic given that the study area had not a law enforced lockout. Another factor might be that sources of PM2.5 remained at normal activity levels, although we have no information to confirm this hypothesis.
Table 3 presents the estimates of the models fitted to the ozone concentrations in the study area. In this case, the model 11 is the best of all models under the DIC and CPO criteria and includes all the covariates.
For model 9, the coefficient for the effect of COVID-19 new cases on the ozone concentration was significant albeit it has a small value ( β C O V I D = 0.005 ). The inclusion of the meteorological covariates in the model for this pollutant reduced the value for the β C O V I D coefficient to a point that, albeit significant, its effect on the response variable is negligible.

4. Discussion

After the outbreak of the COVID-19 scientists all over the world started an unprecedented effort to understand different aspects of the pandemic. The lockdown decrees in many countries provided a unique opportunity to compare the levels of ozone, and particulate matter in urban areas under a reduced influence of human activities. Some of such studies have based their comparisons on point locations [5,9,41] whilst others have used aerial data to make comparisons in pollutant concentrations [8,10]. Ozone spatial and temporal distribution is closely related to NO2 concentrations, although its dynamics are more difficult to model. NO2 concentrations were not used as a response variable due to the lack of this information in our data. Thus, we cannot have a deep discussion about reductions of this pollutant in our study area and its association with human mobility in the nine counties considered. However, our goal was not to model the spatiotemporal dynamics of ozone in the study area, but, unlike other analyses where comparisons of pollutant concentrations during the COVID-19 pandemic have been reported, our aim was to measure through a GLMM test the association of PM2.5 and ozone with COVID-19 new daily cases after filtering out the effect of meteorological variables. The quantification of such association is represented by the corresponding regression coefficient estimates in the GLMM fitted. When only the COVID-19 new cases are included as a covariate along with the temporal and spatial components, the regression coefficient in most of the cases are 0.003 and 0.004 (Table 1), it is thus expected an increase of 0.3–0.4% in PM2.5 concentration for each new COVID-19 case. Note that we are not implying that COVID-19 cases bring an increase in air pollution, but that given the strong correlation between new COVID-19 and mobility, the result implies that an increase in mobility results in an increase in PM2.5 concentration.
We used a generalized linear model with a spatial and a temporal component to account for the effect of spatial and temporal association in the variance of the estimates, which reduces the number of false rejections of significant results [42]. Modeling air pollution is a complex task due to the multiple factors that affect pollutant concentrations at different scales. Albeit their limitations, the models we presented here are useful to gain insight on the possible effect that the reduction of human activities may have on PM2.5 and ozone concentrations in an urbanized area. For PM2.5 and O3, all the inclusion of covariates in the model, improved the fit as measured by the DIC and CPO, the usual statistics to compare model quality in a Bayesian setting. However, the sparse spatial distribution of the covariate data used in the models explains in part the slight association between air pollutants and the number of new cases reported of COVID-19 we found. However, the correlation between the observed and predicted data from the models is indicative that model quality is acceptable but that models could be improved. Such improvements may come from obtaining the covariate and response information from a finer spatial scale or by posting a better functional relationship between the pollutant concentration and the covariates.
Linear models are a useful tool to measure the association between a response variable and a set of covariates. The GLMM model we used allows measuring the association between the concentrations of PM2.5 and ozone with the number of new cases of COVID-19 after filtering out the effects of meteorological variables that explain part of the observed variability of PM2.5 and ozone in the study area. By filtering such effects, we are able to tell that although there was a reduction in the concentrations of these two pollutants, only a small part of such reduction is explained by the number of COVID-19 new cases, and hence due to a reduction of mobility. The term “linear” refers to linearity in the model parameters and not in the covariates [43]. Linear models are sensitive to misspecification of the linearity between the response and the covariates. However, the exploratory data analysis made before the modeling process did not show evidence of nonlinearity between PM2.5 or ozone with the covariates. The inclusion of spatial and temporal terms in the models we fitted has helped to filter out the effect of spatial and temporal variability of the covariates as well, allowing us to obtain the proper power for statistical hypothesis tests, a key property of spatiotemporal statistical modeling [44]. The model results have shown the existence of a reduction in concentrations of ozone in the study area but after filtering out the meteorological covariates such reductions have only a slight association to COVID-19 new cases. Ozone is a by-product of complex interactions between heat sources and atmospheric nitrogen in different forms, mainly nitrogen oxides, and is highly associated with automotive traffic in urban areas [45]. PM2.5 on the other hand, is related to industrial activity and to carbon emissions by diesel engines that power trucks and buses used in public transportation. Although the lockdown decree in the New York City area reduced significatively human mobility, our model results show that the reduction in PM2.5 and ozone observed in our study area is only slightly associated with changes in human mobility, as measured through its association with COVID-19 new cases. However, the current study is not comparing the values of pollutant data during pre-lockdown or in previous years, and can be incorporated in future studies in this domain. However, similar results are observed with the findings of Zangari et al. [46], who found that reductions in NO2 and PM2.5 during the COVID lockdown in the State of New York have little association with reductions in mobility and point out that such reductions are more likely associated to a constant reduction of those pollutants in the atmosphere due to actions taken by authorities in previous years and to weather variables. These authors also mention the spatial variability in the NO2 and PM2.5 reductions across the state. The lockdown imposed in many cities around the world resulted in notorious reductions in human mobility [47]. The New York City transportation system reported reductions in human mobility up to 60% from March to June 2020 [48]. Unfortunately, the daily data were not available to us for the nine counties considered in our study, and this key information was not included in our models.
In recent years, RWD from routine healthcare settings, like EHR powered by statistical analysis and machine learning techniques, produces RWE [49].
It provides insight adding potential to identify new indications in a real-world perspective to make strategic healthcare decisions beyond traditional clinical trials [50]. In context to this, the results of our study have contributed to rationalize the conjecture that a decrease in human-related air pollution results in a positive impact in nature, using RWD and providing a contribution to RWE for future decisions in the pollution-related health care issues and control measures.

5. Conclusions

In this work, we found that the number of new COVID-19 cases in nine counties in New York State has had little influence on the spatiotemporal distribution of both PM2.5 and O3 concentrations, once the observed confounders (meteorological variables), as well as spatial and temporal dependency, were controlled. Despite the declaration of strict lockout for the population in the New York area and the concomitant reduction of human mobility, the observed association was not as strong as those reported by other scientists. The main difference between our results and others reported in the literature is that other authors have done comparisons of pollutant concentrations during the pandemic with previous time periods. We undertook a longitudinal analysis of PM2.5 and ozone atmospheric concentrations with COVID-19 new cases and meteorological factors. Our results are valid at local time and spatial scales. The increase in the number of new COVID-19 cases observed after the reopening of economic activities results in an increase in human mobility. This poses a big opportunity to test if pollution levels increase again.
The models we proposed in this work are useful to test the new observed trends. As COVID-19 contagion is influenced by people’s social activities and mobility, the authorities should consider tightening confinement. Finally, the popular claim that the increase in COVID-19 new cases brings, as a consequence, a reduction in air pollution levels associated with reduced human mobility is reflected in our study area although this reduction is not as strong as expected.

Author Contributions

Conceptualization, L.S., P.J. and C.D.-A.; methodology, P.J, M.S.; software, S.C.; validation, L.S., P.J and S.C.; formal analysis, L.S. and M.S.; resources, S.C.; data curation, L.S., P.J and S.C.; writing—original draft preparation, L.S., C.D.-A., P.J and M.S.; writing—review and editing, L.S., P.J, S.C. and C.D.-A.; funding acquisition, M.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

This work is part of the ‘Cohort-Real World Data’ subprogram of the CIBER of Epidemiology and Public Health (CIBERESP). Carlos Díaz-Avalos was partially supported by grant PAPIIT-UNAM IG100221.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Figure A1. Variation of daily average humidity for individual counties.
Figure A1. Variation of daily average humidity for individual counties.
Ijerph 17 09055 g0a1
Figure A2. Variation of daily average precipitation for individual counties.
Figure A2. Variation of daily average precipitation for individual counties.
Ijerph 17 09055 g0a2
Figure A3. Variation of daily average wind speed for individual counties.
Figure A3. Variation of daily average wind speed for individual counties.
Ijerph 17 09055 g0a3
Figure A4. Scatter plots for the number of daily COVID-19 new cases vs. PM2.5 (in µg/m3) represented in natural logarithmic values for individual counties.
Figure A4. Scatter plots for the number of daily COVID-19 new cases vs. PM2.5 (in µg/m3) represented in natural logarithmic values for individual counties.
Ijerph 17 09055 g0a4
Figure A5. Scatter plots for the number of daily COVID-19 new cases vs. ozone (in mg/m3) represented in natural logarithmic values for individual counties.
Figure A5. Scatter plots for the number of daily COVID-19 new cases vs. ozone (in mg/m3) represented in natural logarithmic values for individual counties.
Ijerph 17 09055 g0a5

References

  1. Li, L.; Li, Q.; Huang, L.; Wang, Q.; Zhu, A.; Xu, J.; Liu, Z.; Li, H.; Shi, L.; Li, R.; et al. Air quality changes during the COVID-19 lockdown over the Yangtze River Delta Region: An insight into the impact of human activity pattern changes on air pollution variation. Sci. Total Environ. 2020, 732, 139282. [Google Scholar] [CrossRef]
  2. Sharma, S.; Zhang, M.; Gao, J.; Zhang, H.; Kota, S.H. Effect of restricted emissions during COVID-19 on air quality in India. Sci. Total Environ. 2020, 728, 138878. [Google Scholar] [CrossRef]
  3. Zambrano-Monserrate, M.A.; Ruano, M.A.; Sanchez-Alcalde, L. Indirect effects of COVID-19 on the environment. Sci. Total Environ. 2020, 728, 138813. [Google Scholar] [CrossRef]
  4. Muhammad, S.; Long, X.; Salman, M. COVID-19 pandemic and environmental pollution: A blessing in disguise? Sci. Total Environ. 2020, 728, 138820. [Google Scholar] [CrossRef] [PubMed]
  5. Dutheil, F.; Baker, J.S.; Navel, V. COVID-19 as a factor influencing air pollution? Environ. Pollut. (Barking Essex 1987) 2020, 263 Pt A, 114466. [Google Scholar] [CrossRef]
  6. Selvam, S.; Muthukumar, P.; Venkatramanan, S.; Roy, P.D.; Manikanda Bharath, K.; Jesuraja, K. SARS-CoV-2 pandemic lockdown: Effects on air quality in the industrialized Gujarat state of India. Sci. Total Environ. 2020, 737, 140391. [Google Scholar] [CrossRef] [PubMed]
  7. Adams, M.D. Air pollution in Ontario, Canada during the COVID-19 State of Emergency. Sci. Total Environ. 2020, 742, 140516. [Google Scholar] [CrossRef] [PubMed]
  8. Goldberg, D.L.; Anenberg, S.C.; Griffin, D.; McLinden, C.A.; Lu, Z.; Streets, D.G. Disentangling the impact of the COVID-19 lockdowns on urban NO2 from natural variability. Geophys. Res. Lett. 2020, 47, e2020GL089269. [Google Scholar] [CrossRef] [PubMed]
  9. Krecl, P.; Targino, A.C.; Oukawa, G.Y.; Cassino Junior, R.P. Drop in urban air pollution from COVID-19 pandemic: Policy implications for the megacity of São Paulo. Environ. Pollut. (Barking Essex 1987) 2020, 265 Pt B, 114883. [Google Scholar] [CrossRef]
  10. Wang, Y.; Wen, Y.; Wang, Y.; Zhang, S.; Zhang, K.M.; Zheng, H.; Xing, J.; Wu, Y.; Hao, J. Four-Month Changes in Air Quality during and after the COVID-19 Lockdown in Six Megacities in China. Environ. Sci. Technol. Lett. 2020. [Google Scholar] [CrossRef]
  11. Wang, M.; Jiang, A.; Gong, L.; Luo, L.; Guo, W.; Li, C.; Zheng, J.; Li, C.; Yang, B.; Zeng, J.; et al. Temperature significant change COVID-19 Transmission in 429 cities. medRxiv 2020. [Google Scholar] [CrossRef] [Green Version]
  12. Makady, A.; de Boer, A.; Hillege, H.; Klungel, O.; Goettsch, W. What Is Real-World Data? A Review of Definitions Based on Literature and Stakeholder Interviews. Value Health 2020, 20, 858–865. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. RWE Navigator. 2020. Available online: https://rwe-navigator.eu/use-real-world-evidence/sources-of-real-world-data/ (accessed on 15 September 2020).
  14. Centers for Disease Control and Prevention, CDC. Cases, Data, and Surveillance. 2020. Available online: https://www.cdc.gov/coronavirus/2019-ncov/cases-updates/ (accessed on 2 June 2020).
  15. New York State, NYC. Information on Novel Corona, NYC. 2020. Available online: https://coronavirus.health.ny.gov/latest-news (accessed on 21 May 2020).
  16. Johns Hopkins University. COVID-19 United States Cases by County—Johns Hopkins Coronavirus Resource Center. 2020. Available online: https://coronavirus.jhu.edu/us-map (accessed on 2 June 2020).
  17. Conticini, E.; Frediani, B.; Caro, D. Can atmospheric pollution be considered a co-factor in extremely high level of SARS-CoV-2 lethality in Northern Italy? Environ. Pollut. 2020, 261, 114465. [Google Scholar] [CrossRef] [PubMed]
  18. Contini, D.; Costabile, F. Does Air Pollution Influence COVID-19 Outbreaks? Atmosphere 2020, 11, 377. [Google Scholar] [CrossRef] [Green Version]
  19. Ceylan, Z. Estimation of COVID-19 prevalence in Italy, Spain, and France. Sci. Total Environ. 2020, 729, 138817. [Google Scholar] [CrossRef] [PubMed]
  20. Briz-Redón, Á.; Serrano-Aroca, Á. A spatio-temporal analysis for exploring the effect of temperature on COVID-19 early evolution in Spain. Sci. Total Environ. 2020, 728, 138811. [Google Scholar] [CrossRef] [PubMed]
  21. Saez, M.; Tobias, A.; Varga, D.; Barceló, M.A. Effectiveness of the measures to flatten the epidemic curve of COVID-19. The case of Spain. Sci. Total Environ. 2020, 727, 138761. [Google Scholar] [CrossRef]
  22. Tobías, A.; Carnerero, C.; Reche, C.; Massagué, J.; Via, M.; Minguillón, M.C.; Alastuey, A.; Querol, X. Changes in air quality during the lockdown in Barcelona (Spain) one month into the SARS-CoV-2 epidemic. Sci. Total Environ. 2020, 726, 138540. [Google Scholar] [CrossRef]
  23. Núñez-Delgado, A. What do we know about the SARS-CoV-2 coronavirus in the environment? Sci. Total Environ. 2020, 727, 138647. [Google Scholar] [CrossRef]
  24. Grivas, G.; Athanasopoulou, E.; Kakouri, A.; Bailey, J.; Liakakou, E.; Stavroulas, I.; Kalkavouras, P.; Bougiatioti, A.; Kaskaoutis, D.; Ramonet, M.; et al. Integrating in situ Measurements and City Scale Modelling to Assess the COVID-19 Lockdown Effects on Emissions and Air Quality in Athens, Greece. Atmosphere 2020, 11, 1174. [Google Scholar] [CrossRef]
  25. Su, T.; Li, Z.; Zheng, Y.; Luan, Q.; Guo, J. Abnormally shallow boundary layer associated with severe air pollution during the COVID-19 lockdown in China. Geophys. Res. Lett. 2020. [Google Scholar] [CrossRef] [PubMed]
  26. Iacus, S.M.; Santamaria, C.; Sermi, F.; Spyratos, S.; Tarchi, D.; Vespe, M. Human mobility and COVID-19 initial dynamics. Nonlinear Dyn. 2020, 101, 1901–1919. [Google Scholar] [CrossRef] [PubMed]
  27. Cartenì, A.; Francesco, L.D.; Martino, M. How mobility habits influenced the spread of the COVID-19 pandemic: Results from the Italian case study. Sci. Total Environ. 2020, 741, 140489. [Google Scholar] [CrossRef]
  28. Lindgren, F.; Rue, H. Bayesian spatial modelling with R-INLA. J. Stat. Softw. 2015, 63, 1–25. [Google Scholar] [CrossRef] [Green Version]
  29. National Weather Service Forecast Office, New York. NOWData. 2020. Available online: https://w2.weather.gov/climate/xmacis.php?wfo=okx (accessed on 2 June 2020).
  30. United States Environmental Protection Agency, US EPA. Outdoor Air Quality Data. 2020. Available online: https://www.epa.gov/outdoor-air-quality-data/download-daily-data (accessed on 2 June 2020).
  31. New York State, NYC. New York State COVID-19 Data. 2020. Available online: https://data.ny.gov/browse?tags=covid-19 (accessed on 2 June 2020).
  32. Centers for Disease Control and Prevention, CDC. Cases Deaths by County|CDC. 2020. Available online: https://www.cdc.gov/coronavirus/2019-ncov/cases-updates/county-map.html (accessed on 2 June 2020).
  33. Cameletti, M.; Blangiardo, M. Spatial and Spatio-Temporal Bayesian Models with R—INLA; John Wiley Sons, Inc.: Hoboken, NJ, USA, 2015; pp. 235–258. ISBN 9781118950203. [Google Scholar]
  34. Lindgren, F.; Rue, H.; Lindstrom, J. An explicit link between Gaussian fields and Gaussian Markov random fields the SPDE approach. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 2011, 73, 423–498. [Google Scholar] [CrossRef] [Green Version]
  35. Illian, J.B.; Sørbye, S.H.; Rue, H. A toolbox for fitting complex spatial point process models using integrated nested Laplace approximation (INLA). Ann. Appl. Stat. 2012, 6, 1499–1530. [Google Scholar] [CrossRef] [Green Version]
  36. R-INLA Project. 2020. Available online: http://www.r-inla.org/home (accessed on 17 April 2020).
  37. Spiegelhalter, D.J.; Best, N.G.; Carlin, B.P. Bayesian measures of model complexity and fit. J. R. Stat. Soc. 2002, 64, 583–639. [Google Scholar] [CrossRef] [Green Version]
  38. Pettit, A.L.I. The conditional predictive ordinate for the normal distribution. J. R. Stat. Soc. Ser. B 1990, 52, 175–184. [Google Scholar] [CrossRef]
  39. Gneiting, T.; Raftery, A.E. Strictly Proper Scoring Rules, Prediction, and Estimation. J. Am. Stat. Assoc. 2007, 102, 359–378. [Google Scholar] [CrossRef]
  40. Rue, H.; Martino, S.; Chopin, N. Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 2009, 71, 319–392. [Google Scholar] [CrossRef]
  41. Singh, V.; Singh, S.; Biswal, A.; Kesarkar, A.P.; Mor, S.; Ravindra, K. Diurnal and temporal changes in air pollution during COVID-19 strict lockdown over different regions of India. Environ. Pollut. (Barking Essex 1987) 2020, 266 Pt 3, 115368. [Google Scholar] [CrossRef]
  42. Cressie, N. Statistics for Spatial Data; John Wiley Sons, Inc.: Hoboken, NJ, USA, 1993; pp. 277–379. ISBN 9781119115151. [Google Scholar]
  43. Seber, G.A.F.; Lee, A.A.F. Linear Regression Analysis; John Wiley Sons, Inc.: Hoboken, NJ, USA, 2003; pp. 4–5. ISBN 10: 0471415405. [Google Scholar]
  44. Cressie, N.; Wikle, C.K. Statistics for Spatio-Temporal Data; John Wiley Sons, Inc.: Hoboken, NJ, USA, 2013; pp. 297–356. ISBN 978-0-471-69274-4. [Google Scholar]
  45. Manisalidis, I.; Stavropoulou, E.; Stavropoulos, A.; Bezirtzoglou, E. Environmental and Health Impacts of Air Pollution: A Review. Front. Public Health 2020, 8. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Zangari, S.; Hill, D.T.; Charette, A.T.; Mirowsky, J.E. Air Quality changes in New York City during the COVID-19 pandemic. Sci. Total Environ. 2020, 742. [Google Scholar] [CrossRef]
  47. Warren, M.S.; Skillman, S.W. Mobility changes in response to COVID-19. arXiv 2020, arXiv:2003.14228. [Google Scholar]
  48. University Transportation Research Center, The City College of New York. Mobility Trends in New York City During COVID-19 Pandemic: Analyses of Transportation Modes Throughout 13 June 2020. Available online: https://www.nyctaxinews.com/Mobility-Report-May2020.pdf (accessed on 14 June 2020).
  49. Zou, K.H.; Li, J.Z.; Imperato, J.; Potkar, C.N.; Sethi, N.; Edwards, J.; Ray, A. Harnessing Real-World Data for Regulatory Use and Applying Innovative Applications. J. Multidiscip. Healthc. 2020, 13, 671–679. [Google Scholar] [CrossRef] [PubMed]
  50. Makady, A.; Ham, R.T.; de Boer, A.; Hillege, H.; Klungel, O.; Goettsch, W. GetReal Work Package Policies for Use of Real-World Data in Health Technology Assessment (HTA): A Comparative Study of Six HTA Agencies. Value Health 2017, 20, 520–532. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Study area (nine counties in the southernmost region of New York State).
Figure 1. Study area (nine counties in the southernmost region of New York State).
Ijerph 17 09055 g001
Figure 2. Variation of daily average dew point for individual counties.
Figure 2. Variation of daily average dew point for individual counties.
Ijerph 17 09055 g002
Figure 3. Variation of daily average temperature for individual counties.
Figure 3. Variation of daily average temperature for individual counties.
Ijerph 17 09055 g003
Figure 4. Variation of the daily average concentration of particulate matter PM2.5 (in µg/m3) in the natural logarithmic scale for individual counties.
Figure 4. Variation of the daily average concentration of particulate matter PM2.5 (in µg/m3) in the natural logarithmic scale for individual counties.
Ijerph 17 09055 g004
Figure 5. Variation of the daily average concentration of ozone (in mg/m3) in natural logarithmic scale for individual counties.
Figure 5. Variation of the daily average concentration of ozone (in mg/m3) in natural logarithmic scale for individual counties.
Ijerph 17 09055 g005
Figure 6. Variation of daily confirmed COVID-19 infected cases for individual counties.
Figure 6. Variation of daily confirmed COVID-19 infected cases for individual counties.
Ijerph 17 09055 g006
Figure 7. Stochastic partial differential equation (SPDE) mesh without boundary (top) and with the boundary of the study region (bottom). Locations of the weather stations in the study counties are highlighted as red circles. Blue line depicts the boundary region for the entire study area.
Figure 7. Stochastic partial differential equation (SPDE) mesh without boundary (top) and with the boundary of the study region (bottom). Locations of the weather stations in the study counties are highlighted as red circles. Blue line depicts the boundary region for the entire study area.
Ijerph 17 09055 g007
Figure 8. Scatter plots for the number of daily COVID-19 new infected cases vs. logarithmic value of PM2.5 concentrations (measured in µg/m3) (upper panel) and logarithmic value of ozone concentrations (measured in mg/m3) (lower panel) for two selected counties Bronx and Suffolk. The red line depicts a Locally weighted scatterplot smoothing (Lowess) for the scattered data plot. Similar plots for all the current study counties are reported in the Appendix A, Figure A4 and Figure A5.
Figure 8. Scatter plots for the number of daily COVID-19 new infected cases vs. logarithmic value of PM2.5 concentrations (measured in µg/m3) (upper panel) and logarithmic value of ozone concentrations (measured in mg/m3) (lower panel) for two selected counties Bronx and Suffolk. The red line depicts a Locally weighted scatterplot smoothing (Lowess) for the scattered data plot. Similar plots for all the current study counties are reported in the Appendix A, Figure A4 and Figure A5.
Ijerph 17 09055 g008
Figure 9. Plots of observed vs. fitted PM2.5 values (in µg/m3) for models 9 (left) and 11 (right). The red line depicts the linear regression between the observed and the predicted values.
Figure 9. Plots of observed vs. fitted PM2.5 values (in µg/m3) for models 9 (left) and 11 (right). The red line depicts the linear regression between the observed and the predicted values.
Ijerph 17 09055 g009
Figure 10. Plots of observed vs. fitted O3 values (in mg/m3) for models 9 (left) and 11 (right). The red line depicts the linear regression between the observed and the predicted values.
Figure 10. Plots of observed vs. fitted O3 values (in mg/m3) for models 9 (left) and 11 (right). The red line depicts the linear regression between the observed and the predicted values.
Ijerph 17 09055 g010
Table 1. Significant variable coefficients of 11 fitted models (for PM2.5).
Table 1. Significant variable coefficients of 11 fitted models (for PM2.5).
ModelMeteorological FactorsAffected
TDewHWsPrecNew
Pos
SpaceTime
1
2 0.003
3
4 0.004
50.068−0.0520.0220.010−0.086
6 0.003
70.068−0.0520.0220.010−0.086
8 0.004
9
100.061−0.0470.0230.050−0.046
110.060−0.0480.0230.053−0.0390.000
Bold if value is significant and grey not in model.
Table 2. Significant variable coefficients of 11 fitted models (for O3).
Table 2. Significant variable coefficients of 11 fitted models (for O3).
ModelMeteorological FactorsAffected
TDewHWsPrecNew PosSpaceTime
1
2 0.004
3
4 0.005
50.077−0.0740.0350.015−0.005
6 0.004
70.077−0.0740.0350.015−0.005
8
9 0.005
100.077−0.0730.0340.016−0.021
110.076−0.0730.0350.018−0.0050.000
Bold if value is significant and grey not in model.
Table 3. Deviance information criterion (DIC) and conditional predictive ordinate (CPO) of models (for PM2.5).
Table 3. Deviance information criterion (DIC) and conditional predictive ordinate (CPO) of models (for PM2.5).
MODELDICCPO
12591.322.50
22232.892.16
32591.432.50
41983.991.92
5747.140.72
62232.812.15
7747.000.72
81983.811.92
92591.302.50
10261.630.27
11257.430.27
Table 4. Deviance information criterion (DIC) and conditional predictive ordinate (CPO) of models (for O3).
Table 4. Deviance information criterion (DIC) and conditional predictive ordinate (CPO) of models (for O3).
MODELDICCPO
12371.414.88
22011.632.25
31869.862.09
4191.400.26
52011.632.19
6191.240.24
72371.292.66
81869.692.09
9174.750.22
10261.630.27
11165.530.22
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Díaz-Avalos, C.; Juan, P.; Chaudhuri, S.; Sáez, M.; Serra, L. Association between the New COVID-19 Cases and Air Pollution with Meteorological Elements in Nine Counties of New York State. Int. J. Environ. Res. Public Health 2020, 17, 9055. https://doi.org/10.3390/ijerph17239055

AMA Style

Díaz-Avalos C, Juan P, Chaudhuri S, Sáez M, Serra L. Association between the New COVID-19 Cases and Air Pollution with Meteorological Elements in Nine Counties of New York State. International Journal of Environmental Research and Public Health. 2020; 17(23):9055. https://doi.org/10.3390/ijerph17239055

Chicago/Turabian Style

Díaz-Avalos, Carlos, Pablo Juan, Somnath Chaudhuri, Marc Sáez, and Laura Serra. 2020. "Association between the New COVID-19 Cases and Air Pollution with Meteorological Elements in Nine Counties of New York State" International Journal of Environmental Research and Public Health 17, no. 23: 9055. https://doi.org/10.3390/ijerph17239055

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop