Next Article in Journal
“Does a Good Firm Diminish the Bad Behavior of Its Employees?”: The Sequential Mediation Effect of Organizational Trust and Organizational Commitment, and the Moderation Effect of Work Overload
Next Article in Special Issue
A Multilevel Analysis of the Associated and Determining Factors of TB among Adults in South Africa: Results from National Income Dynamics Surveys 2008 to 2017
Previous Article in Journal
Health Literacy Level and Comprehension of Prescription and Nonprescription Drug Information
Previous Article in Special Issue
Potential Energy as an Alternative for Assessing Lower Limb Peak Power in Children: A Bayesian Hierarchical Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Model for Highly Fluctuating Spatio-Temporal Infection Data, with Applications to the COVID Epidemic

School of Geography, Queen Mary University of London, Mile End Rd., London E1 4NS, UK
Int. J. Environ. Res. Public Health 2022, 19(11), 6669; https://doi.org/10.3390/ijerph19116669
Submission received: 4 May 2022 / Revised: 26 May 2022 / Accepted: 27 May 2022 / Published: 30 May 2022
(This article belongs to the Special Issue Applied Bayesian Data Analysis in Exercise and Health Research)

Abstract

:
Spatio-temporal models need to address specific features of spatio-temporal infection data, such as periods of stable infection levels (endemicity), followed by epidemic phases, as well as infection spread from neighbouring areas. In this paper, we consider a mixture-link model for infection counts that allows alternation between epidemic phases (possibly multiple) and stable endemicity, with higher AR1 coefficients in epidemic phases. This is a form of regime-switching, allowing for non-stationarity in infection levels. We adopt a generalised Poisson model appropriate to the infection count data and avoid transformations (e.g., differencing) to alternative metrics, which have been adopted in many studies. We allow for neighbourhood spillover in infection, which is also governed by adaptive regime-switching. Compared to existing models, the observational (in-sample) model is expected to better reflect the balance between epidemic and endemic tendencies, and short-term extrapolations are likely to be improved. Two case study applications involve COVID area-time data, one for 32 London boroughs (and 96 weeks) since the start of the COVID epidemic, the other for a shorter time span focusing on the epidemic phase in 144 areas of Southeast England associated with the Alpha variant. In both applications, the proposed methods produce a better in-sample fit and out-of-sample short term predictions. The spatial dynamic implications are highlighted in the case studies.

1. Introduction

The context for modelling spatio-temporal infectious disease data is set by three major considerations. The first is the extent of instability in the data, with stable infection levels characterising endemic infections, but instability in infections that have epidemic phases. The second is the geographic variation in the infection trajectories, for example, some areas experienced earlier epidemic upturns. The third is the infection spillover from adjacent areas (when the spatial context involves a lattice framework such as administrative areas).
Many models of infectious data focus primarily on modelling and forecasting a single epidemic and its components (i.e., modelling the exponential ascent and subsequent descent). One widespread approach uses phenomenological models [1] and is usually based on national infection counts—these are typically fitted using nonlinear least squares with normality assumed for errors. These models are difficult to extend to multiphase epidemic data, which is when the observation span includes multiple epidemics [2,3]. However, as has become apparent with the COVID outbreak, there is a need for modelling multiphase epidemic data with intervening phases of relatively low infection.
Compartmental models [4] represent infectious disease in terms of separate compartments, with epidemic evolution via differential equations. They rely on assumed or estimated parameters to estimate an epidemic curve, but typically cannot explicitly model endemic and epidemic dynamics, especially for multiple waves [5].
Some models, typically also applied to national infection data, adopt theaAutoregressive integrated moving average (ARIMA) strategy [6,7,8]. These involve preliminary differencing or transformation of the data in order to achieve stationarity and also assume normal errors. Thus, essential features of the data are lost in the analysis.
It is argued in the research here that greater flexibility is provided if nonstationarity is explicitly present in the model and not “differenced away” by preliminary and often complex data manipulation. In explicitly allowing for nonstationarity, the model developed below provides an indicator of which phase or “regime” is predominant at a particular point in the infection time series. This is a form of regime-switching or alternation. Since this model typically reflects better the balance between epidemic and endemic tendencies than existing models, the in-sample fit is expected to improve and short-term extrapolations will also generally produce more accurate forecasts—this is demonstrated in two applied case studies.
Regime-switching has been used in other studies [9,10], though here it is implemented with a smooth mechanism governing regime alternation, rather than discrete switching of regimes. Discrete state switching applies to models assuming a latent Markov chain approach such as [11]. Studies also assume normal outcomes based on differencing population rates in successive time units. This assumption might become problematic for small infection counts when the areas have small populations.
Moreover, accounting for spatial differentiation in trends and epidemic upturn timing is important as well as modelling the multiphase aspects. There are so far few models that have attempted to explicitly model multiphase infection data for multiple areas. In a spatially disaggregated situation, infection counts during particular periods (e.g., between epidemic phases) may be small, and conventional approaches (e.g., transforming or differencing data converted to population rates and also assuming normality) are inappropriate. The models used here are appropriate to the form of the space–time count data. The models used are part of a broader “disease mapping” approach appropriate to count data and applicable to often small area infection counts, particularly in endemic phases [12,13].
Specifically, we develop here a model appropriate to area-specific multiphase count data, assuming Poisson sampling, albeit allowing for overdispersion in the form of a negative binomial. The approach provides a spatio-temporal regime-switching model adapted to small-area disease counts. As well as this feature, the model here includes disease spillover effects between neighbouring areas, a feature not present in many spatiotemporal infection models. The model outputs supply a wide range of information about infectious disease spread and waning, for example, parametric indicators of the relative balance between epidemicity and endemicity in each area and spillover infections from neighbouring areas. These indicators are not available in other models applied to area–time infection counts.
The model here has the benefit (unlike approaches based on ARIMA strategies) of avoiding the need to achieve stationarity by differencing and transformation. The analysis is done on a natural and interpretable scale, namely the infection counts [5].
The output of the model proposed here provides important details regarding the spatial dynamics of epidemics. It provides details about differential epidemic trajectories between areas, for example, in terms of where early epidemic upturns (or early downturns from epidemic peaks) are concentrated. The model also allows area-specific one-step ahead forecasts of epidemic counts, which are important for policymakers concerned with developing localised strategies for epidemic containment.

2. Relevant Literature

There have been a considerable number of spatio-temporal studies of disease patterns, generally adopting a Bayesian perspective [12,14]. Spatio-temporal models for infection counts [15,16] are a particular sub-theme. These incorporate the themes of the broader disease mapping literature, such as the gains through borrowing strength and the need to reflect spatial correlation in disease; for example, see Andrews et al. [17] on spatial clustering in COVID rates. Space–time models also need to incorporate the spatial diffusion or spillover related to behaviours such as commuting [18,19]. It is also especially useful in policy terms to be able to extrapolate the infectious disease evolution beyond the observation span, as illustrated in some studies of the COVID epidemic [20,21,22,23].
Low-order autoregression is a feature of several recent spatio-temporal studies of infection data. For example, Paul and Held [24] and Shand et al. [25] adopt first-order autoregression (AR1) models, where autoregressive coefficients on counts or rates in the previous period are spatially varying. The model of Paul and Held includes a spatial lag on infection counts in adjacent areas that allows for neighbourhood spillover effects in infection; related approaches are considered by Martines et al. [26] and Griffith and Li [27]. In infections spread by human contact, it is implausible that higher counts or rates in one period generate smaller infection levels in the next period, and so a positive constraint on the AR1 coefficient is justified. Stationarity may also be assumed [25,28] with an AR1 coefficient under 1, but the analysis below argues that flexibility to pronounced epidemic fluctuations in infection counts is likely to be gained by allowing nonstationarity. Nonstationarity is an option in the Bayesian analysis of AR1 models [29,30].
A particular feature of epidemic time series is that a period of relatively stable infection levels (which can be viewed as an endemic phase) is followed by a sudden sharp phase of increasing infection levels. After the epidemic peak, there is a period of descending rates and a return to stability. Hence, it is argued here that greater flexibility and improved prediction will follow if the autoregressive scheme is allowed to adapt to these pronounced fluctuations with temporary departures from stationarity but returning to stationarity as rates descend and infections resume endemic levels.
In this paper, we consider a mixture-link model for infection counts that allows adaptivity to both explosive phases and to stable endemicity, with higher AR1 coefficients in epidemic phases. This is a form of regime-switching. We also allow for neighbourhood spillover, which is also governed by the adaptive switching mechanism.
A Bayesian estimation approach is used. Assuming an identity link in the count regression, AR1 coefficients exceeding 1 reproduce sharply increasing infection levels during an explosive phase, whereas AR1 coefficients under 1 are associated with stability. Compared to existing models such as [24,25], the observational model will then better reflect the balance between epidemic and endemic tendencies and so provide a better fit, and short-term extrapolations will also generally produce more accurate forecasts.

3. Case Studies

We consider two case study applications involving area–time data for COVID-19 infection counts. These provide differing spatial perspectives and involve different variants underlying the epidemic peaks. The use of two studies provides stronger evidence that a better fit due to the proposed models is not due to the particularities of one dataset alone.
The first case study considers the 32 London boroughs and focuses on the sudden growth in COVID infections due to the Omicron variant at the end of 2021. The link-mixture approach is applied to data from the start of the epidemic in March 2020 through to early 2022 for the London boroughs (96 weeks of infection totals) and shows better fit and improved short-term forecasts over models without regime alternation.
The second case study considers data for a much wider regional framework, namely Southeast England consisting of 144 areas as opposed to 32 areas in the first case study. This study considers a shorter time span, the weeks up to and including the peak of infections due to the Alpha variant at the end of 2020.

4. Methods

4.1. Autoregression for Area–Time Infection Counts

Consider area–time infection count data y i t for areas i = 1 , , N and times 1 , , T , and assume these are negative binomial (NB), y i t N B ( μ i t , Ψ ) . The negative binomial model is a generalisation of the Poisson density and appropriate to count data which may be overdispersed relative to the Poisson, for example, COVID infection counts in the endemic phase may even include zeroes, whereas in the epidemic phase much higher counts occur. Hence, the data are overdispersed with variance exceeding the mean. The NB parameterisation is
p ( y | μ , Ω ) = ( y + Ψ 1 ) ! y ! ( Ψ 1 ) ! ( μ μ + Ψ ) y ( Ψ μ + Ψ ) Ψ .
Assume an AR1 model on previous infection counts in the same area. Additionally, effects of predictors X i t , and unobserved area effects u i , may be represented by a term
η i t = X i t β + u i .
Then, for a basic model, conditioning on the first period’s data, we adopt an identity link
μ i t = ρ i y i , t 1 + exp ( η i t ) ,                     t = 2 , , T
providing positivity in ρ i is ensured.
Including lags on infection counts in nearby areas reflects infection spillover due, for example, to social interactions between residents in neighbouring areas, or to cross-boundary commuting [19]. Let h i j measure spatial interactions between areas i and j , and w i j = h i j / j h i j be row standardised spatial weights, with j w i j = 1 . Then spatial spillover, also with lag 1, can be represented [24] by adding a spatially averaged term λ i j w i j y j , t 1 to the above basic model. Then, one has
μ i t = ρ i y i , t 1 + λ i j w i j y j , t 1 + exp ( η i ) ,
providing positivity in ρ i and λ i is ensured.
Assuming that ρ i and λ i are positive is justified epidemiologically, since—for infections spread by human contact or interaction—higher current totals of infectees in an area y i , t 1 , or its vicinity, j w i j y j , t 1 , are expected to cause higher future infections. A negative effect of existing infection levels on future infections is therefore implausible.

4.2. Link Specification

One then requires an appropriate link function relating ρ i and λ i to relevant parameters. For example, assume spatially correlated conditional autoregressive random effects f 1 i and f 2 i [31] involved in predicting ρ i and λ i , and assume these are zero-centred. The study ([24], p. 1121) adopts a log link by default so that with intercept terms α 1 and α 2 , one has
l o g ( ρ i ) = α 1 + f 1 i , l o g ( λ i ) = α 2 + f 2 i .
A log link allows for explosive effects ( ρ i and/or λ i exceeding 1) but does not necessarily select explosive behaviour. If most of the epidemic series consists of stable infection levels (endemicity), then the estimated ρ i and λ i are likely to be below 1.
For infectious diseases with endemic recurrence now predominant, such as HIV in developed nations, a stationary autoregressive effect may be seen as appropriate. See, for example, Shand et al. [25] who consider time variations in HIV in US counties. For an AR1 model on lagged infections, this implies a logit link with ρ i and λ i are constrained between 0 and 1. Thus, with the same overall model (2), and spatial effects f 3 i and f 4 i , one has
l o g i t ( ρ i ) = κ 1 + f 3 i , l o g i t ( λ i ) = κ 2 + f 4 i ,
Neither of the models in [24] or [25] includes a regime-switching mechanism.

4.3. Choosing between Epidemic or Endemic Phases (Link Mixing)

However, for infectious diseases such as COVID, switching between epidemic and endemic phases is relevant to the effective modelling of wide fluctuations. Hence, a logit link is relevant when infections are at a low and/or stable level, whereas a log link allowing ρ i > 1 and λ i > 1 , is more flexible in periods with explosive growth in infections (e.g., due to a new virus or new variants of that virus). An example is the rapid increase in COVID infections linked to the emergence of the Omicron variant, as considered in the first case study.
Here, we consider a mixture model facilitating time-variations in which link is predominant so reflecting the current infection phase. Other forms of mixing between links have been considered in other types of applications (not involving infectious disease counts) or extra parameters introduced into modelling links. For example, Lang [32] considers a mixture of the canonical symmetric logistic link and one or more asymmetric forms in modelling ordinal and binary outcomes, whereas Czado and Raftery [33] consider right and/or left tail modifications to standard links.
Here, we consider a situation not researched before (as far as the authors are aware), namely choosing between log and logit links. Thus, for weights ω t between 0 and 1, it is here proposed that
ρ i t = ω t exp ( α 1 + g 1 i ) + ( 1 ω t ) exp ( κ 1 + g 1 i ) 1 + exp ( κ 1 + g 1 i ) , λ i t = ω t exp ( α 2 + g 2 i ) + ( 1 ω t ) exp ( κ 2 + g 2 i ) 1 + exp ( κ 2 + g 2 i ) ,
where ρ i t and λ i t now vary by area i and time t, and g 1 i and g 2 i are spatially correlated conditional autoregressive random effects. The ω t are in effect measuring stability or instability in infection rates and so are taken as common to both own area and the neighbouring area lags, ρ i t and λ i t , respectively. For ω t high and approaching 1, infections are typically rapidly increasing, whereas for low ω t , stable endemicity is indicated. Low ω t may also be better for characterizing the descent phase after epidemic peaks.
There is no reason why spatial patterning in autocorrelation should be the same in epidemic or endemic phases, so a variation on the preceding model allows for differing spatial effects between phases, namely
ρ i t = ω t exp ( α 1 + g 1 i ) + ( 1 ω t )   exp ( κ 1 + g 3 i ) 1 + exp ( κ 1 + g 3 i ) , λ i t = ω t exp ( α 2 + g 2 i ) + ( 1 ω t ) exp ( κ 2 + g 4 i ) 1 + exp ( κ 2 + g 4 i ) .

4.4. Alternation Mechanism

The ω t in (5) and (6) are modelled as time-specific beta variables
ω t B e t a ( q 1 t , q 2 t ) ,
where q 1 t and q 2 t are positive parameters. The ω t are between 0 and 1 and so provide smooth alternation between endemic and epidemic phases. The specification in (7) provides a simple approach (and parsimonious in parameterisation) to regime alternation in a situation with multiple epidemics. More elaborate smooth transition schemes have been used [34] but are typically framed for the case of a single transition between regimes, whereas multiple transitions are involved in multiphase epidemics.
In contrast to smooth alternation, discrete switching mechanisms using binary switching indicators as in Markov chain switching [10,11] imply the unequivocal distinction between endemic and epidemic phases with, for example, one week classified as endemic and the next week as epidemic. These may be heavily parameterised, for example, the model in [11] has latent binary indicators Zits according to area, time, and season (in a model for influenza cases).
Relevant covariates if available, possibly time-lagged, may be used in predicting the ω t via beta regression. Regression for the mixing variables can be handled by the parameterisation
ω t B e t a ( M t π t , M t [ 1 π t ] ) ,
with π t being probability parameters (explained by the covariates), and M t positive parameters.

4.5. Other Model Features

The models in (2) may be extended to include time and area–time varying effects, such as seasonal effects, or unobserved area–time random effects δ i t . These represent local trends not fully captured by autoregressive effects on lagged infection levels. Thus, for representations (3) and (4), one has
μ i t = ρ i y i , t 1 + λ i j w i j y j , t 1 + exp ( η i + δ i t ) ,
whereas for representations (5) and (6), one has
μ i t = ρ i t y i , t 1 + λ i t j w i j y j , t 1 + exp ( η i + δ i t ) .

4.6. Summary Epidemic Indicators

Under both (5) and (6), focusing on area variations in ρ i t and λ i t during periods with explosive growth will indicate which areas have been more subject to such growth. These indicators will tend to be highest in the periods just before the epidemic peak when cases are growing fastest.
A number of summary epidemic indicators can be derived. Thus, the summary coefficients ρ ¯ t and λ ¯ t , obtained by averaging ρ i t and λ i t over areas, give an overall impression of infection growth or endemic phases. The ρ i t and λ i t can also be compared to the threshold of 1 to give a probability indication of explosive growth in different areas. Thus, define indicators
r i t x = I ( ρ i t > 1 ) , l i t x = I ( λ i t > 1 ) ,
from which area–time exceedance probabilities can be estimated. Also, the sums R t x = i r i t x and L t x = i l i t x show total areas with explosive infection growth in each period.
To assess effectiveness of spatial predictions (i.e., area-specific predictions), one may compare observed growth rates in cases yi,t+1/yi,t with modelled growth rates μi,t+1/μi,t This comparison is particularly relevant in epidemic phases or in assessing short-term forecasts.

4.7. Model Specification

The forms (8) and (9) are adopted in the case studies below. The spatial effects ( f 1 i , f 2 i ) ,   ( f 3 i , f 4 i ) and ( g 1 i , g 2 i , g 3 i , g 4 i ) involved in defining the autoregression coefficients are taken to follow the conditional autoregressive (CAR) scheme of [31]. It is assumed that
η i t = X i t β + u i ,
where u i are mean-centred CAR spatial effects as in [31]. It is assumed that the area–time effects δ i t follow a first-order random walk δ i t N ( δ i , t 1 , σ δ 2 ) , with initial conditions δ i 1 taken as fixed effects, δ i 1 N ( 0 , 1 ) . For identification, an intercept is omitted from X i t β and covariates are centred. A single covariate is used in both case studies; the mid-2020 population estimates are divided by 100,000.
Gamma priors with shape one and rate 0.01 are adopted on inverse variance parameters, the parameters { q 1 t , q 2 t } , and on the negative binomial overdispersion parameter Ω . Normal N ( 0 , 100 ) priors are assumed on fixed effects { α 1 , α 2 , κ 1 , κ 2 , β 1 } . We consider one-step ahead predictions. The predictive means are taken as
μ i , T + 1 = ρ i T y i , T + λ i T j w i j y j , T + exp ( η i t + δ i , T + 1 ) ,
and include the updated value δ i , T + 1 N ( δ i T , σ δ 2 ) .

5. Analysis and Estimation

We apply the link-mixture models specified in Equations (5) and (6), and the mean as in (9), these constituting models 3 and 4, respectively. Two simpler options are the log link as in (3), constituting model 1, and the other (as model 2) is the logit link as in (4). Models 1 to 4 are denoted M1, M2, M3, and M4, respectively. Bayesian estimation is adopted and implemented via the BUGS program [35]. Two chains of 20,000 iterations are taken with inferences from the last 10,000 and convergence checks as in [36].
Fit is measured by the widely applicable information criterion (WAIC) [37]. The WAIC is a measure of goodness of fit with a penalty for complexity (more complex models receive a greater penalty). Lower values of the WAIC indicate a better fit. The advantages of the WAIC over other fit measures used in Bayesian inference are discussed by Lambert [38]. The performance of predictions P ( y r e p , i t | y i t )   =   P ( y r e p , i t | θ ) P ( y i t | θ ) d θ (where θ denotes all parameters) is measured by the Dawid–Sebastiani score (DSS) and by the ranked probability score (RPS) [39]. These two criteria are explicitly designed to assess the predictive success of models for count time series and are now incorporated in the R software package (R Foundation for Statistical Computing, Vienna, Austria) [40]. Both these criteria are lower for better fitting models.
Let Y t denote region-wide totals at period t (i.e., total infections for all areas combined). Assume the models are fitted to T time periods with period T + 1 as the holdout. One-step ahead predictions for T + 1 are assessed by whether these predictions include actual infection counts at T + 1 and by the RPS for one-step ahead predictions.
Code and data are provided as Supplementary Materials.

6. Case Study 1: London Boroughs, 32 Areas, 96 Weeks

The data for the first study consisted of weekly totals of new COVID cases in the 32 boroughs of London. The time span considered starts (t = 1) at the week ending Sunday 8 March 2020, with a final observation (t = 96) for the week ending Sunday 2 January 2022.
The upturn due to the new Omicron variant is apparent in the last few weeks of the series. The peak infections were at week 94 (with 169,322 cases, compared to 65,771 in week 93), after which a downturn started, with 155,181 cases at week 96. At the peak of the London Omicron wave, the UK Office of National Statistics estimated that around 8.8% of Londoners had COVID-19 ([41], Table 1e). In contrast, between weeks 1 and 30, most weeks recorded under 5000 new cases across London, and weeks 52–66 had under 5000 new cases—see Figure 1, which plots cases from weeks 44 to 96.
We take weeks 1–95 as the observed data, with week 96 as the holdout. There were 155181 cases in that week as infection levels due to Omicron started to tail off from the peak in week 94. Table 1 compares the four models in terms of fit to the data and prediction accuracy within the observed span. Table 1 also compares their out-of-sample predictions to week 96.
Regarding fit to the observed data, the WAIC, RPS, and DSS criteria are all lower for the link-choice models (models 3 and 4) than for the default log and logit link models (models 1 and 2 in Equations (3) and (4), respectively).
Figure 2 plots out one of the fit measures, the RPS, by week. It shows worse predictions under models 1 and 2 (M1 and M2 are the red and blue lines in Figure 2). Models M1 and M2 show worse fit in an upturn due to the Alpha variant, which produced a peak infection count of 93798 for the week ending 3 January 2021 (week 44 of the series).
Models 3 and 4 also have greater accuracy in one-step ahead prediction in terms of the coverage of the 95% predictive interval for Y r e p , T + 1 of the actual value and the RPS for week T + 1 . The 95% predictive interval for T + 1 under model 4 is (154,018, 175,048) including the true value of 155,181, and the one-step ahead RPS is 42,923. The predictive interval under model 3 also includes the true value. In contrast, models M1 and M2 over-predict Y T + 1 , their 95% predictive intervals for Y r e p , T + 1 do not include the actual value, and the RPS measures of predictive fit are much worse.
The posterior means ρ i under M1 (which are time constant) vary from 0.13 to 0.25, whereas the mean λ i varies from 0.19 to 0.72. There is therefore no indication in which areas epidemic growth occurred. In contrast, under models 3 and 4, the ρ i t and λ i t parameters will exceed 1 in weeks with a very high growth in cases.
From the latter parameters (only available under models M3 or M4), one may identify the upturn weeks in which areas have epidemic growth. Table 2, accordingly, shows the 20 weeks with the highest values of R t x under M4 . In a few weeks (such as weeks 2 and 94), all 32 boroughs have nonstationary growth, but Table 2 shows that such growth is concentrated in a relatively few weeks in the observation span of 95 weeks.
Figure 3A,B plot out the posterior mean ω t under M4 for weeks 50–95 and the averages ρ ¯ t of the ρ i t . For these weeks, the ω t and ρ ¯ t correlate highly (over 0.99) with actual growth rates in London-wide total cases Y t / Y t 1 , emphasizing how well the parameters reproduce the actual infection data. For 6 of these 45 weeks, the London-wide ρ ¯ t under M4 has a posterior mean exceeding 1 (i.e., rapid case growth in epidemic periods), with the highest ρ ¯ t being 1.81 for week 94. These results confirm the utility of the link-mixture mechanism in reproducing actual infection count fluctuations.

Spatial Dynamics

The course of infection in particular areas is a major concern. Figure 4 maps out boroughs according to the probabilities r i t x in week t = 93 (the week preceding the Omicron infection peak in London at week t = 94), where r i t x are the probabilities of epidemic growth in different areas at particular time points. A spatial concentration of epidemic growth is especially apparent in Southeast London, with the moran.test facility in R yielding a Moran I spatial coefficient of 0.43 with p-value under 0.0001.
The predicted area-specific changes in cases between weeks 93 and 94 (when the omicron related epidemic peaked) correlate closely, confirming the model’s utility in representing spatial dynamics. Thus, the correlation between μi,94i,93 and yi,94/yi,93 over the 32 areas is 0.79. Similarly, in the short-term predictions to week 96, the correlation between μi,96i,95 and yi,96/yi,95 over the 32 areas is 0.90.
Other spatial aspects of the model, such as the assumed spatial correlation in unobserved area effects u i and the spatial correlation in the autoregressive parameter random effects, are confirmed. For the g 1 i   and   g 2 i in the M3 model, we obtain Moran coefficients of 0.33 and 0.07 with respective 95% predictive intervals (0.18, 0.48) and (−0.01, 0.18). So, spatial correlation is stronger in determining the ρi than the λi. The Moran for the spatial CAR effects u i is 0.44 with a 95% interval (0.06, 0.77).

7. Case Study 2: Southeast England, 144 Areas, 20 Weeks

The data for this study relates to the broader southeast of England, encompassing 144 local authority areas in three standard regions (London, East, and Southeast). The time span consists of 21 weeks from the week ending 9 August 2020 through to the week ending 27 December 2020. This period includes a peak in cases related especially to the Alpha variant, namely week 21 with 210,099 cases, whereas in weeks 1–17 there were under 50,000 cases per week. We consider observations for the first 20 weeks, with week 21 held out from estimation. We compare the models in terms of their fit to the observed data (weeks 1–20) and one-step ahead predictions to week 21 when cases peaked.
Table 3 shows, as for the London study, that models 3 and 4 provide a better fit and predictions to the observed data. Table 4 shows the RPS by week for the four models. Models M1 and M2 have a worse predictive fit in weeks with rapid shifts in case numbers (large increases or falls, as in weeks 19 and 15).
As to tracking extreme increases associated with the Alpha variant, Figure 5A,B plot the M4 posterior means by a period of the statistics R t x and L t x , the total number of areas with slopes ρ i t or λ i t exceeding 1 (consistent with epidemic growth). These both peak in week 19, at 44.5 and 40.8, respectively (out of a total of 144 areas), implying that the sharp growth in cases is from both local transmission and broader geographic diffusion. These statistics closely correlate (0.86 and 0.87, respectively) with observed growth ratios Y t / Y t 1 , confirming the utility of derived model indicators in reproducing actual infection dynamics.
Models 3 and 4 also have better predictive out-of-sample performance for week 21 than M1 and M2. For example, the 95% predictive interval for the region-wide total at T = 21, namely Y r e p , T + 1 under model 4 is (194,169, 214,482) comfortably including the actual value of 210,099. In contrast, models M1 and M2 tend to underpredict the future value.
As for the previous case study, spatial dynamics are of major importance. We find that all the random effects relevant in the best-fitting M4 are confirmed as spatially correlated: the Moran I for ui  g 1 i , g 2 i ,   g 3 i , and g 4 i are, respectively, (with 95% intervals) 0.26 (0.06, 0.47), 0.32 (0.13,0.62), 0.45 (0.24, 0.71), 0.51 (0.29,0.74), and 0.44 (0.24,0.64).
Figure 6 shows the spatial pattern of epidemic probabilities in week 19 when there was a near doubling of cases. As for Figure 4, there is spatial clustering in infection growth with a Moran statistic of 0.44 (with highly significant p-value). Such clustering supports features of the model such as allowing for neighbourhood infection spillover.

8. Discussion

The literature on epidemic modelling has paid little explicit attention to methods for spatially disaggregated infection data in a situation of multiple epidemic phases with intervening spells of endemic infection. Many studies involve a single region or nation [9,10]. The present paper has proposed a methodology for spatially disaggregated infection counts including both regime alternation in situations with multiple epidemic phases and neighbourhood spillover in infection. The advantages of the methods presented here have been shown in two case studies, distinct in the epidemic virus considered and in their spatial framework.
Existing models for area–time infection counts mostly include no mechanism to distinguish epidemic from endemic phases, and hence short-term forecasts using them will tend to be less accurate than the methods proposed here. Approaches based on phenomenological models (e.g., logistic curves) or compartmental models, are difficult to adapt to multiple epidemic phases or to spatially disaggregated data, whereas ARIMA models generally use data differencing and transformation rather than analyse the data as they are. They are also difficult to extend to multiple areas, i.e., to a spatio-temporal situation.
In contrast, the method proposed in this paper adapts to nonstationarity in cases and to spatially disaggregated data. For infection count time series with epidemic phases, stationarity is a restrictive assumption and allowing nonstationarity is appropriate [42]. The model proposed here includes novel features such as a mechanism to represent epidemic against endemic phases, both in the aggregate (region-wide) and for individual areas and applying both to local infection spread and infection diffusion from neighbouring areas. The model can be seen as a spatio-temporal regime-switching model. We avoid transformation used in some spatio-temporal infection models, e.g., [43], and retain counts as a natural metric [5].
A number of diagnostic statistics are presented (with relevance to interpreting the time course of an infectious disease) and shown in the case studies to closely reproduce actual infection trends. An example is the match between the diagnostics in Figure 3A,B with actual growth in London cases, with a similar close correlation in the Greater Southeast case study.
Another result of these novel features is that the link-mixture model produces a better representation of spatial dynamics and improved short-term forecasts. Forecasts of infection change at area-specific levels (such as the 32 areas in the first case study) correlate positively with actual changes in cases.
The case studies in this paper have used relatively large areas (e.g., averaging 170 thousand in the London case study), but the approach used remains appropriate for smaller neighbourhoods (e.g., areas with around 10,000 population), where small infection counts are likely to be involved. A generalised Poisson model with Bayesian smoothing mechanisms to borrow strength remains suitable at lower spatial disaggregation. The approach of this paper may also be used with other outcomes, possibly usually less frequent than cases, such as infection-related deaths.
Possible extensions or variations of the approach proposed above may be considered. One is to make the mixing variables ωt area-specific, namely ωit, though at the expense of extra parameterisation and possibly weakened identification. Another, as suggested above, is to introduce covariates to explain the disease course. This could be done via the Xit in ηit, or in a beta regression for the ωt. Covariates might be infection-related such as the proportions of infections due to a new variant. Intervention or environmental variables may also be included in this regression. For example, there is increasing evidence of links between COVID infection and weather conditions [44].
Another potential extension is to multiple outcomes (e.g., cases and hospitalizations), for example, using multivariate CAR spatial effects in (5) and (6). This type of model might include the time-lagged dependence of hospitalisations on cases.
The methodology proposed here may have application beyond infectious disease counts, particularly to longitudinal spatial count data involving considerable time fluctuations. In spatial applications, it is relevant when positive feedback from neighbouring locations is anticipated on substantive grounds [45]. Possible examples include urban crime [46] and spatial innovation diffusion [47].

9. Conclusions

Many epidemic time series—COVID being a current example—show periods of relatively stable infection levels (characterisable as endemicity), followed by phases of rapidly increasing infection levels. After the epidemic peaks, there is a period of descending rates and a return to stability. Hence some mechanism is needed to alternate repeatedly between epidemic and endemic phases or “regimes”.
The regime-alternation specification used in this paper is relatively simple, applicable both to local infection spread and spread from neighbouring areas and can be adapted to multiple epidemic phases. It is parsimonious in parameter terms, whereas considerably heavier parameterisation may be used in those spatio-temporal regime-switching studies that have been carried out using discrete Markov switching [11]. Heavy parameterisation may lead to improved in-sample fit but does not necessarily produce improved out-of-sample predictions such as short-term infection forecasts [48].
Spatio-temporal infection data also raise the issue of neighbourhood infection spillover, which is not included in some spatio-temporal infection models, e.g., [11,43]. In the analysis above, we introduce regime alternation into an autoregressive space–time framework to reflect pronounced fluctuations in infection levels, while also allowing for neighbourhood spillover in infection, which is itself governed by regime alternation.
We show how the proposed method provides improved fit and short-term predictions compared to other spatio-temporal infection models that do include infection spillover but have no adaptation to epidemic phasing [24,25]. Detailed results from the two case studies, which have different variants involved in epidemic peaks and different spatial frameworks, confirm the utility of the model.
In the near future, recurrent epidemic phases of COVID may occur as a result of new variants even if the disease takes on endemic features. In such a situation, appropriate modelling techniques provide relevant research contributions to monitoring and containing the impacts of COVID and the above paper is intended as one such contribution.
The case studies in this paper both concern COVID, whereas other regime-switching applications include dengue [9] and influenza [11]. Hence, a full evaluation of the method here should include application to other infectious diseases with evaluation including out-of-sample predictions.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph19116669/s1, File S1: Code and Spatial Data; File S2: Incidence Data Greater South East; File S3: Incidence Data London Boroughs.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data obtainable at https://coronavirus.data.gov.uk/ (accessed on 3 May 2022).

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Smith, B.; Bancej, C.; Fazil, A.; Mullah, M.; Yan, P.; Zhang, S. The performance of phenomenological models in providing near-term Canadian case projections in the midst of the COVID-19 pandemic: March–April, 2020. Epidemics 2021, 35, 100457. [Google Scholar] [CrossRef] [PubMed]
  2. Hsieh, Y.; Cheng, Y. Real-time forecast of multiphase outbreak. Emerg. Infect. Dis. 2006, 12, 122. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Li, J.; Lou, Y. Characteristics of an epidemic outbreak with a large initial infection size. J. Biol. Dyn. 2016, 10, 366–378. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Brauer, F. Compartmental Models in Epidemiology. In Mathematical Epidemiology; Brauer, F., van den Driessche, P., Wu, J., Eds.; Springer: Berlin/Heidelberg, Germany, 2008; pp. 19–79. [Google Scholar]
  5. Cacciapaglia, G.; Cot, C.; Sannino, F. Multiwave pandemic dynamics explained: How to tame the next wave of infectious diseases. Sci. Rep. 2021, 11, 1–8. [Google Scholar]
  6. Duan, X.; Zhang, X. ARIMA modelling and forecasting of irregularly patterned COVID-19 outbreaks using Japanese and South Korean data. Data Brief 2020, 31, 105779. [Google Scholar] [CrossRef]
  7. Alabdulrazzaq, H.; Alenezi, M.; Rawajfih, Y.; Alghannam, B.; Al-Hassan, A.; Al-Anzi, F. On the accuracy of ARIMA based prediction of COVID-19 spread. Results Phys. 2021, 27, 104509. [Google Scholar] [CrossRef]
  8. Aslam, M. Using the Kalman filter with ARIMA for the COVID-19 pandemic dataset of Pakistan. Data Brief 2020, 31, 105854. [Google Scholar] [CrossRef]
  9. Lim, J.; Dickens, B.; Haoyang, S.; Ching, N.; Cook, A. Inference on dengue epidemics with Bayesian regime switching models. PLoS Comput. Biol. 2020, 16, e1007839. [Google Scholar] [CrossRef]
  10. Martinez-Beneito, M.; Conesa, D.; Lopez-Quilez, A.; Lopez-Maside, A. Bayesian Markov switching models for the early detection of influenza epidemics. Stat. Med. 2008, 27, 4455–4468. [Google Scholar] [CrossRef] [Green Version]
  11. Salvador, R. Bayesian Temporal and Spatio-Temporal Markov Switching Models for the Detection of Influenza Outbreaks. Ph.D. Thesis, Universitat de València, Valencia, Spain, 2017. [Google Scholar]
  12. Waller, L.; Carlin, B. Disease Mapping. In Chapman & Hall/CRC Handbooks of Modern Statistical Methods; CRC Press: Boca Raton, FL, USA, 2010; pp. 217–243. [Google Scholar] [CrossRef] [Green Version]
  13. Pringle, D. Mapping disease risk estimates based on small numbers: An assessment of empirical Bayes techniques. Econ. Soc. Rev. 1996, 27, 341–364. [Google Scholar]
  14. Lagazio, C.; Dreassi, E.; Biggeri, A. A hierarchical Bayesian model for space-time variation of disease risk. Stat. Model. 2001, 1, 17–29. [Google Scholar]
  15. Lowe, R.; Lee, S.; O’Reilly, K. Combined effects of hydrometeorological hazards and urbanisation on dengue risk in Brazil: A spatiotemporal modelling study. Lancet Planet Health 2021, 5, e209–e219. [Google Scholar] [CrossRef]
  16. Coly, S.; Garrido, M.; Abrial, D.; Yao, A. Bayesian hierarchical models for disease mapping applied to contagious pathologies. PLoS ONE 2021, 16, e0222898. [Google Scholar] [CrossRef] [PubMed]
  17. Andrews, M.; Tamura, K.; Best, J.; Ceasar, J.; Batey, K.; Kearse, T.; Powell-Wiley, T. Spatial Clustering of County-Level COVID-19 Rates in the US. Int. J. Environ. Res. Public Health 2021, 18, 12170. [Google Scholar] [CrossRef]
  18. Dalvi, A.; Braga, J. Spatial diffusion of the 2015–2016 Zika, dengue and chikungunya epidemics in Rio de Janeiro Municipality, Brazil. Epidemiol. Infect. 2019, 147, e237. [Google Scholar] [CrossRef] [Green Version]
  19. Mitze, T.; Kosfeld, R. The propagation effect of commuting to work in the spatial transmission of COVID-19. J. Geogr. Syst. 2022, 24, 5–31. [Google Scholar] [CrossRef]
  20. Vahedi, B.; Karimzadeh, M.; Zoraghein, H. Spatiotemporal prediction of COVID-19 cases using inter-and intra-county proxies of human interactions. Nat. Commun. 2021, 12, 1–15. [Google Scholar] [CrossRef]
  21. Rui, R.; Tian, M.; Tang, M.; Ho, G.; Wu, C. Analysis of the spread of COVID-19 in the USA with a spatio-temporal multivariate time series model. Int. J. Environ. Res. Public Health 2021, 18, 774. [Google Scholar] [CrossRef]
  22. Watson, S.; Liu, Y.; Lund, R.; Gettings, J.; Nordone, S.; McMahan, C.; Yabsley, M. A Bayesian spatio-temporal model for forecasting the prevalence of antibodies to Borrelia burgdorferi, causative agent of Lyme disease, in domestic dogs within the contiguous United States. PLoS ONE 2017, 12, e0174428. [Google Scholar] [CrossRef] [Green Version]
  23. Giuliani, D.; Dickson, M.; Espa, G.; Santi, F. Modelling and predicting the spatio-temporal spread of COVID-19 in Italy. BMC Infect. Dis. 2020, 20, 1–10. [Google Scholar] [CrossRef]
  24. Paul, M.; Held, L. Predictive assessment of a non-linear random effects model for multivariate time series of infectious disease counts. Stat. Med. 2011, 30, 1118–1136. [Google Scholar] [CrossRef] [PubMed]
  25. Shand, L.; Li, B.; Park, T.; Albarracín, D. Spatially varying auto-regressive models for prediction of new human immunodeficiency virus diagnoses. J. R. Stat. Soc. Ser. C Appl. Stat. 2018, 67, 1003–1022. [Google Scholar] [CrossRef] [PubMed]
  26. Martines, M.; Ferreira, R.; Toppa, R.; Assunção, L.; Desjardins, M.; Delmelle, E. Detecting space--time clusters of COVID-19 in Brazil: Mortality, inequality, socioeconomic vulnerability, and the relative risk of the disease in Brazilian municipalities. J. Geogr. Syst. 2021, 23, 7–36. [Google Scholar] [CrossRef] [PubMed]
  27. Griffith, D.; Li, B. Spatial-temporal modeling of initial COVID-19 diffusion: The cases of the Chinese Mainland and Conterminous United States. Geo-Spat. Inf. Sci. 2021, 24, 340–362. [Google Scholar] [CrossRef]
  28. Fokianos, K. Some recent progress in count time series. Statistics 2011, 45, 49–58. [Google Scholar] [CrossRef]
  29. Berger, J.; Yang, R. Noninformative priors and Bayesian testing for the AR(1) model. Econom. Theory 1994, 10, 461–482. [Google Scholar] [CrossRef]
  30. Phillips, P. To criticize the critics: An objective Bayesian analysis of stochastic trends. J. Appl. Econom. 1991, 6, 333–364. [Google Scholar] [CrossRef] [Green Version]
  31. Besag, J.; York, J.; Mollié, A. Bayesian image restoration with two applications in spatial statistics. Ann. Inst. Statist. Math. 1991, 43, 1–59. [Google Scholar] [CrossRef]
  32. Lang, J. Bayesian ordinal and binary regression models with a parametric family of mixture links. Comput. Stat. Data Anal. 1999, 31, 59–87. [Google Scholar] [CrossRef]
  33. Czado, C.; Raftery, A. Choosing the link function and accounting for link uncertainty in generalized linear models using Bayes factors. Stat. Pap. 2006, 47, 419–442. [Google Scholar] [CrossRef] [Green Version]
  34. Deschamps, P. Comparing smooth transition and Markov switching autoregressive models of US unemployment. J. Appl. Econom. 2008, 23, 435–462. [Google Scholar] [CrossRef]
  35. Lunn, D.; Spiegelhalter, D.; Thomas, A.; Best, N. The BUGS project: Evolution, critique and future directions. Stat. Med. 2009, 28, 3049–3067. [Google Scholar] [CrossRef] [PubMed]
  36. Brooks, S.; Gelman, A. General methods for monitoring convergence of iterative simulations. J. Comput. Graph. Stat. 1998, 7, 434–455. [Google Scholar]
  37. Watanabe, S. Asymptotic equivalence of Bayes cross validation and Widely Applicable Information Criterion in singular learning theory. J. Mach. Learn. Res. 2010, 11, 3571–3594. [Google Scholar]
  38. Lambert, B. A Student’s Guide to Bayesian Statistics; Sage: New York, NY, USA, 2008. [Google Scholar]
  39. Czado, C.; Gneiting, T.; Held, L. Predictive model assessment for count data. Biometrics 2009, 65, 1254–1261. [Google Scholar] [CrossRef]
  40. Liboschik, T.; Fokianos, K.; Fried, R. Tscount: An R package for analysis of count time series following generalized linear models. J. Stat. Softw. 2017, 82, 1–51. [Google Scholar] [CrossRef]
  41. Office of National Statistics. Coronavirus (COVID-19) Infection Survey: England; Office of National Statistics: London, UK, 2022.
  42. Cazelles, B.; Champagne, C.; Dureau, J. Accounting for non-stationarity in epidemiology by embedding time-varying parameters in stochastic models. PLoS Comput. Biol. 2018, 14, e1006211. [Google Scholar] [CrossRef] [Green Version]
  43. Amorós, R.; Conesa, D.; López-Quílez, A.; Martinez-Beneito, M. A spatio-temporal hierarchical Markov switching model for the early detection of influenza outbreaks. Stoch. Environ. Res. Risk Assess. 2020, 34, 275–292. [Google Scholar] [CrossRef] [Green Version]
  44. Tan, L.; Schultz, D. How Is COVID-19 affected by weather? Metaregression of 158 studies and recommendations for best practices in future research. Weather Clim. Soc. 2022, 14, 237–255. [Google Scholar] [CrossRef]
  45. Glaser, S. A Review of Spatial Econometric Models for Count Data. In Hohenheim Discussion Papers in Business, Economics and Social Sciences, No. 19-2017; University of Hohenheim: Stuttgart, Germany, 2017. [Google Scholar]
  46. Liesenfeld, R.; Richard, J.; Vogler, J. Likelihood-Based Inference and Prediction in Spatio-Temporal Panel Count Models for Urban Crimes. J. Appl. Econom. 2017, 32, 600–620. [Google Scholar] [CrossRef] [Green Version]
  47. Bivand, R. Spatial diffusion and spatial statistics: Revisting Hägerstrand’s study of innovation diffusion. Procedia Environ. Sci. 2015, 27, 106–111. [Google Scholar] [CrossRef] [Green Version]
  48. Inoue, A.; Kilian, L. In-sample or out-of-sample tests of predictability: Which one should we use? Econom. Rev. 2005, 23, 371–402. [Google Scholar] [CrossRef] [Green Version]
Figure 1. COVID cases, London, weeks 44–96.
Figure 1. COVID cases, London, weeks 44–96.
Ijerph 19 06669 g001
Figure 2. Ranked probability score by week; models compared.
Figure 2. Ranked probability score by week; models compared.
Ijerph 19 06669 g002
Figure 3. (A) posterior mean omega, London boroughs, (B) posterior mean ρ ¯ t .
Figure 3. (A) posterior mean omega, London boroughs, (B) posterior mean ρ ¯ t .
Ijerph 19 06669 g003
Figure 4. Probabilities of epidemic growth, London Boroughs, Week 93.
Figure 4. Probabilities of epidemic growth, London Boroughs, Week 93.
Ijerph 19 06669 g004
Figure 5. (A) Average number of own area slopes exceeding 1, R t x . (B) Average number of spatial lag slopes exceeding 1, L t x .
Figure 5. (A) Average number of own area slopes exceeding 1, R t x . (B) Average number of spatial lag slopes exceeding 1, L t x .
Ijerph 19 06669 g005
Figure 6. Probabilities of epidemic growth, Greater Southeast, week 19.
Figure 6. Probabilities of epidemic growth, Greater Southeast, week 19.
Ijerph 19 06669 g006
Table 1. Comparative Model Fit, London Boroughs (N = 32, T = 96).
Table 1. Comparative Model Fit, London Boroughs (N = 32, T = 96).
Fit to Observed Data (T = 95)
WAICRPSDSS
Model 132,267185,30024,683
Model 231,689180,50023,930
Model 329,292111,02422,467
Model 429,727111,34523,177
One-Step Ahead Prediction, Actual Count: 155,181
95% Interval for YT+1RPST+1
Mean2.5%97.5%
Model 1193,600168,700224,80096,920
Model 2192,600168,300224,30095,520
Model 3162,897154,613171,43940,823
Model 4163,584154,018175,04842,923
Table 2. Weeks with Highest Growth in Cases, Total Areas (from 32) with ρ i t > 1.
Table 2. Weeks with Highest Growth in Cases, Total Areas (from 32) with ρ i t > 1.
Week (t)Posterior Mean Total Areas2.5%97.5%
94323232
2323232
3323032
42323032
41302632
4302532
30271932
69271832
31251632
72221130
2721931
70201029
9320929
6614130
654015
673012
32309
34207
242010
71104
Table 3. Comparative Model Fit, Southeast England (N = 144, T = 21).
Table 3. Comparative Model Fit, Southeast England (N = 144, T = 21).
Fit to Observed Data (T = 20)
WAICRPSDSS
Model 127,579118,68522,317
Model 227,613118,14822,384
Model 325,43965,66319,348
Model 425,34665,09219,145
One-Step Ahead Prediction, Actual Count: 210,099
95% Interval for YT+1RPST+1
Mean2.5%97.5%
Model 1195,244181561210,08827,025
Model 2195,545181644210,54827,223
Model 3202,268192260213,11224,062
Model 4204,026194169214,48223,661
Table 4. Ranked Probability Score (RPS) (Posterior Means by Week and Model).
Table 4. Ranked Probability Score (RPS) (Posterior Means by Week and Model).
WeekM1M2M3M4Total Cases,
Greater Southeast, Yt
Relative Increase in
Cases Compared to Previous Week
Ratio of RPS M1 to M4
254153642342921611.231.26
365565750851326411.221.28
484885166967839721.501.25
591491769269844581.121.31
61379136763763740300.902.16
7146914711060104468461.701.41
8213521381608152711,3651.661.40
9246424741770172317,0341.501.43
10245324621826182320,5231.201.35
11395539762591255429,6331.441.55
12514050772939292130,2631.021.76
13456645643307327934,5461.141.39
14532753193649367645,0071.301.45
1510,89810,8753729341238,2270.853.19
16841083743311302734,3450.902.78
17497649923737361541,0901.201.38
1811,53411,4275598569367,0901.632.03
1931,66031,47410,67110,405127,9051.913.04
2019,36019,19716,93717,439154,5181.211.11
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Congdon, P. A Model for Highly Fluctuating Spatio-Temporal Infection Data, with Applications to the COVID Epidemic. Int. J. Environ. Res. Public Health 2022, 19, 6669. https://doi.org/10.3390/ijerph19116669

AMA Style

Congdon P. A Model for Highly Fluctuating Spatio-Temporal Infection Data, with Applications to the COVID Epidemic. International Journal of Environmental Research and Public Health. 2022; 19(11):6669. https://doi.org/10.3390/ijerph19116669

Chicago/Turabian Style

Congdon, Peter. 2022. "A Model for Highly Fluctuating Spatio-Temporal Infection Data, with Applications to the COVID Epidemic" International Journal of Environmental Research and Public Health 19, no. 11: 6669. https://doi.org/10.3390/ijerph19116669

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop