Multivariate Modeling of Some Datasets in Continuous Space and Discrete Time

Abstract

Multivariate space–time datasets are often collected at discrete, regularly monitored time intervals and are typically treated as components of time series in environmental science and other applied fields. To effectively characterize such data in geostatistical frameworks, valid and practical covariance models are essential. In this work, we propose several classes of multivariate spatio-temporal covariance matrix functions to model underlying stochastic processes whose discrete temporal margins correspond to well-known autoregressive and moving average (ARMA) models. We derive sufficient and/or necessary conditions under which these functions yield valid covariance matrices. By leveraging established methodologies from time series analysis and spatial statistics, the proposed models are straightforward to identify and fit in practice. Finally, we demonstrate the utility of these multivariate covariance functions through an application to Kansas weather data, using co-kriging for prediction and comparing the results to those obtained from traditional spatio-temporal models.

1. Introduction

Multivariate space–time datasets frequently arise in environmental science, meteorology, geophysics, and many other fields. Examples include studying the impact of soil greenhouse gas fluxes on global warming potential, or analyzing temperature–precipitation relationships under climate change (see [1,2,3], among others). Typically, temporal data are collected at regularly spaced intervals, in contrast to spatial data that are often recorded at irregular locations, such as weather stations. With the increasing availability and complexity of such datasets, it is essential to develop efficient models that capture their intricate dependence structures.

This paper focuses on constructing valid covariance matrix functions that jointly incorporate spatial and temporal information for multivariate random fields. While the spatial statistics literature includes various spatial models, few account for discrete-time dependencies, despite time series playing a crucial role in most environmental and geophysical processes. Traditional approaches often rely on separable space–time covariance structures, which assume the overall covariance is the product of purely spatial and purely temporal components. While computationally convenient, these models ignore space–time interactions that are often fundamental to the underlying physical processes. An increasing body of work has highlighted the importance of nonseparable models. For example, ref. [4] introduced nonseparable stationary spatio-temporal covariance functions, and subsequent generalizations for both stationary and nonstationary processes were developed in [5,6,7], among others. Applications to environmental data such as air pollution are explored by [8,9], while ref. [10] incorporates an inflated gamma distribution to model precipitation trends with zero inflation. However, most of these models are constructed under the assumption of continuous time. In practice, time is typically observed on a discrete, regular grid, whereas spatial locations are distributed more irregularly. Although some models incorporate discrete time through stochastic differential equations or spectral methods (e.g., [11,12]), these approaches often lack closed-form expressions for the covariance structure. While ref. [13] deals with the univariate case, in this work, we derive explicit covariance matrix functions for multivariate space–time processes with discrete temporal components, where the temporal margins follow well-established autoregressive and moving average (ARMA) models. Leveraging the rich theoretical foundation of ARMA processes along with classical spatial modeling, we aim to build flexible, interpretable, and computationally feasible models.

In many modern scientific applications, such as geosciences, environmental monitoring, and economics, large numbers of variables are observed simultaneously. These variables are often correlated, and borrowing information from related (secondary) variables can improve the prediction of a primary variable, especially when the latter is sparsely observed. For simplicity, spatial variables are often modeled separately, ignoring cross-variable dependencies.A key contribution of this work is the development of multivariate spatial covariance structures that capture both within-variable spatial dependence and cross-variable covariances, while also incorporating discrete time information. This enables more accurate predictions through co-kriging across a wide range of applications. While previous efforts have been made in this direction, many are limited to purely spatial or continuous-time settings, or they rely on Bayesian frameworks. Notable contributions include [14,15,16,17], among others. For example, multivariate Poisson-lognormal spatial models have improved predictions in traffic safety studies [18], and recent works have established kriging formulas [19] and copula-based models [20] for multivariate spatial data. We aim to integrate parameter interpretability from analytic model expressions into a unified space–time framework to facilitate multivariate fitting and co-kriging.

On a global scale, many spatial datasets are collected using spherical coordinates. Euclidean-based distances and covariance structures can become distorted on the sphere, especially over large distances, making spherical modeling critical in geophysical and atmospheric sciences. Recent advances include constructions of isotropic positive definite functions on spheres [21], covariance functions for stationary and isotropic Gaussian vector fields [22], and isotropic variogram matrix functions expressed through ultraspherical polynomials [23]. Drawing from these approaches, we also extend some of our discrete-time multivariate spatio-temporal models to spherical domains to ensure validity across both Euclidean and spherical spaces.

We aim to develop a flexible multivariate spatio-temporal modeling framework that incorporates discrete-time structure, spatial correlation (in both Euclidean and spherical spaces), and cross-variable dependencies. Specifically, we consider a p-variate space–time random field

$$\{\mathbf{Z}(\mathbf{s},t)={(Z_1(\mathbf{s},t),\dots ,Z_p(\mathbf{s},t))}^{\prime },\mathbf{s}\in {\mathbb{S}}^d\mathrm{or}{\mathbb{R}}^d,t\in \mathbb{Z}\},$$

with covariance matrix function

$$\mathbf{C}({\mathbf{s}}_1,{\mathbf{s}}_2,t_1,t_2)=\left(\begin{array}{ccc}{C}_{1,1}({\mathbf{s}}_1,{\mathbf{s}}_2,t_1,t_2)& \dots & C_{1,p}({\mathbf{s}}_1,{\mathbf{s}}_2,t_1,t_2)\\ ⋮& \ddots & ⋮\\ C_{p,1}({\mathbf{s}}_1,{\mathbf{s}}_2,t_1,t_2)& \dots & C_{p,p}({\mathbf{s}}_1,{\mathbf{s}}_2,t_1,t_2)\end{array}\right),$$

where each entry

$$C_{i,j}({\mathbf{s}}_1,{\mathbf{s}}_2,t_1,t_2)=\mathrm{Cov}(Z_i({\mathbf{s}}_1,t_1),Z_j({\mathbf{s}}_2,t_2)),$$

for $i,j=1,\dots ,p$, where ${\mathbb{S}}^d$ and ${\mathbb{R}}^d$ denote the d-dimensional unit sphere and Euclidean space, respectively. The process is stationary in both space and time if $E\left(\mathbf{Z}\right(\mathbf{s},t\left)\right)$ is constant for all $(\mathbf{s},t)$ and $C({\mathbf{s}}_0,{\mathbf{s}}_0+\mathbf{s};t_0,t_0+t)$ depends only on the spatial lag $\mathbf{s}$ and temporal lag t. We then denote the spatial and temporal margins as $\mathbf{C}({\mathbf{s}}_1,{\mathbf{s}}_2,t,t)$ and $\mathbf{C}(\mathbf{s},\mathbf{s},t_1,t_2)$, respectively, following [24]. In practice, analyzing multivariate space–time data often begins with marginal exploration, applying time series models to study temporal behavior and multivariate spatial analysis to capture cross-variable structure. Given the substantial research advances in both areas, combining their strengths provides a robust foundation for model development, selection, and estimation.

The remainder of this paper is organized as follows. In Section 2, we propose several classes of multivariate spatio-temporal covariance matrix functions, whose discrete-time margins follow ARMA models. We derive necessary and sufficient conditions for these functions to define valid covariance matrices. Section 3 extends the models to incorporate general ARMA margins. In Section 4, we apply our models to Kansas weather data to demonstrate their performance in spatio-temporal prediction compared to traditional methods.

2. Moving-Average-Type Temporal Margin

We begin constructing the foundation of our overall framework by examining the covariance structure corresponding to a first-order moving average (MA(1)) model in the discrete temporal margin. It is straightforward to verify that Equation (1) satisfies the defining properties of an MA(1) process at a fixed spatial location. Notably, this structure does not rely on the assumption of temporal stationarity. The main challenge in proving the validity of Equation (1) lies in its nature as a discrete space–time matrix function that varies across different time scales, making it more complex than simply verifying a static covariance matrix. Theorem 8 in [25] offers useful insights that support the proof of the following Theorem 1 (see Appendix A).

Theorem 1.

Let ${\mathbf{G}}_0({\mathbf{s}}_1,{\mathbf{s}}_2)$ and ${\mathbf{G}}_1({\mathbf{s}}_1,{\mathbf{s}}_2),{\mathbf{s}}_1,{\mathbf{s}}_2\in \mathbb{D}$, $\mathbb{D}\subset {\mathbb{R}}^d$ or ${\mathbb{S}}^d,d\ge 1$ be $p\times p$ matrix functions, and let ${\mathbf{G}}_0({\mathbf{s}}_1,{\mathbf{s}}_2)$ be symmetric, i.e., ${\mathbf{G}}_0{({\mathbf{s}}_1,{\mathbf{s}}_2)}^{\prime }={\mathbf{G}}_0({\mathbf{s}}_1,{\mathbf{s}}_2)$. Then, the  $p\times p$ function

$$\mathbf{C}({\mathbf{s}}_1,{\mathbf{s}}_2;t)=\left\{\begin{array}{cc}{\mathbf{G}}_0({\mathbf{s}}_1,{\mathbf{s}}_2),\hfill & t=0,\hfill \\ {\mathbf{G}}_1({\mathbf{s}}_1,{\mathbf{s}}_2),\hfill & t=1,\hfill \\ {\mathbf{G}}_1{({\mathbf{s}}_2,{\mathbf{s}}_1)}^{\prime },\hfill & t=-1,\hfill \\ \mathbf{0},\hfill & t\ne 0,\pm 1,t\in \mathbb{Z},{\mathbf{s}}_1,{\mathbf{s}}_2\in \mathbb{D}.\hfill \end{array}\right.$$

(1)

is a covariance matrix function on $\mathbb{D}\times \mathbb{Z}$ if and only if the following two conditions are satisfied:

(i) 

${\mathbf{G}}_0({\mathbf{s}}_1,{\mathbf{s}}_2)+{\mathbf{G}}_1({\mathbf{s}}_1,{\mathbf{s}}_2)+{\mathbf{G}}_1{({\mathbf{s}}_2,{\mathbf{s}}_1)}^{\prime }$ is a covariance matrix function on $\mathbb{D}$,

(ii) 

${\mathbf{G}}_0({\mathbf{s}}_1,{\mathbf{s}}_2)-{\mathbf{G}}_1({\mathbf{s}}_1,{\mathbf{s}}_2)-{\mathbf{G}}_1{({\mathbf{s}}_2,{\mathbf{s}}_1)}^{\prime }$ is a covariance matrix function on $\mathbb{D}$.

This theorem reduces the verification of a complex space–time problem to that of a purely spatial covariance model. Building upon the foundational structure developed earlier, we are now prepared to incorporate a broader range of spatial covariance margins to enrich the class of admissible models. Specifically, we integrate the widely used Matérn-type spatial covariance function into our framework and derive the full set of parameter conditions required to ensure validity. In Theorem 2, we begin with a parsimonious Matérn structure in which all smoothness parameters $\alpha$ in $\mathbf{M}(h\mid \mathbf{v},\alpha )$ are assumed to be equal, as specified in Equation (4) below. Theorem 3 of [14] provides necessary and sufficient conditions under various settings for Equation (4) to define a valid covariance matrix. These results offer important insights that inform the conditions of the theorem and corollary that follows.

Theorem 2.

Let $\mathbf{v}=(v_1,v_2,\dots ,v_p)$, $\mathbf{\alpha }=({\alpha }_1,{\alpha }_2)$, and $\mathbf{\beta }=({\beta }_1,{\beta }_2)$ be constant vectors. $v_k\ge 0, {\alpha }_k\ge 0, -1/2\le {\beta }_k\le 1/2$, and let $v_{ij}=(v_i+v_j)/2$, $\mathbb{D}\subset {\mathbb{R}}^d$. The sufficient condition for the $p\times p$ matrix function

$$\mathbf{C}(h;t)=\left\{\begin{array}{cc}c\mathbf{M}\left(h\right|\mathbf{v},{\alpha }_1)+(1-c)\mathbf{M}\left(h\right|\mathbf{v},{\alpha }_2),\hfill & t=0,\hfill \\ c\mathbf{M}\left(h\right|\mathbf{v},{\alpha }_1){\beta }_1+(1-c)\mathbf{M}\left(h\right|\mathbf{v},{\alpha }_2){\beta }_2,\hfill & t=\pm 1,h\in \mathbb{D}\hfill \\ \mathbf{0},\hfill & otherwise,\hfill \end{array}\right.$$

(2)

to be a correlation matrix function on $\mathbb{D}\times \mathbb{Z}$ is that the constant c satisfies

$$0\le c\le 1.$$

(3)

• And if $p\le 2$, (3) is also necessary.
• where

$$\mathbf{M}\left(h\right|\mathbf{v},\alpha )=({\left({\rho }_{ij}m\left(h\right|v_{ij},\alpha )\right)}_{1\le i,j\le p},$$

(4)

$m\left(h\right|v_{ij},\alpha )={\displaystyle \frac{2^{1-v_{ij}}}{\Gamma \left(v_{ij}\right)}}{\left(\alpha h\right)}^{v_{ij}}{K}_{v_{ij}}\left(\alpha h\right)$, $i,j=1,2$, ${\rho }_{ij}={\displaystyle \frac{\Gamma {(v_i+\frac{d}{2})}^{\frac{1}{2}}}{\Gamma {\left(v_i\right)}^{\frac{1}{2}}}}{\displaystyle \frac{\Gamma {(v_j+\frac{d}{2})}^{\frac{1}{2}}}{\Gamma {\left(v_j\right)}^{\frac{1}{2}}}}{\displaystyle \frac{\Gamma \left(v_{ij}\right)}{\Gamma (v_{ij}+\frac{d}{2})}}$.

The following theorem generalizes the parsimonious Matérn covariance structure by relaxing the constraint that all smoothness parameters $\alpha$ in $\mathbf{M}(h\mid \mathbf{v},\alpha )$ must be equal, as in Equation (4). Following [14], we assume that $\mathbf{M}(h\mid \mathbf{v},\mathbf{\alpha },{\rho }_{12})$ is a general multivariate Matérn covariance function in Theorem 3. In addition, the choice of c is assumed to satisfy the conditions of Theorem 2 in [13], ensuring that the main diagonal elements of the resulting matrix structure are valid univariate correlation functions.

Theorem 3.

Let $\mathbf{v}=(v_1, v_2, v_{12})$, $\mathbf{\alpha }=({\alpha }_1, {\alpha }_2, {\alpha }_{12})$, ${\mathbf{\alpha }}^{\prime }=({\alpha }_1^{\prime }, {\alpha }_2^{\prime }, {\alpha }_{12}^{\prime })$, $\mathit{\beta }=({\beta }_1, {\beta }_2)$ be constant vectors. $v_k\ge 0, {\alpha }_k\ge 0, {\alpha }_k^{\prime }\ge 0, -1/2\le {\beta }_k\le 1/2$, $\mathbb{D}\subset {\mathbb{R}}^d$. A sufficient and necessary condition for the $p\times p$ matrix function, $p\le 2$

$$\mathbf{C}(h;t)=\left\{\begin{array}{cc}c\mathbf{M}\left(h\right|\mathbf{v},\mathbf{\alpha },{\rho }_{12})+(1-c)\mathbf{M}\left(h\right|\mathbf{v},{\mathbf{\alpha }}^{\prime },{\rho }_{12}^{\prime }),\hfill & t=0,\hfill \\ c\mathbf{M}\left(h\right|\mathbf{v},\mathbf{\alpha },{\rho }_{12}){\beta }_1+(1-c)\mathbf{M}\left(h\right|\mathbf{v},{\mathbf{\alpha }}^{\prime },{\rho }_{12}^{\prime }){\beta }_2,\hfill & t=\pm 1,h\in \mathbb{D}\hfill \\ \mathbf{0},\hfill & otherwise,\hfill \end{array}\right.$$

(5)

to be a correlation matrix function on $\mathbb{D}\times \mathbb{Z}$ is that the constant c satisfies

$$\begin{array}{c}\hfill \underset{h\ge 0,D\left(h\right)>0}{inf}{\displaystyle \frac{c^2{(1\pm 2{\beta }_1)}^{2}H\left(h\right)+{(1-c)}^2{(1\pm 2{\beta }_2)}^2\tilde{H}\left(h\right)}{(1\pm 2{\beta }_1)(1\pm 2{\beta }_2)D\left(h\right)}}\ge c(c-1).\end{array}$$

(6)

given $D\left(h\right)\ne 0$. Where

$$\mathbf{M}\left(h\right|\mathbf{v},\mathbf{\alpha },{\rho }_{12})=\left[\begin{array}{cc}{m}_{11}\left(h\right|v_1,{\alpha }_1)& {\rho }_{12}{m}_{12}\left(h\right|v_{12},{\alpha }_{12})\\ {\rho }_{12}{m}_{12}\left(h\right|v_{12},{\alpha }_{12})& m_{22}\left(h\right|v_2,{\alpha }_2)\end{array}\right],$$

(7)

$m_{ij}\left(h\right|v_k,{\alpha }_k)={\displaystyle \frac{2^{1-v_k}}{\Gamma \left(v_k\right)}}{\left({\alpha }_{k}h\right)}^{v_k}{K}_{v_k}\left({\alpha }_{k}h\right)$, $i,j=1,2$, $k=1,2,12$.

$$\begin{array}{c}\hfill H\left(h\right)={\displaystyle \frac{{\alpha }_1^{2v_1}{\alpha }_2^{2v_2}{c}_{v_1}{c}_{v_2}}{{({\alpha }_1^2+h^2)}^{v_1+d/2}{({\alpha }_2^2+h^2)}^{v_2+d/2}}}-{\displaystyle \frac{{\rho }_{12}^2{\alpha }_{12}^{4v_{12}}{c}_{v_{12}}^2}{{({\alpha }_{12}^2+h^2)}^{2v_{12}+d}}},\end{array}$$

$\tilde{H}\left(h\right)$ is defined like $H\left(h\right)$ with ${\alpha }_i$ replaced with ${\alpha }_i^{\prime }$, $i=1,2,12$ and

$$\begin{array}{cc}\hfill D\left(h\right)& ={\displaystyle \frac{{\alpha }_1^{2v_1}{\alpha }_2^{\prime 2v_2}{c}_{v_1}{c}_{v_2}}{{({\alpha }_1^2+h^2)}^{v_1+d/2}{({\alpha }_2^{\prime 2}+h^2)}^{v_2+d/2}}}+{\displaystyle \frac{{\alpha }_1^{\prime 2v_1}{\alpha }_2^{2v_2}{c}_{v_1}{c}_{v_2}}{{({\alpha }_1^{\prime 2}+h^2)}^{v_1+d/2}{({\alpha }_2^2+h^2)}^{v_2+d/2}}}\hfill \\ \hfill & -{\displaystyle \frac{2{\rho }_{12}{\rho }_{12}^{\prime }{\alpha }_{12}^{2v_{12}}{\alpha }_{12}^{\prime 2v_{1}2}{c}_{v_{12}}^2}{{\left(({\alpha }_{12}^2+h^2)({\alpha }_{12}^{\prime 2}+h^2)\right)}^{v_{12}+d/2}}}.\hfill \end{array}$$

If fact, from [14], $\mathbf{M}\left(h\right|\mathbf{v},\alpha ,{\rho }_{12})$ is a valid covariance matrix if and only if

$$\begin{array}{cc}\hfill {\rho }_{12}^2\le & {\displaystyle \frac{c_{v1}{c}_{v2}}{c_{v_{12}}^2}}{\displaystyle \frac{{\alpha }_1^{2v_1}{\alpha }_2^{2v_2}}{{\alpha }_{12}^{4v_{12}}}}\underset{h\ge 0}{inf}{\displaystyle \frac{{({\alpha }_{12}^2+h^2)}^{2v_{12}+d}}{{({\alpha }_1^2+h^2)}^{v_1+d/2}{({\alpha }_2^2+t^2)}^{v_2+d/2}}},\hfill \end{array}$$

(8)

$$\begin{array}{cc}\hfill {\rho }_{12}^{\prime 2}\le & {\displaystyle \frac{c_{v1}{c}_{v2}}{c_{v_{12}}^2}}{\displaystyle \frac{{\alpha }_1^{\prime 2v_1}{\alpha }_2^{\prime 2v_2}}{{\alpha }_{12}^{\prime 4v_{12}}}}\underset{h\ge 0}{inf}{\displaystyle \frac{{({\alpha }_{12}^{\prime 2}+h^2)}^{2v_{12}+d}}{{({\alpha }_1^{\prime 2}+h^2)}^{v_1+d/2}{({\alpha }_2^{\prime 2}+t^2)}^{v_2+d/2}}}.\hfill \end{array}$$

(9)

where $c_v={\pi }^{-d/2}\Gamma (v+d/2)/\Gamma \left(v\right)$. Therefore, we can show that $H\left(h\right)\ge 0$, $\tilde{H}\left(h\right)\ge 0$, and $D\left(h\right)\ge 0$. Under certain conditions, the minimum of the left-hand side of inequality (8) can be equal to zero, which leads to the following corollary.

Corollary 1.

The sufficient and necessary condition for Equation (5) to be a correlation matrix function can be reduced to $0\le c\le 1$ in the following cases:

(a) When ${\alpha }_{12}\le min({\alpha }_1,{\alpha }_2)$, ${\alpha }_{12}^{\prime }\le min({\alpha }_1^{\prime },{\alpha }_2^{\prime })$, $v_{12}={\displaystyle \frac{v_1+v_2}{2}}$,

$$\begin{array}{c}\hfill {\rho }_{12}^2={\displaystyle \frac{c_{v_1}{c}_{v_2}}{c_{v_{12}}^2}}{\left({\displaystyle \frac{{\alpha }_{12}^2}{{\alpha }_1{\alpha }_2}}\right)}^d,{\rho }_{12}^{\prime 2}={\displaystyle \frac{c_{v_1}{c}_{v_2}}{c_{v_{12}}^2}}{\left({\displaystyle \frac{{\alpha }_{12}^{\prime 2}}{{\alpha }_1^{\prime }{\alpha }_2^{\prime }}}\right)}^d.\end{array}$$

(b) When ${\alpha }_{12}\ge max({\alpha }_1,{\alpha }_2)$, ${\alpha }_{12}^{\prime }\ge max({\alpha }_1^{\prime },{\alpha }_2^{\prime })$, $v_{12}={\displaystyle \frac{v_1+v_2}{2}}$, 

$$\begin{array}{c}\hfill {\rho }_{12}^2={\displaystyle \frac{c_{v_1}{c}_{v_2}}{c_{v_{12}}^2}}{\left({\displaystyle \frac{{\alpha }_1}{{\alpha }_{12}}}\right)}^{2v_1}{\left({\displaystyle \frac{{\alpha }_2}{{\alpha }_{12}}}\right)}^{2v_2},{\rho }_{12}^{\prime 2}={\displaystyle \frac{c_{v_1}{c}_{v_2}}{c_{v_{12}}^2}}{\left({\displaystyle \frac{{\alpha }_1^{\prime }}{{\alpha }_{12}^{\prime }}}\right)}^{2v_1}{\left({\displaystyle \frac{{\alpha }_2^{\prime }}{{\alpha }_{12}^{\prime }}}\right)}^{2v_2}.\end{array}$$

The proofs of the theorems and corollary are deferred to the Appendix A. It is well known that setting $v=1/2$ in the Matérn covariance function yields the exponential form. This leads to the following example:

Example 1.

Let $\mathbf{\alpha }$, ${\mathbf{\alpha }}^{\prime }$, ${\rho }_{12}$, ${\rho }_{12}^{\prime }$ and ${\beta }_k(k=1,2)$ be assumed as in Theorem 3, and take $v_1=v_2=v_{12}={\displaystyle \frac{1}{2}}$; then, A sufficient and necessary condition for the matrix function of exponential type

$$\mathbf{C}(h;t)=\left\{\begin{array}{cc}c\mathbf{E}\left(h\right|\mathbf{\alpha },{\rho }_{12})+(1-c)\mathbf{E}\left(h\right|{\mathbf{\alpha }}^{\prime },{\rho }_{12}^{\prime }),\hfill & t=0,\hfill \\ c\mathbf{E}\left(h\right|\mathbf{\alpha },{\rho }_{12}){\beta }_1+(1-c)\mathbf{E}\left(h\right|{\mathbf{\alpha }}^{\prime },{\rho }_{12}^{\prime }){\beta }_2,\hfill & t=\pm 1,h\in \mathbb{D}\hfill \\ \mathbf{0},\hfill & otherwise,\hfill \end{array}\right.$$

(10)

to be a stationary correlation matrix function on $\mathbb{D}\times \mathbb{Z}$ is that the constant c satisfies inequality (6). Where

$$\mathbf{E}\left(h\right|\mathbf{\alpha },{\rho }_{12})=\left[\begin{array}{cc}{e}_{11}\left(h\right|{\alpha }_1)& {\rho }_{12}{e}_{12}\left(h\right|{\alpha }_{12})\\ {\rho }_{12}{e}_{12}\left(h\right|{\alpha }_{12})& e_{22}\left(h\right|{\alpha }_2)\end{array}\right].$$

(11)

$e_{ij}\left(h\right|{\alpha }_k)=exp(-{\alpha }_{k}h)$, $i,j=1,2$, $k=1,2,12$.

3. ARMA Type Temporal Margin

In the previous section, we considered the spatio-temporal covariance structure with a moving average of order one (MA(1)) as the temporal margin. in this section, we extend the covariance matrix to more general cases involving some other autoregressive and moving average (ARMA) temporal margins.

The following model establishes the necessary and sufficient conditions for a valid spatio-temporal covariance matrix with ARMA-type temporal dependence. As before, this theorem assumes uniform $\alpha$ in $\mathbf{M}(h\mid \mathbf{v},\alpha )$.

Theorem 4.

Let $\mathbf{v}=(v_1,v_2,v_{12})$, $\mathit{\beta }=({\beta }_1,{\beta }_2)$, be constant vectors. $v_k\ge 0, {\alpha }_k\ge 0, -1\le {\beta }_k\le 1$, and let $v_{12}=(v_1+v_2)/2$, $\mathbb{D}\subset {\mathbb{R}}^d$ or ${\mathbb{S}}^d$. A sufficient condition for the $p\times p$ matrix function

$$\mathbf{C}(h;t)=c\mathbf{M}\left(h\right|\mathbf{v},{\alpha }_1){\beta }_1^{\left|t\right|}+(1-c)\mathbf{M}\left(h\right|\mathbf{v},{\alpha }_2){\beta }_2^{\left|t\right|},t\in \mathbb{Z},h\in \mathbb{D}$$

(12)

to be a correlation matrix function on $\mathbb{D}\times \mathbb{Z}$ is that the constant c satisfies the following:

$$0\le c\le 1.$$

(13)

• And if $p\le 2$, (13) is also necessary.
• where

$$\mathbf{M}\left(h\right|\mathbf{v},\alpha )=({\left({\rho }_{ij}m\left(h\right|v_{ij},\alpha )\right)}_{1\le i,j\le p},$$

(14)

$m\left(h\right|v_k,\alpha )={\displaystyle \frac{2^{1-v_k}}{\Gamma \left(v_k\right)}}{\left(\alpha h\right)}^{v_k}{K}_{v_k}\left(\alpha h\right)$, $i,j=1,2$, $k=1,2,12$, ${\rho }_{12}={\displaystyle \frac{\Gamma {(v_1+\frac{d}{2})}^{\frac{1}{2}}}{\Gamma {\left(v_1\right)}^{\frac{1}{2}}}}{\displaystyle \frac{\Gamma {(v_2+\frac{d}{2})}^{\frac{1}{2}}}{\Gamma {\left(v_2\right)}^{\frac{1}{2}}}}{\displaystyle \frac{\Gamma \left(v_{12}\right)}{\Gamma (v_{12}+\frac{d}{2})}}$.

We now extend this theorem to various values of $\alpha$ in $\mathbf{M}(h\mid \mathbf{v},\alpha )$. As in the preceding section, we follow [14] and assume that both $\mathbf{M}(h\mid \mathbf{v},\mathbf{\alpha },{\rho }_{12})$ and $\mathbf{M}(h\mid \mathbf{v},{\mathbf{\alpha }}^{\prime })$ below are general multivariate Matérn covariance functions. Furthermore, we assume that the choice of c satisfies the conditions in Theorem 4 in [13], ensuring that the main diagonal elements in the resulting matrix structure are valid univariate correlation functions.

Theorem 5.

Let $\mathbf{v}=(v_1,v_2,v_{12})$, $\mathbf{\alpha }=({\alpha }_1,{\alpha }_2,{\alpha }_{12})$, ${\mathbf{\alpha }}^{\prime }=({\alpha }_1^{\prime },{\alpha }_2^{\prime },{\alpha }_{12}^{\prime })$, $\mathit{\beta }=({\beta }_1,{\beta }_2)$ be constant vectors. $v_k\ge 0, {\alpha }_k\ge 0, {\alpha }_k^{\prime }\ge 0, -1\le {\beta }_k\le 1$, $\mathbb{D}\subset {\mathbb{R}}^d$ or ${\mathbb{S}}^d$. A sufficient and necessary condition for $p\times p$ matrix function, $p\le 2$

$$\mathbf{C}(h;t)=c\mathbf{M}\left(h\right|\mathbf{v},\mathbf{\alpha },{\rho }_{12}){\beta }_1^{\left|t\right|}+(1-c)\mathbf{M}\left(h\right|\mathbf{v},{\mathbf{\alpha }}^{\prime },{\rho }_{12}^{\prime }){\beta }_2^{\left|t\right|},t\in \mathbb{Z},h\in \mathbb{D}$$

(15)

to be a correlation matrix function on $\mathbb{D}\times \mathbb{Z}$ is that the constant c satisfies

$$\begin{array}{c}\hfill \underset{h\ge 0,D\left(h\right)>0}{inf}{\displaystyle \frac{c^2{\left({\beta }_1^{\ast }\right)}^{2}H\left(h\right)+{(1-c)}^2{\left({\beta }_2^{\ast }\right)}^2\tilde{H}\left(h\right)}{\left({\beta }_1^{\ast }\right)\left({\beta }_2^{\ast }\right)D\left(h\right)}}\ge c(c-1).\end{array}$$

(16)

where

$$\mathbf{M}\left(h\right|\mathbf{v},\mathbf{\alpha },{\rho }_{12})=\left[\begin{array}{cc}{m}_{11}\left(h\right|v_1,{\alpha }_1)& {\rho }_{12}{m}_{12}\left(h\right|v_{12},{\alpha }_{12})\\ {\rho }_{12}{m}_{12}\left(h\right|v_{12},{\alpha }_{12})& m_{22}\left(h\right|v_2,{\alpha }_2)\end{array}\right],$$

$m_{ij}\left(h\right|v_k,{\alpha }_k)={\displaystyle \frac{2^{1-v_k}}{\Gamma \left(v_k\right)}}{\left({\alpha }_{k}h\right)}^{v_k}{K}_{v_k}\left({\alpha }_{k}h\right)$, ${\beta }_i^{\ast }={\displaystyle \frac{1-{\beta }_i^2}{1+{\beta }_i^2-2{\beta }_{i}cos\left(\omega \right)}},i,j=1,2,k=1,2,12$

$$\begin{array}{c}\hfill H\left(h\right)={\displaystyle \frac{{\alpha }_1^{2v_1}{\alpha }_2^{2v_2}{c}_{v_1}{c}_{v_2}}{{({\alpha }_1^2+h^2)}^{v_1+d/2}{({\alpha }_2^2+h^2)}^{v_2+d/2}}}-{\displaystyle \frac{{\rho }_{12}^2{\alpha }_{12}^{4v_{12}}{c}_{v_{12}}^2}{{({\alpha }_{12}^2+h^2)}^{2v_{12}+d}}},\end{array}$$

$\tilde{H}\left(h\right)$ is defined like $H\left(h\right)$, with ${\alpha }_i$ replaced with ${\alpha }_i^{\prime }$, $i=1,2,12$.

$$\begin{array}{cc}\hfill D\left(h\right)& ={\displaystyle \frac{{\alpha }_1^{2v_1}{\alpha }_2^{\prime 2v_2}{c}_{v_1}{c}_{v_2}}{{({\alpha }_1^2+h^2)}^{v_1+d/2}{({\alpha }_2^{\prime 2}+h^2)}^{v_2+d/2}}}+{\displaystyle \frac{{\alpha }_1^{\prime 2v_1}{\alpha }_2^{2v_2}{c}_{v_1}{c}_{v_2}}{{({\alpha }_1^{\prime 2}+h^2)}^{v_1+d/2}{({\alpha }_2^2+h^2)}^{v_2+d/2}}}\hfill \\ \hfill & -{\displaystyle \frac{2{\rho }_{12}{\rho }_{12}^{\prime }{\alpha }_{12}^{2v_{12}}{\alpha }_{12}^{\prime 2v_{1}2}{c}_{v_{12}}^2}{{\left(({\alpha }_{12}^2+h^2)({\alpha }_{12}^{\prime 2}+h^2)\right)}^{v_{12}+d/2}}}.\hfill \end{array}$$

Incorporating different ${\alpha }_i$ values into the model allows for more detailed spatial parameterization, enabling a more precise capture of spatial trends. Once again, the condition in this theorem can be simplified under several special cases:

Corollary 2.

The sufficient and necessary condition for Equation (15) to be a correlation matrix function can be reduced to $0\le c\le 1$ in the following cases:

(a) When ${\alpha }_{12}\le min({\alpha }_1,{\alpha }_2)$, ${\alpha }_{12}^{\prime }\le min({\alpha }_1^{\prime },{\alpha }_2^{\prime })$, $v_{12}={\displaystyle \frac{v_1+v_2}{2}}$,

$$\begin{array}{c}\hfill {\rho }_{12}^2={\displaystyle \frac{c_{v_1}{c}_{v_2}}{c_{v_{12}}^2}}{\left({\displaystyle \frac{{\alpha }_{12}^2}{{\alpha }_1{\alpha }_2}}\right)}^d,{\rho }_{12}^{\prime 2}={\displaystyle \frac{c_{v_1}{c}_{v_2}}{c_{v_{12}}^2}}{\left({\displaystyle \frac{{\alpha }_{12}^{\prime 2}}{{\alpha }_1^{\prime }{\alpha }_2^{\prime }}}\right)}^d.\end{array}$$

(b) When ${\alpha }_{12}\ge max({\alpha }_1,{\alpha }_2)$, ${\alpha }_{12}^{\prime }\ge max({\alpha }_1^{\prime },{\alpha }_2^{\prime })$, $v_{12}={\displaystyle \frac{v_1+v_2}{2}}$, 

$$\begin{array}{c}\hfill {\rho }_{12}^2={\displaystyle \frac{c_{v_1}{c}_{v_2}}{c_{v_{12}}^2}}{\left({\displaystyle \frac{{\alpha }_1}{{\alpha }_{12}}}\right)}^{2v_1}{\left({\displaystyle \frac{{\alpha }_2}{{\alpha }_{12}}}\right)}^{2v_2},{\rho }_{12}^{\prime 2}={\displaystyle \frac{c_{v_1}{c}_{v_2}}{c_{v_{12}}^2}}{\left({\displaystyle \frac{{\alpha }_1^{\prime }}{{\alpha }_{12}^{\prime }}}\right)}^{2v_1}{\left({\displaystyle \frac{{\alpha }_2^{\prime }}{{\alpha }_{12}^{\prime }}}\right)}^{2v_2}.\end{array}$$

The proof of this corollary is similar to that of Corollary 1. The temporal margin in both theorems is given by

$$\mathbf{C}(0,t)=c{\mathbf{I}}_{2\times 2}{\beta }_1^{\left|t\right|}+(1-c){\mathbf{I}}_{2\times 2}{\beta }_2^{\left|t\right|},t\in \mathbb{Z},$$

which is a linear combination of valid correlation matrices. This structure encompasses a family of valid spatio-temporal correlation functions with stationary AR(1) (first-order autoregressive model), AR(2), and ARMA(2,1) temporal margins. The parameters ${\alpha }_k$ and ${\nu }_k$ for $k=1,2,12$ can be interpreted as the spatial scaling and smoothness parameters, respectively. The parameters ${\beta }_1$ and ${\beta }_2$ govern the temporal dynamics, while c serves as a mixing parameter balancing the two components.

To apply the proposed parametric models, one may first use time series techniques to fit ARMA models at each spatial location. This process can help determine the appropriate ARMA order and provide starting values for ${\beta }_1$, ${\beta }_2$, and c. Final parameter estimation can then be performed using either maximum likelihood estimation or the weighted least squares method of [26] (see also Equation (22) in [27]). For the spatial component, standard procedures in spatial statistics can be employed to estimate initial values for ${\alpha }_i$ and the cross-correlation parameters $\rho$, ${\rho }^{\prime }$. For instance, one can use the fitted parameters from the marginal spatial and cross-correlation functions at different time lags as starting points. Additional insights into the temporal structure can be obtained using tools such as the autocorrelation function (ACF), partial autocorrelation function (PACF), and information criteria like AIC and BIC. Since the temporal margin can initially be analyzed independently, this step provides useful guidance for model selection. Ultimately, the choice of the final model should be guided by space–time fitting criteria, which are generally robust to small variations in the marginal temporal model. Simplicity is also an important consideration in final model selection. Therefore, the proposed models, along with the stepwise estimation strategy, offer a practical and flexible approach by decomposing the complex spatio-temporal modeling problem into two more manageable steps. The proposed framework also provides an intuitive path toward modeling multivariate spatio-temporal processes, where each spatial location may follow an ARMA-type temporal process. One benefit of this approach is that it allows the multivariate MA(1) process to be approximated by analyzing marginal trends. Since the spatial correlation structure can differ across variables and time lags, it is often beneficial to estimate the trend separately at each time lag to obtain more accurate initial values. These components can then be integrated into a unified model, which is subsequently refined using joint estimation.

For the data application presented in the next section, parameter estimation was conducted using the least squares method from [7] and the techniques developed in [27]. Extending these techniques to accommodate general ARMA(p, q) temporal margins would require further theoretical development of the results presented here. However, such extensions remain computationally feasible, particularly when using Cressie’s weighted least squares approach. We leave the exploration of more complex temporal margins for future research.

4. Data Example: Kansas Daily Temperature Data

This dataset is sourced from the National Oceanic and Atmospheric Administration (NOAA) and includes observations from 105 weather stations across Kansas. For our real-data application, we focus on two highly correlated variables: daily maximum and minimum temperatures recorded over 8030 days, from 1 January 1990, to 31 December 2011, across all 105 counties. To preprocess the data, we compute weekly averages over the 8030 days, resulting in 1144 weeks of average maximum and minimum temperatures, which we use as our raw dataset. To reduce short-term variability to obtain a more stable pattern, we compute weekly averages from the daily temperature data. We divide the dataset into training and testing sets: the first 800 weeks (approximately the first fifteen years) are used for training, and the remaining 344 weeks (the last seven years) are used for testing. To detrend and deseasonalize the data, we follow the procedure outlined in [27] by subtracting the overall mean weekly temperature for each calendar week. Specifically:

Let $X_{y,w,i}$ be the weekly average temperature in year y, week w, location i; ${\overline{X}}_{w,i}$ be the average temperature for week w at location i across n years; and $X_{y,w,i}^{\ast }$ represents the weekly value at location i with the seasonal mean removed, defined as:

$$X_{y,w,i}^{\ast }=X_{y,w,i}-{\overline{X}}_{w,i}$$

(17)

where

$${\overline{X}}_{w,i}={\displaystyle \frac{1}{n}}\sum _{y=1}^n{X}_{y,w,i},w=1,2,\dots ,52$$

(18)

This deseasonalization step removes the dominant annual signal and yields weekly anomalies, which reveals the underlying MA(1) correlation pattern.

We then compute the autocorrelation function (ACF) and cross-correlation function (CCF) of the de-trended minimum and maximum temperature series across the 105 counties using the training period. Figure 1 and Figure 2 display the ACFs of average maximum and minimum temperatures for all locations, as well as for three randomly chosen stations. Based on the ACF and CCF plots, both variables exhibit a pattern consistent with a moving average process of order one (MA(1)), supporting the use of a spatio-temporal model with an MA(1) temporal margin.

Figure 1. ACFs of maximum temperature in Kansas counties.

Figure 2. ACFs of minimum temperature in Kansas counties.

The next step is to calculate space–time correlation using detrended data, $X_{y,w,i}$ for model fitting. Since the data includes many location pairs at each distance, it is hard to extract stable spatial trends across time lags. To reduce noise, we apply spatial binning using $h=4$ and $\delta =2$, which means that we average the spatial correlations within each 4-km bin and discard any empty bins. The binned correlations are the input data for further model fitting. We use the least squares optimization method to fit empirical spatial correlations for minimum temperature, maximum temperature, and their cross-correlation at lag zero. These fits provide suitable initial values for the PMM, SMM, and Cauchy models introduced below.

Guided by this exploratory analysis, using an MA(1)-type temporal margin is a suitable choice for Theorem 3 application. While the correlation approaches 1 at the distance $h=0$ in Theorem 3, real world data often exhibits a nugget effect and must be accounted for. By incorporating the nugget effect as described in Theorem 3, we formulate the proposed model, referred to as the PMM (Partially Mixed Model) based on $\mathbf{C}(h;t)$ in Equation (5), as follows:

$${\mathbf{C}}_{PMM}(h;t)=\left[\begin{array}{cc}(1-{\eta }_1)& 1\\ 1& (1-{\eta }_2)\end{array}\right]\circ \mathbf{C}(h;t)+\mathbf{C}(0;t)\circ \left[\begin{array}{cc}{\eta }_1{\mathbb{1}}_{\{h=0\}}& 0\\ 0& {\eta }_2{\mathbb{1}}_{\{h=0\}}\end{array}\right].$$

(19)

Cressie’s weighted-least-squares optimization method [26] for parameter estimation (Algorithm 1):

Algorithm 1 Estimation Procedure

Initialize parameters:

${\mathit{\theta }}^{\left(0\right)}=({\eta }_1,{\eta }_2,{\alpha }_{11},{\alpha }_1,{\alpha }_1^{\prime },{\alpha }_2,{\alpha }_2^{\prime }{\alpha }_{12},{\alpha }_{{12}^{\prime }},c,{\beta }_1,{\beta }_2,{\rho }_{12},{\rho }_{{12}^{\prime }})$;

Set iteration counter $d=0$;

Repeat

Compute predicted covariances in Equation (19) at $t=0,1,2$ across all distances;

Calculate weighted sum of squares:

${\mathrm{WSS}}^{\left(d\right)}=\sum {\left[\mathrm{residuals}\mathrm{at}t=0,1,2\mathrm{across}\mathrm{all}\mathrm{distances}\right]}^2$;

Update parameters ${\mathit{\theta }}^{(d+1)}$ by minimizing ${\mathrm{WSS}}^{\left(d\right)}$ using the L-BFGS-B algorithm;

$d\leftarrow d+1$;

until convergence: $|{\mathrm{WSS}}^{(d+1)}-{\mathrm{WSS}}^{\left(d\right)}|<\delta$, for a small threshold $\delta >0$.

Finally, the fitted and estimated parameter values for the PMM model are as follows: ${\eta }_1=0.1014$, ${\eta }_2=0.1280$, ${\alpha }_1=0.000025$, ${\alpha }_1^{\prime }=0.004088$, ${\alpha }_2=0.003852$, ${\alpha }_2^{\prime }=0.000025$, ${\alpha }_{12}=0.002868$, ${\alpha }_{12}^{\prime }=0.000100$, $c=0.5254$, ${\beta }_1=0.2496$, ${\beta }_2=0.2591$, ${\rho }_{12}=0.6964$, ${\rho }_{12}^{\prime }=0.6523$, and all $v_{ij}$ are set to 2.5. All of the estimated parameters satisfy the conditions in Theorem 3 to ensure Equation (19) is valid as a covariance matrix function. Otherwise, the involved matrix is not invertible, and co-kriging cannot be performed. Next, we apply the purely spatial multivariate Matérn model (SMM), as proposed in [14], for comparison with the incorporated nugget effect.

$$\mathbf{C}\left(h\right)=\left[\begin{array}{cc}(1-{\eta }_1)& 1\\ 1& (1-{\eta }_2)\end{array}\right]\circ \left\{\mathbf{M}\left(h\right|\mathbf{v},\mathbf{\alpha },{\rho }_{12})\right\}+\left[\begin{array}{cc}{\eta }_1{\mathbb{1}}_{\{h=0\}}& 0\\ 0& {\eta }_2{\mathbb{1}}_{\{h=0\}}\end{array}\right].$$

(20)

In addition, we compared the performance of the Cauchy separable model in continuous time, as proposed in [14], with the nugget effect incorporated.

$$\mathbf{C}(h;t)=\{\left[\begin{array}{cc}(1-{\eta }_1)& 1\\ 1& (1-{\eta }_2)\end{array}\right]\circ \mathbf{M}\left(h\right|\mathbf{v},\mathbf{\alpha },{\rho }_{12})+\left[\begin{array}{cc}{\eta }_1{\mathbb{1}}_{h=0}& 0\\ 0& {\eta }_2{\mathbb{1}}_{h=0}\end{array}\right]\}·\left\{\right(1+{a\left|t\right|}^{2\alpha }{)}^{-1}\},$$

(21)

where $t\in \mathbb{R},h\in \mathbb{D}$.

Figure 3 and Figure 4 show the fitted PMM, SMM, and Cauchy models at time lags of 0 and 1 for maximum temperature, minimum temperature, and their cross space–time correlations. In Figure 3, the PMM model fits the empirical correlations better than the SMM and Cauchy models, capturing the underlying structure more accurately. In Figure 4, for maximum and minimum temperature correlations at lag 1, the PMM better capture the correlation patterns, while the Cauchy model performs slightly better for the cross-correlation.

Figure 3. Empirical Temperature space–time correlations and fitted models at time lag 0 in Kansas.

Figure 4. Empirical Temperature space–time correlations and fitted models at time lag 1 in Kansas.

Across both figures, correlation dispersion increases at long distances, as seen in the first plot of Figure 3. This pattern aligns with real-world expectations, where correlation typically decreases with distance, and it also contributes to reduced model fitting performance. Figure 5 shows that at time lag 2, all correlations are near zero, highlighting the MA(1) temporal structure in the data. PMM model correlation estimates are also zero by definition.

Figure 5. Empirical Temperature space–time correlations at time lag 2 in Kansas.

After fitting the PMM, SMM, and Cauchy models on the training data, the next step is to perform co-kriging for prediction on the testing data, as described below.

The response variable $\widehat{Y}(s_0,t_0)$ at location $s_0$, time $t_0$ is estimated as follows:

$$\widehat{Y}(s_0,t_0)=\sum _{i=1}^n\sum _{j=1}^m{\lambda }_{ij}^{Y}Y(s_i,t_j)+\sum _{i=1}^n\sum _{j=1}^m{\lambda }_{ij}^{X}X(s_i,t_j,).$$

(22)

where the weights ${\lambda }_{ij}^Y$ and ${\lambda }_{ij}^X$ are obtained by solving the following:

$${\lambda }_{\mathrm{ck}}=K_{\mathrm{ck}}^{-1}{k}_{\mathrm{ck}},$$

(23)

$$K_{\mathrm{ck}}=\left(\begin{array}{cccc}{C}_{YY}& C_{YX}& \mathbf{1}& \mathbf{0}\\ C_{XY}& C_{XX}& \mathbf{0}& \mathbf{1}\\ {\mathbf{1}}^{\top }& {\mathbf{0}}^{\top }& 0& 0\\ {\mathbf{0}}^{\top }& {\mathbf{1}}^{\top }& 0& 0\end{array}\right),$$

(24)

where:

$${\mathbf{C}}_{YY}=\left(\begin{array}{ccc}{\mathbf{C}}_{YY}(s_i-s_j,t_1-t_1)& \dots & {\mathbf{C}}_{YY}(s_i-s_j,t_1-t_m)\\ ⋮& \ddots & ⋮\\ {\mathbf{C}}_{YY}(s_i-s_j,t_m-t_1)& \dots & {\mathbf{C}}_{YY}(s_i-s_j,t_m-t_m)\end{array}\right).$$

(25)

${\mathbf{C}}_{YY}(s_i-s_j,t_1-t_1)$ is the covariance matrix across distances at time lag $t_1-t_1$ for variable Y and

$${\mathbf{k}}_{\mathrm{ck}}=\left(\begin{array}{c}{C}_{YY}(s_0-s_1,t_0-t_1)\\ ⋮\\ C_{YY}(s_0-s_n,t_0-t_m)\\ C_{YX}(s_0-s_1,t_0-t_1)\\ ⋮\\ C_{YX}(s_0-s_n,t_0-t_m)\\ 1\\ 0\end{array}\right).$$

(26)

In the PMM and Cauchy models, co-kriging is performed using the minimum and maximum values across all locations at $t-1$ and $t-2$ as input data, and SMM model uses $t-1$ only.

In addition, we consider a traditional time series modeling approach. Since standard time series prediction functions in the R package do not support forecasting with fixed parameters, we developed a custom implementation using the Innovations algorithm described in [4]. We fit the time series model on the training data for maximum temperatures at all 105 stations. Specifically, for each station, we estimated the parameters $\theta$ and $\sigma$, which are the key components of a moving average process of order one (MA(1)), and we used them to generate predictions on the testing data.

Finally, predictions were obtained for the testing period. The root mean squared error (RMSE) and 95% data interval was computed for each method to assess predictive performance. Table 1 reports the model performance across all counties for maximum temperature.

Table 1. Kansas maximum temperature RMSE statistics.

Measure	PMM	SMM	Cauchy	Time Series
% Stations w/Lowest RMSE	93.3%	4.8%	0%	1.9%
AVG. RMSE at All Stations	3.887092	4.686701	3.938303	3.914282
95% Data Interval	[3.81, 3.96]	[4.64, 4.73]	[3.86, 4.02]	[3.84, 3.99]

The percentage of Stations with the Lowest RMSE shows that the PMM model outperforms the others at most locations, achieving the lowest RMSE at 93.3% of the 105 stations. This demonstrates the model’s broad applicability and consistency across different locations. Consequently, the PMM model also produces the lowest average RMSE across all locations. While this difference may seem small, it is important in the de-seasonalized weekly average temperature data, where fluctuations are limited, making even small improvements both statistically and practically meaningful; see [28]. Moreover, the PMM model proves to be more reliable at individual stations, consistently providing better local predictions. This suggests that the model captures more complex spatial structures than simple MA(1) temporal margin or simple spatial correlation margin like the SMM model. The models used for comparison also have strong performance, using the marginal average as the starting points. All models shared those initial value together, so slight improvements are still considered beneficial. Based on this analysis, the proposed PMM model demonstrates consistently better predictive performance, particularly when the temporal margin of the space–time process is properly modeled using an MA(1) structure. The PMM model can also perform well when there is a large number of missing values in the primary variable by leveraging information from the secondary variable, which time series models are unable to utilize. Also, in real-world applications involving complex spatial–temporal data, model selection can be challenging. The PMM model stands out as an easy choice by simply using the marginal spatial and temporal correlations to select the appropriate structure in the PMM model. These results suggest that incorporating both strongly correlated spatial components and discrete-time dependence improves the overall predictive accuracy.

5. Discussion

This work presents a foundational framework for direct modeling of space–time random fields with spatially correlated structures and time series components. The methodology developed here enables the integration of spatial covariance models with some autoregressive and moving average temporal structures, offering a tractable yet flexible approach for analyzing spatio-temporal data. Looking ahead, several avenues for further development are promising. One direction is to incorporate more complex forms of temporal dependence, such as general ARMA or nonstationary time dynamics, to better reflect the intricate temporal behaviors observed in environmental and geophysical data. From an inferential standpoint, parameter estimation techniques can be enhanced by moving beyond least squares approaches. Specifically, adopting maximum likelihood estimation to fit the full correlation structure could lead to more efficient and statistically robust inference, particularly when the data exhibits strong space–time interactions. Additionally, while some of the current framework relies on the Matérn class of spatial covariance functions due to its theoretical and practical appeal, other families of spatial structures, including compactly supported or nonstationary models, may offer advantages in specific applications. Exploring these alternatives can further improve the adaptability of the modeling strategy to diverse scientific domains.