Next Article in Journal
On the Dynamics of Fractional Models for Power Systems with Incommensurate Orders: Chaos, Multistability, and Control
Previous Article in Journal
On Hybrid-Function Solutions of the Lotka–Volterra Equations
Previous Article in Special Issue
Bayesian Estimation of Autoregressive Models with Exogenous Variables Under Scale-Mixtures of Normal Errors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Full Bayesian Analysis of ARX Models Under Scale-Mixtures of Normal Errors: An Application to Solar Radiation in Najran, Saudi Arabia

by
Ayman A. Amin
1,2 and
Shuhrah A. Alghamdi
3,*
1
Department of Mathematics, College of Arts and Sciences, Najran University, Najran 66462, Saudi Arabia
2
Science and Engineering Research Center, Najran University, Najran 66462, Saudi Arabia
3
Department of Mathematical Sciences, College of Sciences, Princess Nourah bint Abdulrahman University, Riyadh 11564, Saudi Arabia
*
Author to whom correspondence should be addressed.
Mathematics 2026, 14(17), 3163; https://doi.org/10.3390/math14173163
Submission received: 25 June 2026 / Revised: 25 August 2026 / Accepted: 31 August 2026 / Published: 2 September 2026

Abstract

Autoregressive models with exogenous variables (ARX) constitute a fundamental family of time series tools with broad applicability across engineering, environmental science, and finance. A persistent limitation of standard Bayesian treatments is the Gaussian error assumption, which frequently proves inadequate when dealing with real data displaying heavy tails or occasional extreme observations. To overcome this shortcoming, the present paper develops a complete Bayesian inferential framework for ARX models under the scale-mixtures of normal (SMN) error distribution, integrating model identification, parameter estimation, and multi-step-ahead prediction within a unified scheme. A stochastic search variable selection (SSVS) procedure is adapted to perform simultaneous selection of the autoregressive order and the active exogenous regressors by assigning binary latent indicators to each candidate coefficient. Mixture-of-normals priors are specified for the dynamic and exogenous coefficients and an inverse-gamma prior for the error scale, while Bernoulli priors govern the latent selection indicators. These choices yield tractable full conditional posterior distributions: multivariate normal for the complete coefficient vector, inverse-gamma for the scale, and Bernoulli for the indicators. The conditional predictive distribution of future observations is also multivariate normal. For SMN-specific mixing parameters whose conditionals lack standard forms, Metropolis–Hastings steps are embedded within the Gibbs sampler. An extensive simulation study evaluates recovery accuracy across three SMN distributions and several ARX configurations. The methodology is then applied to the forecasting of daily global horizontal irradiance (GHI) in Najran, southwestern Saudi Arabia, using clear-sky GHI as an exogenous covariate, demonstrating the practical value of the proposed framework in a renewable energy context.

1. Introduction

Autoregressive models with exogenous variables (ARX) represent a widely employed class of dynamic models that extend the pure autoregressive (AR) framework by incorporating the explanatory power of observable external covariates. By conditioning the current level of a response variable on its own past values as well as on relevant input signals, ARX models offer a principled and parsimonious representation of a broad range of causal dynamic relationships [1,2]. Their versatility has made them standard tools for prediction and system identification in domains as varied as macroeconomic forecasting [3,4], load and electricity demand modeling [5], environmental science [6], renewable energy systems [7,8], and control engineering [9]. Solar radiation forecasting is a particularly demanding member of this family of applications. Daily global horizontal irradiance (GHI) is strongly driven by a deterministic astronomical envelope, yet the residual day-to-day dynamics are perturbed by intermittent cloud cover, dust intrusions, and other abrupt atmospheric events. These factors induce heavy-tailed, occasionally extreme deviations, while the relevant autoregressive and exogenous lag structure is rarely known in advance. This combination of genuine structural uncertainty and non-Gaussian noise is precisely the joint problem that motivates the present paper. It is revisited throughout as a concrete, substantive application, rather than as a post hoc illustration.
Two distinct inferential problems arise whenever an ARX model is fitted to observed data. The first is structural specification: it is rarely known in advance which AR lags or which external regressor lags carry genuine predictive information [10]. The second is estimation uncertainty: once a structure is tentatively accepted, all parameter uncertainty must be properly propagated to downstream forecasts. Classical methods typically decouple these tasks, resolving structure via information criteria in a first stage and conducting inference conditional on the selected structure in a second stage, thereby ignoring the additional uncertainty stemming from model selection [11]. A fully Bayesian treatment, by contrast, treats model structure and parameter values as jointly uncertain, allowing their posteriors to be learned simultaneously from the data.
The body of Bayesian literature on AR-type models under Gaussian errors is substantial. Foundational regression-based Bayesian inference was laid out by Box and Tiao [12], while Chib and Greenberg [13] introduced a Gibbs sampling approach for regression models with ARMA-correlated disturbances. McCulloch and Tsay [14] demonstrated that full conditional posterior distributions of pure AR models can be expressed in standard forms amenable to direct sampling. The stochastic search variable selection (SSVS) approach of George and McCulloch [15,16] provides a highly effective Bayesian mechanism for variable selection, and its adaptation to time series settings has been pursued by Chen [17], So et al. [18], Chen et al. [19], and Amin et al. [20]. Gibbs sampling has also been proposed for the Bayesian analysis of seasonal ARMA and double-seasonal AR models [21,22]. Bayesian inference for ARX models under Gaussian errors has been pursued along several complementary lines. Peterka [11] derived one of the earliest conjugate posteriors for linear system identification with Gaussian noise, subsuming the ARX model as a special case. Pillonetto et al. [23] later proposed a kernel-based Bayesian framework for regularized system identification in which the ARX structure arises naturally, while Pillonetto and Ljung [24] extended this perspective by treating stable kernels probabilistically and modeling the associated impulse responses as zero-mean Gaussian vectors. More recently, Cooper et al. [10] developed a cross-validation strategy for Bayesian ARX model selection, demonstrating that joint log-scores outperform pointwise criteria under serial dependence.
A complementary concern is the robustness of the assumed error distribution. Departures from Gaussianity—manifesting as excess kurtosis, occasional outliers, or distinct clusters of anomalous observations—are commonplace in environmental, financial, and engineering time series. The scale-mixtures of normal (SMN) distribution [25,26] provide a coherent and flexible way to handle such deviations. By writing each observation as a Gaussian variate with a randomly rescaled variance, the framework subsumes Student’s t, slash, and contaminated normal distributions as members of a common parametric family, while the normal itself arises as a degenerate case. The hierarchical structure of the SMN representation is particularly convenient for Bayesian computation, because conditionally on the latent scale variables, the likelihood is Gaussian, and many full conditional posteriors admit closed forms [27,28].
The intersection of AR modeling and SMN errors has attracted some attention in the literature. Ferreira et al. [29] treated partial linear models with AR disturbances following an SMN distribution, while Mahmoudi et al. [30] considered heavy-tailed finite mixture AR models from a Bayesian viewpoint. Work by Ryu and Kim [31] and Agarwal and Tripathi [32] examined Bayesian inference for pure AR processes under exponential power and Student’s t errors, respectively. Recently, Amin [33,34,35] extended the SMN error framework to seasonal AR models, establishing a full Bayesian estimation, prediction, and analysis procedure. Most recently, Amin and Alghamdi [36] proposed the Bayesian estimation of ARX models under SMN errors. Nevertheless, a comprehensive Bayesian treatment of ARX models under SMN errors—one that integrates simultaneous order and variable selection with robust parameter estimation and multi-step forecasting—appears to be absent from the existing literature.
The present paper fills this gap through several contributions. First, we extend the SSVS mechanism to perform simultaneous selection of AR lags and exogenous variable lags in a general ARX model that is capable of accommodating any number of exogenous inputs with individual lag structures. Second, we derive tractable full conditional posterior distributions for all model unknowns under the SMN assumption. A defining structural feature of the ARX model is its linearity in all coefficients, which permits the joint posterior of the complete coefficient vector to be characterized as a single multivariate normal distribution. Third, we establish a closed-form multivariate normal conditional predictive distribution for multi-step-ahead forecasting, enabling uncertainty-quantified predictions. Fourth, we design a Gibbs sampler with embedded Metropolis–Hastings steps that combines these results into an efficient, fully automated algorithm. Fifth, we validate the methodology via an extensive simulation study and an empirical application to daily solar radiation forecasting in Najran, Saudi Arabia, illustrating the practical utility of the proposed framework in the growing domain of solar energy analytics.
To situate these contributions relative to existing approaches, the proposed framework is positioned against three related strands of the literature: classical (non-Bayesian) ARX modeling [2,37,38], Bayesian ARX under Gaussian errors [10,11,23,24], and robust Bayesian AR-type models under SMN errors that do not address structural selection [29,30,36]. No existing approach combines robust SMN error modeling, joint AR-order and exogenous-lag selection, and closed-form multi-step probabilistic forecasting within a single MCMC sampler, which is the specific gap the present paper closes.
The paper is organized as follows. Section 2 introduces the SMN distribution and presents the ARX model. Section 3 develops the Bayesian framework comprising the SSVS prior structure, the augmented likelihood, the joint posterior, and the predictive formulation. Section 4 derives all full conditional distributions and presents the proposed MCMC algorithm. Section 5 reports the simulation study. Section 6 presents the empirical application to solar radiation in Najran. Section 7 concludes the work.

2. ARX Models Under Scale-Mixtures of Normal Errors

2.1. Scale-Mixtures of Normal Distributions

The SMN class constitutes a rich and analytically tractable family of symmetric distributions capable of representing data with heavier-than-Gaussian tails [25,26]. A scalar random variable y belongs to this class with location μ and scale parameter σ 2 if it can be expressed as the stochastic mixture:
y = μ + u 1 / 2 ε ,
where ε N ( 0 , σ 2 ) , the mixing variable u > 0 has marginal density p ( u ν ) indexed by a parameter vector ν , and  ε and u are mutually independent. Integrating out u gives y SMN ( μ , σ 2 , ν ) , with the conditional distribution y u N ( μ , u 1 σ 2 ) .
Three SMN special cases are of primary interest. Under  u G ( ν / 2 , ν / 2 ) with ν > 0 , the marginal of y is Student’s t with ν degrees of freedom (SMN-t). When u Beta ( ν , 1 ) with ν > 0 , the resulting distribution is the slash (SMN-sl), which places more probability mass in the tails than the t for moderate ν . Setting u to be a Bernoulli-type variable taking value γ ( 0 , 1 ) with probability ν and value 1 with probability ( 1 ν ) , i.e.,
p ( u ν , γ ) = ν I { γ } ( u ) + ( 1 ν ) I { 1 } ( u ) , ν , γ ( 0 , 1 ) ,
yields the contaminated normal (SMN-cn), a two-component scale mixture capturing occasional large excursions from a dominant Gaussian body. Finally, p ( u = 1 ) = 1 recovers the normal (SMN-n). The SMN family is particularly well-suited to situations where the analyst is uncertain about the degree of tail heaviness, since the mixing parameter ν can be inferred from the data [27].

2.2. ARX Models

Let { y t } denote a scalar time series of interest and let { x j , t } , j = 1 , , q , be q observed exogenous sequences. A general ARX model of AR order p, exogenous lag orders d 1 , , d q , and an additive intercept μ 0 is defined by:
y t = μ 0 + i = 1 p ϕ i y t i + j = 1 q l = 0 d j 1 α j l x j , t l + ε t , t = 1 , , n ,
where μ 0 is the intercept, ϕ i are the AR coefficients, α j l is the response coefficient of the l-th lag of the j-th exogenous input, and  ε t is an SMN-distributed error with zero mean and scale σ 2 . The model intercept μ 0 captures the unconditional mean of y t and guards against bias when the series has a nonzero level, as often occurs after transformations such as differencing or log-ratio computation.
Remark 1.
Standard sub-models follow immediately from (3). Removing all exogenous inputs ( q = 0 ) gives the AR ( p ) model. Removing the AR component ( p = 0 ) and keeping d j = 1 yields the multiple linear regression model.
To express the model compactly, define the augmented regressor vector
z t = 1 , y t 1 , , y t p , x 1 , t , , x 1 , t d 1 + 1 , , x q , t , , x q , t d q + 1 T ,
and the full coefficient vector
θ = μ 0 , ϕ 1 , , ϕ p , α 10 , , α 1 , d 1 1 , , α q 0 , , α q , d q 1 T ,
of dimension m = 1 + p + j = 1 q d j . The model then reads
y t = z t T θ + ε t ,
and stacking all n observations yields the matrix form
y = Z θ + ε ,
where y = ( y 1 , , y n ) T , ε = ( ε 1 , , ε n ) T , and  Z is the n × m design matrix with t-th row z t T . The matrix Z partitions naturally as
Z = 1 n | Y L | X 1 | | X q ,
where 1 n is the n-vector of ones corresponding to the intercept, Y L is the n × p lag matrix with ( t , i ) -entry y t i , and  X j is the n × d j matrix with ( t , l ) -entry x j , t l .
A key structural property of the ARX model that will be central to the Bayesian derivations is its linearity in θ . Because  z t contains only predetermined quantities (past observations and current/past exogenous values) and the intercept is a constant, the conditional mean z t T θ is linear in θ for all t. In the present ARX setting, linearity enables the full conditional posterior of the entire augmented coefficient vector θ —encompassing intercept, AR lags, and all exogenous regressors—to be obtained analytically as a multivariate normal distribution, as shown later in Section 4.
An inferential challenge persists even for this linear model. The values of p and d 1 , , d q are typically unknown. We handle this by fixing upper bounds p max and d j , max and relying on the SSVS to select active elements [15].

3. Bayesian Framework

3.1. Prior Specification

For each coefficient θ k , k = 1 , , m , we introduce a binary latent indicator δ k { 0 , 1 } , where δ k = 1 signifies that the k-th regressor is active and δ k = 0 that it is negligible. Following George and McCulloch [15], the conditional prior on θ k given δ k is a two-component normal mixture:
ζ ( θ k δ k ) = δ k N ( 0 , c k 2 τ k 2 ) + ( 1 δ k ) N ( 0 , τ k 2 ) , k = 1 , , m .
Here, τ k 2 1 concentrates θ k near zero when the regressor is excluded, while c k 2 τ k 2 with c k 1 allows θ k to be appreciably different from zero when the regressor is included. Conditional independence of the θ k ’s given their indicators leads to the multivariate normal prior:
ζ ( θ δ ) = N m 0 , M δ W M δ ,
where M δ = diag ( a 1 τ 1 , , a m τ m ) with a k = c k if δ k = 1 and a k = 1 otherwise, and  W is a prior correlation matrix.
For the error scale parameter, an inverse-gamma prior is adopted:
ζ ( σ 2 ) = I G a 0 2 , b 0 2 ,
where a 0 , b 0 > 0 are hyperparameters; small values make the prior diffuse. Each latent indicator independently follows a Bernoulli prior p ( δ k = 1 ) = P k , and the joint prior over δ = ( δ 1 , , δ m ) T is:
ζ ( δ ) = k = 1 m P k δ k ( 1 P k ) 1 δ k .
Equal prior inclusion probabilities P k = 1 / 2 yield the non-informative uniform prior ζ ( δ ) = 2 m over all 2 m submodels. Priors for ν follow Cabral et al. [28]. SMN-t uses a truncated exponential on ν ( 2 , ) with rate parameter λ U ( c , d ) , SMN-sl uses the same but on ν ( 1 , ) , and SMN-cn uses ν Beta ( ν 0 , ν 1 ) and γ Beta ( γ 0 , γ 1 ) .
Hyperparameter configuration. Following the recommendations of George and McCulloch [15] for the SSVS prior (9), the spike variance is set small, τ k 2 = 0.01 , and the slab-to-spike variance ratio is set large, c k 2 = 100 , for every candidate coefficient θ k , so that excluded regressors are shrunk close to zero while included regressors are essentially unconstrained relative to the scale of the data. The prior inclusion probabilities are set to P k = 0.5 , corresponding to the non-informative uniform prior over all 2 m candidate submodels discussed above. The error-scale prior is set diffuse, a 0 = b 0 = 0.01 , so that ζ ( σ 2 ) contributes negligible prior information relative to the likelihood. These default choices are adopted in this work, while a sensitivity analysis of the ARX-SMN posterior with respect to alternative specifications of ( c k , τ k , a 0 , b 0 ) represents a worthwhile extension that is left for future research. Accordingly, the variable-selection outcomes and posterior summaries reported in Section 5 and Section 6 should be interpreted as conditional on this hyperparameter configuration. A different, yet still reasonable, choice of ( c k , τ k , a 0 , b 0 ) could shift individual inclusion probabilities and posterior interval widths. Even so, the broad substantive conclusions are expected to remain robust, given how far these estimates lie from zero relative to their posterior spread.
Collecting Θ = ( θ , σ 2 , δ , ν ) and assuming ( θ , σ 2 , δ ) ν a priori, the joint prior factorizes as:
ζ ( Θ ) = ζ ( θ δ ) ζ ( σ 2 ) ζ ( δ ) ζ ( ν ) .

3.2. Augmented Likelihood and Joint Posterior

Let u = ( u 1 , , u n ) T collect the latent scale variables. Conditional on u , each error ε t u t N ( 0 , u t 1 σ 2 ) , so from the SMN representation (1) and model (6), y t θ , σ 2 , u t N ( z t T θ , u t 1 σ 2 ) with density
ζ ( y t θ , σ 2 , u t ) = u t 2 π σ 2 1 / 2 exp u t 2 σ 2 ( y t z t T θ ) 2 .
Because the ε t are conditionally independent across t = 1 , , n , and each u t is independent of θ , σ 2 a priori with density p ( u t ν ) , the augmented joint density of ( y , u ) is obtained by multiplying ζ ( y t θ , σ 2 , u t ) and p ( u t ν ) over t. Since each u t enters its own summand only as a scalar weight on the corresponding squared residual ( y t z t T θ ) 2 , the n individual exponents stack into the single quadratic form ( y Z θ ) T U ( y Z θ ) , with  U = diag ( u 1 , , u n ) collecting the weights. This gives
ζ ( y , u θ , σ 2 , ν ) ( σ 2 ) n / 2 exp 1 2 σ 2 ( y Z θ ) T U ( y Z θ ) t = 1 n u t 1 / 2 p ( u t ν ) .
Equation (14) is a standard hierarchical data-augmentation device for SMN distributions [27,28]. Conditioning on u gives a weighted-least-squares Gaussian kernel with observation-specific precisions u t / σ 2 , while marginalizing over u recovers the (non-Gaussian) SMN likelihood. Applying Bayes’ theorem with the joint prior (13) yields the joint posterior
ζ ( θ , σ 2 , δ , u , ν y ) ζ ( Θ ) ( σ 2 ) n / 2 exp 1 2 σ 2 ( y Z θ ) T U ( y Z θ ) t = 1 n u t 1 / 2 p ( u t ν ) .
Since Z θ is linear in θ , the exponent in (15) is a negative definite quadratic form in θ , guaranteeing a Gaussian conditional posterior for θ as established in Section 4.1.

3.3. Predictive Formulation

Let y f = ( y n + 1 , , y n + k ) T be the vector of k future observations. The h-step-ahead equation is
y n + h = z n + h T θ + ε n + h , h = 1 , , k ,
where z n + h includes the intercept indicator, AR terms (drawing on future y’s for h > 1 ), and the future exogenous values assumed known or externally projected. Expressing the k future equations jointly in matrix notation,
y f = Z f 1 W f y L + X f α + μ 0 c f + Z f 1 ε f ,
where Z f is the k × k lower-triangular AR recursion matrix, W f carries the AR weights applied to the last p observed values y L = ( y n , , y n p + 1 ) T , X f collects the future exogenous values weighted by α , c f absorbs the cumulative intercept contributions, and  ε f = ( ε n + 1 , , ε n + k ) T are the future errors. The unconditional predictive density ζ ( y f y ) is obtained by marginalizing the conditional predictive distribution over the joint posterior (15). As shown next, the conditional predictive distribution is multivariate normal, enabling efficient Monte Carlo approximation via the MCMC algorithm.

4. Conditional Distributions and MCMC Algorithm

4.1. Full Conditional Posterior and Predictive Distributions

At this stage, we derive the full collection of conditional distributions that serve as the foundation for the MCMC algorithm in Bayesian analysis of ARX models.

4.1.1. Conditional Posterior of θ

Retaining only the terms in (15) that depend on θ and using the multivariate normal prior (10), we obtain the kernel
ζ ( θ σ 2 , δ , u , ν , y ) exp 1 2 σ 2 ( y Z θ ) T U ( y Z θ ) 1 2 θ T Σ 0 1 ( δ ) θ ,
where Σ 0 ( δ ) is the prior covariance matrix ( M δ W M δ ) for the model coefficients. Expanding the exponent gives 1 2 θ T σ 2 Z T U Z + Σ 0 1 ( δ ) θ 2 σ 2 θ T Z T U y + const , a quadratic form in θ whose leading matrix is the posterior precision. Matching this to the canonical form 1 2 ( θ μ θ ) T ( V θ ) 1 ( θ μ θ ) of a Gaussian density—i.e., completing the square in θ —yields the multivariate normal N m ( μ θ , V θ ) , with 
V θ = σ 2 Z T U Z + σ 2 Σ 0 1 ( δ ) 1 , μ θ = 1 σ 2 V θ Z T U y .
This is the usual conjugate update of a Gaussian likelihood (14) with a Gaussian prior (10), so no further approximation is required at this step.

4.1.2. Conditional Posterior of σ 2

Since ( θ , δ ) enter (14) only through θ , this term is fixed when conditioning on θ , and the augmented likelihood contributes the kernel ( σ 2 ) n / 2 exp { Q / ( 2 σ 2 ) } with Q = ( y Z θ ) T U ( y Z θ ) , which is conjugate to the inverse-gamma prior (11). Collecting only the σ 2 -dependent terms from (15) identifies an inverse-gamma kernel:
σ 2 rest I G a 0 + n 2 , b 0 + ( y Z θ ) T U ( y Z θ ) 2 .
i.e., the prior shape a 0 / 2 and rate b 0 / 2 are updated by adding half the sample size and half the weighted residual sum of squares Q, respectively the standard normal-inverse-gamma conjugate pairing.

4.1.3. Conditional Posterior of Each δ k

Since δ k enters the model only through the two-component mixture prior (9) on θ k , Bayes’ rule applied to the discrete prior { P k , 1 P k } on δ k = { 1 , 0 } , weighted by the conditional density of θ k under the corresponding mixture component, gives p ( δ k = 1 θ k , rest ) P k ζ ( θ k δ k = 1 , rest ) and p ( δ k = 0 θ k , rest ) ( 1 P k ) ζ ( θ k δ k = 0 , rest ) ; normalizing these two quantities to sum to one shows that for each k = 1 , , m , the conditional posterior of δ k is Bernoulli with inclusion probability
p ( δ k = 1 θ , σ 2 , δ ( k ) , u , ν , y ) = A k A k + B k ,
where A k = P k ζ ( θ k δ k = 1 , rest ) and B k = ( 1 P k ) ζ ( θ k δ k = 0 , rest ) . This posterior-odds update is the standard two-component mixture computation underlying the SSVS mechanism of George and McCulloch [15].

4.1.4. Conditional Posteriors Under SMN-t

The conditional posterior of each scale variable u t is a gamma distribution:
u t rest G ν + 1 2 , ( y t z t T θ ) 2 2 σ 2 + ν 2 .
This follows because, with  e t = y t z t T θ , the augmented likelihood (14) contributes the factor u t 1 / 2 exp { u t e t 2 / ( 2 σ 2 ) } , and the SMN-t mixing density is u t G ( ν / 2 , ν / 2 ) ; multiplying the two gives a kernel proportional to u t ( ν + 1 ) / 2 1 exp { u t [ e t 2 / ( 2 σ 2 ) + ν / 2 ] } , which is recognized directly as the Gamma density in (22)—again a direct conjugacy result requiring no approximation.
The degrees-of-freedom parameter ν has a non-standard conditional posterior:
ζ ( ν rest ) ( ν / 2 ) ν / 2 Γ ( ν / 2 ) n t = 1 n u t ν / 2 1 exp ν 1 2 t = 1 n u t + λ , ν > 2 ,
sampled via a Metropolis–Hastings step using the truncated normal proposal:
T N ν ( i 1 ) c ν / d ν , 1 / d ν , ( 2 , ) ,
where c ν and d ν are the first and second derivatives of log ζ ( ν · ) evaluated at ν ( i 1 ) . The candidate is accepted with probability min { r , 1 } , where r is given as:
r = [ ζ ( ν · ) f ( ν ( i 1 ) ν , · ) ] / [ ζ ( ν ( i 1 ) · ) f ( ν ν ( i 1 ) , · ) ] .
The hyperparameter λ follows λ ν T G ( 2 , ν , ( c , d ) ) .

4.1.5. Conditional Posteriors Under SMN-sl

The conditional posterior of each scale variable u t is a truncated gamma distribution:
u t rest T G ν + 1 2 , ( y t z t T θ ) 2 2 σ 2 , ( 0 , 1 ) .
This is obtained, as for SMN-t above, by multiplying the same Gaussian-kernel factor u t 1 / 2 exp { u t e t 2 / ( 2 σ 2 ) } by the slash mixing density p ( u t ν ) u t ν 1 1 ( 0 , 1 ) ( u t ) and recognizing the resulting kernel as a Gamma density truncated to ( 0 , 1 ) . The ν has a truncated gamma distribution:
ν rest T G n + 1 , λ t = 1 n log u t , ( 1 , ) ,
and the hyperparameter λ follows λ ν T G ( 2 , ν , ( c , d ) ) .

4.1.6. Conditional Posteriors Under SMN-cn

Because the SMN-cn mixing variable takes only the two values { γ , 1 } with prior weights { ν , 1 ν } (2), multiplying each prior weight by the corresponding Gaussian-kernel factor from (14) and renormalizing gives a discrete (two-point) conditional posterior for u t . Specifically, the scale variable u t follows the two-point distribution taking value γ with weight ν 1 / ( ν 1 + ν 2 ) and value 1 with weight ν 2 / ( ν 1 + ν 2 ) , where
ν 1 = ν γ 1 / 2 exp γ 2 σ 2 ( y t z t T θ ) 2 , ν 2 = ( 1 ν ) exp 1 2 σ 2 ( y t z t T θ ) 2 .
The contamination weight satisfies ν rest Beta ( ν 0 + m γ , ν 1 + n m γ ) , with m γ = t 1 ( u t = γ ) . The contamination severity parameter γ has the non-standard conditional posterior
ζ ( γ rest ) γ γ 0 1 ( 1 γ ) γ 1 1 t = 1 n ν γ 1 / 2 e γ 2 σ 2 ( y t z t T θ ) 2 + ( 1 ν ) e 1 2 σ 2 ( y t z t T θ ) 2 ,
sampled with a Metropolis–Hastings step using the logit-normal proposal.

4.1.7. Conditional Predictive Distribution of y f

Since (17) expresses y f as an affine transformation of the future error vector ε f , and  ε f U f , σ 2 is jointly Gaussian under the same SMN hierarchy introduced in Section 3.2, it follows that any affine transformation of a Gaussian vector is itself Gaussian. Expanding (17) and marginalizing over all quantities other than y f , the conditional predictive distribution is multivariate normal N k ( μ y f , V y f ) , where
μ y f = Z f 1 W f y L + X f α + μ 0 c f , V y f = σ 2 Z f T U f Z f 1 ,
with U f = diag ( u n + 1 , , u n + k ) , and the recursion matrices
Z f = 1 0 0 ϕ 1 1 0 ϕ k 1 ϕ 1 1 k × k , W f = ϕ 1 ϕ 2 ϕ p ϕ 2 ϕ 3 0 ϕ k ϕ p 0 k × p .

4.2. MCMC Algorithm for Full Bayesian Analysis of ARX Models

The full conditional posterior distributions derived in the preceding subsections, alongside the conditional predictive distribution, collectively provide all the necessary building blocks for constructing an efficient MCMC algorithm that carries out the full Bayesian analysis on the ARX model under SMN errors. This MCMC algorithm encompasses identification, estimation, and multi-step-ahead forecasting within a single algorithmic pass. These distributions are now assembled into the Gibbs sampler with embedded Metropolis–Hastings steps presented in Algorithm 1.
Algorithm 1 MCMC algorithm for full Bayesian analysis of ARX-SMN Models
1:
Inputs: Observations y ; exogenous matrices X 1 , , X q ; upper bounds p max , d j , max ; forecast horizon k; future exogenous values; MCMC settings N sim , N burn , N thin .
2:
Construct Z via (8). Initialize θ ( 0 ) and ( σ 2 ) ( 0 ) using OLS on the full model.
3:
for  r = 1 , , N sim do
4:
        θ ( r ) N m ( μ θ , V θ )                              [Equation (19)]
5:
        ( σ 2 ) ( r ) I G a 0 + n 2 , b 2                            [Equation (20)]
6:
        δ k ( r ) Bin ( 1 , A k / ( A k + B k ) ) , k = 1 , , m                      [Equation (21)]
7:
        y f ( r ) N k ( μ y f , V y f )                             [Equation (30)]
8:
       SMN-specific steps:
9:
         SMN-t:
      u t ( r ) G ν + 1 2 , ( y t z t T θ ) 2 2 σ 2 + ν 2 t ;
      ν ( r ) : MH from (23)–(24);
      λ ( r ) T G ( 2 , ν , ( c , d ) )
10:
       SMN-sl:
    u t ( r ) T G ν + 1 2 , ( y t z t T θ ) 2 2 σ 2 , ( 0 , 1 ) t ;
    ν ( r ) T G ( n + 1 , λ t log u t , ( 1 , ) ) ;
    λ ( r ) T G ( 2 , ν , ( c , d ) )
11:
       SMN-cn:
    u t ( r ) from two-point distribution (28) t ;
    ν ( r ) Beta ( ν 0 + m γ , ν 1 + n m γ ) ;
    γ ( r ) : MH from (29)
12:
end for
13:
Discard the first N burn draws; retain every N thin -th draw from the remainder.
14:
Assess convergence via autocorrelations and the Geweke z-statistic [39].
15:
Compute posterior means, standard deviations, 95% credible intervals, model selection frequencies, and Bayesian forecasts from retained draws.
The algorithm is initialized with OLS estimates of the full model, which do not require distributional assumptions [40]. All steps except the Metropolis–Hastings updates for ν (SMN-t) and γ (SMN-cn) draw directly from standard distributions, ensuring efficient mixing. Chain convergence is monitored using sample autocorrelations at multiple lags, the Geweke spectral diagnostic [39], and the Raftery–Lewis criterion [41]. A burn-in period of N burn iterations is discarded, and thinning by factor N thin reduces residual autocorrelation in the retained draws [42,43]. Posterior summaries—including means, standard deviations, and 95% credible intervals—together with Bayesian point and interval forecasts, are subsequently computed from the retained draws, which constitute an approximately independent sample from the joint posterior and predictive distributions.
Stationarity of the AR component. The conditional posterior of θ derived in Section 4.1 is multivariate normal and unconstrained, so Algorithm 1 does not explicitly enforce stationarity of the AR polynomial 1 i = 1 p ϕ i L i at every iteration. In the simulation study and empirical application, posterior draws concentrated overwhelmingly in the stationary region, consistent with the moderate true AR coefficients used throughout; nonetheless, for series with roots close to the unit circle or with a large p max , the unconstrained sampler could in principle visit non-stationary configurations with non-negligible prior mass. A stationarity-preserving reparameterization in terms of partial autocorrelations, or a rejection/truncation step applied to θ within the Gibbs sampler, would remove this possibility at the cost of losing the closed-form multivariate normal update in (19), and we flag this as an explicit limitation of the current framework rather than an already-solved issue.
Joint interpretation of δ and θ . Because δ k ( r ) is re-sampled at every MCMC iteration in Algorithm 1, the retained draws of θ k are not conditioned on a single fixed submodel but instead accumulate contributions from every visited configuration of δ . The reported posterior mean, standard deviation, and credible interval of θ k are therefore Bayesian-model-averaged (BMA) summaries across the whole visited model space, while the posterior inclusion probability (PIP) of δ k answers the discrete question of whether the k-th regressor belongs in the model. The two quantities are complementary rather than redundant. A coefficient may display a high PIP together with a credible interval that still touches zero if the slab component in (9) carries appreciable posterior mass near the origin. Conversely, a large but uncertain effect can coexist with a moderate PIP when the sign and magnitude are not sharply identified across the visited configurations. This joint reading is applied explicitly to the real-data results in Section 6.3.

5. Simulation Study

This section assesses the finite-sample performance of Algorithm 1 through controlled experiments across three distinct ARX model configurations and three members of the SMN family.

5.1. Experimental Design

Table 1 summarizes the three simulation scenarios. In each case, the true model includes a scale parameter σ 2 = 1.0 , a forecast horizon k = 5 , a sample size n = 200 , and one or two exogenous inputs generated independently from an A R ( 1 ) process with AR coefficient ρ = 0.7 . Scenarios differ in the number of AR lags, the exogenous lag structure, and the SMN error distribution. Concretely, Model I has AR order p = 2 and a single exogenous input entering contemporaneously only ( d 1 = 1 ), generated under SMN-t errors with ν = 3 degrees of freedom. Model II has AR order p = 1 and two exogenous inputs, the first entering at lags 0–1 ( d 1 = 2 ) and the second contemporaneously only ( d 2 = 1 ), generated under SMN-cn errors with contamination probability ν = 0.2 and contamination scale γ = 0.1 . Model III has an AR order p = 2 and two exogenous inputs, the first entering contemporaneously only ( d 1 = 1 ) and the second at lags 0–1 ( d 2 = 2 ), generated under SMN-sl errors with ν = 2 . These three configurations are chosen to span a range of AR orders (1–2), single- versus multiple-exogenous-input structures, and all three non-Gaussian members of the SMN family, providing a representative test bed for the identification, estimation, and forecasting performance of Algorithm 1.
For each scenario, N R = 500 independent datasets are generated. Algorithm 1 is applied to each with p max = 4 and d j , max = 4 , using N sim = 25,000, N burn = 5000 , and N thin = 20 , yielding 1000 retained draws. For each replicate we record: (i) latent indicator frequencies as posterior inclusion probabilities to quantify identification accuracy; (ii) posterior summaries (mean, standard deviation, 95% credible interval bounds) for all parameters; and (iii) the root mean squared error (RMSE) and mean Winkler score (MWS) for k-step-ahead forecasts. The Winkler score [44] for a 100 ( 1 α ) % interval ( L h , U h ) at step h is
W S α , h = ( U h L h ) + 2 α ( L h y n + h ) if y n + h < L h , ( U h L h ) if L h y n + h U h , ( U h L h ) + 2 α ( y n + h U h ) if y n + h > U h .
Lower RMSE and MWS values reflect more accurate point and interval forecasts, respectively [45].

5.2. Single-Replicate Illustration

Before reporting aggregated results, we illustrate the MCMC algorithm’s behavior using one representative dataset from Model I. Table 2 presents the five most frequent latent-indicator configurations observed across the 1000 retained MCMC draws. The most frequently selected configuration ( δ ϕ , δ α ) = ( ( 1 , 1 , 0 , 0 ) , ( 1 , 0 , 0 , 0 ) ) represents the true ARX(2,1) data-generating process. Specifically, it is observed in 29.4% of the retained draws, a proportion substantially higher than any competing specification. Also, Table 3 presents the posterior inclusion probabilities (PIP), indicating that the truly active lags all exceed 0.95, while the inactive lags remain below 0.32, with standard errors less than 0.02. This confirms that the SSVS mechanism correctly locates the generating structure. Table 4 presents the Bayesian parameter estimates and five-step-ahead forecasts. The posterior means recovering the true values closely, all true parameters lie within the 95% credible intervals, and forecast uncertainty grows modestly with horizon length as expected.
For this representative Model I dataset, MCMC convergence is supported by the diagnostics in Table 5. Geweke z-scores fall within ( 1.96 , 1.96 ) , the Raftery–Lewis test suggests about 1000 iterations, and empirical autocorrelations of the thinned chain are negligible across all parameters. This conclusion is further reinforced by the trace plots and marginal posterior distributions presented in Figure 1. The trace plots exhibit rapid mixing with no visible trends, drifts, or sustained excursions, consistent with the near-zero autocorrelations of Table 5. The marginal posterior densities are unimodal and approximately symmetric for the AR and exogenous coefficients and moderately right-skewed for the strictly positive scale parameters σ 2 and ν , as expected. No evidence of multimodality or switching between competing lag configurations is apparent in any marginal density, indicating that the sampler concentrates on a single dominant region of the model space corresponding to the true generating structure. Figure 1 thus demonstrates, in a concrete single-dataset setting, the practical reliability of Algorithm 1 before the aggregated results of Section 5.3 are considered.

5.3. Aggregated Results

Identification. We report the rate of exact model identification as both the AR order and the exogenous lag structure simultaneously matching the true generating model. This rate of exact model identification exceeds 80% across all three simulation scenarios and all three SMN distributions. In addition, average marginal posterior inclusion probabilities exceed 0.75 for the active lags, whereas those linked to inactive lags are less than 0.25. This validates the unified SSVS scheme as an effective mechanism for joint AR-order and exogenous-variable selection in the ARX models.
Estimation. Table 6, Table 7 and Table 8 report averaged posterior summaries over the 500 replicates for each model under each SMN case. Point estimates are accurate regardless of which SMN member is assumed, and the 95% credible interval averages consistently bracket the true parameter values. Empirical coverage probabilities remain close to the nominal 95% level—typically between 92% and 98%—across parameters and models, apart from those tied to inactive lags. This pattern indicates well-calibrated uncertainty quantification, with interval coverage free from systematic bias.
Forecasting. Table 9 displays the RMSE and MWS values for five-step-ahead Bayesian predictions averaged over the 500 replicates. Across all three ARX configurations and SMN cases, the RMSE stays approximately one standard deviation of the underlying series, and the MWS is comparable to the width of the 95% credible interval. Both RMSE and MWS rise slightly with horizon length, consistent with accumulating disturbance uncertainty. The three SMN cases produce nearly indistinguishable forecasting performance. This indicates that the framework’s predictive accuracy is largely insensitive to the choice of mixing distribution under the baseline design of Table 1, which features moderate degrees of freedom, a moderate contamination level, and a sample size of n = 200 . Robustness under more severe contamination or alternative sample sizes is examined only to the extent reported below, and remains an important avenue for further investigation.
Across the 500 replicates, the average Metropolis–Hastings acceptance rates are about 92% and 68% for the SMN-t and the SMN-cn cases, respectively. These values fall comfortably within standard ranges, indicating that the samplers explore their respective posterior distributions efficiently. Moreover, across all simulation scenarios, the MCMC chains satisfy the convergence diagnostics, confirming that the reported posterior and predictive summaries are derived from properly converged simulations. Under the simulation settings used, each complete run of the MCMC algorithm takes on average less than 14 seconds per dataset on a standard laptop (Intel Core i7, 16 GB RAM, Julia 1.12.6).
Effect of sample size. To assess how estimation and forecasting accuracy scale with the length of the observed series, we re-estimate Model I (SMN-t) at sample sizes n = 100 and n = 300 , keeping every other design element unchanged from Table 1. Table 10 reports averaged posterior summaries over the 500 replicates for Model I (SMN-t) with sample sizes n = 100 and n = 300 , while Table 11 displays the RMSE and MWS values for five-step-ahead Bayesian predictions averaged over the 500 replicates. These two tables are read alongside the n = 200 baseline already reported in Table 6 and Table 9.
Posterior uncertainty contracts systematically as n grows. Averaged across the AR and exogenous coefficients, posterior standard deviations fall by roughly half between n = 100 and n = 300 (e.g., σ ¯ μ 0 : 0.236 → 0.131; σ ¯ ϕ 1 : 0.084 → 0.043), consistent with the usual posterior contraction rate for regular parametric models. The degrees-of-freedom parameter ν is by far the most sample-size-sensitive quantity. Its posterior standard deviation shrinks from 1.738 at n = 100 to 0.945 at n = 200 (Table 6) to 0.600 at n = 300 , reflecting the well-documented difficulty of pinning down the tail heaviness of a Student-t distribution from short series. Posterior bias is likewise reduced at larger n—for example, μ ¯ ϕ 1 moves from 0.488 ( n = 100 ) to 0.492 ( n = 200 ) to 0.504 ( n = 300 ), converging toward the true value 0.5. Coverage probabilities for the active coefficients stay close to the nominal 95% level at every sample size (92.8–97.4%), while coefficients tied to inactive lags continue to show the mild overcoverage already noted for n = 200 (97.0–99.8%), indicating that the SSVS shrinkage mechanism does not compromise interval calibration even when the series is comparatively short.
These patterns carry over to forecasting. RMSE in Table 11 decreases essentially monotonically in n at every horizon (e.g., y n + 1 : 1.45 at n = 100 versus 1.25 at n = 300 ; y n + 5 : 1.92 versus 1.61), confirming that sharper parameter estimates at larger n translate directly into more accurate point forecasts. MWS exhibits the same broad pattern of improvement but with greater horizon-to-horizon variability. For example, at h = 1 the n = 100 case attains a lower average MWS than the n = 200 baseline (10.31 versus 11.25), despite its larger RMSE. This behavior is consistent with the substantially heavier right skew of the MWS distribution relative to RMSE across replicates. Because the Winkler score penalizes interval misses heavily, its 500-replicate average is more sensitive than RMSE to a handful of runs with wide or missed intervals. The underlying improvement with n is nonetheless clearly visible by n = 300 , where MWS is lower than the n = 200 baseline at every horizon.
Effect of contamination level. To assess robustness to a higher proportion of outlying observations, we re-estimate Model II (SMN-cn) with contamination probabilities ν = 0.3 and ν = 0.4 , holding every other design element unchanged from Table 1. Table 12 reports averaged posterior summaries over the 500 replicates for Model II (SMN-cn) with contamination probabilities ν = 0.3 and ν = 0.4 , and Table 13 displays the RMSE and MWS values for five-step-ahead Bayesian predictions averaged over the 500 replicates; both are read alongside the ν = 0.2 baseline already reported in Table 7 and Table 9.
Increasing the contamination probability from ν = 0.2 to ν = 0.4 —so that up to 40% of observations are drawn from the high-variance contaminating component—leaves posterior means close to their true values throughout, with no evidence of systematic bias emerging as contamination becomes more frequent. μ ¯ ϕ 1 remains at 0.610–0.611 across all three contamination levels, and the inactive coefficients continue to be shrunk toward zero (e.g., μ ¯ α 12 stays within 0.007 of its true value at every ν ). Posterior uncertainty widens as the sample becomes noisier, as expected. The posterior standard deviation grows with ν for both the AR and exogenous coefficients (e.g., σ ¯ μ 0 : 0.174, 0.180, 0.194; σ ¯ α 11 : 0.125, 0.141, 0.157, at ν = 0.2 , 0.3 , 0.4 ) and the error scale ( σ ¯ σ 2 : 0.201, 0.247, 0.316). Coverage probabilities for the active coefficients remain broadly acceptable at ν = 0.3 and ν = 0.4 (91.2–96.6%), while inactive-lag and scale/shape parameters continue to show good-to-mild overcoverage (96.8–99.8%). The contamination parameters themselves remain well identified at every setting. The posterior mean of ν tracks its true value closely (0.247, 0.332, and 0.408 against true values 0.2, 0.3, and 0.4), and γ is recovered accurately throughout ( μ ¯ γ 0.10 0.11 against a true value of 0.1).
Forecast accuracy degrades in the expected direction as contamination intensifies. RMSE in Table 13 increases monotonically with ν at every horizon relative to the ν = 0.2 baseline in Table 9 (e.g., y n + 1 : 1.66, 1.80, 1.92; y n + 5 : 3.26, 3.36, 3.44), confirming that a larger proportion of outlying observations makes point forecasts modestly less precise, as anticipated. MWS, by contrast, does not increase as cleanly with ν . As in the sample-size comparison above, this is consistent with the very heavy right skew of the Winkler score across replicates. The RMSE pattern is unambiguous and is the more reliable indicator of the (modest and expected) forecasting cost of heavier contamination.We emphasize that this robustness evidence is confined to contamination probabilities up to ν = 0.4 under the SMN-cn mixing distribution with γ = 0.1 fixed. Substantially more severe contamination levels, alternative contamination scales, and deliberate model misspecification (e.g., fitting the ARX-SMN model to data generated from a non-SMN error process) were not examined. The robustness claims of this paper should therefore be read as applying specifically to the SMN error families and contamination levels investigated in this section, rather than as a general guarantee of robustness under arbitrary departures from the assumed model.

6. Empirical Application: Daily Solar Radiation in Najran, Saudi Arabia

6.1. Background and Data Description

Accurate forecasting of solar irradiance is a critical enabler of reliable planning and dispatch in solar energy systems [6,7]. Saudi Arabia possesses some of the world’s highest solar energy potential, with annual global horizontal irradiance (GHI) routinely exceeding 2000 kWh / m 2 [46,47]. The southern region of Najran is particularly noteworthy: situated at approximately 17.5 ° N latitude, it benefits from persistently high direct-normal irradiance values and a strategic geographic position for the country’s Vision 2030 renewable energy targets [46]. This resource richness motivates the present application of a probabilistic forecasting model to Najran solar radiation.
We analyze a continuous 80-day record of daily meteorological observations from the Najran ground station, spanning from 1 December 2005 to 18 February 2006 ( n raw = 80 ). This winter sub-sample captures a period of changing solar angles and variable cloud-cover conditions without the strongly deterministic extremes of the Saudi summer, providing a challenging but realistic forecasting environment.
Two time series are employed:
  • Global Horizontal Irradiance (GHI) [ y t , endogenous]: the total daily shortwave radiation received on a horizontal surface at ground level, encompassing both direct beam and diffuse components, measured in Wh/m2 by a pyranometer at the Najran meteorological station. GHI is the primary target variable in solar energy forecasting because it determines the potential electricity yield of a photovoltaic installation [6,48].
  • Clear-Sky GHI [ x t , exogenous]: the theoretical GHI that would be recorded on a completely cloudless day, computed from a radiative-transfer model using solar geometry (latitude, Earth–Sun distance, hour angle), and a standard atmospheric composition (aerosol optical depth, water vapor, ozone) [48,49]. Because clear-sky GHI captures the deterministic astronomical variation in available solar energy, it serves as an ideal external driver for the ARX model. It tracks the slowly changing baseline around which the actual GHI fluctuates due to transient meteorological factors.
The two daily GHI and Clear-Sky GHI series are shown in Figure 2, and their descriptive statistics are summarized in Table 14. From Table 14, the observed mean daily GHI ( 6135.2 Wh / m 2 ) falls considerably below the clear-sky mean ( 6369.5 Wh / m 2 ), quantifying the average atmospheric attenuation from clouds, aerosols, and humidity. Strikingly, the coefficient of variation of GHI (6.76%) is more than that of clear-sky GHI (5.91%), reflecting the dominant role of transient weather variability in driving actual radiation fluctuations, whereas clear-sky GHI evolves slowly according to astronomical cycles alone.

6.2. Stationarity Transformations

Direct modeling of the GHI and clear-sky GHI in their raw levels is inadvisable for two reasons. First, both series exhibit a local deterministic trend caused by the steadily changing day length between December and mid-February, inducing non-stationarity and potentially spurious correlations [7,50]. Second, the difference in magnitudes between the two variables can produce numerical instability in the MCMC sampler. We therefore apply a two-step preprocessing pipeline. In the first step, each series is standardized to zero mean and unit variance using its sample mean and standard deviation, yielding y t = ( y t y ¯ ) / s y and x t = ( x t x ¯ ) / s x . In the second step, first differences are applied: Δ y t = y t y t 1 and Δ x t = x t x t 1 . The resulting series { Δ y t } and { Δ x t } represent standardized day-to-day changes in observed and clear-sky GHI, respectively. By filtering out the slow astronomical trend, differencing isolates the short-term meteorological dynamics—such as the effect of a cloud event on the following day’s radiation budget—that are the primary target of the ARX model. The density of { Δ y t } in Figure 2 exhibits moderate excess kurtosis and occasional outliers corresponding to abrupt weather transitions (e.g., sudden dust storms or heavy cloud intrusions), providing empirical justification for the SMN error assumption [29,51].
The transformed dataset has n = 79 usable observations after differencing. We partition this into a training set of n tr = 69 observations and a hold-out test set of n te = 10 observations to evaluate out-of-sample forecast accuracy.

6.3. Bayesian ARX Analysis of Daily Najran Solar Radiation

Algorithm 1 is applied to the training set of the transformed series { Δ y t } with exogenous input { Δ x t } , using p max = 5 , d 1 , max = 5 , and k = 10 for the forecast horizon. The MCMC settings are N sim = 11,000 , N burn = 1000 , and N thin = 10 . Future clear-sky GHI values over the 10-day test window are taken from the observed clear-sky record, which is known in advance from astronomical calculations and represents no forecasting challenge [48,49].
Model identification. Table 15 presents the posterior inclusion probabilities of latent indicators of the ARX model from the 1000 retained MCMC draws, reported for each of the four SMN distributions. The latent indicators δ ϕ = ( δ 1 ϕ , , δ 5 ϕ ) govern AR lag inclusion, and δ α = ( δ 10 α , , δ 14 α ) governs clear-sky GHI lag inclusion. Across all four SMN specifications, except of the SMN-cn case, the latent indicators with the highest posterior inclusion probability corresponds to the ARX(2,3) model, comprising the first two AR lags and the first three lags of the clear-sky GHI change. This structure admits a natural physical interpretation. The two AR lags reflect a two-day cloud memory. The three clear-sky lags ( α 10 , α 11 , α 12 ) reflect the multi-day influence of atmospheric conditions. The contemporaneous lag α 10 accounts for the direct modulation of actual GHI by the prevailing clear-sky envelope. The two successive lagged coefficients capture the gradual dissipation of aerosol loading and humidity anomalies that attenuate radiation over consecutive days before the atmosphere returns to its baseline state. The relative disagreement of the SMN-cn specification underscores the sensitivity of variable selection to the assumed tail behavior under the contaminated normal, where the heavier contamination component may absorb part of the signal otherwise attributed to the higher-order lags.
Parameter estimates. Beyond the model-identification results above, Table 16 additionally reports the full Bayesian posterior summaries of every model parameter estimated directly on the real Najran GHI series, providing an empirical evaluation of the proposed methodology under authentic, non-simulated conditions that complements the controlled simulation results of Section 5. Table 16 reports the Bayesian posterior summaries of all model parameters under each of the four SMN distributions. The intercept μ 0 carries a posterior mean close to zero and a 95% credible interval that includes zero in all four cases, consistent with the near-zero unconditional mean of the differenced standardized series. Turning to the AR structure, a striking and physically meaningful pattern emerges: the posterior means of all active AR coefficients are negative across every SMN specification. Under SMN-t, the first three AR lags have 95% credible intervals that exclude zero, i.e., the posterior evidence supports a non-zero effect, with posterior means ϕ 1 0.607 , ϕ 2 0.321 , and ϕ 3 0.224 , while ϕ 4 and ϕ 5 have credible intervals that include zero. A qualitatively similar pattern is observed under the other SMN cases. Under SMN-cn, the AR coefficients are substantially attenuated, and only ϕ 1 ’s credible interval lies just outside zero ( 0.118 ), reflecting the fact that the contaminated normal absorbs a larger share of the observed variability through its mixing component. The consistent negativity of the AR coefficients in the differenced series is physically interpretable as mean-reverting oscillatory dynamics in daily GHI changes. An anomalously large positive change on a given day—associated, for instance, with a sudden clearing of cloud cover—tends to be followed by a partial downward correction over subsequent days, as the atmosphere gradually returns to its ambient aerosol and humidity equilibrium.
Among the exogenous clear-sky coefficients, α 10 is by far the dominant driver. Its 95% credible interval excludes zero by a wide margin in all four cases, providing strong posterior evidence for a non-zero effect. This confirms that the contemporaneous change in clear-sky GHI is the single most informative predictor of observed GHI changes. The first lagged coefficient α 11 also has a credible interval that excludes zero under SMN-t (≈0.533), SMN-sl (≈0.713), and SMN-n (≈0.800), capturing the residual influence of the previous day’s atmospheric state on current radiation levels. The higher lags α 12 , α 13 , and α 14 carry credible intervals that include zero across all specifications, indicating that their contributions are negligible once the contemporaneous and first-lagged clear-sky signals are accounted for. These lags illustrate concretely the joint reading of posterior inclusion probabilities (PIP) and credible intervals set out in Section 4.2. Under SMN-t, α 12 has an intermediate PIP of 0.524 (Table 15) together with a 95% credible interval of ( 0.035 , 0.865 ) that includes zero (Table 16). Both quantities agree on the same substantive conclusion, i.e., roughly half of the retained draws support, including this lag, and the BMA-averaged effect, while positive on average, is not sharply distinguishable from zero. So, the two summaries reinforce rather than contradict one another once it is recognized that the reported credible interval already averages over both the included and excluded mixture components.
The SMN-specific parameter estimates provide particularly informative evidence about the distributional character of the radiation residuals. Under SMN-t, the estimated degrees of freedom ν ^ 2.28 , which signals extremely heavy-tailed innovations, consistent with abrupt meteorological discontinuities such as dust intrusions and sudden cloud-cover transitions. The SMN-sl estimate ν ^ 1.08 similarly places the error distribution near the Cauchy family, corroborating the presence of large occasional deviations. Under SMN-cn, the estimated contamination probability ν ^ 0.358 indicates that approximately 36% of daily observations arise from a contaminating component. The estimated contamination scale γ ^ 0.006 implies that this component carries a variance of σ ^ 2 / γ ^ 0.83 , roughly 167 times larger than the dominant component variance σ ^ 2 0.005 , capturing the high-amplitude outliers produced by episodic extreme weather events. The scale parameter σ 2 itself varies markedly across distributions—from 0.005 under SMN-cn to 0.228 under SMN-n. This is because the heavy-tailed specifications attribute large residuals to the mixing component rather than to σ 2 , leaving a much tighter residual core. The inflated σ 2 estimate under SMN-n thus reflects the inadequacy of the Gaussian assumption for this dataset. Despite these distributional differences, all four SMN cases produce broadly concordant estimates of the dynamic and exogenous coefficients, demonstrating that structural inference on the ARX model is robust to the precise choice of tail specification. Across all four SMN cases, MCMC chains pass the Geweke and Raftery–Lewis diagnostics, confirming the convergence of the chains. The Metropolis–Hastings acceptance rates are about 95% and 70% for the SMN-t and the SMN-cn cases, respectively.
Forecasting. Table 17 presents the 10-step-ahead Bayesian forecasts of the standardized-differenced GHI series for the held-out test period, together with the true observed values and forecast accuracy metrics. Under all four SMN distributions, most of the 10 true values fall within the 95% credible intervals, validating the calibration of the predictive distribution. The RMSE values are small in every case—below 1.1 standardized units at all horizons—consistent with the general finding that clear-sky GHI provides an informative structural signal that reduces residual uncertainty. We compute the RMSE of the 10-step-ahead Bayesian forecasts for the anti-transformed daily GHI series; for the ARX model, the RMSEs are approximately 153.9 (SMN-t), 161.1 (SMN-sl), 159.0 (SMN-cn), and 163.1 (SMN-n), all of which are small relative to the daily GHI series’ standard deviation. Accordingly, based on point RMSE, the ARX specification with SMN-t attains the lowest anti-transformed forecast error among the four fitted SMN cases for this series. With only ten held-out horizons, however, this ranking should be interpreted as descriptive evidence rather than a strong claim of superiority. The comparison is examined formally and the corresponding caveats made explicit—via the Diebold–Mariano test reported below. Table 18 presents the 10-step-ahead Bayesian forecasts under SMN-t together with the observed (anti-transformed) values.
Comparison with a conventional Gaussian Bayesian ARX benchmark. Among the four fitted specifications, SMN-n is, by construction, exactly the conventional Gaussian Bayesian ARX model, so Table 16 and Table 17 already report a direct within-sample and out-of-sample comparison against this standard benchmark. To formally test whether the robust SMN specifications forecast significantly better than this Gaussian benchmark, we apply the Diebold–Mariano test [52] with the small-sample correction of Harvey, Leybourne, and Newbold to the absolute-error loss differentials between each SMN forecast and the Gaussian case (SMN-n), using the ten held-out anti-transformed forecasts. Table 19 summarizes the results.
None of the three pairwise comparisons is statistically significant at the 5% level, which is unsurprising given the limited power of a Diebold–Mariano test based on only ten held-out horizons. The test should therefore be interpreted as confirmatory rather than as a substitute for the descriptive RMSE ranking reported above. For the SMN-t versus SMN-n comparison, the p-value of 0.153 offers suggestive evidence that SMN-t may outperform SMN-n. The negative mean loss differential is consistent with the anti-transformed RMSE ranking, though the evidence remains insufficient to establish statistical significance at the 5% level. This outcome highlights the limited sample size and underscores the need for further evaluation over longer horizons.We emphasize that this comparison is confined to the four SMN specifications nested within the proposed Bayesian ARX framework. The forecasting claims of this paper should accordingly be read as relative to the Gaussian Bayesian ARX case and among the SMN family evaluated on a ten-observation holdout, rather than as an established advantage over the broader class of conventional forecasting methods.
Taken together, and for this single 80-day Najran record, the solar radiation results indicate that the proposed ARX-SMN framework captures the short-term stochastic dynamics of daily GHI in this application. The model provides well-calibrated uncertainty intervals for multi-day-ahead forecasts and remains computationally efficient on a dataset of this size. The identification of clear-sky GHI as the dominant exogenous driver, along with the detection of non-Gaussian residuals, are both physically meaningful findings that align with the design intent of the proposed methodology. Given the modest sample size and single-station scope of this application, these findings are best interpreted as an illustrative case study rather than a general demonstration of superiority across solar-forecasting applications.

7. Conclusions

This paper has established a unified full Bayesian framework for ARX models under SMN errors. This framework addresses simultaneously the challenges of dynamic order selection, exogenous variable selection, robust parameter estimation, and multi-step-ahead probabilistic forecasting. The treatment rests on two structural pillars. The first is the linearity of the ARX model in its entire coefficient vector, which enables the joint full conditional posterior of all dynamic and exogenous coefficients to be expressed as a single multivariate normal distribution. The second is the hierarchical SMN representation, which transforms the non-Gaussian estimation problem into a sequence of conditionally Gaussian steps admitting tractable closed-form posteriors, supplemented by Metropolis–Hastings updates only where necessary. The SSVS mechanism has been adapted to handle two conceptually distinct variable selection problems—AR lag selection and exogenous input selection—within a single prior structure, using Bernoulli indicators for each candidate coefficient. The resulting Gibbs sampler with embedded Metropolis–Hastings steps is computationally efficient and is easily extended to accommodate additional SMN members or larger predictor sets. Simulation experiments across three ARX configurations and three SMN distributions confirm that the algorithm achieves accurate parameter recovery, reliable identification of the generating model structure, and precise probabilistic forecasting. The empirical application to daily solar radiation in Najran, Saudi Arabia, illustrates the practical value of the methodology in this single case study. Clear-sky GHI is automatically identified as the dominant exogenous driver of observed radiation changes, the estimated mixing parameters consistently point to markedly heavy-tailed residuals attributable to episodic dust intrusions and abrupt cloud-cover transitions, and the ten-day-ahead probabilistic forecasts attain high point accuracy alongside well-calibrated predictive intervals.As this application is based on a single 80-observation record from one meteorological station, these findings should be read as a demonstration of feasibility rather than as evidence of general practical superiority or of generalizability to other locations, seasons, or forecasting horizons.
Some limitations of the present study should be acknowledged, and they define concrete directions for future work. First, the current simulation study, while spanning three ARX configurations, all three non-Gaussian SMN members, and moderate contamination levels, does not examine settings with a much larger number of candidate (and predominantly irrelevant) regressors, strongly correlated exogenous predictors, more severe contamination levels, or deliberate model misspecification.The robustness claims made throughout this paper should accordingly be understood as pertaining specifically to the SMN error families, sample sizes, and contamination levels actually investigated, rather than as a general guarantee of performance under arbitrarily adversarial departures from the assumed model. Extending the design along these dimensions would give a more complete picture of the robustness of the SSVS mechanism in higher-dimensional and more adversarial settings. Second, the empirical application is based on a single 80-day record from one meteorological station; validating the framework on longer records, on additional stations, or across different seasons would strengthen the generalizability of the substantive conclusions drawn for Najran solar radiation. Third, a comprehensive benchmarking comparison against classical ARX models and alternative Bayesian LASSO-type shrinkage [53] evaluated over a longer out-of-sample window remains an important open task. Fourth, a formal sensitivity analysis of the posterior to the SSVS hyperparameters would complement the default configuration adopted in this study. Fifth, the current Gibbs sampler does not explicitly enforce stationarity of the AR polynomial, and a stationarity-preserving reparameterization is a natural refinement for series with roots close to the unit circle.
Beyond these specific extensions, embedding the ARX-SMN framework within a state-space or mixture structure would allow the AR and exogenous coefficients to evolve over time, providing a more faithful representation of the structural instabilities that frequently characterize environmental and economic time series.

Author Contributions

Conceptualization, A.A.A.; Methodology, A.A.A.; Software, A.A.A.; Validation, A.A.A. and S.A.A.; Writing—original draft, A.A.A.; Writing—review and editing, S.A.A.; Project administration, S.A.A. All authors have read and agreed to the published version of the manuscript.

Funding

The authors extend their appreciation to the Deanship of Scientific Research and Libraries in Princess Nourah bint Abdulrahman University for funding this research work through the Supporting Publication in Top-Impact Journals Initiative (SPTIF-2026). The first author is thankful to the Deanship of Graduate Studies and Scientific Research at Najran University for funding this work under the Consortium Funding Program grant code (NU/CPL/SERC/14/4440-6).

Data Availability Statement

The dataset used in this study is publicly accessible through the GitHub repository at https://github.com/aymanaamin/najran_solar_radiation/ (accessed on 10 June 2026).

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Hamilton, J.D. Time Series Analysis; Princeton University Press: Princeton, NJ, USA, 1994. [Google Scholar]
  2. Box, G.E.P.; Jenkins, G.M.; Reinsel, G.C.; Ljung, G.M. Time Series Analysis: Forecasting and Control; John Wiley & Sons: Hoboken, NJ, USA, 2015. [Google Scholar]
  3. Sims, C.A. Macroeconomics and reality. Econometrica 1980, 48, 1–48. [Google Scholar] [CrossRef] [Scilit]
  4. Koop, G.; Korobilis, D. Bayesian multivariate time series methods for empirical macroeconomics. Found. Trends Econom. 2010, 3, 267–358. [Google Scholar] [CrossRef] [Scilit]
  5. Deb, C.; Zhang, F.; Yang, J.; Lee, S.E.; Shah, K.W. A review on time series forecasting techniques for building energy consumption. Renew. Sustain. Energy Rev. 2017, 74, 902–924. [Google Scholar] [CrossRef] [Scilit]
  6. Diagne, M.; David, M.; Lauret, P.; Boland, J.; Schmutz, N. Review of solar irradiance forecasting methods and a proposition for small-scale insular grids. Renew. Sustain. Energy Rev. 2013, 27, 65–76. [Google Scholar] [CrossRef] [Scilit]
  7. Voyant, C.; Notton, G.; Kalogirou, S.; Nivet, M.L.; Paoli, C.; Motte, F.; Fouilloy, A. Machine learning methods for solar radiation forecasting: A review. Renew. Energy 2017, 105, 569–582. [Google Scholar] [CrossRef] [Scilit]
  8. Yang, D.; Kleissl, J.; Gueymard, C.A.; Pedro, H.T.C.; Coimbra, C.F.M. History and trends in solar irradiance and PV power forecasting: A preliminary assessment and review using text mining. Sol. Energy 2018, 168, 60–101. [Google Scholar] [CrossRef] [Scilit]
  9. Ljung, L. System Identification: Theory for the User; Prentice-Hall: Hoboken, NJ, USA, 1987. [Google Scholar]
  10. Cooper, A.; Simpson, D.; Kennedy, L.; Forbes, C.; Vehtari, A. Cross-validatory model selection for Bayesian autoregressions with exogenous regressors. Bayesian Anal. 2025, 20, 573–597. [Google Scholar] [CrossRef] [Scilit]
  11. Peterka, V. Bayesian System Identification. Automatica 1981, 17, 41–53. [Google Scholar] [CrossRef] [Scilit]
  12. Box, G.E.; Tiao, G. Bayesian Inference in Statistical Analysis; Addison-Wesley: Reading, MA, USA, 1973. [Google Scholar]
  13. Chib, S.; Greenberg, E. Bayes inference in regression models with ARMA(p,q) errors. J. Econom. 1994, 64, 183–206. [Google Scholar] [CrossRef] [Scilit]
  14. McCulloch, R.E.; Tsay, R.S. Bayesian analysis of autoregressive time series via the Gibbs sampler. J. Time Ser. Anal. 1994, 15, 235–250. [Google Scholar] [CrossRef] [Scilit]
  15. George, E.I.; McCulloch, R.E. Variable selection via Gibbs sampling. J. Am. Stat. Assoc. 1993, 88, 881–889. [Google Scholar] [CrossRef]
  16. George, E.I.; McCulloch, R.E. Approaches for Bayesian variable selection. Stat. Sin. 1997, 7, 339–373. [Google Scholar]
  17. Chen, C.W.S. Subset selection of autoregressive time series models. J. Forecast. 1999, 18, 505–516. [Google Scholar] [CrossRef]
  18. So, M.K.P.; Chen, C.W.S.; Liu, F.C. Best subset selection of autoregressive models with exogenous variables and GARCH errors. J. R. Stat. Soc. Ser. C 2006, 55, 201–224. [Google Scholar] [CrossRef] [Scilit]
  19. Chen, C.W.S.; Liu, F.C.; Gerlach, R. Bayesian subset selection for threshold autoregressive moving-average models. Comput. Stat. 2011, 26, 1–30. [Google Scholar] [CrossRef] [Scilit]
  20. Amin, A.A.; Emam, W.; Tashkandy, Y.; Chesneau, C. Bayesian subset selection of seasonal autoregressive models. Mathematics 2023, 11, 2878. [Google Scholar] [CrossRef] [Scilit]
  21. Amin, A.A. Gibbs Sampling for Bayesian Prediction of SARMA Processes. Pak. J. Stat. Oper. Res. 2019, 397–418. [Google Scholar] [CrossRef] [Scilit]
  22. Amin, A.A. Full Bayesian analysis of double seasonal autoregressive models with real applications. J. Appl. Stat. 2024, 51, 1524–1544. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  23. Pillonetto, G.; Dinuzzo, F.; Chen, T.; De Nicolao, G.; Ljung, L. Kernel Methods in System Identification, Machine Learning and Function Estimation: A Survey. Automatica 2014, 50, 657–682. [Google Scholar] [CrossRef] [Scilit]
  24. Pillonetto, G.; Ljung, L. Full Bayesian identification of linear dynamic systems using stable kernels. Proc. Natl. Acad. Sci. USA 2023, 120, e2218197120. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  25. Andrews, D.F.; Mallows, C.L. Scale mixtures of normal distributions. J. R. Stat. Soc. Ser. B 1974, 36, 99–102. [Google Scholar] [CrossRef] [Scilit]
  26. West, M. On scale mixtures of normal distributions. Biometrika 1987, 74, 646–648. [Google Scholar] [CrossRef]
  27. Rosa, G.J.M.; Gianola, D.; Padovani, C.R. Robust linear mixed models with normal/independent distributions and Bayesian MCMC implementation. Biom. J. 2003, 45, 573–590. [Google Scholar] [CrossRef] [Scilit]
  28. Cabral, C.R.B.; Lachos, V.H.; Madruga, M.R. Bayesian analysis of skew-normal independent linear mixed models with heterogeneity in the random-effects population. J. Stat. Plan. Inference 2012, 142, 181–200. [Google Scholar] [CrossRef] [Scilit]
  29. Ferreira, G.; Castro, L.M.; Lachos, V.H.; Dias, R. Bayesian modeling of autoregressive partial linear models with scale mixture of normal errors. J. Appl. Stat. 2013, 40, 1796–1816. [Google Scholar] [CrossRef] [Scilit]
  30. Mahmoudi, M.R.; Maleki, M.; Baleanu, D.; Nguyen, V.T.; Pho, K.H. A Bayesian approach to heavy-tailed finite mixture autoregressive models. Symmetry 2020, 12, 929. [Google Scholar] [CrossRef] [Scilit]
  31. Ryu, H.; Kim, D.H. Robust Bayesian analysis for autoregressive models. J. Korean Data Inf. Sci. Soc. 2015, 26, 487–493. [Google Scholar] [CrossRef] [Scilit][Green Version]
  32. Agarwal, M.; Tripathi, P.K. Classical and Bayes analyses of autoregressive model with heavy-tailed error. Am. J. Math. Manag. Sci. 2024, 43, 40–60. [Google Scholar] [CrossRef] [Scilit]
  33. Amin, A.A. Bayesian estimation of seasonal autoregressive models with scale-mixtures of normal errors. Commun. Stat.-Theory Methods 2026, 55, 659–675. [Google Scholar] [CrossRef] [Scilit]
  34. Amin, A.A. Bayesian modeling and forecasting of seasonal autoregressive models with scale-mixtures of normal errors. Comput. Stat. 2025, 40, 3453–3475. [Google Scholar] [CrossRef] [Scilit]
  35. Amin, A.A. Full Bayesian analysis of seasonal autoregressive models under scale-mixtures of normal errors. J. Stat. Comput. Simul. 2026, 96, 184–204. [Google Scholar] [CrossRef] [Scilit]
  36. Amin, A.A.; Alghamdi, S.A. Bayesian Estimation of Autoregressive Models with Exogenous Variables Under Scale-Mixtures of Normal Errors. Mathematics 2026, 14, 2188. [Google Scholar] [CrossRef] [Scilit]
  37. Lütkepohl, H. New Introduction to Multiple Time Series Analysis; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2005. [Google Scholar]
  38. Tsay, R.S. Analysis of Financial Time Series, 3rd ed.; John Wiley & Sons: Hoboken, NJ, USA, 2010. [Google Scholar]
  39. Geweke, J. Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments. Bayesian Stat. 1992, 4, 641–649. [Google Scholar]
  40. LeSage, J.P. Applied Econometrics Using MATLAB; Technical report; Department of Economics, University of Toronto: Toronto, ON, Canada, 1999. [Google Scholar]
  41. Raftery, A.E.; Lewis, S.M. The number of iterations, convergence diagnostics and generic Metropolis algorithms. Pract. Markov Chain Monte Carlo 1995, 7, 763–773. [Google Scholar]
  42. Link, W.A.; Eaton, M.J. On thinning of chains in MCMC. Methods Ecol. Evol. 2012, 3, 112–115. [Google Scholar] [CrossRef] [Scilit]
  43. Robert, C.P.; Casella, G. The Metropolis–Hastings algorithm. In Monte Carlo Statistical Methods; Springer: Berlin/Heidelberg, Germany, 2004; pp. 267–320. [Google Scholar]
  44. Winkler, R.L. A decision-theoretic approach to interval estimation. J. Am. Stat. Assoc. 1972, 67, 187–191. [Google Scholar] [CrossRef] [Scilit]
  45. Hyndman, R.J.; Athanasopoulos, G. Forecasting: Principles and Practice; OTexts: Melbourne, Australia, 2018. [Google Scholar]
  46. Almasoud, A.H.; Gandayh, H.M. Future of solar energy in Saudi Arabia. J. King Saud Univ. Sci. 2015, 27, 153–157. [Google Scholar] [CrossRef] [Scilit]
  47. Tlili, I. Renewable energy in Saudi Arabia: Current status and future potentials. Environ. Dev. Sustain. 2015, 17, 859–886. [Google Scholar] [CrossRef] [Scilit]
  48. Ineichen, P. Comparison of eight clear sky broadband models against 16 independent data banks. Sol. Energy 2006, 80, 468–478. [Google Scholar] [CrossRef] [Scilit]
  49. Gueymard, C.A. Clear-sky irradiance predictions for solar resource mapping and large-scale applications: Improved validation methodology and detailed performance analysis of 18 broadband radiative models. Sol. Energy 2012, 86, 2145–2169. [Google Scholar] [CrossRef] [Scilit]
  50. Boland, J.; Scott, L.; Luther, M. Modelling the diffuse fraction of global solar radiation on a horizontal surface. Environmetrics Off. J. Int. Environmetrics Soc. 2001, 12, 103–116. [Google Scholar] [CrossRef]
  51. Lange, K.L.; Little, R.J.A.; Taylor, J.M.G. Robust statistical modeling using the t distribution. J. Am. Stat. Assoc. 1989, 84, 881–896. [Google Scholar] [CrossRef] [Scilit]
  52. Diebold, F.X.; Mariano, R.S. Comparing predictive accuracy. J. Bus. Econ. Stat. 1995, 13, 253–263. [Google Scholar] [CrossRef] [Scilit]
  53. Park, T.; Casella, G. The Bayesian Lasso. J. Am. Stat. Assoc. 2008, 103, 681–686. [Google Scholar] [CrossRef] [Scilit]
Figure 1. Trace plots and marginal posterior distributions for one replicate of Model I (SMN-t).
Figure 1. Trace plots and marginal posterior distributions for one replicate of Model I (SMN-t).
Mathematics 14 03163 g001
Figure 2. Time and density plots of daily Najran solar radiation. y t and x t are the daily GHI and Clear-Sky GHI series (in Wh/m2), respectively, and Δ y t is the first difference of the daily GHI.
Figure 2. Time and density plots of daily Najran solar radiation. y t and x t are the daily GHI and Clear-Sky GHI series (in Wh/m2), respectively, and Δ y t is the first difference of the daily GHI.
Mathematics 14 03163 g002
Table 1. Experimental design for the simulation study.
Table 1. Experimental design for the simulation study.
Model μ 0 ϕ 1 ϕ 2 α 10 α 11 α 20 α 21 Error
I1.40.5−0.30.6SMN-t ( ν = 3.0 )
II1.50.60.70.40.6SMN-cn ( ν = 0.2 , γ = 0.1 )
III1.80.7−0.40.50.60.4SMN-sl ( ν = 2.0 )
Table 2. Most frequent latent-indicator configurations for one replicate of Model I. δ ϕ = ( δ 1 ϕ , , δ 4 ϕ ) and δ 1 α = ( δ 10 α , , δ 13 α ) .
Table 2. Most frequent latent-indicator configurations for one replicate of Model I. δ ϕ = ( δ 1 ϕ , , δ 4 ϕ ) and δ 1 α = ( δ 10 α , , δ 13 α ) .
δ ϕ δ 1 α Frequency (%)
(1,1,0,0)(1,0,0,0)29.4
(1,1,0,0)(1,1,0,0)15.8
(1,1,0,0)(1,0,0,1)10.4
(1,1,0,0)(1,0,1,0)9.8
(1,1,0,0)(1,1,1,0)4.2
Table 3. Posterior inclusion probabilities ( p ^ ) and their standard errors ( s . e .) of latent-indicator configurations for one replicate of Model I.
Table 3. Posterior inclusion probabilities ( p ^ ) and their standard errors ( s . e .) of latent-indicator configurations for one replicate of Model I.
δ ϕ δ 1 α
δ i ϕ p ^ s . e . δ 1 i α p ^ s . e .
δ 1 ϕ 0.9990.001 δ 10 α 0.9980.001
δ 2 ϕ 0.9750.005 δ 11 α 0.3140.015
δ 3 ϕ 0.1240.010 δ 12 α 0.2380.013
δ 4 ϕ 0.1010.010 δ 13 α 0.2340.013
Table 4. Bayesian estimates and five-step-ahead forecasts for one replicate of Model I (SMN-t). μ : posterior mean; σ : posterior SD; [ L , U ] : 95% credible interval.
Table 4. Bayesian estimates and five-step-ahead forecasts for one replicate of Model I (SMN-t). μ : posterior mean; σ : posterior SD; [ L , U ] : 95% credible interval.
ParameterTrue μ σ LU
Parameter estimates
μ 0 1.401.3160.1551.0021.601
ϕ 1 0.500.5390.0520.4370.647
ϕ 2 −0.30−0.2990.060−0.423−0.181
ϕ 3 0.00−0.0210.048−0.1140.066
ϕ 4 0.000.0330.037−0.0390.110
α 10 0.600.6570.0880.4920.837
α 11 0.00−0.0690.097−0.3360.069
α 12 0.00−0.0560.089−0.2860.071
α 13 0.00−0.0630.075−0.2440.059
σ 2 1.001.0410.1900.7341.487
ν 3.002.7730.5792.1384.349
Five-step-ahead forecasts
y n + 1 2.1600.4311.767−2.8263.592
y n + 2 1.4921.0282.303−3.3614.818
y n + 3 −0.0380.9962.045−2.8345.210
y n + 4 0.1920.6192.071−3.2214.624
y n + 5 −0.2540.6691.970−3.2854.292
Table 5. Convergence diagnostics of the MCMC chain for one replicate of Model I (SMN-t).
Table 5. Convergence diagnostics of the MCMC chain for one replicate of Model I (SMN-t).
Raftery–Lewis DiagnosticGeweke Z-StatisticAutocorrelations
Parameter Ntotal Nmin Factor Z-Scorep-ValueLag 1Lag 5Lag 10Lag 50
μ 0 8939370.953−0.8350.4040.025−0.018−0.002−0.036
ϕ 1 8939370.9530.1200.9040.027−0.0100.0410.033
ϕ 2 8939370.9530.9330.351−0.0070.0130.0200.014
ϕ 3 10539371.124−0.1930.8470.009−0.0260.001−0.005
ϕ 4 9699371.0340.6630.5070.061−0.0500.006−0.028
α 10 8939370.953−0.3710.711−0.0400.0030.009−0.001
α 11 9699371.034−0.5190.6040.015−0.0280.0010.048
α 12 8939370.9530.0810.9350.0050.052−0.029−0.026
α 13 9699371.034−1.3950.1630.032−0.0470.0170.022
σ 2 9699371.034−0.4630.6430.1100.028−0.0610.047
ν 8939370.953−1.6650.0960.0440.004−0.030−0.014
Table 6. Averaged Bayesian estimation results for Model I. CP: coverage probability of 95% credible intervals.
Table 6. Averaged Bayesian estimation results for Model I. CP: coverage probability of 95% credible intervals.
ParameterTrue μ ¯ σ ¯ L ¯ U ¯ CP (%)
μ 0 1.41.3530.1631.0381.66496.0
ϕ 1 0.50.4920.0560.3880.59796.2
ϕ 2 −0.3−0.2900.062−0.402−0.16295.6
ϕ 3 0.00.0000.049−0.0910.09399.2
ϕ 4 0.00.0020.043−0.0780.08397.4
α 10 0.60.5950.0830.4330.75396.4
α 11 0.00.0010.074−0.1290.13999.8
α 12 0.0−0.0010.071−0.1320.12999.8
α 13 0.0−0.0020.065−0.1230.11699.6
σ 2 1.01.0530.1970.7351.50592.6
ν 3.03.2120.9452.2065.76894.4
Table 7. Averaged Bayesian estimation results for Model II.
Table 7. Averaged Bayesian estimation results for Model II.
ParameterTrue μ ¯ σ ¯ L ¯ U ¯ CP (%)
μ 0 1.51.4170.1741.0871.77294.6
ϕ 1 0.60.6100.0520.5140.71296.2
ϕ 2 0.0−0.0020.049−0.0980.09098.4
ϕ 3 0.00.0020.048−0.0890.09599.6
ϕ 4 0.00.0040.036−0.0680.07198.4
α 10 0.70.7080.0960.5170.89392.8
α 11 0.40.3860.1250.0990.61093.2
α 12 0.00.0070.080−0.1280.15599.4
α 13 0.0−0.0050.070−0.1370.12799.8
α 20 0.60.5880.0830.4250.75295.0
α 21 0.00.0000.076−0.1450.13599.2
α 22 0.00.0000.069−0.1280.12199.2
α 23 0.0−0.0030.064−0.1200.11699.8
σ 2 1.00.9530.2010.6051.40797.6
ν 0.20.2470.0820.1190.44796.0
γ 0.10.1100.0330.0580.18894.0
Table 8. Averaged Bayesian estimation results for Model III.
Table 8. Averaged Bayesian estimation results for Model III.
ParameterTrue μ ¯ σ ¯ L ¯ U ¯ CP (%)
μ 0 1.81.6650.2031.2592.05192.0
ϕ 1 0.70.7140.0660.5900.84194.6
ϕ 2 −0.4−0.3930.072−0.528−0.25395.0
ϕ 3 0.00.0020.055−0.1030.10698.6
ϕ 4 0.00.0110.041−0.0670.09198.8
α 10 0.50.4960.0890.3210.66596.6
α 11 0.0−0.0040.077−0.1440.13499.2
α 12 0.0−0.0050.072−0.1420.12699.8
α 13 0.0−0.0070.065−0.1300.11599.0
α 20 0.60.5970.0990.4100.79592.6
α 21 0.40.3690.1310.0640.60893.2
α 22 0.0−0.0050.081−0.1540.13699.8
α 23 0.0−0.0050.074−0.1450.12899.0
σ 2 1.00.9880.2000.6481.43796.4
ν 2.01.9910.7131.2123.90596.6
Table 9. RMSE and MWS of simulation results for five-step-ahead Bayesian predictions.
Table 9. RMSE and MWS of simulation results for five-step-ahead Bayesian predictions.
RMSEMWS
y n + k μ σ L U μ σ L U
Model I
y n + 1 1.371.390.074.6311.2530.445.1657.51
y n + 2 1.681.490.055.3412.6129.515.9285.10
y n + 3 1.621.390.074.3711.5125.525.9248.48
y n + 4 1.611.480.055.4312.9025.305.9981.48
y n + 5 1.862.070.075.8217.1355.926.05103.08
Model II
y n + 1 1.661.460.065.3312.4323.125.7986.26
y n + 2 2.381.850.116.5618.5735.796.80118.91
y n + 3 2.722.210.117.9423.6945.557.14147.63
y n + 4 2.952.250.127.7529.0848.426.74162.62
y n + 5 3.262.460.148.6033.8654.887.24202.76
Model III
y n + 1 1.551.180.084.5410.7520.294.9564.42
y n + 2 1.931.450.065.3212.9620.816.1874.72
y n + 3 3.002.100.167.8132.6047.956.27177.25
y n + 4 2.712.180.137.9229.1051.146.32187.51
y n + 5 3.012.140.178.2632.5448.886.38190.08
Table 10. Averaged Bayesian estimation results for Model I (SMN-t) with sample sizes n = 100 and n = 300 .
Table 10. Averaged Bayesian estimation results for Model I (SMN-t) with sample sizes n = 100 and n = 300 .
Parameter True μ ¯ σ ¯ L ¯ U ¯ CP (%) μ ¯ σ ¯ L ¯ U ¯ CP (%)
n = 100 n = 300
μ 0 1.41.2790.2360.8251.73196.41.3670.1311.1151.61696.2
ϕ 1 0.50.4880.0840.3290.64295.60.5040.0430.4210.58694.0
ϕ 2 −0.3−0.2760.095−0.445−0.05992.8−0.2960.048−0.387−0.20496.2
ϕ 3 0.0−0.0030.064−0.1210.11499.60.0000.041−0.0780.07797.0
ϕ 4 0.00.0110.056−0.0920.11598.60.0050.035−0.0630.07397.4
α 10 0.60.5750.1250.3400.80596.40.5930.0670.4670.72397.4
α 11 0.00.0060.103−0.1660.20699.60.0040.063−0.1120.12499.7
α 12 0.0−0.0070.099−0.1970.15799.60.0010.060−0.1120.11499.4
α 13 0.0−0.0030.087−0.1610.15199.7−0.0010.055−0.1070.10398.8
σ 2 1.01.0640.2910.6421.77795.01.0000.1530.7461.34496.4
ν 3.03.2391.7382.1628.01197.02.9830.6002.2024.52495.6
Table 11. RMSE and MWS of simulation results for five-step-ahead Bayesian predictions of Model I (SMN-t) with sample sizes n = 100 and n = 300 .
Table 11. RMSE and MWS of simulation results for five-step-ahead Bayesian predictions of Model I (SMN-t) with sample sizes n = 100 and n = 300 .
RMSEMWS
y n + k μ σ L U μ σ L U
n = 100
y n + 1 1.451.280.054.1010.3123.404.9739.29
y n + 2 1.911.510.055.1413.2327.785.7660.95
y n + 3 2.361.620.136.4217.6027.515.76103.03
y n + 4 2.021.570.075.8214.3526.155.7881.63
y n + 5 1.921.540.075.6214.5126.955.8188.63
n = 300
y n + 1 1.251.100.033.979.1517.555.2947.37
y n + 2 1.601.480.075.3312.7227.956.0571.14
y n + 3 1.641.530.065.7313.4131.206.1688.07
y n + 4 1.571.380.065.4612.0222.376.1594.95
y n + 5 1.611.350.105.0411.4919.616.1761.00
Table 12. Averaged Bayesian estimation results for Model II (SMN-cn) with contamination probabilities ν = 0.3 and ν = 0.4 .
Table 12. Averaged Bayesian estimation results for Model II (SMN-cn) with contamination probabilities ν = 0.3 and ν = 0.4 .
Parameter True μ ¯ σ ¯ L ¯ U ¯ CP (%) μ ¯ σ ¯ L ¯ U ¯ CP (%)
ν = 0 . 3 ν = 0 . 4
μ 0 1.51.4000.1801.0461.75392.01.3800.1941.0021.75892.8
ϕ 1 0.60.6110.0510.5140.71196.60.6110.0520.5140.71294.6
ϕ 2 0.0−0.0020.048−0.0950.08996.8−0.0020.049−0.0940.08998.2
ϕ 3 0.00.0030.047−0.0860.09499.40.0000.048−0.0890.09499.0
ϕ 4 0.00.0030.037−0.0690.07298.60.0050.038−0.0700.07698.2
α 10 0.70.7070.1050.5070.92292.60.7110.1200.4870.95293.4
α 11 0.40.3700.1410.0410.62793.00.3550.1570.0120.64791.2
α 12 0.00.0050.086−0.1410.15899.40.0070.094−0.1490.18099.8
α 13 0.0−0.0040.076−0.1500.13399.2−0.0030.082−0.1570.14599.6
α 20 0.60.5870.0950.4050.77695.80.5840.1080.3730.79295.6
α 21 0.0−0.0030.083−0.1580.14099.4−0.0030.091−0.1700.15599.4
α 22 0.00.0010.074−0.1360.13399.40.0010.081−0.1480.14499.4
α 23 0.0−0.0020.067−0.1250.12099.8−0.0020.073−0.1340.12799.8
σ 2 1.01.0010.2470.5671.56597.41.0600.3160.5361.82697.2
ν ν 0.3320.0860.1790.52397.20.4080.0940.2290.60598.6
γ 0.10.1040.0320.0560.18097.80.1030.0330.0560.18697.6
Table 13. RMSE and MWS of simulation results for five-step-ahead Bayesian predictions of Model II (SMN-cn) with contamination probabilities ν = 0.3 and ν = 0.4 .
Table 13. RMSE and MWS of simulation results for five-step-ahead Bayesian predictions of Model II (SMN-cn) with contamination probabilities ν = 0.3 and ν = 0.4 .
RMSEMWS
y n + k μ σ L U μ σ L U
ν = 0.3
y n + 1 1.801.600.086.1013.2021.537.4581.03
y n + 2 2.542.010.137.5918.1034.528.10120.00
y n + 3 2.852.340.138.3622.3844.908.57142.53
y n + 4 3.022.350.128.4722.5237.639.11136.18
y n + 5 3.362.530.149.2828.8450.088.21190.44
ν = 0.4
y n + 1 1.921.690.066.5213.6119.338.5462.77
y n + 2 2.672.130.148.1818.4432.239.27113.02
y n + 3 2.952.470.098.8922.1846.379.76142.24
y n + 4 3.162.560.109.4123.2141.9010.15159.53
y n + 5 3.442.670.189.8827.6849.429.45192.85
Table 14. Descriptive statistics for raw daily Najran solar radiation, 1 December 2005—18 February 2006 ( n raw = 80 ). CV: coefficient of variation.
Table 14. Descriptive statistics for raw daily Najran solar radiation, 1 December 2005—18 February 2006 ( n raw = 80 ). CV: coefficient of variation.
VariableMeanStd. Dev.MinMaxCV (%)
GHI (Wh/m2)6135.2414.95033.07302.06.76
Clear-Sky GHI (Wh/m2)6369.5376.75198.07487.05.91
Table 15. Posterior inclusion probabilities of latent-indicators for the Najran daily GHI change series under SMN distributions.
Table 15. Posterior inclusion probabilities of latent-indicators for the Najran daily GHI change series under SMN distributions.
δ ϕ δ α
SMN δ 1 ϕ δ 2 ϕ δ 3 ϕ δ 4 ϕ δ 5 ϕ δ 10 α δ 11 α δ 12 α δ 13 α δ 14 α
SMN-t0.7400.5810.4480.3260.1100.9990.6750.5240.4100.199
SMN-sl0.8590.7140.4740.3510.0770.9990.8130.6540.4700.221
SMN-cn0.1680.1070.1310.0810.0990.9990.1250.1210.1060.103
SMN-n0.9670.6340.3980.1540.0910.9990.9610.6720.4220.140
Table 16. Bayesian estimates for the Najran daily GHI change series under SMN distributions.
Table 16. Bayesian estimates for the Najran daily GHI change series under SMN distributions.
Parameter μ σ LU μ σ LU
SMN- t SMN-sl
μ 0 0.06430.0345−0.00380.12780.06960.0347−0.00710.1315
ϕ 1 −0.60720.3000−1.0081−0.0959−0.77700.2696−1.0129−0.1253
ϕ 2 −0.32110.2763−0.9043−0.0360−0.54120.2619−0.8914−0.0391
ϕ 3 −0.22440.2171−0.7191−0.0152−0.35710.2116−0.7494−0.0200
ϕ 4 −0.15670.1523−0.50910.0136−0.23090.1453−0.50180.0084
ϕ 5 −0.01370.0517−0.10680.0890−0.02870.0546−0.11820.0873
α 10 0.88610.04770.79800.98320.90660.04900.81060.9932
α 11 0.53290.29720.04230.96430.71340.27180.08310.9957
α 12 0.25750.2840−0.03530.86490.48810.2778−0.01770.8844
α 13 0.17490.2174−0.04400.68190.26440.2252−0.05690.7084
α 14 0.07930.1339−0.08130.41600.11630.1329−0.08630.3964
σ 2 0.02790.01220.01290.05960.02010.00890.00970.0440
ν 2.27870.27892.10583.13381.08010.14831.00221.5015
SMN-cnSMN-n (Gaussian)
μ 0 0.02130.0183−0.01380.05920.00460.0546−0.10580.1103
ϕ 1 −0.11840.1012−0.36310.0035−0.73900.1949−1.0981−0.3445
ϕ 2 −0.08410.0819−0.21010.0280−0.41830.2679−0.9689−0.0390
ϕ 3 −0.08260.0664−0.17700.0143−0.20580.2258−0.77230.0418
ϕ 4 −0.03960.0508−0.12020.0376−0.05790.1284−0.34660.1515
ϕ 5 0.00220.0196−0.03600.04080.02670.0714−0.11670.1643
α 10 0.85150.02000.81060.88610.94260.09300.74261.1191
α 11 0.08660.0917−0.02190.28460.80020.23590.27131.2143
α 12 0.07210.0772−0.03740.19200.46560.3255−0.01221.1329
α 13 0.06380.0663−0.04290.16160.20160.2707−0.10410.8611
α 14 0.02920.0454−0.04830.10370.03620.1339−0.17480.3436
σ 2 0.00500.00270.00250.01120.22760.05370.15140.3624
ν 0.35800.07250.22930.5089
γ 0.00590.00370.00260.0160
Table 17. Ten-step-ahead Bayesian forecasts of differenced-standardized daily GHI at Najran under four SMN distributions. μ : posterior forecast mean; σ : posterior forecast SD; L, U: 95% credible bounds.
Table 17. Ten-step-ahead Bayesian forecasts of differenced-standardized daily GHI at Najran under four SMN distributions. μ : posterior forecast mean; σ : posterior forecast SD; L, U: 95% credible bounds.
y n + k y n + 1 y n + 2 y n + 3 y n + 4 y n + 5 y n + 6 y n + 7 y n + 8 y n + 9 y n + 10
True−1.94−0.131.260.681.07−0.871.79−0.43−0.41−0.36
SMN-t
μ −0.947−0.8921.1320.5601.314−0.9431.599−0.433−0.5000.217
σ 0.3930.4840.5490.4990.4850.4010.4670.4300.4950.591
L−1.560−1.7360.238−0.3530.387−1.7510.586−1.211−1.365−0.561
U−0.158−0.0422.1231.5022.259−0.1352.4390.4240.2821.492
RMSE0.9950.7590.1280.1170.2440.0710.1870.0010.0860.579
SMN-sl
μ −0.982−0.9391.2490.5351.444−1.0031.518−0.408−0.5320.326
σ 0.3250.4250.5090.4910.4550.3980.6210.4440.4170.533
L−1.594−1.7390.405−0.4010.564−1.8310.569−1.242−1.372−0.544
U−0.346−0.0802.1911.4602.338−0.2612.4320.4260.2831.532
RMSE0.9610.8060.0110.1430.3740.1310.2680.0260.1180.688
SMN-cn
μ −0.851−0.8280.9090.7001.077−0.9451.764−0.473−0.398−0.002
σ 0.5550.5880.5820.5560.5770.5680.5630.5700.5980.592
L−2.093−2.259−0.391−0.675−0.397−2.3810.385−2.002−1.860−1.536
U0.5420.5022.3612.0612.3730.3863.0170.6861.0651.371
RMSE1.0920.6950.3510.0230.0070.0730.0220.0390.0170.360
SMN-n (Gaussian)
μ −0.960−0.9700.9680.7261.389−0.9681.686−0.214−0.4990.091
σ 0.5290.6590.6740.7000.6960.6680.7230.6880.7030.759
L−2.073−2.269−0.285−0.6590.076−2.3350.166−1.557−2.010−1.281
U0.0500.2732.4472.0192.7540.3163.1461.0920.7551.705
RMSE0.9830.8370.2930.0490.3190.0950.1000.2200.0850.453
Table 18. Ten-step-ahead Bayesian forecasts of observed (anti-transformed) daily GHI at Najran under SMN-t distribution.
Table 18. Ten-step-ahead Bayesian forecasts of observed (anti-transformed) daily GHI at Najran under SMN-t distribution.
y n + k y n + 1 y n + 2 y n + 3 y n + 4 y n + 5 y n + 6 y n + 7 y n + 8 y n + 9 y n + 10
True5730.05675.06198.06479.06923.06561.07302.07122.06950.06800.0
Forecast6143.05773.06242.86475.37020.66629.37292.77113.26905.76995.7
Table 19. Diebold–Mariano test comparing absolute-error loss of each SMN forecasts against the Gaussian specification (anti-transformed GHI, k = 10 horizons).
Table 19. Diebold–Mariano test comparing absolute-error loss of each SMN forecasts against the Gaussian specification (anti-transformed GHI, k = 10 horizons).
ComparisonMean Loss DifferentialDM Statistic (HLN-Corrected)p-Value
SMN-t vs. SMN-n (Gaussian) 17.30 1.428 0.153
SMN-cn vs. SMN-n (Gaussian) 28.93 1.372 0.170
SMN-sl vs. SMN-n (Gaussian) 6.32 0.576 0.565
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Amin, A.A.; Alghamdi, S.A. Full Bayesian Analysis of ARX Models Under Scale-Mixtures of Normal Errors: An Application to Solar Radiation in Najran, Saudi Arabia. Mathematics 2026, 14, 3163. https://doi.org/10.3390/math14173163

AMA Style

Amin AA, Alghamdi SA. Full Bayesian Analysis of ARX Models Under Scale-Mixtures of Normal Errors: An Application to Solar Radiation in Najran, Saudi Arabia. Mathematics. 2026; 14(17):3163. https://doi.org/10.3390/math14173163

Chicago/Turabian Style

Amin, Ayman A., and Shuhrah A. Alghamdi. 2026. "Full Bayesian Analysis of ARX Models Under Scale-Mixtures of Normal Errors: An Application to Solar Radiation in Najran, Saudi Arabia" Mathematics 14, no. 17: 3163. https://doi.org/10.3390/math14173163

APA Style

Amin, A. A., & Alghamdi, S. A. (2026). Full Bayesian Analysis of ARX Models Under Scale-Mixtures of Normal Errors: An Application to Solar Radiation in Najran, Saudi Arabia. Mathematics, 14(17), 3163. https://doi.org/10.3390/math14173163

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop