1. Introduction
Photovoltaic (PV) systems require accurate modelling and monitoring to ensure their profitability. The amount of irradiance at the site, the global plane-of-array irradiance (GPI), is the foundation of designing, modelling and monitoring PV systems. The GPI comprises the plane-of-array’s (POA) direct beam, ground and diffuse irradiance components. GPI is used to model and monitor PV systems, as this shows the amount of generated solar power, and, therefore, it is one of the most important contributing factors to designing a PV system. The global horizontal irradiance (GHI), direct normal irradiance (DNI), and diffuse horizontal irradiance (DHI) components are required to calculate these irradiance components.
Irradiance components with a transposition model calculate GPI (
) as
is the direct beam irradiance,
is the ground-reflected irradiance, and
is the diffuse irradiance component in the POA on the collector. The GHI, DNI, and DHI components are required to calculate
,
and
. The sum of the DNI projected onto the horizontal surface using the cosine of the solar zenith angle
and DHI gives the GHI, as shown in
Figure 1 [
1]:
The units of GHI, DHI, and DNI are .
Most ground-based stations at least have measurements of GHI. Other measurements include radiometric data such as DNI, DHI, and ultra-violet and meteorologic data such as the temperature, pressure, rainfall, relative humidity, wind direction and wind speed. Pyranometers measure DHI and GHI, and the pyrheliometer measures DNI.
GHI is measured with a hemispherical view and is mounted horizontally. Similar in setup to other pyranometers, the DHI pyranometer includes the additional feature of being shaded from direct sunlight. The pyrheliometer has a narrow view that only measures the beam directly from the Sun and is usually a Sun tracker for increased accuracy [
2]. The irradiance measurements are converted to
and logged accordingly.
Calibrating the equipment to the ISO 9060:2018 standard [
3] is necessary, and it is advisable to undergo recalibration every two years to ensure the reliability of measurements. The maintenance required is to clean the domes and regularly check and replace the desiccant, which keeps the instruments dry internally.
GHI, DNI, and DHI are interdependent; therefore, having only two irradiance measurements is sufficient to estimate the third using the decomposition models (also sometimes called separation models) [
4]. If only the GHI is available, the DNI and DHI also are estimated using the decomposition models. The transposition models calculate GPI using the irradiance components. Therefore, GHI, DHI and DNI correlations are usually empirically expressed as a decomposition model [
5].
Indices are relationships between different irradiance components. Decomposition and transposition models utilise these relationships.
The definition of the direct beam transmittance
and diffuse transmittance
is
Ref. [
6] defines the
as
All K-values (, , and ) are unitless.
The extraterrestrial irradiance on a normal surface
depends on the day of the year
The solar constant is usually 1367 .
Determining the horizontal extraterrestrial irradiance
involves multiplying it by the cosine of
as expressed in Equation (
7):
Multipredictor decomposition models can improve accuracy compared to single predictor models [
7]. However, the disadvantage is that multiple measurements must be available, which is not always the case for developing countries or brand-new sites of PV installations.
Refs. [
8,
9] developed a logistical model to estimate solar diffuse radiation [
8,
9]. Refs. [
10,
11,
12] have proposed machine-learning-based models to predict solar diffusion and direct components [
10,
11,
12]. Ref. [
13] proposed a satellite-based decomposition model as an alternative to ground-based measurements [
13,
14] proposed statistical models for estimating diffuse radiation [
14].
Decomposition models have been developed by assessing previous models and improving the accuracy of these estimations. As more data and measurements become available, researchers have the opportunity to develop models for different climates and temporal resolutions. Most models predominantly use
. Some of the variables used in the decomposition models are the solar altitude angle
and dew point temperature
. Using
as the main predictor in decomposition models is popular because of its simplicity and applicability [
7].
Ref. [
15] developed a relationship between the
and
[
15,
16] extended the
-
relationship to latitudes from 31 to 42° North [
16]. Ref. [
17] established a GHI and DNI relationship for a Mediterranean site to estimate
using
[
17].
The Direct Insolation Simulation Code (DISC) was developed by [
18]. Refs. [
18,
19] developed the Dirint model with the hopes of increasing the performance of the DISC model [
19]. The Dirint model of [
19] has shown superior performance when estimating the DNI [
20].
In Korea, ref. [
21] developed a model using six Korean locations. The authors of [
4,
21] developed a new model using [
18]’s DISC model by refitting the coefficients [
4]. Ref. [
22] developed a DNI estimation model using the solar elevation angle for Norway based on hourly GHI and DHI records [
22].
Ref. [
23] derived
for Hong Kong [
23]. Ref. [
24] determined
using two models with
and
[
24].
The main limitations of decomposition models are that some have a limited climate scope, and the dataset’s temporal resolution affects the irradiance estimation accuracy. A decomposition model in a tropical climate may be unsuitable for a desert climate and vice versa. Intra-hourly-based models perform differently from daily or monthly models, which is why many available decomposition models exist.
The accuracy of decomposition models has been evaluated in several regions, such as Belgium [
5], China [
25], the USA [
20], and North Africa [
26].
Ref. [
27] provided an extensive study of 140 available decomposition models. The authors state that the predicted DNI’s accuracy highly depends on the decomposition model. Validation studies exist but are limited to a few models and test stations, i.e., biased to a specific location or climate [
27]. Research indicates that no decomposition model has been developed and validated for South Africa.
Ref. [
28] state that, in general, decomposition models tend to overestimate DHI and underestimate DNI, and typically, models tend to underestimate DHI in overcast periods and overestimate during clear-sky periods [
20].
Higher resolution data include higher
values, resulting in extreme overestimations of DNI. These hourly DNI estimates have higher accuracy than 1-min DNI estimates. Subhourly estimations would be highly beneficial for the real-time monitoring and forecasting of solar power [
27].
Figure 2 visualises the testing and validation countries of common decomposition models in green for models such as [
15,
16,
17,
24], DISC ([
18]), and Dirint ([
4,
19,
21,
22,
23]) [
4,
15,
16,
17,
18,
19,
21,
22,
23,
24].
The decomposition model in South America was developed in Brazil in [
29] and in Argentina and Brazil in [
30]. Northern African models include Nigeria [
31], Algeria [
32], and Morocco [
33].
Ref. [
34] developed a model for Australia and observed that the model only slightly outperformed the Dirint model [
34]. The BRL model developed by [
9] included a method to construct multiple variable logistic models for the diffuse solar fraction, which includes Mozambique [
9].
Figure 2 represents these discussed models [
9,
29,
30,
31,
32,
33,
34] in red.
South African research on decomposition models includes the following: ref. [
35] published the only Southern African-based study on the relationship between radiation and
[
35]. However, this relationship is with photosynthetically active radiation related to agricultural practices, not PV systems. Clear-sky model assessments and validation studies have been performed by [
36,
37] for Southern African countries. Clear-sky models simplify atmospheric attenuation to estimate solar irradiance under clear-sky conditions, do not represent decomposition models, and do not include these studies as comparison models, as they are irrelevant to the research.
Ref. [
38]’s thesis assessed decomposition and transposition models in South Africa and showed that the models tend to overestimate the DHI but underestimate the DNI [
38]. Furthermore, the DISC and Dirint decomposition models showed the most accurate estimations of the DNI and DHI for South African climatic conditions [
39].
As discussed, decomposition models are empirical relationships between GHI, DHI and DNI. All three irradiance components are required to estimate GPI. Decomposition models are useful as they reduce the measurement equipment by decomposing one irradiance component into two others; for example, they use GHI to estimate DHI and DNI.
Most decomposition models are not universally applicable and localised to a specific climate, and the temporal resolution is not always transferable. There has not been extensive literature published representing the Southern African region in decomposition models, which this research article will attempt to address.
2. Model Development
The methodology to develop a novel decomposition model is based on selected data from the automated quality control (QC) procedure proposed in [
40] and addresses three geographical models:
A localised decomposition model, which is site-specific;
A clustered decomposition model, which encapsulates several sites to group an area based on their geographical location;
A regional (Southern African) model, which encapsulates the data from the SAURAN network for developing a model specific to Southern Africa.
Figure 3 details an overview of the decomposition model development, which is discussed in this section. The first part is ensuring the data are quality-controlled, followed by the development of the decomposition model. The accuracy of the models are rigorously scrutinised to determine if the proposed models outperform the baseline models.
2.1. SAURAN Database
The Southern African Universities Radiometric Network (SAURAN) is a network that includes multiple stations across Southern Africa, collecting meteorological data such as irradiance and wind, among others [
41].
Table 1 summarises the SAURAN stations’ corresponding geographical information, such as latitude, longitude, and elevation above sea level.
Table 2 summarises the SAURAN database and dataset sizes, followed by
Table 3 which shows the subsequent data points available for model development. Further, the data points assessed are
between 0.175 and 0.875.
The data points are hourly measurements of the GHI, DNI, and DHI. The split of the train–validation–test datasets is 50:25:25, with the exceptions of two datasets, ILA and MIN. The ILA and MIN have a 0:0:100 data split and are two unknown datasets as part of the test study.
Table 3 also shows each station’s mean GHI, DNI, and DHI, determined after applying the QC procedure.
2.2. Comparison Metrics
The comparison metrics are the root mean square error (RMSE), mean absolute error (MAE), and mean bias error (MBE).
where
is the measured value and
is the predicted value. A low RMSE and MAE indicate a good model, whereas an MBE should be closer to zero. RMSE indicates the concentration of data around the line of best fit. Therefore, a smaller RMSE is indicative of a more accurate model.
The Pearson correlation coefficient
r indicates the correlation between data:
In Equation (
9),
and
represent the individual points with index
i, and
and
represent the mean of the
x and
y sample set. An
r closer to −1 has a negative correlation, meaning if one variable increases, the other decreases. In contrast, if
r is closer to 1, it has a positive correlation, meaning if one variable increases, the other would also [
42].
Statistical indicators used for the comparison metrics are the MBE, RMSE, and MAE, which are all expressed as a percentage of the mean measured DNI [
27] and
. Further comparison metrics are two MAE
-intervals:
and
.
The MBE indicates whether a model over- or underestimates the DNI, and the RMSE indicates the deviation of the errors. A significant difference between MAE and RMSE indicates a larger variance in the data. Lower RMSE and MAE are ideal, whereas an MBE closer to zero is optimal. The MAE is an unbiased estimator and also evaluates the two intervals. Lower and higher indicate overcast and clear-sky conditions, respectively. Therefore, the two intervals assess the models under varying weather conditions.
2.3. Regression and Fitting
The relationship between two variables is quantified using statistical methods like regression. Regression techniques can be linear, multi-linear and non-linear.
The definition of a linear relationship is
where
y is the response,
x is the regressor,
is the intercept, and
is the slope. A regression analysis quantifies the strength of a relationship between
y and
x [
42].
The least squares method estimates
and
so that the sum of the squares of the residuals is at a minimum. The residual sum of squares is denoted as
and is the sum of squares of the errors about the regression line. Thus, the minimisation of
where
denotes the predicted or fitted value.
The coefficient of determination,
, indicates how good the fit of a model is and is a number between zero and one.
A higher
value indicates that the model explains the variation in the response variable around its mean, and the regression model fits the observation better [
42].
Polynomial regression is the modelling of a dependent,
y, as an
-degree polynomial of
xExponential regression is where the best fit of an equation is an exponential function, like
or
Multi-linear regression has multiple variables, which is the outcome of a response variable
2.4. Software Development Tools
The model development utilises a combination of data science applications and modelling. The primary tool is the open-source language Python with the anaconda interface [
43], and various available libraries [
44,
45,
46].
2.5. Baseline Models
Three comparative models are used as a baseline to compare the new models. Based on the literature, the DISC and Dirint models performed well for Southern African climates [
39,
47].
The Dirint [
19] and Lee [
4] models are also used for comparison because their foundation is similar to the DISC model [
18].
Ref. [
18]’s DISC quasi-physical approach has three assumptions [
4]:
The relative air mass () is the dominant parameter affecting the relationship between and ;
The physical model used to calculate
will provide a physically based reference from which the changes in
can be calculated (see Equation (
20) below);
Seasonal, annual and climate variations in the relationship between and are fully accounted for by parametric functions in that relate to , cloud cover, and PW vapour.
The absolute AM (
) is the pressurised normalisation of AM, expressed as
where
P refers to the atmospheric pressure at the test site and
is the atmospheric pressure at sea level.
The modelled DNI is determined using Equation (
3):
where
and
The clear-sky limit
is a polynomial in
:
Two intervals determine the coefficients and : and .
Ref. [
18]’s model possesses a different functional form because the quasi-physical approach is applied; therefore, it partially reflects the physics involved in the atmospheric transmission of solar radiation [
4]. The
,
and
parameters were fitted based on solar radiation data from Atlanta, Georgia, USA, 1981 [
18]. Ref. [
18] adopted the Bird clear-sky model for
(see Equation (
22)). The parameters
,
and
, as described in Equations (
23) and (
24), were then fitted based on the dataset.
The DISC model, termed ‘quasi-physical’, combines a clear-sky model with experimental fits for other sky conditions. The model is a clear-sky irradiance attenuated by a function of
. The authors of [
18] derived the empirical regressions from 12 years of recorded radiation data at 70 stations [
5,
18].
The Dirint model is based on the DISC model and was developed by [
19]. The goal was to improve the accuracy of the DISC model by [
18].
The Dirint model uses a clearness index variation parameter
:
Furthermore, a stability index parameter
,
considers the previous (
), current (
i) and next hourly (
) record. When the preceding or hourly record is missing,
is
A low
is a stable condition, whereas a high
characterises unstable conditions, which allows the distinction between hazy and partly cloudy conditions. The
is an adequate atmospheric PW estimator [
19]. The Dirint model’s atmospheric PW (
W) is estimated using
The Dirint is a four-dimension conditional model, with the
,
,
and
W. Based on the four-dimensional model, the calculation of hourly DNI is
where
Coefficients and are from a complex lookup table.
Ref. [
4] created a new model for Korea with the same format as [
18]’s DISC model.
For
or
The evaluation consists of comparing the localised, clustered and regional models against the three baseline models: DISC, Dirint and Lee. The DISC and Dirint models were selected based on their performance in estimating DNI for Southern African climates. The Lee and Dirint models have foundational similarities to the DISC model. These models consider whether the newly developed decomposition model improves the accuracy of hourly DNI estimations for Southern Africa. The accuracy evaluation uses the comparison metrics discussed in the next section.
2.6. Decomposition Model Development Methodology
The methodology builds on the DISC model. The DISC model stands out as one of the better-performing models for estimating DNI for South Africa [
39]. Its simplicity is evident in its lack of a need for a complex four-dimensional lookup table, unlike the Dirint model.
The original DISC model uses Equation (
21), an exponential function. However, the regression model for an exponential function, as discussed in
Section 2.3, showed difficulty in finding optimal
a,
b and
c coefficients in all cases. Instead, a second-order polynomial function of
is a suitable substitute with similar regression results.
The training set then fits
a,
b and
c for intervals
and
:
and the validation and testing sets evaluate the model’s accuracy.
Figure 3 summarises the development for each decomposition model in this study, where each model undergoes the following initial processing steps:
Empirical formulae estimate , , pressure, , , and . From this, the assessment of available models aids in developing a new model.
Data are split into intervals of 0.05 , starting from 0.175 to 0.875.
is then modelled as Equation (
34);
The interval or intervals are then fitted against the function to determine Equation (
34) to determine the
a,
b and
c coefficients using a least squares regression analysis.
From the
-interval function, the
-
,
-
and
-
coefficients are fitted to a polynomial of Equation (
35) with regards to
.
These equations can be used to determine
and
, which, in turn, calculate the DNI (see Equations (
19) and (
20)).
For each SAURAN station, a localised decomposition model is developed. A clustered decomposition model describes an area with similar irradiance patterns using the clustered areas discussed in [
40]. Ref. [
49] first presented a two-cluster correlation map using the SAURAN database [
49], and, by using this approach, this study formulated four clusters instead of two in Southern Africa, as shown in
Figure 4a.
Figure 4a shows the clusters’ geographical location, and
Figure 4b shows the penetration levels of GHI.
Table 4 shows the different clusters’ training sets’ mean GHI, DNI, and DHI.
Cluster 1 receives the most GHI and DNI, and Cluster 3 receives the least, as evident from
Figure 4b. The different climates are also evident in these clusters: Cluster 3 is more humid and receives, on average, more DHI than Cluster 1.
Figure 5 shows how the cluster data are combined. Each cluster and the regional (Southern African) model are combined with even distributions of datasets to avoid introducing a bias, as some stations are over-represented in the original dataset. Some stations, such as the SUN, UPR and RVD stations, have considerably more data available as they are either older stations or have not been closed down.
The different stations have varying climates, and therefore, a larger representation of one station will result in a biased model towards that station. The advantage of the even distribution is that every station is sufficiently represented and will not cause a model bias, but this reduces the amount of available data.
Cluster 2’s stations have higher elevation and summer humidity due to its warm, rainy summers and dry, cold winters. The expected annual irradiance levels are lower, as seen in
Figure 4b. The stations have higher humidity because of their location and higher DHI levels.
The two stations in Cluster 2, UPR and CSIR, are expected to have more diffuse particles due to the higher air pollution levels and, therefore, higher DHI levels. Cluster 2 has a large bias of the data from Pretoria, South Africa, from the CSIR and UPR datasets.
Cluster 4 has lower annual irradiance levels, as seen in
Figure 4b, and FRH and NMU are closer to the coastline, whereas GRT is inland.