A New Database of Global and Direct Solar Radiation Using the Eastern Meteosat Satellite, Models and Validation
Abstract: We present a new database of solar radiation at ground level for Eastern Europe and Africa, the Middle East and Asia, estimated using satellite images from the Meteosat East geostationary satellites. The method presented calculates global horizontal (G) and direct normal irradiance (DNI) at hourly intervals, using the full Meteosat archive from 1998 to present. Validation of the estimated global horizontal and direct normal irradiance values has been performed by comparison with high-quality ground station measurements. Due to the low number of ground measurements in the viewing area of the Meteosat Eastern satellites, the validation of the calculation method has been extended by a comparison of the estimated values derived from the same class of satellites but positioned at 0°E, where more ground stations are available. Results show a low overall mean bias deviation (MBD) of +1.63 Wm−2 or +0.73% for global horizontal irradiance. The mean absolute bias of the individual station MBD is 2.36%, while the root mean square deviation of the individual MBD values is 3.18%. For direct normal irradiance the corresponding values are overall MBD of +0.61 Wm−2 or +0.62%, while the mean absolute bias of the individual station MBD is 5.03% and the root mean square deviation of the individual MBD values is 6.30%. The resulting database of hourly solar radiation values will be made freely available. These data will also be integrated into the PVGIS web application to allow users to estimate the energy output of photovoltaic (PV) systems not only in Europe and Africa, but now also in Asia.
Retrieval of ground-level solar radiation retrieved from satellite has been performed by many groups going back at least to Möser and Raschke, 1984  and Cano et al., 1986 . Another early work is that of Pinker and Laszlo, 1992 . Since then, both geostationary and polar-orbiting satellites have been used to estimate solar radiation at ground level, and existing data sets cover nearly the whole earth, though with widely varying spatial and temporal resolution [4–8].
A number of solar radiation data sets have been retrieved using data from the Meteosat family of European geostationary satellites situated at 0° longitude. Examples include SOLEMI [4,9], the different versions of HelioClim [6,10], CM SAF [9,11], LSA SAF [12,13]. Some of these data are available free of charge, while others license the data on a commercial basis. The commercial/free status of the individual data sets may change with time. However, at the time of writing, to our knowledge there are no freely available high-resolution data for solar radiation retrieved from the eastern Meteosat satellites situated over the Indian Ocean (These satellites are officially named Meteosat Indian Ocean Data Coverage (IODC). We find this rather uninformative and will refer to the satellites as “Meteosat East”).
Here we describe the results of a procedure to retrieve ground-level solar radiation components using data from the Eastern Meteosat satellites. The resulting database consists of hourly values of global horizontal (G) and direct normal irradiance (DNI) at the earth surface with a spatial resolution similar to the native pixel resolution of the satellite images.
The organization of the paper is as follows: Section 2 will give an overview of the methods used for the calculation of solar irradiance from satellite data and the properties of the resulting solar radiation database. Section 3 presents the results of the validation of hourly global horizontal and direct normal irradiance using ground station data. Section 4 discusses the results and presents some applications of the data. Section 5 contains the conclusions.
2. Methods and Input Data for the Retrieval of Solar Radiation From Geostationary Satellite Images
2.1. Algorithms for Calculating Surface Solar Radiation Components
The cloudy part of the applied method is based on the well established and widely used Heliosat method (please see  for an overview of applications). For the calculation of the all sky solar irradiance the SPECMAGIC algorithm is used . This combination is a standard method for the calculation of solar surface radiation of the CM SAF, the Climate Monitoring Satellite Application Facility. The method is described in more detail in the following paragraphs.
The retrieval of the solar surface irradiance is performed in a two step approach. In a first step the effective cloud albedo (CAL) is retreived from the visible broadband channel of the Meteosat satellite. The observed reflection is corrected for different luminance conditions due to variations in the Sun-Earth distance and the solar zenith angle θ. Furthermore, the dark offset of the instrument has to be subtracted from the satellite image counts D. The observed reflections are therefore normalised by application of Equation (1).
Here, D is the observed digital count which includes the dark offset D0 of the satellite instrument. f(distance) accounts for the variation in the Earth sun distance. The effective cloud albedo is then derived from the observed normalised reflections by Equation (2):
Here, ρ is the observed reflection for each pixel and time.
ρmax is the “maximum” reflection. It is determined by the 95 percentile of all reflection values at local noon in a target region (latitude 45.8°S to 52.7°S and longitude 40°E to 56°E) (This region is for Meteosat East. For the Meteosat satellites at 0° longitude the target region is correspondingly further west). This region is characterised by high frequency of cloud occurrence for each month. In this manner changes in the satellite brightness sensitivity are accounted for. ρmax depends slightly on the scattering angle, which is the angle between the sun and satellite.
In order to account for this effect the following empirical relation is applied:
For the fixed target region the satellite angles are constant and no systematic dependency on the sun azimuth has been found. This explains why the correction depends only on the solar zenith angle. Details on evaluation of the self-calibration approach are given in .
ρcs is the clear sky reflection, which is a statistical value derived for every pixel and time slot separately. This is essentially done by estimation of the minimal reflection of the satellite images during a certain time span (e.g., a month) for each time slot. In detail this is done by iteration as follows. At the start all reflection values ρ (within the time span) are used to calculate an average reflection. This average reflection serves as initial threshold value ρthres. A new average is then calculated with all reflections that are smaller than the initial threshold value plus a small value ∊, given as ∊ = 0.035ρmax. This average is then the threshold for the next iteration, where again all reflection values below ρthres + ∊ are used to calculate a new value for ρthres. The iteration is proceeded until no reflection value is available that is higher than ρthres + ∊, hence until the threshold ρthres does not change any more. ρcs is then defined as being equal to ρthres. It is assumed that at this point all cloudy pixels are filtered out.
As a consequence of the law of energy conservation, radiation which is not reflected or absorbed by clouds passes through the clouds. The effective cloud albedo provides therefore a measure for the cloud transmission, i.e., the amount of clear sky (=cloudless) radiation that passes through the clouds. The irradiance can therefore be calculated by Equation (4).
Here, G is the solar surface irradiance, often referred as global irradiance and Gclear is the radiation for clear (=cloudless) skies.
In the second step of the calculation, the clear-sky irradiance Gclear is calculated using the SPECMAGIC model for clear-sky solar irradiance . Gclear is then used to calculate the global irradiance using Equation (4).
SPECMAGIC is described in detail in ; here, only a brief outline is given. The clear sky model is based on radiative transfer modelling (RTM). It is a hybrid Look-Up-Table approach. The RTM is used to calculate look-up tables. These consider the effect of absorption and scattering of aerosols as well as rayleigh scattering on the irradiance. The effect of the absorbers water vapour and ozone is considered by parameterisation developed and validated by radiative transfer modelling. SPECMAGIC enables the use of enhanced information about the atmosphere: aerosol optical depth, aerosol type, water vapour and ozone.
In addition to the global irradiance, SPECMAGIC performs also the calculation of the direct irradiance. The same method (hybrid Look-Up-Table approach) is used to derive Bclear. The beam irradiance for all sky conditions, Ball is then calculated by the use of Equation (5).
2.2. Sources of Input Data
The accuracy of the estimated Gclear and Bclear depends on the accuracy of the information about aerosols and water vapour, the dominant variables for cloudless sky irradiance.
The water vapour information results from the analysis of the global Numerical Weather Prediction model (NWP) of the European Center for Medium Weather Forecast (ECMWF). The weather predictions system is described in , and the data are available online .
For the aerosol information, 8 years (2003–2010) of reanalysis data from the project “Monitoring Atmospheric Composition and Climate” (MACC) [21–24] have been used to calculate long term monthly means of aerosol optical depth. These data are in turn used to consider the effect of aerosols on the solar surface irradiance. The MACC reanalysis data is generated on a Gaussian T159 grid which corresponds to 120 km resolution. For the use in SPECMAGIC the aerosol data have been re-gridded to a 0.5 × 0.5 degree regular latitude-longitude grid. Further, high AOD values has been smoothed in order to account for the sensitivity of CAL on high aerosol loads.
Though it would be possible to use the monthly aerosol data we have chosen to use the long-term average monthly values. This choice has been made mainly because the time period of the aerosol data is shorter than that of the satellite data. Using the monthly data for the shorter period would introduce an inconsistency in the time series. It would also make these data inconsistent with the longer time series of solar radiation data produced by the CM SAF collaboration, and reduce their usefulness for climate change studies which are the main motivation for the efforts of CM SAF.
For the surface albedo (SAL) values based on the United States Geographical Survey (USGS) land-cover map  are used. A formula given in  is applied in order to consider the solar zenith angle dependency of SAL. For ozone concentration a climatological value is used.
The METEOSAT images used for the calculation of CAL are available from the EUMETSAT web site .
2.3. Meteosat Satellites Relevant to the Meteosat East Data Retrieval
The solar radiation database presented here is derived from images obtained by a number of different geostationary meteorological satellites operated by EUMETSAT. These satellites belong the the Meteosat First Generation (MFG) class, and the images are obtained using the MVIRI on-board instrument. The relevant satellites are listed in Table 1, with their positions and periods of operation. The Meteosat satellites are generally placed in one of two geostationary locations: the Meteosat Prime location at 0° longitude, and the Meteosat East locations over the Indian Ocean, at around 60°E. In this paper we will use these designations (Prime and East) to distinguish the satellite locations.
As can be seen from Table 1, the satellites Meteosat-5 and Meteosat-7 have both been active over the Meteosat Prime location (0° longitude) and in different positions over the Indian Ocean. During the period July 1998 to July 2006 there were two satellites with similar instruments in different positions. This period allows a direct comparison between the solar radiation estimates from the two satellites.
2.4. Solar Radiation Retrieval
The computer codes described in Section 2.1 have been applied to produce solar radiation data for a number of years for the area covered by Meteosat Prime and Meteosat East. The Meteosat First Generation (MFG) satellites record an image every half hour, but for the present study, only the full-hour slots have been used.
The calculation of CAL is performed on the satellite image in the native resolution and projection. However, for the calculation of the solar radiation, the CAL data are projected onto a regular latitude/longitude grid with spatial resolution 0.05° (3 arc-minutes). The accuracy of the calculation of CAL decreases towards the edge of the image where the satellite views the ground and clouds at a very shallow angle. For this reason the area in which calculations are performed is restricted to a region 65° from the satellite nadir point (for instance, for Meteosat 5, when located at 63°E, the limits are 65°N, 65°S, 2°W and 128°E). In the final output the data are given on a latitude-longitude grid (spatial resolution 0.05°).
3. Validation of Global Horizontal and Direct Normal Irradiance Retrieval from MVIRI Data
The validation of the satellite-based retrieval has been performed by comparison with solar radiation measurements performed at ground level. A number of statistical measures have been used in this validation exercise. The definition of these measures can be found in Appendix.
This section will present the main results of the validation exercise. The data used for the validation as well as more detailed analysis is available at a dedicated web page .
3.1. Ground Station Measurement Data Used for the Validation
The main source of ground station measurements used in this study is the Baseline Surface Radiation Network, BSRN . The data from these stations are regarded as being of high quality and have been used extensively for validation of satellite-derived solar radiation products.
The geographical distribution of these stations is very uneven. While there are several stations in Western Europe, North America and Japan, Africa and Asia are only covered in a very sparse fashion. For this reason, a few other stations have been added to the validation exercise, especially for Eastern Europe. These station data are available from the Global Atmosphere Watch (GAW)  and distributed by the World Radiation Data Centre . Finally, ground station measurements from the Joint Research Centre, Ispra, Italy have been added to the list.
The stations used in the validation are listed in Table 2.
The BSRN stations typically supply global horizontal (G) and direct normal irradiance (DNI) values at an interval of 1 min. This is also the case for the Ispra station. However, the data for Kishinev and Thessaloniki are available only as hourly values.
3.2. Data Selection and Quality Control
There are two datasets per station. On the one hand, the estimated values at the station’s location derived from the satellite images and on the other hand, the measured irradiance data at the station. As previously mentioned, only one satellite image per hour will be considered and processed for this study.
Since the satellite image has a finite resolution (about 3–5 km) each pixel effectively is an average over the corresponding area. This means that it is not possible to capture changes in the solar radiation on timescales less than a few minutes. For this reason, the ground station measurements have been averaged over a 10-min window centered around the time the satellite measures the radiance of the image pixel corresponding to the location of the station. This does not apply to the stations for which only hourly data are available. This difference should be kept in mind when inspecting the results. The longer time averaging for the hourly data may lead to smaller values for the mean absolute deviation and the root-mean-square deviation values, while the mean bias deviation should be relatively unaffected by the choice of averaging period.
As a result, both estimated and measured irradiance datasets present one value per hour. Therefore the first step is the selection of the closest moments in time from both of them. Only if the time difference between the estimated value and the nearest time-stamped measured value is below 30 min, these values will be selected; otherwise both values are discarded. So mainly the ground data availability restricts the number of points in the comparison.
Once the closest moments in time have been selected from both datasets, a simple quality control procedure is applied to all pairs of data:
All missing values are removed. BSRN irradiance data usually present “−999” or “−999.9” values to highlight missing data. In these cases, both measured and the corresponding estimated value are eliminated.
Negative measured or estimated irradiance values when the sun’s elevation angle is below 0° are substituted by zero values and kept in the datasets.
However, negative measured or estimated irradiance values when the sun’s elevation angle is above 0° are removed from both datasets. If one of the values in the pair is wrong, the whole pair is discarded.
For the analysis of the validation results, apart from the general comparison between estimated and measured irradiance values of both datasets as a whole, the validation has been performed, also distributing the data according to different criteria, like months, solar coordinates, angular distance between the sun and the satellite or sky type. In order to distribute data into different sky types, the sky classification defined by Ineichen et al. , has been used. This one is based on a modified clearness index, k′t, (Equation (6)), defined by Perez et al. , which has the advantage of being relatively less dependent on the solar elevation angle than the normal clearness index, kt.
Here AM is the optical air mass as defined by Kasten . Sky conditions are delineated into three intervals according to the k′t value as follows:
Clear sky conditions: 0.65 < k′t ≤ 1;
Intermediate conditions: 0.3 <k′t ≤ 0.65;
Overcast conditions: 0 < k′t ≤ 0.3.
For all stations, the validation period is one year. Some of the stations have been compared against both the Meteosat Prime and Meteosat East estimates, if the station lies within the field of view of both satellites.
Using the measurements from the stations listed in Table 2 the validation metrics in Equations (A2)–(A5) can be calculated from the hourly measured and estimated values. In the following sections, the MBD values are calculated considering both day and night values, as is common in the climatological community. This should be borne in mind when comparing these results with those reported by others. The relative statistics (rMBD, rMAB and rRMSD) will not be affected by this choice.
3.3. Validation Results, Global Horizontal Irradiance
The results of the validation of the global irradiance estimates are shown in Table 3.
The MBD remains within ±10 Wm−2 for all stations except two (Ispra and Carpentras). These two stations are also the only ones where rMBD is higher than 5%. rRMSD is much higher, ranging from 17% to more than 50% in Toravere and Xianghe. This result is common for satellite-based solar radiation estimates and reflects the difficulty of correctly estimating the precise position and timing of clouds. RMSD is generally higher in cloudy climates and at locations near the edge of the satellite images, such as Toravere and Xianghe.
From the values in Table 3 we can calculate the global statistical quantities in Equations (A7)–(A9). The average measured irradiance of all the stations is Gavg = 196.59 Wm−2, and the global bias deviation is gMBD = 1.63 Wm−2. The relative global bias is rgMBD = 0.73%, while rgMAB = 2.36% and rgRMSD = 3.18%. For the calculation of these values, a station used to validate data from both satellites is included with the results for both satellites, as if it were two different stations. This is the case of De Aar, Solar Village, Kishinev, Sde Boqer and Thessaloniki. However, the results for Sde Boqer for 2005 and 2009 considering Meteosat East have been averaged before calculating the aggregate statistics for all stations.
The mean bias deviation has also been calculated according to the type of sky, as described in Section 3.2. The results are shown in Table 4. For clear-sky conditions the method tends to underestimate the irradiance: at most of the stations, there is a negative bias. This bias tends to be larger near the edge of the satellite images (Toravere and Xianghe have the largest negative bias values), while the bias tends to be relatively low in desert areas (Sde Boqer, Solar Village and Tamanrasset). At the same time the irradiance under intermediate sky conditions tends to be overestimated, sometimes by as much as 25%. In overcast situations the overestimation of the irradiance is even more evident, with the extreme example of Xianghe where the estimate is 100% higher than the average measured value. This may be due to the fact that the station is close to the edge of the satellite field of view.
These results indicate that SPECMAGIC, while representing well the average irradiance, tends to make estimates that give intermediate values rather than the extreme values that are measured under clear-sky or overcast situations.
A graphical comparison of the measured and estimated values is shown in Figure 1, for two stations: Solar Village in a desert climate and Ispra, Italy which is a humid temperate climate. The overall MBD for Solar Village is very low, while the Ispra location has the highest MBD of all stations. The pattern of results is rather different for the two stations. For Solar Village, the majority of points are below the diagonal (estimated is lower than measured), with a number of scattered points far above the diagonal. This is consistent with the finding that the estimates tend to be too low for clear-sky conditions and too high for more cloudy conditions. For Ispra, the estimated values are generally higher than measurements at all irradiance levels. This could be due to an underestimate of the effects of aerosols. It might also indicate a problem in the measurements.
As mentioned in the beginning of this section, all the validation data are available online. The interested reader may use these data to produce similar plots for any of the stations used in the validation exercise.
3.4. Validation Results, Direct Normal Irradiance
The algorithm described in Section 2.1 can also estimate the direct component of the solar radiation, either as direct horizontal or direct normal irradiance. DNI is also measured at nearly all BSRN stations as well as at some of the non-BSRN stations used for the validation in the previous section.
Table 5 shows the results of the validation of DNI estimates from the SPECMAGIC model, using the stations that have DNI data available.
The relative global mean absolute bias (rgMAB) and relative global root mean square deviation (rgRMSD) have values rgMAB = 5.03% and rgRMSD = 6.30%. These values are significantly higher than the corresponding values for the global horizontal irradiance.
For most stations, the mean bias deviation value is higher than the one observed in the validation of the global irradiance. Also, the rMAB and rRMSD values are approximately twice as high as those of the global irradiance. However, when global statistics are analyzed we can see that the global MBD for all the stations and the relative global MBD are lower in the validation of the beam component than for the global irradiance. The higher deviations of the estimated beam irradiance, in some cases as overestimation and in other as underestimation, tend to compensate better than in the case of the global irradiance. The very low overall MBD for DNI should therefore be regarded as fortuitous.
As for the global irradiance estimates, we can calculate the global statistical quantities in Equations (A7)–(A9). The average measured DNI of all the stations is DNIavg = 214.62 Wm−2, and the global mean bias deviation is gMBD = 0.61 Wm−2. The relative global bias is rgMBD = 0.62%.
3.5. Comparison of Irradiance Probability Density
Besides the statistical measures (MBD, MAB, RMSD, etc.) used for the validation of the estimation model, it is interesting to analyze the probability distribution of the irradiance values, to see if the occurrence of the different irradiance levels are properly represented by the model.
For this analysis, the data when the sun’s elevation angle is below 5 degrees are not considered. The remaining data are distributed into bins of width 50 Wm−2 from 0 to 1200 Wm−2. For the direct irradiance the 0Wm−2 value will not be displayed, in order to avoid the high peak in the probability distribution at that level of irradiance.
As an example of the probability distribution graphs, those of the global and direct normal irradiances for Cocos Island and Sde Boqer are shown in Figure 2. These two stations have been chosen as they represent quite different climates.
For the global irradiance, in general, the model does not provide the very low and high irradiance values measured at the stations. For intermediate irradiance levels, there is no clear pattern. For the two stations shown in Figure 2, the overestimation derived from the model for Sde Boqer (+8.41 Wm−2) is reflected in the graph where it is seen that the model has too many occurrences at high irradiance (800–900 Wm−2) and too few at low irradiance (<100 Wm−2). For Cocos Island there are no consistent differences in the intermediate irradiance range.
Regarding the frequency distribution of the beam normal irradiance values, the general trend for the various stations is the one observed in Sde Boqer. There is a higher number of observations of very high irradiance values that are not reached by the estimation model, while for the intermediate irradiance levels, the estimated values show a higher occurrence. However, it is the opposite case in Cocos Island, especially in the range of high beam irradiance values. This is reflected in the overall high positive bias (+22.94 Wm−2). This is likely to be due to an underestimation of the aerosol content in the area, leading to an overestimate of DNI under clear-sky conditions.
The lack of very high DNI values in the satellite estimates may be due to the fact that we are using long-term averages of AOD data. Periods with exceptionally low aerosol load will tend to have very high DNI values, which will be seen in the measurements but not captured by the satellite-based estimates.
The hourly estimated and measured data are available in the online supplementary material. This allows interested readers to construct these graphs for any station in the validation data set.
4. Results and Discussion
The methods described in Section 2 have been used to calculate solar radiation parameters for every full-hour time slot in the period 1999–2013, with a hiatus in 2006 due to uncertainty about the quality of data from Meteosat-5 towards the end of the operational life of that satellite. Thus, a total of 14 years are available, which makes it possible to calculate long-term averages with low uncertainty from interannual variation.
4.1. Sample Results
An example of a map of solar irradiance (global horizontal and direct normal) is shown in Figure 3. The time slot is 09:00GMT on 14 March 2005, showing the maximum irradiance, corresponding to cloudless conditions, just west of the center of the image (which is at 63°E), and illustrating the overall extent of valid data.
4.2. Comparison of Meteosat Prime and East Estimates
From 1998 to 2006 two very similar satellites were both in orbit at the same time at widely different positions (Meteosat 7 at 0° and Meteosat 5 at 63°E). This makes it possible to do a direct comparison of the solar radiation retrieval from the two satellites in the area where they overlap.
Figure 5 shows a map of the relative difference between H for the year 2005 calculated from the two satellites, defined as:
The result shows a significant gradient in the east-west direction, with estimates from Meteosat Prime higher than those of Meteosat East in the western part and vice versa in the eastern part. This means that the retrieval algorithm tends to give lower values near the edge of the satellite image.
The effects of aerosols and water vapour are calculated by the clear-sky radiation model and are therefore independent of the viewing angle of the satellite, so the differences shown in Figure 5 must in some way be due to the effect of clouds, either in the calculation of CAL or in the treatment of clouds by the SPECMAGIC algorithm. A possible explanation is that due to the finite thickness of clouds, broken cloud fields can be identified when viewed directly from above (close to the satellite nadir) but will appear as continuous cloud cover when viewed from a shallow angle (as is the case near the edge of the image). This would lead to an overestimation of cloudiness and hence an underestimation of radiation.
The individual hourly slots can be summed to produce maps of the global horizontal and direct normal irradiation for longer time periods. Figure 4 shows H and HDNI for the year 2002.
In the validation results shown in Table 3 some of the stations were visible from both satellites at the same time. For these stations the same trend is seen. De Aar and Thessaloniki are both closer in longitude to the Meteosat Prime nadir, and their MBD is more positive for Meteosat Prime (at De Aar, rMBD is 0.60% for Meteosat Prime vs. −1.21% for Meteoast East, while for Thessaloniki the values are +3.55% vs. −3.64%). Solar Village is closer to Meteosat East and has rMBD of −2.55% for Meteosat Prime and −0.23% for Meteosat East. Sde Boqer and Kishinev are close being at equal distance to the two satellites, and here we see rather little difference in rMBD (3.41% vs. 3.94% for Sde Boqer, 1.37% vs. 0.50% for Kishinev).
An analogous case is evident in mountain areas which often have very localized gradients in the available solar radiation. In some cases the local patterns are shifted relative to each other in the data sets obtained from the two different satellites. This may be due to the effect of parallax when the two satellites are observing persistent cloud systems over mountains from different angles. This effect will lead to an increased uncertainty in mountainous regions.
4.3. Comparing the Results with Existing Databases
In the scientific bibliography there are several publications in which solar radiation estimates retrieved from satellite images are validated by comparison with ground measurements. The validation is commonly performed on daily or monthly average irradiance values, although in some cases hourly irradiance values are analyzed, like in this paper.
Two examples of hourly validation data were performed by Ineichen (2011 and 2013) [35,36]. The author compared the irradiance values derived from various satellite products with the measurements registered in several stations. It should be noted that these data sets are derived from the Meteosat MSG class of satellites, so the methods employed are somewhat different. Nevertheless it is possible to get an idea of how the accuracy of the present data set compares with other recent efforts.
A detailed description of the method we used to compare these results is found in the supplementary material .
Data of global horizontal and beam normal irradiance are validated in hourly values. The magnitude of the errors is similar of those reported in this paper.
In the first report , five different satellite products are validated: SolarGis, Helioclim 3 data bank, 3Tier algorithm, EnMetSol considering two different clear sky models (denoted Solis and Dumortier) and IrSolAv estimates. The estimates are validated with irradiance measurements registered at 20 stations in the case of the global horizontal irradiance and 12 stations for the beam component. The validation results for G and DNI are shown in Table 6.
The magnitude of the general statistics are similar to those obtained in the present paper. The validation of the SPECMAGIC estimates reports rgMBD, rgMAB and rgRMSD values as low as the best satellite product analyzed in , for both G and DNI.
If the validation of the global irradiance on the horizontal plane is performed distributing the data according to sky type, we obtain the results shown in Table 7. Again, the results are similar to those derived from the SPECMAGIC method.
For all satellite products considered, including SPECMAGIC estimates, the global horizontal irradiance is underestimated in clear sky situations, while for intermediate and more significantly overcast situations, the solar resource is overestimated.
It should be noted that although the number of stations used in  is similar to that used in the present study, there is not a great overlap in the actual list of stations. In fact, only 8 stations used in  are the same as those we have used. This may skew the results because some station locations may be more “challenging” than others for the algorithms. We have therefore repeated the comparison using these 8 stations: Cabauw, Camborne, Carpentras, Payerne, Sde Boqer, Thessaloniki, Toravere (Thessaloniki is used for the DNI comparison). IrSolAv was not validated for all these stations and therefore has been excluded from this comparison. These results are given in Table 8.
Given the low number of stations, it is difficult to clearly distinguish between the values for the different products. It is possible to do a test for statistical significance of the differences in the global variances (the square of rgRMSD). A two-tailed f-test statistic (7times7 degrees of freedom) on the values for G in Table 8 shows that only SolarGIS is significantly better than the results from SPECMAGIC (p < 0.04). For the DNI comparison (7 stations), none of the rgRMSD results from  are significantly different from the SPECMAGIC result.
Similarly, for the results in Table 6, few of the differences in rgRMSD between SPECMAGIC and the other products are statistically significant: only the differences with Heliosat 3 (G and DNI) and 3Tier (DNI) are statistically significant at p < 0.05. As noted previously, this may be in part due to the difference in choice of stations.
In the second report , six different satellite products are validated: SolarGis, Helioclim 3, Solemi, Heliomont (Meteoswiss), EnMetSol, IrSolAv. Estimates are compared with global horizontal and beam normal irradiance experimental data registered at 17 stations. Results are shown in Table 9. Again, the range of the statistics is similar to that observed in the present work. In this case, the number of stations in common is even smaller, and a comparison for these few stations does not make statistical sense.
We have presented the results of applying the Heliosat and SPECMAGIC algorithms to images from the Meteosat Eastern geostationary satellites in order to produce hourly maps of surface solar irradiance (global and direct). For validation purposes, estimates from the Meteosat Prime satellites were also produced. Validation from 16 ground stations show a low overall yearly bias (gMBD) in the estimation of the global horizontal irradiance of +1.63 Wm−2 or +0.73%. The mean absolute bias of the individual station bias values (rgMAB) is 2.36% while the root-mean-square of the station bias values (rgRMSD) is 3.18%. For the annual average DNI estimation, the corresponding values are: gMBD = +0.61 Wm−2 or +0.62%, rgMAB = 5.03%, and rgRMSD = 6.30%. The very low gMBD value is a fortuitous cancelling of individual deviations. The two latter values give a better idea of the uncertainty in estimates at individual locations. A comparison with validation results given by Ineichen [35,36] shows that the accuracy of the present results is similar to that of other recent works on satellite-based solar radiation databases.
The overall deviations from measured data are quite low. However, there are still areas where improvements could be made. A direct comparison between solar radiation estimates from the Meteosat Prime and East over the same time period shows that the radiation estimates tend to be higher near the center of the satellite image than near the edge. This is probably due to the fact that the finite thickness of clouds will make the cloud cover seem more extensive when viewed at a shallow angle as is the case near the edge of the satellite image. To resolve this issue would require more information about cloud type than is currently available in the method.
For the time being, there is no particular treatment of snow cover in the method, so areas affected by snow may have larger uncertainties. Since none of the validation stations are in high mountain or arctic areas, this problem is not seen in the validation results but should be acknowledged anyway. Methods to account for snow cover are being studied at present and will be applied to future versions of the solar radiation database.
For the present study, long-term monthly averages of aerosol data have been employed, as described in Section 2.2. This choice may have an influence on the year-to-year variability of the total solar radiation, which is of interest to investors and operators of solar energy power plants. We plan to investigate the influence of using monthly aerosol data on the resulting solar radiation time series.
Once processing has been completed, the hourly maps of solar radiation will be made freely available to the public. To our knowledge, this new data set is the first freely available high-resolution solar radiation data set covering Asia (there exist several for Europe and Africa, and free data are to some extent also available for the Americas). The new data set should be useful for researchers, planners and installers of solar energy systems, as well as for studies of climate and biological processes.
The SPECMAGIC method can also calculate spectrally resolved solar irradiance. We plan to use this feature to produce maps of spectrally resolved irradiance to study the effects of spectral changes on PV system productivity for the area covered by the data. Maps of photosynthetically active radiation may also be produced.
Solar radiation data are essential for the estimation of solar energy system performance. An important application of the data presented in this study will be to perform estimates of solar energy system performance. In particular, it is planned that these data will be incorporated into the web-based PV estimation tool PVGIS [37,38].
Baseline Surface Radiation Network
Climate Monitoring Satellite Application Facility
Direct Normal Irradiance
European Centre for Medium-range Weather forecast
Global Atmosphere Watch
Monitoring Atmospheric Composition and Climate
Meteosat First Generation satellites
Meteosat Second Generation satellites
Numerical Weather Prediction
PhotoVoltaic Geographical Information System
Radiative Transfer Model
United States Geological Survey
Air Mass (-)
|B, Bclear, Ball|
Direct (beam) radiation, clear-sky & all-sky beam radiation (Wm−2)
Effective Cloud Albedo, also called Cloud Index (-)
Digital count of the satellite instrument
Direct normal irradiance & average DNI of all stations (Wm−2)
Global horizontal irradiance (Wm−2)
Average measured irradiance of all the stations (Wm−2)
Measured Global horizontal irradiance (Wm−2)
Global horizontal clear-sky irradiance (Wm−2)
Global horizontal irradiation (kWh m−2)
Direct normal irradiation (kWh m−2)
Relative difference in H between the two satellites (%)
Clear-sky index (-)
Clearness index (-)
Modified clearness index (-)
Mean Absolute Bias, relative Mean Absolute Bias
global Mean Absolute Bias, relative global Mean Absolute Bias
Mean Bias Deviation, relative Mean Bias Deviation
global Mean Bias Deviation, relative global Mean Bias Deviation
Number of data points used for the validation (-)
Number of ground stations used for the validation (-)
Intensity of reflected light measured by satellite (-)
Threshold value of ρ, for calibration of satellite measurements (-)
Clear-sky and monthly maximum values of ρ (-)
Value of ρmax corrected as a function of θ (-)
Root Mean Square Deviation, relative Root Mean Square Deviation
global Root Mean Square Deviation, relative global Root Mean Square Deviation
Solar zenith angle (-)
i’th time series value
retrieved (estimated) value
We would like to thank EUMETSAT for the access to satellite image data and the CM SAF Project for the possibility to use the algorithms developed within that project.
The contributions of each author to the work described in this paper are as follows:
Ana Gracia Amillo did most of the work on validation of satellite data against ground station data and the comparison with other recent work and wrote the section on validation and parts of the results & discussion.
Thomas Huld performed the data processing for Meteosat East and some of the Meteosat Prime data, as well as postprocessing to produce annual means and differences between satellites (Figures 3 and 5). He wrote most of the introduction and conclusions and part of the discussion.
Richard Müller produced an updated version of the SPECMAGIC code and processed the climatological data needed as input. He wrote most of the section on methods.
Conflicts of Interest
The authors declare no conflict of interest.
Appendix Statistical Measures Used for the Validation
A number of different statistical measures have been used to estimate the uncertainty in the irradiance retrieved from satellite data. These are defined briefly here.
For a given set of data (station or satellite-based estimate), the annual average is calculated from the N values:
The Mean Bias Deviation (MBD) is calculated as shown in Equation (A2):
Here is the measured irradiance at the ith time point while is the estimated irradiance at the same time point. In this calculation both day and night time slots are considered. N is the total number of time points for which both measured and estimated data are available.
The relative MBD (rMBD) is defined in Equation (A3) as:
The Mean Absolute Bias (MAB) is calculated as (Equation (A4)):
The Root Mean Square Deviation (RMSD) is given as:
Relative values of MAB and RMSD are calculated like Equation (A3): rMAB = MAB/〈G〉 and rRMSD = RMSD/〈G〉
To get an overall estimate of the bias in yearly average solar irradiation, we can calculate the avarage of the MBD values at all the station locations. This is termed the global MBD (and respectively, relative global MBD):
Here, MBDs is the MBD of station number s. Ns is the number of stations.
A measure of the uncertainty of the yearly average irradiation in a given point can be given as the relative global MAB and RMSD:
- Möser, W.; Raschke, E. Incident solar radiation over europe estimated from METEOSAT data. J. Clim. Appl. Meteor 1984, 23, 166–170. [Google Scholar]
- Cano, D.; Monget, J.; Albuisson, M.; Guillard, H.; Regas, N.; Wald, L. A method for the determination of the global solar radiation from meteorological satellite data. Solar Energy 1986, 37, 31–39. [Google Scholar]
- Pinker, R.; Laszlo, I. Modelling surface solar irradiance for satellite applisations on a global scale. J. Appl. Meteorol 1992, 31, 166–170. [Google Scholar]
- Meyer, R.; Hoyer, C.; Schillings, C.; Trieb, F.; Diedrich, E.; Schroedter, M. SOLEMI: A new satellite-based service for high-resolution and precision solar radiation data for Europe, Africa and Asia. Proceedings of the 2003 ISES Solar World Congress, GÃűteborg, Sweden, 14–19 June 2003.
- Müller, R.; Matsoukas, C.; Gratzki, A.; Behr, H.; Hollmann, R. The CM-SAF operational scheme for the satellite based retrieval of solar surface irradiance—A LUT based eigenvector hybrid approach. Remote Sens. Environ 2009, 113, 1012–1024. [Google Scholar]
- Rigollier, C.; Levefre, M.; Wald, L. The method Heliosat-2 for deriving shortwave solar radiation from satellite images. Solar Energy 2004, 77, 159–169. [Google Scholar]
- Laszlo, I.; Ciren, P.; Liu, H.; Kondragunta, S.; Tarpley, J.D.; Goldberg, M.D. Remote sensing of aerosol and radiation from geostationary satellites. Adv. Space Res 2008, 41, 1882–1893. [Google Scholar]
- Karlsson, K.-G.; Riihelä, A.; Müller, R.; Meirink, J.F.; Sedlar, J.; Stengel, M.; Lockhoff, M.; Trentmann, J.; Kaspar, F.; Hollmann, R.; et al. CLARA-A1: The CM SAF cloud, albedo and radiation dataset from 28 yr of global AVHRR data. Atmos. Chem. Phys. Discuss 2013, 13, 935–982. [Google Scholar]
- SOLEMI. Available Online: http://www.dlr.de/tt/solemi (accessed on 26 August 2014).
- Blanc, P.; Gschwind, B.; Lefèvre, M.; Wald, L. The HelioClim project: Surface solar irradiance data for climate applications. Remote Sens 2011, 3, 343–361. [Google Scholar] [CrossRef]
- CM SAF. Available Online: http://www.cmsaf.eu (accessed on 26 August 2014).
- Geiger, B.; C. Meurey, D.; Lajas, L.; Franchistéguy, L.; Carrer, D.; Roujean, J.-L. Near real-time provision of downwelling shortwave radiation estimates derived from satellite observations. Meteorol. Appl 2008, 15, 411–420. [Google Scholar]
- LSA SAF. Available Online: http://landsaf.meteo.pt (accessed on 26 August 2014).
- Müller, R.; Behrendt, T.; Hammer, A.; Kemper, A. A new algorithm for the satellite-based retrieval of solar surface irradiance in spectral bands. Remote Sens 2012, 4, 622–647. [Google Scholar]
- Müller, R.; Trentmann, J.; Träger-Chatterjee, C.; Posselt, R.; Stöckli, R. The Role of the Effective Cloud Albedo for Climate Monitoring and Analysis. Remote Sens 2011, 3, 2305–2320. [Google Scholar]
- Hammer, A.; Heinemann, D.; Hoyer, C.; Kuhlemann, R.; Lorenz, E.; Müller, R.; Beyer, H. Solar energy assessment using remote sensing technologies. Remote Sens. Environ 2003, 86, 423–432. [Google Scholar]
- Posselt, R.; Müller, R.; Stöckli, R.; Trentmann, J. Spatial and temporal homogeneity of solar surface irradiance across satellite generations. Remote Sens 2011, 3, 1029–1046. [Google Scholar]
- Skartveit, A.; Olseth, J.; Tuft, M. An hourly diffuse fraction model with correction for variability and surface albedo. Solar Energy 1998, 63, 173–183. [Google Scholar]
- Dee, D.P.; Uppala, S.M.; Simmons, A.J.; Berrisford, P.; Poli, P.; Kobayashi, S.; Andrae, U.; Balmaseda, M.A.; Balsamo, G.; Bauer, P.; et al. The ERA-Interim reanalysis: Configuration and performance of the data assimilation system. Q. J. R. Meteorol. Soc 2011, 137, 553–597. [Google Scholar]
- ECMWF. Available Online: http://www.ecmwf.int (accessed on 26 August 2014).
- Morcrette, J.-J.; Boucher, O.; Jones, L.; Salmond, D.; Bechtold, P.; Beljaars, A.; Benedetti, A.; Bonet, A.; Kaiser, J.W.; Razinger, M.; et al. Aerosol analysis and forecast in the European Centre for Medium-Range Weather Forecasts Integrated Forecast System: Forward modeling. J. Geophys. Res 2009, 114. [Google Scholar] [CrossRef]
- Benedetti, A.; Morcrette, J.-J.; Boucher, O.; Dethof, A.; Engelen, R.J.; Fisher, M.; Flentje, H.; Huneeus, N.; Jones, L.; Kaiser, J.W.; et al. Aerosol analysis and forecast in the European Centre for Medium-Range Weather Forecasts Integrated Forecast System: 2. Data assimilation. J. Geophys. Res 2009, 114. [Google Scholar] [CrossRef]
- Inness, A.; Baier, F.; Benedetti, A.; Bouarar, I.; Chabrillat, S.; Clark, H.; Clerbaux, C.; Coheur, P.; Engelen, R.J.; Errera, Q.; et al. TheMACC reanalysis: An 8 yr data set of atmospheric composition. Atmos. Chem. Phys 2013, 13, 4073–4109. [Google Scholar]
- MACC. Available Online: http://www.gmes-atmosphere.eu (accessed on 26 August 2014).
- Brown, J.F.; Loveland, T.; Merchant, J.W.; Reed, B.C.; Ohlen, D.O. Using multi-source data in global land-cover characterization: Concepts, requirements, and methods. Photogramm. Eng. Remote Sens 1983, 59, 977–987. [Google Scholar]
- Dickinson, R.E. Land surface processes and climate—Surface albedos and energy balance. Adv. Geophys 1983, 25, 305–353. [Google Scholar]
- EUMETSAT. Available Online: http://www.eumetsat.int (accessed on 26 August 2014).
- A New Database of Global and Direct Solar Radiation Using the Eastern Meteosat Satellite,Models and Validation. Available Online: http://re.jrc.ec.europa.eu/esti/meteast/index.html (accessed on 26 August 2014).
- Baseline Surface Radiation Network. Available Online: http://bsrn.awi.de (accessed on 26 August 2014).
- Global Atmosphere Watch. Available Online: http://www.wmo.int/gaw/ (accessed on 26 August 2014).
- World Radiation Data Centre. Available Online: http://wrdc.mgo.rssi.ru (accessed on 26 August 2014).
- Ineichen, P.; Barroso, C.S.; Geiger, B.; Hollmann, R.; Marsouin, A.; Müller, R. Satellite Application Facilities irradiance products: Hourly time step comparison and validation over Europe. Int. J. Remote Sens 2009, 30, 5549–5571. [Google Scholar]
- Perez, R.; Ineichen, P.; Seals, R.; Zelenka, A. Making full use of the clearness index for parametrizing hourly insolation conditions. Solar Energy 1990, 45, 111–114. [Google Scholar]
- Kasten, F. A simple parameterization of two pyrheliometric formulae for determining the Linke turbidity factor. Meteorol. Rdsch 1980, 33, 124–127. [Google Scholar]
- Ineichen, P. Five Satellite Products Deriving Beam and Global Irradiance Validation on Data from 23 Ground Stations. Available online: http://archive-ouverte.unige.ch/unige:23669 (accessed on 26 August 2014).
- Ineichen, P. Long Term Satellite Hourly, Daily and Monthly Global, Beam and Diffuse Irradiance Validation. Interannual Variability Analysis. Available online: http://archive-ouverte.unige.ch/unige:29606 (accessed on 26 August 2014).
- Huld, T.; Müller, R.; Gambardella, A. A new solar radiation database for estimating PV performance in Europe and Africa. Solar Energy 2012, 86, 1803–1815. [Google Scholar]
- PVGIS. Available Online: http://re.jrc.ec.europa.eu/pvgis/ (accessed on 26 August 2014).
|Satellite||Class||Start Date||End Date||Longitude|
|Meteosat-5||MFG||2 May 1991||13 February 1997||0°|
|Meteosat-5||MFG||1 July 1998||16 April 2007||63°E|
|Meteosat-7||MFG||6 March 1998||19 July 2006||0°|
|Meteosat-7||MFG||1 November 2006||ongoing||57°E|
|Station||Lat||Lon||Climate type||Prime||East||Years Used|
|Cabauw (NL)||51.97N||4.93E||Temperate maritime||X||2005|
|Camborne (UK)||50.22N||5.32W||Temperate maritime||X||2005|
|Cocos Island (AU)||12.19S||96.84E||Tropical wet||X||2009|
|De Aar (ZA)||30.67S||23.99E||Arid||X||X||2002|
|Florianopolis (BR)||27.53S||48.52W||Humid subtropical||X||2005|
|Lindenberg (DE)||52.22N||14.12E||Moderate maritime||X||2005|
|Payerne (CH)||46.81N||6.94E||Semi continental||X||2005|
|Sde Boqer (IL)||30.87N||34.77E||Dry steppe||X||X||2005, 2009|
|Solar Village (SA)||24.91N||46.78E||Arid||X||X||2002|
|Tamanrasset (DZ)||22.79N||5.53E||Hot, desert||X||2005|
|Toravere (EE)||58.27N||26.47E||Cold humid||X||2005|
|Xianghe (CN)||39.75N||116.96E||Continental humid||X||2005|
|Ispra (IT)||45.81N||8.63E||Mediterranean moist||X||2005|
|Kishinev (MD)||47.00N||28.82E||Cool temperature, moist||X||X||2005|
|Thessaloniki (GR)||40.63N||22.96E||Mediterranean temperate||X||X||2005|
|Station||Year||(Gmeas) Wm−2||MBD (Wm−2)||rMBD (%)||MAB (Wm−2)||rMAB (%)||RMSD (Wm−2)||rRMSD (%)|
|Gmeas||rMBD (%)||Gmeas||rMBD (%)||Gmeas||rMBD (%)|
|Station||Year||(DNImeas) (Wm−2)||MBD (Wm−2)||rMBD (%)||MAB (Wm−2)||rMAB (%)||RMSD (Wm−2)||rRMSD (%)|
|SolarGis||Heliosat 3||3Tier||EnMetSol (solis)||EnMetSol (dumor)||IrSolAv||SPECMAGIC|
|Global horizontal irradiance|
|Direct normal irradiance|
|Clear Sky Conditions|
|SolarGis||Heliosat 3||3Tier||EnMetSol (solis)||EnMetSol (dumor)||IrSolAv||SPECMAGIC|
|Intermediate Sky Conditions|
|Overcast Sky Conditions|
|SolarGis||Heliosat 3||3Tier||EnMetSol (solis)||EnMetSol (dumor)||SPECMAGIC|
|Global horizontal irradiance|
|Direct normal irradiance|
|Global horizontal irradiance|
|Direct normal irradiance|
© 2014 by the authors; licensee MDPI, Basel, Switzerland This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).
Amillo, A.G.; Huld, T.; Müller, R. A New Database of Global and Direct Solar Radiation Using the Eastern Meteosat Satellite, Models and Validation. Remote Sens. 2014, 6, 8165-8189. https://doi.org/10.3390/rs6098165
Amillo AG, Huld T, Müller R. A New Database of Global and Direct Solar Radiation Using the Eastern Meteosat Satellite, Models and Validation. Remote Sensing. 2014; 6(9):8165-8189. https://doi.org/10.3390/rs6098165Chicago/Turabian Style
Amillo, Ana Gracia, Thomas Huld, and Richard Müller. 2014. "A New Database of Global and Direct Solar Radiation Using the Eastern Meteosat Satellite, Models and Validation" Remote Sensing 6, no. 9: 8165-8189. https://doi.org/10.3390/rs6098165