Forecasting

The paper applies innovation diffusion models to study the adoption process of solar PV energy in the UK from 2010 to 2021 by comparing the trajectories between three main categories, residential, commercial, and utility, in terms of both the number of installations and installed capacity data. The effect of the UK incentives on adoptions by those categories is studied by analyzing the timing, intensity, and persistence of the perturbations on adoption curves. The analysis confirms previous findings on PV adoption, namely the fragile role of the media support to solar PV, the ability of the proposed model to capture both the general trend of adoptions and the effects induced by ad hoc incentives, and the dramatic dependence of solar PV from public incentives. Thanks to the granularity of the data, the results reveal several interesting aspects, related both to differences in adoption patterns depending on the category considered, and to some regularities across categories. A comparison between the models for number of installations and for installed capacity data suggests that the latter (usually more easily available than the former) may be highly informative and, in some cases, may provide a reliable description of true adoption data. Full article

This paper proposes the application of a multivariate diffusion model, based on ordinary differential equations, to investigate the energy transition in Germany. Specifically, the model is able to analyze the dynamic interdependencies between coal, gas and renewables in the energy market. A system dynamics representation of the model is also performed, allowing a deeper understanding of the system and the set-up of suitable strategic interventions through a simulation exercise. Such simulation provides a useful indication of how renewable energy consumption may be stimulated as a result of well-specified policies. Full article

Tourism is one of the main sources of wealth for the Moroccan regions, since, in 2019, it contributed 7.1% to the total GDP. However, it is considered to be one of the sectors most vulnerable to exogenous shocks (political and social stability, currency change, natural disasters, pandemics, etc.). To control this, policymakers tend to use various techniques to forecast tourism demand for making crucial decisions. In this study, we aimed to forecast the number of tourist arrivals to the Marrakech-Safi region using annual data for the period from 1999 to 2018 by using three conventional approaches (ARIMA, AR, and linear regression), and then we compared the results with three artificial intelligence-based techniques (SVR, XGBoost, and LSTM). Then, we developed hybrid models by combining both the conventional and AI-based models, using the technique of ensemble learning. The findings indicated that the hybrid models outperformed both conventional and AI-based techniques. It is clear from the results that using hybrid models can overcome the limitations of each method individually. Full article

Since its inception in 2009, Bitcoin has increasingly gained main stream attention from the general population to institutional investors. Several models, from GARCH type to jump-diffusion type, have been developed to dynamically capture the price movement of this highly volatile asset. While fitting the Gaussian and the Generalized Hyperbolic and the Normal Inverse Gaussian (NIG) distributions to log-returns of Bitcoin, NIG distribution appears to provide the best fit. The time-varying Hurst parameter for Bitcoin price reveals periods of randomness and mean-reverting type of behaviour, motivating the study in this paper through fractional Ornstein–Uhlenbeck driven by a Normal Inverse Gaussian Lévy process. Features such as long-range memory are jump diffusion processes that are well captured with this model. The results present a 95% prediction for the price of Bitcoin for some specific dates. This study contributes to the literature of Bitcoin price forecasts that are useful for Bitcoin options traders. Full article

We propose a functional time series method to obtain accurate multi-step-ahead forecasts for age-specific mortality rates. The dynamic functional principal component analysis method is used to decompose the mortality curves into dynamic functional principal components and their associated principal component scores. Machine-learning-based multi-step-ahead forecasting strategies, which automatically learn the underlying structure of the data, are used to obtain the future realization of the principal component scores. The forecasted mortality curves are obtained by combining the dynamic functional principal components and forecasted principal component scores. The point and interval forecast accuracy of the proposed method is evaluated using six age-specific mortality datasets and compared favorably with four existing functional time series methods. Full article

Demographic change is leading to the aging of German society. As long as the baby boom cohorts are still of working age, the working population will also age—and decline as soon as this baby boom generation gradually reaches retirement age. At the same time, there has been a trend toward increasing absenteeism (times of inability to work) in companies since the zero years, with the number of days of absence increasing with age. We present a novel stochastic forecast approach that combines population forecasting with forecasts of labor force participation trends, considering epidemiological aspects. For this, we combine a stochastic Monte Carlo-based cohort-component forecast of the population with projections of labor force participation rates and morbidity rates. This article examines the purely demographic effect on the economic costs associated with such absenteeism due to the inability to work. Under expected future employment patterns and constant morbidity patterns, absenteeism is expected to be close to 5 percent by 2050 relative to 2020, associated with increasing economic costs of almost 3 percent. Our results illustrate how strongly the pronounced baby boom/baby bust phenomenon determines demographic development in Germany in the midterm. Full article

Effective weather forecast information helps smallholder farmers improve their adaptation to climate uncertainties and crop productivity. The main objective of this study was to assess the impact of weather forecast adoption on crop productivity. We coupled agent-based and crop productivity models to study the impact of farmers’ management decisions on maize productivity under different rainfall scenarios in Ethiopia. A household survey was conducted with 100 households from 5 villages and was used to validate the crop model. The agent-based model (ABM) analyzed the farmers’ behaviors in crop management under different dry, wet, and normal rainfall conditions. ABM results and crop data from the survey were then used as input data sources for the crop model. Our results show that farming decisions based on weather forecast information improved yield productivity from 17% to 30% under dry and wet seasons, respectively. The impact of adoption rates due to farmers’ intervillage interactions, connections, radio, agriculture extension services, and forecast accuracy brought additional crop yields into the Kebele compared to non-forecast users. Our findings help local policy makers to understand the impact of the forecast information. Results of this study can be used to develop agricultural programs where rainfed agriculture is common. Full article

This work proposes and evaluates a method for the nowcasting of solar irradiance variability in multiple time horizons, namely 5, 10, and 15 min ahead. The method is based on a Convolutional Neural Network structure that exploits infrared sky images acquired through an All-Sky Imager to estimate the range of possible values that the Clear-Sky Index will possibly assume over a selected forecast horizon. All data available, from the infrared images to the measurements of Global Horizontal Irradiance (necessary in order to compute Clear-Sky Index), are acquired at SolarTech^LAB in Politecnico di Milano. The proposed method demonstrated a discrete performance level, with an accuracy peak for the 5 min time horizon, where about 65% of the available samples are attributed to the correct range of Clear-Sky Index values. Full article

Many people do not possess the necessary savings to deal with unexpected financial events. People’s biases play a significant role in their ability to forecast future financial shocks: they are typically overoptimistic, present-oriented, and generally underestimate future expenses. The purpose of this study is to investigate how varying risk information influences people’s financial awareness, in order to reduce the chance of a financial downfall. Specifically, we contribute to the literature by exploring the concept of ‘nudging’ and its value for behavioural changes in personal financial management. While of great practical importance, the role of nudging in behavioural financial forecasting research is scarce. Additionally, the study steers away from the standard default choice architecture nudge, and adds originality by focusing on eliciting implementation intentions and precommitment strategies as types of nudges. Our experimental scenarios examined how people change their financial projections in response to nudges in the form of new information on relevant risks. Participants were asked to forecast future expenses and future savings. They then received information on potential events identified as high-risk, low-risk or no-risk. We investigated whether they adjusted their predictions in response to various risk scenarios or not and how such potential adjustments were affected by the information given. Our findings suggest that the provision of risk information alters financial forecasting behaviour. Notably, we found an adjustment effect even in the no-risk category, suggesting that governments and institutions concerned with financial behaviour can increase financial awareness merely by increasing salience about possible financial risks. Another practical implication relates to splitting savings into different categories, and by using different wordings: A financial advisory institution can help people in their financial behaviour by focusing on ‘targets’, and by encouraging (nudging) people to make breakdown forecasts rather than general ones. Full article

In this paper, we conduct a thorough investigation of the predictive ability of forward and backward stepwise regressions and hidden Markov models for the futures returns of several commodities. The predictive performance relative a standard AR(1) benchmark is assessed under both statistical and economic loss functions. We find that the evidence that either stepwise regressions or hidden Markov models may outperform the benchmark under standard statistical loss functions is rather weak and limited to low-volatility regimes. However, a mean-variance investor that adopts flexible forecasting models (especially stepwise predictive regressions) when building her portfolio, achieves large benefits in terms of realized Sharpe ratios and mean-variance utility compared to an investor employing AR(1) forecasts. Full article

Image classification is widely used to build predictive models for breast cancer diagnosis. Most existing approaches overwhelmingly rely on deep convolutional networks to build such diagnosis pipelines. These model architectures, although remarkable in performance, are black-box systems that provide minimal insight into the inner logic behind their predictions. This is a major drawback as the explainability of prediction is vital for applications such as cancer diagnosis. In this paper, we address this issue by proposing an explainable machine learning pipeline for breast cancer diagnosis based on ultrasound images. We extract first- and second-order texture features of the ultrasound images and use them to build a probabilistic ensemble of decision tree classifiers. Each decision tree learns to classify the input ultrasound image by learning a set of robust decision thresholds for texture features of the image. The decision path of the model predictions can then be interpreted by decomposing the learned decision trees. Our results show that our proposed framework achieves high predictive performance while being explainable. Full article

Temperature is the most used meteorological variable for a large number of applications in urban resilience planning, but direct measurements using traditional sensors are not affordable at the usually required spatial density. On the other hand, spaceborne remote sensing provides surface temperatures at medium to high spatial resolutions, almost compatible with the needed requirements. However, in this case, limitations are represented by cloud conditions and passing times together with the fact that surface temperature is not directly comparable to air temperature. Various methodologies are possible to take benefits from both measurements and analysis methods, such as direct assimilation in numerical models, multivariate analysis, or statistical interpolation. High-resolution thermal fields in the urban environment are also obtained by numerical modelling. Several codes have been developed to resolve at some level or to parameterize the complex urban boundary layer and are used for research and applications. Downscaling techniques from global or regional models offer another possibility. In the Milan metropolitan area, given the availability of both a high-quality urban meteorological network and spaceborne land surface temperatures, and also modelling and downscaling products, these methods can be directly compared. In this paper, the comparison is performed using: the ClimaMi Project high-quality data set with the accurately selected measurements in the Milan urban canopy layer, interpolated by a cokriging technique with remote-sensed land surface temperatures to enhance spatial resolution; the UrbClim downscaled data from the reanalysis data set ERA5; a set of near-surface temperatures produced by some WRF outputs with the building environment parameterization urban scheme. The comparison with UrbClim and WRF of the cokriging interpolated data set, mainly based on the urban canopy layer measurements and covering several years, is presented and discussed in this article. This comparison emphasizes the primary relevance of surface urban measurements and highlights discrepancies with the urban modelling data sets. Full article

As the availability of big data-sets becomes more widespread so the importance of motif (or repeated pattern) identification and analysis increases. To date, the majority of motif identification algorithms that permit flexibility of sub-sequence length do so over a given range, with the restriction that both sides of an identified sub-sequence pair are of equal length. In this article, motivated by a better localised representation of variations in time series, a novel approach to the identification of motifs is discussed, which allows for some flexibility in side-length. The advantages of this flexibility include improved recognition of localised similar behaviour (manifested as motif shape) over varying timescales. As well as facilitating improved interpretation of localised volatility patterns and a visual comparison of relative volatility levels of series at a globalised level. The process described extends and modifies established techniques, namely SAX, MDL and the Matrix Profile, allowing advantageous properties of leading algorithms for data analysis and dimensionality reduction to be incorporated and future-proofed. Although this technique is potentially applicable to any time series analysis, the focus here is financial and energy sector applications where real-world examples examining S&P500 and Open Power System Data are also provided for illustration. Full article

We introduce a simple extension to the CBDX model to project cohort mortality rates to extreme old age. The proposed approach fits a polynomial to a sample of age effects, uses the fitted polynomial to project the age effects to ages beyond the sample age range, then splices the sample and projected age effects, and uses the spliced age effects to obtain mortality rates for the higher ages. The proposed approach can be used to value financial instruments such as life annuities that depend on projections of extreme old age mortality rates. Full article

Supply Chain Finance (SCF) has gradually taken on digital characteristics with the rapid development of electronic information technology. Business audit information has become more abundant and complex, which has increased the efficiency and increased the potential risk of commercial banks, with credit risk being the biggest risk they face. Therefore, credit risk assessment based on the application of digital SCF is of great importance to commercial banks’ financial decisions. This paper uses a hybrid Extreme Gradient Boosting Multi-Layer Perceptron (XGBoost-MLP) model to assess the credit risk of Digital SCF (DSCF). In this paper, 1357 observations from 85 Chinese-listed SMEs over the period 2016–2019 are selected as the empirical sample, and the important features of credit risk assessment in DSCF are automatically selected through the feature selection of the XGBoost model in the first stage, then followed by credit risk assessment through the MLP in the second stage. Based on the empirical results, we find that the XGBoost-MLP model has good performance in credit risk assessment, where XGBoost feature selection is important for the credit risk assessment model. From the perspective of DSCF, the results show that the inclusion of digital features improves the accuracy of credit risk assessment in SCF. Full article

One of the most critical issues for wind energy exploitation is the high variability of the resource, resulting in very difficult forecasting of the power that wind farms can grant. A vast literature has therefore been devoted to wind speed and wind power quantitative forecasting, using different techniques. The widely used statistical and learning models that are based on a continuation in the future of the series’ past behaviour offer a performance that may be much less satisfactory when the values suddenly change their trend. The application to wind speed data of two techniques usually employed for the technical analysis of financial series–namely support and resistances identification and candlestick charts–is investigated here, with the main aim to detect inversion points in the series. They are applied to wind speed data series for two locations in Spain and Italy. The proposed indicators confirm their usefulness in identifying peculiar behaviours in the system and conditions where the trend may be expected to change. This additional information offered to the forecasting algorithms may also be included in innovative approaches, e.g., based on machine learning. Full article

Electrical load forecasting study is required in electric power systems for different applications with respect to the specific time horizon, such as optimal operations, grid stability, Demand Side Management (DSM) and long-term strategic planning. In this context, machine learning and data analytics models represent a valuable tool to cope with the intrinsic complexity and especially design future demand-side advanced services. The main novelty in this paper is that the combination of a Recurrent Neural Network (RNN) and Principal Component Analysis (PCA) techniques is proposed to improve the forecasting capability of the hourly load on an electric power substation. A historical dataset of measured loads related to a 33/11 kV MV substation is considered in India as a case study, in order to properly validate the designed method. Based on the presented numerical results, the proposed approach proved itself to accurately predict loads with a reduced dimensionality of input data, thus minimizing the overall computational effort. Full article