Next Article in Journal
The Mission-Oriented Approach for (Cross-Border) Regional Development
Next Article in Special Issue
Key Ratios for Long-Term Prediction of Hotel Financial Distress and Corporate Default: Survival Analysis for an Economic Stagnation
Previous Article in Journal
New Town Development and Sustainable Transition under Urban Entrepreneurialism in China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Deep Recurrent Convolutional Neural Network for Bankruptcy Prediction: A Case of the Restaurant Industry

by
Rafael Becerra-Vicario
1,
David Alaminos
2,*,
Eva Aranda
1 and
Manuel A. Fernández-Gámez
1
1
Department of Finance and Accounting, Campus El Ejido s/n, University of Malaga, 29071 Malaga, Spain
2
Department of Economic Theory and Economic History, Campus El Ejido s/n, University of Malaga, 29071 Malaga, Spain
*
Author to whom correspondence should be addressed.
Sustainability 2020, 12(12), 5180; https://doi.org/10.3390/su12125180
Submission received: 16 May 2020 / Revised: 18 June 2020 / Accepted: 23 June 2020 / Published: 25 June 2020

Abstract

:
Using logistic regression technique and Deep Recurrent Convolutional Neural Network, this study seeks to improve the capacity of existing bankruptcy prediction models for the restaurant industry. In addition, we have verified, in the review of existing literature, the gap in the research of restaurant bankruptcy models with sufficient time in advance and that only companies in the restaurant sector in the same country are considered. Our goal is to build a restaurant bankruptcy prediction model that provides high accuracy, using information distant from the bankruptcy situation. We had a sample of Spanish restaurants corresponding to the 2008–2017 period, composed of 460 solvent and bankrupt companies, for which a total of 28 variables were analyzed, including some of a non-financial nature, such as age of restaurant, quality, and belonging to a chain. The results indicate that the best bankruptcy predictors are financial variables related to profitability and indebtedness and that Deep Recurrent Convolutional Neural Network exceeds logistic regression in predictive capacity.

1. Introduction

The objective of this study is to estimate bankruptcy prediction models for companies belonging to the restaurant industry. The fact of focusing on this industry derives from two essential reasons: First, because of the importance of this branch of activity, both in the field of the Spanish economy, in which the service sector has special weight and in participation of the same in the international level. Second is due to the notable increase in bankruptcy situations of companies belonging to this sector, with a significant impact, even in the first year of activity. These circumstances have motivated interest in analyzing the causes that lead to bankruptcy in the restaurant industry and trying to provide tools or strategies to their managers, with a view to avoiding it and ensuring the permanence of their companies.
The previous studies done so far have focused on American companies, analyzing bankruptcy 1 or 2 years before bankruptcy [1]. Consequently, the absence of empirical work with samples of Spanish companies in this sector of activity makes it especially interesting that we analyze the causes that cause it. This paper contributes to the literature on bankruptcy prediction in the sector: (1) provides new models with high classification accuracy, (2) uses an exclusive sample of restaurants, (3) with a horizon of up to three years for bankruptcy. In addition, we apply a novel deep learning method, Deep Recurrent Convolutional Neural Networks, which has obtained high accuracy levels in previous works [2,3].
On the other hand, and in order to have a greater margin to carry out strategies that avoid the bankruptcy of these companies, we intend to obtain models that have the objective of predicting it 1, 2, and 3 years before it occurs, comparing the similarities and differences of these models as we move away from the moment of bankruptcy. Likewise, and in order to obtain robust models, a total analysis period of 10 years has been considered, between the year 2008 and 2017, a period that would cover several economic cycles and, consequently, avoids the risk of obtaining models only valid for times of growth or economic decline.
From a professional point of view, the results obtained and the high predictive capacity of the model are useful for decision-making by managers of companies in the sector and other stakeholders such as financial institutions, investors, or regulators.
To achieve our objectives, the structure of the document includes an introduction and review of the published literature on insolvency prediction models in the tourism sector in general and in the restaurant sector in particular, describing the different methodologies that have traditionally been used to establish insolvency prediction models and the different variables that the authors have considered decisive when predicting bankruptcy in restaurants. The second part of the document is dedicated to presenting the methodology used, the results obtained, and their discussion. The final part deals with the main conclusions and implications of our study and future lines of research on the subject.

2. Literature Review

Although there are numerous studies on the prediction of bankruptcy [4,5,6,7,8], those carried out specifically for the hospitality sector are scarce, despite the recognition of the high vulnerability to the bankruptcy of companies belonging to the said sector. Another relevant issue is the ability of models to predict bankruptcy well in advance since in most cases, there are indications of financial problems several years before the bankruptcy [9]. Gu [10] carried out the first empirical study focused exclusively on the prediction of bankruptcy in the restaurant sector using American companies in its sample. In the following works, more advanced statistical methods began to be used. Such has been the case of logistic regression (LOGIT) and artificial neural networks (NN) and currently, newer methods based on the detection of atypical companies and the analysis of their financial indicators using the test of equality of means or the chi-square [11]. The first to use a LOGIT model were Kim and Gu [12], which used LOGIT applied to 32 companies in the hospitality sector (16 in bankruptcy and another 16 not bankrupt). In addition, Kim and Gu [13] estimated a LOGIT model using the same sample of restaurants used by Gu [10], in order to compare the predictive capacity of a LOGIT model against the model estimated by Gu [10]. Their results showed greater precision, although not with a high difference, of the LOGIT model. Park and Hancer [14] made a statistical prediction of bankruptcy using a sample of 80 companies (40 bankrupts and 40 solvents), which combined hotel companies, restaurant and entertainment services companies. They compared the predictive capacity of a LOGIT model and an NN, concluding that the NNs predict better within the sample, but that the predictive capacity of both models is similar in the external sample used to check the accuracy of the models. Recently, Gregova et al. [15] used logistic regression, random forest, and neural network models in order to identify a model with the highest predictive accuracy of financial distress to industrial enterprises. Neural network models yielded the best results.
Another question much discussed by numerous authors in the insolvency prediction literature deals with the variables that are the best predictors of corporate insolvency. Many variables are used, highlighting those that refer to debt and profit margin [16,17], or regardless of income [12,16,18]. Besides, the existence of dependency between the explanatory variables of economic sustainability and the country of origin of the models has recently been verified [19].
Of the empirical bankruptcy prediction studies discussed above, only three of them have used data from restaurant companies exclusively, and three others included restaurant companies in a mixed manner (including companies from other industries). The first of the works carried out in this area was that of Gu and Gao [20], who estimated a multidiscriminant analysis model (MDA) of bankruptcy prediction based on a sample of 14 bankrupt companies, including 4 hotels and 10 restaurants, and a similar number of solvent companies. The model was able to classify the companies within the sample with an accuracy of 93%. However, since the model was derived from a mixed sample of hotels and restaurants and was not tested with restaurants outside the sample, its applicability to restaurant bankruptcy prediction is limited. Gu [10] used a sample of somewhat larger size, considering 18 bankrupt restaurants, paired with as many unbroken restaurants, with data from the 1986–1998 period. The estimated model obtained a prediction level outside the sample of 80%. Later Kim and Gu [13] estimated a LOGIT model using the same data from Gu’s MDA model (2002) [10]. The LOGIT model, resulting from a more advanced statistical sophistication, correctly predicted 94% of the companies that had gone bankrupt one year before bankruptcy, as well as 93% of the companies used in the external sample to verify the ability to predict. With these results, it was demonstrated that the LOGIT model provided a somewhat higher predictive capacity (94% compared to 92% of the MDA of Gu [10]), without considering on the other hand that the LOGIT model has greater theoretical strength.
For their part, Kim and Gu [12] estimated two LOGIT models to predict bankruptcy with 1 and 2 years prior, to companies belonging to the hospitality sector. The predictive capacity of the model amounted to 91% for 1 year before bankruptcy and 84% for 2 years before. The authors concluded, based on the estimated models, that companies in this sector are closer to bankruptcy if they have a lower cash flow and greater indebtedness. Youn and Gu [21] was the subsequent empirical study that focused on the restaurant industry using information from publicly traded or publicly traded companies. These authors were the pioneers in applying NN in prediction for this industry. Together they estimated a LOGIT model in order to compare the predictive capacity of both statistical techniques, estimating models to predict bankruptcy 1 and 2 years before it. They determined that, although NNs predict well, they do not provide better prediction than LOGIT, especially in the external sample. Park and Hancer [14] estimated LOGIT and NN models as bankruptcy predictors of this sector, estimating both types of models for 1 year before bankruptcy. Based on the empirical results of two methodologies, NN obtained a higher level of prediction than the LOGIT model within the sample (97.5% versus 90% of the LOGIT model). However, when the test is carried out for verification in the external sample (formed by 8 solvent companies and 8 insolvent companies that had not been included in the initial model), both models predict 100%. Recently, Kim and Upneja [18] estimated the financial difficulties of American restaurants with the AdaBoost Decision Tree model, showing an accuracy close to 97%. Kim [16] examined the financial difficulties of the hospitality sector in the US concluding that for the restaurant-stacking model, debt-to-equity ratio and the net profit margin, in line with Kim (2018) and Valaskova et al., (2018), and also the growth in owners’ equity and the stock price trend were significant predictors. Finally, Brito et al. [22] applied different variations of Support Vector Machine, LOGIT, Decision Trees, Random Forest, AdaBoost and Neural Network to predict business failure in hospitality sector, showing as Random Forest and AdaBoost are most accurate techniques, after obtaining 96% of accuracy.
Regarding the methodological aspect, within statistical techniques, logistic regression (Logit) has been the one that has shown the best predictive capacity and reliability compared to other techniques such as Multivariate Discriminant Analysis (MDA). Over the past decades, Logit has shown precision with out-of-sample data in a median range of 71–77% [23,24]. For its part, MDA has shown an average precision of 68–76% [25,26]. Prediction techniques have evolved, emerging new techniques such as neural networks that have shown their predictive superiority both with Logit and other computational classifiers, such as decision trees and genetic algorithms, among others [27]. In this line, neural networks have been the most widely used technique in studies of financial distress prediction and bankruptcy, with an average precision of close to 85%, obtaining greater precision than statistical techniques and even showing an average precision higher than that of other computational classifiers [28,29,30,31]. To provide greater methodological innovation, this work uses the combination of neural networks with the Deep Learning type design, which has shown in recent years to be a type of methodology that improves the prediction results achieved so far as well as improves the reliability of the results of the models built since their design hidden layers (or also called ‘black box’) are better specified than previous individual computational methods [32]. For this reason, the Deep Recurrent Neural Network is chosen as a computational technique, to improve the precision results of financial distress in the restaurant sector and that it can become a new tool for the analysis of this problem.

3. Methods

In the present study, we use two different methodologies to predict bankruptcy: logistic regression model (LOGIT) and Deep Recurrent Convolutional Neural Network (DRCNN). Although the LOGIT models have had and continue to maintain special relevance in the studies carried out in this area in the last 30 years, the deep learning models correspond to more advanced methodologies, which have shown to have significant potential in the field of prediction. The main advantage of LOGIT models lies not only in the ability to predict previously if a company is expected to be solvent and insolvent, but also to provide information regarding the variables that are significantly explanatory of bankruptcy, and consequently, allow deduct appropriate strategies in the management of the company in order to ensure its solvency. On the other hand, the deep learning models have great classification potential, surpassing LOGIT in many cases, although they do not have the explanatory utility of the latter. In this paper, we compare the usefulness of both methodologies in the prediction of bankruptcy in the restaurant industry in Spain, contrasting their results with those obtained in previous work.

3.1. Logistic Regression

The LOGIT model is a non-linear model, although it contains a linear combination of parameters and observations of the explanatory variables. The logistic function is bounded between 0 and 1, thus providing the probability that an element is in one of the two established groups. From a dichotomous event, the LOGIT model predicts the probability that the event will or will not take place. If the probability estimate is greater than 0.5, then the prediction is that it does belong to that group, and otherwise, it would assume that it belongs to the other group considered.
To estimate the model, we start from the quotient between the probability that an event will occur and the probability that it will not occur. The probability of an event occurring will be determined by Expression (1):
P ( Y i = 1 x i ) = e ( β 0 + β 1 X 1 + + β k X k ) 1 + e ( β 0 + β 1 X 1 + + β k X k ) = 1 1 + e ( β 0 + β 1 X 1 + + β k X k )
where β 0 is the constant term of the model and β 1 , . , β k are the coefficients of the variables. If logarithms are finally applied in (1), the linear expression of the model is obtained Y i , as follows:
Y i = l n P ( Y i = 1 ) 1 P ( Y i = 1 ) = l n e ( β 0 + β 1 X 1 + + β k X k ) = β 0 + β 1 X 1 + + β k X k
The coefficients of the model ( β 0 , β 1 , . , β k )   are estimated by applying the maximum likelihood method, which would entail a series of steps: first, specify the maximum likelihood function, the model that collects the joint probability for the independent observations considered; secondly calculate the Neperian logarithm of the function of likelihood; thirdly, the calculation of the derivative of the Neperian logarithm of the said function with respect to the parameters that are to be estimated, and finally, to obtain the solutions to the system of k-equations posed or plausible estimators [33].
In this study, stepwise regression is used, where the choice of predictive variables is carried out by an automatic procedure. In each step, a variable is added to add or subtract from the set of explanatory variables based on some pre-specified criteria [34,35]. In our case, the backward approach is applied. All the initial explanatory variables are introduced, and the method expels those non-significant variables considering the R-square result obtained by the model.

3.2. Deep Recurrent Convolution Neural Network

Recurrent neural networks (RNN) have been successfully used in many fields for time-series prediction due to this huge prediction performance. For a simple neural network, the inputs are assumed to be independent of each other. The common structure of RNN is organized by the output of which is dependent on its previous computations [36]. Given an input sequence vector x, the hidden states of a recurrent layer s, and the output of a single hidden layer y, can be calculated as follows:
s t = σ ( W x s x t + W s s s t 1 + b s )
y t = o ( W s o s t + b y )
where Wxs, Wss, and Wso denote the weights from the input layer x to the hidden layer s, the hidden layer to itself and the hidden layer to its output layer, respectively. by are the biases of hidden layer and output layer. σ and o are the activation functions.
S T F T { z ( t ) } ( τ , ω ) T ( τ , ω ) = + z ( t ) ω ( t τ ) e j ω t   d t
where z (t) is the vibration signals, ω (t) is the Gaussian window function focused around 0. T (τ, ω) is a complex function that describes the vibration signals over time and frequency.
When time-frequency features {Ti} are used for bankruptcy prediction with RNN, the convolutional operation is conducted in the state transition. To calculate the hidden layers with a convolutional operation, the following equation is applied:
S t = σ ( W T S T t + W s s S t 1 + B s )
Y t = o ( W Y S S t + B y )
where W term indicates the convolution kernels. The convolutional operation has been determined by local connections, weight sharing, and local grouping, which allow every unit to integrate time-frequency data in the current layer. The convolution is operated between weights and inputs and is performed in the transition of inputs to the hidden layers.
Recurrent Convolutional Neural Network (RCNN) can be heaped to establish a deep architecture, named deep recurrent convolutional neural network [37]. With DRCNN for bankruptcy prediction, the last part of the model is a supervised learning layer for bankruptcy, which is determined as:
r ^ = σ ( W h h + b h )
where Wh is the weight and bh is the bias, respectively. The error between predicted observations and actual ones in the training data for bankruptcy prediction can be calculated and backpropagated to train the model [38]. Considering that the actual data at time t is r, the loss function is determined as shown in the next equation:
L ( r , r ^ ) = 1 2 r r ^ 2 2
The stochastic gradient descent is applied for optimization in order to learn the parameters. The gradient of loss function regarding parameters Wh and bh are determined as follows:
L W h = ( r r ^ ) σ ( . ) h
L b h = ( r r ^ ) σ ( . )
In addition, and in order that the DRCNN model can report the importance of each variable in the results of the built model, a sensitivity analysis was applied [39]. This analysis consists of taking 100% of the data and dividing them into groups, and each group of data is processed in the network constructed as many times as there are variables of the model. The value of one of the variables is modified each time, placing it with zero value. The answers of the network are evaluated in relation to the objective values or classification values already known, by means of Expression (12).
S x i = j = 1 n ( Φ x i j ( 0 ) Φ x i j ) 2
where Φxij (0) is the value of the network output when the variable Xij is zero, Φxij is the known classification value, Xi is the variable whose importance you want to establish, y Sxi is the sensitivity value of the variable.

4. Data and Variables

The database used in this work is formed by 460 companies, both solvent and insolvent, belonging to the restaurant industry and whose activity is developed or has been developed in Spanish territory. An insolvent company is one that is legally declared as a legal situation of a bankruptcy situation. These data have been obtained from the SABI database (Iberian Balance Analysis System), which is defined as an economic-financial database that includes more than 1,250,000 Spanish companies and more than 400,000 Portuguese companies. In order to validate the models to be estimated and check their predictive capacity, test samples are also used, different, and outside those used in the estimation of the models. The sample is divided into data within the sample (training), which is used to build the model. This step has 70% of the total sample data. And the remaining 30% of data is dedicated to data outside the sample (testing). This step is used to quantify the precision capability of the built model.
Specifically, the present study has considered three different samples in order to analyze the bankruptcy prediction of companies in the restaurant industry in Spain, for 1, 2, and 3 years before the bankruptcy. In the three samples carried out, the same number of solvent companies as of insolvent companies has been considered, a general rule carried out in all bankruptcy prediction studies, as well as that maintained in the specific case of the restaurant industry. Likewise, and since DRCNN properly requires another sub-sample, a partition will be made, using a part of the data as a validation sample. This sample differs totally in concept and utility with respect to the test sample, since the validation sample is required only for the correct estimation of the DRCNN, avoiding its over-training. The test sample, on the other hand, is the one used to verify the capacity of generalization of the models with data other than those used properly to obtain them. Table 1 gives details of the number of companies in the sample and the percentages of which belong to the chain and hold a quality certificate.
In the study, a total of 28 financial variables or ratios have been considered, obtained from the review of the literature of previous research papers on the prediction of bankruptcy in the restaurant industry [1]. All the variables that have been considered are quantitative, corresponding to different economic ratios obtained from the accounting information of the companies used in the different samples. These ratios have been classified, in turn, in the categories of size, efficiency, liquidity, cash flow, profitability, solvency, and non-financial (Table 2). In addition to the financial ratios under analysis, a dummy variable of the binomial type has been used, which is the dependent variable to identify the company as solvent or insolvent.
Regarding non-financial variables, we have considered the age of the restaurant (VN1), which is calculated by applying a logarithm to age. The variable of belonging to a chain (VN2) is a dummy variable, in which it is denoted with 1 if the restaurant belongs to a chain and 0 otherwise. Finally, the variable of quality (VN3) is also a dummy variable in which it is denoted with 1 if the restaurant holds the quality certificate ‘Q’ and 0 otherwise. This quality certificate is granted by the Institute for Spanish Tourist Quality of Spanish Ministry of Industry. Establishments endorsed by the “Quality Q” have passed strict audits that ensure that their service provision is a guarantee of quality, safety, and professionalism. All of this is to ensure customers the best possible tourist experience.

5. Results and Discussion

5.1. Exploratory Analysis

The exploratory analysis proposed in this study includes a descriptive analysis of the variables, which is presented in a differentiated way for the solvent and insolvent companies of each of the three samples, in order to compare the parameters obtained, depending on whether the companies are solvent or insolvent (Table 3, Table 4 and Table 5). Observing the means obtained for each of the variables, differentiating the solvent companies from the insolvent companies, it is deduced that in the M.I sample, 62.5% of the selected variables have a different signed average, depending on whether they are solvent companies or of the insolvent companies and that among them would be all the variables considered of profitability and most of the variables classified as liquidity and cash flow, as well as half of the solvency variables. Although it is necessary to highlight that, generally, there are variables that never show a negative sign (such is the case of the variable VE2 representative of Income/Total Assets). When analyzing the means of the M.II sample, it was observed that only 46% of the variables have a different sign depending on whether they are solvent and insolvent companies, this proportion being even lower in the M.III sample, in which so it only occurs in 25% of the variables. These results make us deduce that as we move away from the moment of bankruptcy, the differences between the variables of the solvent and insolvent companies are attenuated, and consequently, it is foreseeable that it will be more complicated to be able to make a prediction of the solvency with greater accuracy.
With respect to the Mann-Whitney test, it was analysed if two populations are independent of each other, where the null hypothesis is to check if the two populations are distributed in the same way. If the null hypothesis is not accepted, this would imply a central displacement of one of the distributions with respect to the other, which I would suggest a difference in the shape of dispersion of a population with respect to the other [40]. This test would be analogous to the t-test used in the tests parametric. In this study, most variables reject the null hypothesis at a level of significance of 5%. Therefore, given the high percentage of significance of almost all the variables, it seems possible to obtain adequate prediction models, since they are a priori variables that are appropriate to assess insolvency.
Although this descriptive analysis has shown evidence of which variables may be relevant in the bankruptcy study, it is not yet possible to conclude whether these variables are really significant, while this first analysis would be insufficient to assess whether the differences presented are precisely because of their significance or because of their own variability that the economic variables present. This leads to the need for a confirmatory analysis to assess the significance of such variables in the bankruptcy analysis.

5.2. Confirmatory Analysis

In this section, a confirmatory analysis of the results obtained in the exploratory analysis will be carried out. In this sense, two models will be estimated for each of the selected samples in order to predict 1, 2, and 3 years of bankruptcy. Once the different models have been obtained for each of the three samples, and for the purpose of comparison, a summary of their results is presented below (Table 6, Table 7 and Table 8).
DRCNN architecture is composed of 24 input nodes, 14 hidden nodes, and 2 output nodes for the model M.I. In the case of the model M.II, the specific architecture is composed of 24 input nodes, 11 hidden nodes, and 2 output nodes. Finally, for the model M.III, the architecture is composed of 24 input nodes, 15 hidden nodes, and 2 output nodes. In all cases, the activation function of the hidden layer used was a hyperbolic tangent, and Softmax was the applied activation function of the output layer.
In conclusion, it is possible to highlight the relevance of the VR3, VR1, and VS8 variables as explanatory variables in the bankruptcy prediction models. The higher the values of the VR3 and VR1 variables, the more solvent the company expects, while the higher the value of the VS8 variable, the more likely it is that the company will be insolvent. In addition, other variables, such as VE2 and VS1, although they have not been so relevant, have been necessary to obtain robust models. Variables VE2 and VS8 have been significant in all estimated LOGIT models. Likewise, the VR3 variable was also significant in more than one model (M.I and M.II), the VS1 and VR1 variables being significant only in the M.II and M.III models, respectively. On the other hand, in DRCNN models, these variables have been significant, but other VZ1 has been significant in two models (M.I and M.II). Other variables appear as explanatory variables in the DRCNN models, such as VN3 and VR4 (in M.I), and VS4 (in M.II).
Comparing the prediction levels of the chosen models (LOGIT and DRCNN), it can be verified that in all cases, the level of DRCNN success is higher than that of LOGIT, both inside and outside the sample (test sample). Likewise, if we compare the level of adjustment measured by the area under the COR curve of each model, it was also found that the adjustment in the case of the DRCNN model would exceed that of LOGIT for M.I and M.II, although it is lower in the case of M.III. The prediction capacity, as we move away from bankruptcy, decreases, and this capacity of the model obtained for M.III is, therefore, lower than that of the other models. This fact would show that the prediction of bankruptcy is more accurate as we approach the time of bankruptcy, while the economic variables used would show more differences between solvent and insolvent companies.
The present study makes prediction models for horizons more than one year prior to the bankruptcy, while the rest of the previous work only considers one year prior to bankruptcy [16,18]. The most relevant significant variable that our models have yielded—Net Profit/Income— was also proven as a meaningful variable in other previous works [16]. However, other meaningful variables shown in our study, such as Net Profit/Total Assets and Total Liabilities/Total Assets, are different from the most significant variables shown by previous bankruptcy literature for restaurants, such as the proportion of debt over equity, equity growth, income margin, or EBITDA over total liabilities [13,16,18].

5.3. Discussion

This paper analyzed the causes that can lead to bankruptcy for a company in the restaurant sector, trying to determine a set of financial and non-financial variables that explain sufficiently in advance that a company in the sector is in danger of bankruptcy and provide tools for managers to avoid this situation. Initially, the most significant antecedents in the generic bankruptcy literature were analyzed, as well as works related exclusively to bankruptcy prediction in companies in the tourism sector in general, as well as insolvency prediction research focused exclusively on the restaurant sector.
The results obtained in our work indicate a high predictive capacity, mainly in the M. III model, in the same sense indicated by Youn and Gu (2010) and Park and Hancer (2012), who obtained NN models with a high level of prediction, although these last authors found that, although the NN models predict well, they do not provide a better prediction than LOGIT, especially in the external sample.
Regarding the best predictors of bankruptcy in restaurants, our study suggests variables related to liquidity, solvency, and profitability. In this sense, Kim (2018), in her study on the hospitality sector for the USA, partially coincides. Specifically, this author points out the debt/capital ratio like our indicator VS7 Liabilities/Net Equity. There is also agreement with this author regarding the high predictive capacity of the Net Profit Margin indicator similar in predictive capacity to VR1, used in our study. The importance of VR1 was also considered in other studies such as that of Kim and Gu (2006) and Kim and Upneja (2014).
Non-financial variables considered in our study as VN3, related to quality and significant in some of our models (M.I), were not considered in the previous literature.
Our models confirm that the prediction of bankruptcy is more accurate when we approach the moment in which it occurs in the same sense as that contributed by Kim and Gu (2006).
Finally, the relationship between the country of origin and the significant variables in bankruptcy prediction observed in previous studies (Kovacova et al., 2019) is confirmed by our study when different variables were found than in other studies for the same sector but a different country.

6. Conclusions

The objective of this paper is to develop bankruptcy prediction models for companies in the restaurant industry. For this, a sample of 460 companies with activity developed in Spain was used, from which financial and non-financial information was obtained. Subsequently, statistical and computational techniques were applied, which showed robust results.
The results obtained indicate that the best predictors of bankruptcy are the variables related to liquidity, profitability, and solvency. In addition, other non-financial variables, such as quality, are significant in predicting the bankruptcy of results. The results also suggest that the DRCNN computational technique shows a high level of classification, with an accuracy of 93.50% for one year before bankruptcy, 89.60% for two years prior, and 85.60% for three years prior to bankruptcy.
The main limitation of our research is that we did not had access to internal information from the companies studied, which would have allowed us to have qualitative information that could have been significant, such as business model, level of market presence, CEO financial education, or corporate social responsibility policies.
As a future line of research, it would be interesting to analyze whether the conclusions obtained in this work can apply to the three types of differentiated activities within the sector: restaurants, restaurant services, and beverage establishments, that is, to check the results of the complete sample with the results obtained by analyzing each of these activities in detail. Likewise, it is also proposed as a future line of research to analyze this economic sector in different European countries and compare the results obtained between the different countries, to analyse if the conclusions obtained would be generalizable or not.
In this way, it could also be verified whether the conclusions obtained by the previous studies and that have focused on samples of American companies may or may not be extrapolated to these countries, or as they have occurred in the present work with the sample of Spanish companies, it is verified that the conclusions obtained in American companies would not be extrapolated for the rest of the European countries.

Author Contributions

This paper was designed and drafted by all of the authors. Data collection, D.A. and E.A.; literature review, R.B.-V. and D.A.; software, D.A.; original draft preparation, D.A., E.A. and M.A.F.-G.; supervision, R.B.-V. and M.A.F.-G.; project administration, R.B.-V., D.A., and E.A. All of the authors wrote the discussion part and the conclusions. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Universidad de Málaga.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Li, H.; Xu, Y.-H.; Li, X.R.; Xu, H. Failure analysis of corporations with multiple hospitality businesses. Tour. Manag. 2019, 73, 21–34. [Google Scholar] [CrossRef]
  2. Li, O.; Liu, H.; Chen, C.; Rudin, C. Deep learning for case-based reasoning through prototypes: A neural network that explains its predictions. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI18), New Orleans, LA, USA, 2–7 February 2018; pp. 3530–3537. [Google Scholar]
  3. Singaravel, S.; Suykens, J.; Geyer, P. Deep-learning neural-network architectures and methods: Using component-based models in building-design energy prediction. Adv. Eng. Inform. 2018, 38, 81–90. [Google Scholar] [CrossRef]
  4. Alaminos, D.; del Castillo, A.; Férnández, M.A. A Global Model for Bankruptcy Prediction. PLoS ONE 2016, 13, e0166693. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Piñeiro, C.; de Llano, P.; Rodríguez, M. Fracaso e insolvencia empresarial: Una reinterpretación en términos de recursos y capacidades. AECA Rev. Asoc. Española Contab. Adm. Empresas 2017, 119, 69–71. [Google Scholar]
  6. Ashraf, S.; Félix, E.G.S.; Serrasqueiro, Z. Do traditional financial distress prediction models predict the early warning signs of financial distress? J. Risk Financ. Manag. 2019, 12, 55. [Google Scholar] [CrossRef] [Green Version]
  7. Fernández, M.A.; Laguillo, G.; del Castillo, A.; Becerra, R. Focused vs unfocused models for bankruptcy prediction: Empirical evidence for Spain. Contaduría Adm. 2019, 64, e96. [Google Scholar]
  8. Vo, D.H.; Pham, B.N.V.; Ho, C.M.; McAleer, M. Corporate Financial Distress of Industry Level Listings in Vietnam. J. Risk Financ. Manag. 2019, 12, 155. [Google Scholar] [CrossRef] [Green Version]
  9. Kliestik, T.; Misankova, M.; Valaskova, K.; Svabova, L. Bankruptcy prevention: New effort to reflect on legal and social changes. Sci. Eng. Ethics 2018, 24, 791–803. [Google Scholar] [CrossRef]
  10. Gu, Z. Analyzing bankruptcy in the restaurant industry. A multiple discriminant model. Int. J. Hosp. Manag. 2002, 21, 25–42. [Google Scholar] [CrossRef]
  11. Svabova, L.; Durica, M. Being an outlier: A company non-prosperity sign? Equilib. Q. J. Econ. Econ. Policy 2019, 14, 359–375. [Google Scholar] [CrossRef]
  12. Kim, H.; Gu, Z. A logistic regression analysis for predicting bankruptcy in the Hospitality Industry. J. Hosp. Financ. Manag. 2006, 14, 17–34. [Google Scholar] [CrossRef]
  13. Kim, H.; Gu, Z. Predicting Restaurant Bankruptcy. A Logit Model in Comparison with a Discriminant Model. J. Hosp. Tour. Res. 2006, 30, 474–493. [Google Scholar] [CrossRef]
  14. Park, S.-S.; Hancer, M. A comparative study of logit and artificial neural networks in predicting bankruptcy in the hospitality industry. Tour. Econ. 2012, 18, 311–338. [Google Scholar] [CrossRef] [Green Version]
  15. Gregova, E.; Valaskova, K.; Adamko, P.; Tumpach, M.; Jaros, J. Predicting financial distress of slovak enterprises: Comparison of selected traditional and learning algorithms methods. Sustainability 2020, 12, 3954. [Google Scholar] [CrossRef]
  16. Kim, S.Y. Predicting hospitality financial distress with ensemble models: The case of US hotels, restaurants, and amusement and recreation. Serv. Bus. 2018, 12, 483–503. [Google Scholar] [CrossRef]
  17. Valaskova, K.; Kliestik, T.; Kovacova, M. Management of financial risk in Slovak enterprises using regression analysis. Oeconomia Copernic. 2018, 9, 105–121. [Google Scholar] [CrossRef] [Green Version]
  18. Kim, S.Y.; Upneja, A. Predicting restaurant financial distress using decision tree and AdaBoosted decision tree models. Econ. Model. 2014, 36, 354–362. [Google Scholar] [CrossRef]
  19. Kovacova, M.; Kliestik, T.; Valaskova, K.; Durana, P.; Juhaszova, Z. Systematic review of variables applied in bankruptcy prediction models of Visegrad group countries. Oeconomia Copernic. 2019, 10, 743–772. [Google Scholar] [CrossRef] [Green Version]
  20. Gu, Z.; Gao, L. A multivariate model for predicting business failures of hospitality firms. Tour. Hosp. Res. 2000, 2, 37–49. [Google Scholar] [CrossRef]
  21. Youn, H.; Gu, Z. Predict US restaurant firm failures: The artificial neural network mode versus logistic regression model. Tour. Hosp. Res. 2010, 10, 171–187. [Google Scholar] [CrossRef]
  22. Brito, J.H.; Pereira, J.M.; Ferreira da Silva, A.; Angélico, M.J.; Abreu, A.; Teixeira, S. Machine learning for prediction of business company failure in hospitality sector. In Advances in Tourism, Technology and Smart Systems; Rocha, Á., Abreu, A., de Carvalho, J., Liberato, D., González, E., et al., Eds.; Springer: Singapore, 2020; Volume 171, pp. 307–317. [Google Scholar]
  23. Altman, E.I.; Iwanicz-Drozdowska, M.; Laitinen, E.K.; Suvas, A. Financial distress prediction in an international context: A review and empirical analysis of altman’s z-score model. J. Int. Financ. Manag. Acc. 2017, 28, 131–171. [Google Scholar] [CrossRef]
  24. Bateni, L.; Asghari, F. Bankruptcy prediction using logit and genetic algorithm models: A comparative analysis. Comput. Econ. 2016, 55, 335–348. [Google Scholar] [CrossRef]
  25. Lin, T.-H. A cross model study of corporate financial distress prediction in Taiwan: Multiple discriminant analysis, logit, probit and neural networks models. Neurocomputing 2009, 72, 3507–3516. [Google Scholar] [CrossRef]
  26. Waqas, H.; Md-Rus, R.; Elgammal, M.M. Predicting financial distress: Importance of accounting and firm-specific market variables for Pakistan’s listed firms. Cogent. Econ. Financ. 2018, 6, 1545739. [Google Scholar] [CrossRef] [Green Version]
  27. Sun, J.; Li, H.; Huang, Q.-H.; He, K.-Y. Predicting financial distress and corporate failure: A review from the state-of-the-art definitions, modeling, sampling, and featuring approaches. Knowl Based Syst. 2014, 57, 41–56. [Google Scholar] [CrossRef]
  28. Tkáč, M.; Verner, R. Artificial neural networks in business: Two decades of research. Appl. Soft Comput. 2016, 38, 788–804. [Google Scholar] [CrossRef]
  29. Barboza, F.; Kimura, H.; Altman, E. Machine learning models and bankruptcy prediction. Expert Syst. Appl. 2017, 83, 405–417. [Google Scholar] [CrossRef]
  30. Liang, D.; Tsai, C.-F.; Dai, A.-J.; Eberle, W. A novel classifier ensemble approach for financial distress prediction. Knowl. Inf. Syst. 2017, 54, 437–462. [Google Scholar] [CrossRef]
  31. Amani, F.A.; Fadlalla, A.M. Data mining applications in accounting: A review of the literature and organizing framework. Int. J. Account. Inf. Syst. 2017, 24, 32–58. [Google Scholar] [CrossRef]
  32. Mai, F.; Tian, S.; Lee, C.; Ma, L. Deep learning models for bankruptcy prediction using textual disclosures. Eur. J. Oper. Res. 2019, 274, 743–758. [Google Scholar] [CrossRef]
  33. Levy, J.-P.; Varela, J. Análisis Multivariable para las Ciencias Sociales; Prentice Hall: Madrid, Spain, 2003. [Google Scholar]
  34. Nordberg, L. Stepwise selection of explanatory variables in the binary logit model. Scand. Stat. Theory Appl. 1981, 8, 17–26. [Google Scholar]
  35. Zhang, Z. Variable selection with stepwise and best subset approaches. Ann. Transl. Med. 2016, 4, 136. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Wang, S.; Chen, X.; Tong, C.; Zhao, Z. Matching synchrosqueezing wavelet transform and application to aeroengine vibration monitoring. IEEE Trans. Instrum. Meas. 2017, 66, 360–372. [Google Scholar] [CrossRef]
  37. Huang, C.-W.; Narayanan, S.S. Deep convolutional recurrent neural network with attention mechanism for robust speech emotion recognition. In Proceedings of the 2017 IEEE International Conference on Multimedia and Expo, Hong Kong, China, 10–14 July 2017; pp. 583–588. [Google Scholar] [CrossRef]
  38. Ma, M.; Mao, Z. Deep recurrent convolutional neural network for remaining useful life prediction. In Proceedings of the 2019 IEEE International Conference on Prognostics and Health Management (ICPHM), San Francisco, CA, USA, 17–20 June 2019; pp. 1–4. [Google Scholar] [CrossRef]
  39. Samarasinghe, S. Neural Networks for Applied Sciences and Engineering: From Fundamentals to Complex. Pattern Recognition; Auerbach Publications: New York, NY, USA, 2007. [Google Scholar]
  40. López Cachero, M.; López de la Manzanara Barbero, J. Estadística Para Actuarios; Mapfre: Madrid, Spain, 1996. [Google Scholar]
Table 1. Sample size.
Table 1. Sample size.
SampleM.IM.IIM.III
SolvBankrSolvBankrSolvBankr
Companies230230224224192192
Age (Log)0.910.760.940.780.970.79
Belonging to chain (%)20.8113.9017.6513.8719.0913.84
Quality Certificate (%)26.2320.6225.6417.8326.5419.21
Table 2. Description of the independent variables.
Table 2. Description of the independent variables.
SIZECODEExpected Sign
Total Assets (Log)VZ1-
EFFICIENCY
Income/Non-Current AssetsVE1-
Income/Total AssetsVE2-
Cost of Sales/Average InventoryVE3+
LIQUIDITY & CASH-FLOW
(Treasury + Short-term financial investments + debtors)/Current LiabilitiesVL1-
Current Assets/Current LiabilitiesVL2-
EBIT/Current LiabilitiesVL3-
EBITDA/Current LiabilitiesVL4-
Working Capital/Total AssetsVL5-
(Free cash flow + financial expenses)/Total LiabilitiesVC1-
(Free cash flow + dividends)/Total LiabilitiesVC2-
Cash-flow operating/Total LiabilitiesVC3-
PROFITABILITY
Net Profit/IncomeVR1-
Net Profit/Net Equity (ROE)VR2-
Net Profit/Total Assets (ROA)VR3-
EBIT/Total AssetsVR4-
Gross profit marginVR5-
SOLVENCY
Long-term debts/Total AssetsVS1+
EBIT/Financial expensesVS2-
EBIT/Total LiabilitiesVS3-
EBITDA/Total LiabilitiesVS4-
Net Equity/Non-Current LiabilitiesVS5-
Total Assets/Net EquityVS6-
Total Liabilities/Net EquityVS7+
Total Liabilities/Total AssetsVS8+
NON-FINANCIAL
Age (Log)VN1-
Belonging to chainVN2-
Quality (Quality Certificate ‘Q’)VN3-
Table 3. Descriptive statistics; M.I.
Table 3. Descriptive statistics; M.I.
MEANMEDIANS.D.MINIMUMMAXIMUMM-W TEST
SolvBankrSolvBankrSolvBankrSolvBankrSolvBankrM-WSig.
SIZEVZ15.545.175.125.062.732.814.124.016.446.222.1470.000
EFFICIENCYVE15.646.753.893.785.7612.940.310.0141.1598.811.4620.000
VE22.061.201.670.871.551.160.150.006.967.652.4890.000
VE317.7026.215.794.2435.51112.370.000.00289.821.192.941.9530.017
LIQUIDITY & CASH-FLOWVC10.16−0.030.06−0.021.260.35−1.55−1.3515.291.878.9620.000
VC20.13−0.050.03−0.031.180.34−1.55−1.3514.181.877.1640.000
VC30.14−0.020.060.021.320.28−1.66−1.1216.170.805.4520.000
VL12.420.671.120.353.730.900.000.0025.976.104.9470.024
VL22.290.751.210.442.990.880.000.0124.155.216.2640.000
VL30.26−0.230.13−0.160.480.49−1.56−2.823.161.664.4160.000
VL40.52−0.130.32−0.090.760.51−0.08−2.825.952.003.8420.007
VL50.13−0.480.09−0.290.350.91−0.68−7.360.890.694.6130.000
PROFITABILITYVR10.02−0.560.01−0.150.041.78−0.03−12.170.231.026.3450.000
VR20.13−0.410.070.240.263.86−1.35−28.691.724.014.9630.000
VR30.03−0.210.02−0.110.040.33−0.07−2.020.230.368.1620.000
VR40.05−0.200.04−0.100.060.36−0.09−2.690.300.516.4920.000
VR50.04−0.470.03−0.120.051.55−0.04−11.920.321.653.1690.000
SOLVENCYVS10.250.460.170.390.260.390.000.000.852.112.3450.000
VS214.34−11.362.27−3.0251.8433.21−5.23−316.36554.9751.149.1650.028
VS30.15−0.120.07−0.090.300.20−0.10−0.912.710.8210.7560.000
VS40.26−0.070.15−0.050.350.21−0.08−0.912.780.992.6270.000
VS52.62−0.070.360.007.123.260.00−19.7363.8315.233.4890.000
VS66.262.932.88−0.567.9528.381.07−143.0145.32187.766.5380.000
VS75.261.931.88−1.567.9528.380.07−144.0144.32186.762.7820.000
VS80.621.290.651.050.270.910.060.300.988.362.3960.000
Note: M-W: Mann-Whitney test; S.D.: Standard Deviation.
Table 4. Descriptive statistics; M.II.
Table 4. Descriptive statistics; M.II.
MEANMEDIANS.D.MINIMUMMAXIMUMM-W TEST
SolvBankrSolvBankrSolvBankrSolvBankrSolvBankrM-WSig.
SIZEVZ15.475.235.145.022.792.864.084.026.416.252.2380.000
EFFICIENCYVE15.104.953.863.184.315.710.310.0024.1933.882.4180.000
VE22.021.211.640.881.531.110.150.006.966.393.9420.000
VE317.0414.104.604.5636.3224.670.000.00289.82140.233.6750.011
VC10.17−0.040.060.001.320.34−1.55−1.1215.291.661.7620.000
VC20.14−0.070.03−0.021.230.34−1.55−1.1614.181.612.8950.000
VC30.150.060.060.051.390.27−1.66−0.8316.171.628.3460.000
LIQUIDITY & CASH-FLOWVL12.070.721.190.472.520.710.000.0114.183.432.8620.000
VL22.020.851.240.582.010.810.000.0310.884.203.4510.031
VL30.22−0.090.13−0.050.310.27−0.34−1.021.840.661.6230.000
VL40.440.020.310.020.440.29−0.03−0.822.280.817.4820.000
VL50.13−0.270.09−0.190.330.52−0.63−2.870.890.715.6270.000
PROFITABILITYVR10.02−0.180.01−0.050.040.34−0.02−1.760.230.372.1910.000
VR20.130.220.070.120.202.20−0.22−17.681.1111.223.8580.000
VR30.03−0.100.02−0.040.040.19−0.06−0.980.180.272.6870.000
VR40.05−0.080.04−0.030.050.21−0.06−1.320.260.411.0630.000
VR50.04−0.130.03−0.020.050.34−0.02−1.660.320.830.4150.000
SOLVENCYVS10.250.440.170.440.260.330.000.000.851.531.4080.000
VS210.12−2.402.25−1.0626.7114.45−5.23−84.70250.6091.700.9580.000
VS30.13−0.050.06−0.020.220.15−0.08−0.711.840.420.4190.027
VS40.250.000.150.010.300.15−0.03−0.692.280.451.9410.000
VS52.830.120.350.007.455.910.00−57.2363.8332.058.1960.000
VS66.028.132.832.137.3836.001.07−144.2445.32176.213.1140.000
VS75.027.131.831.137.3836.000.07−145.2444.32175.212.5620.000
VS80.621.070.650.980.270.510.060.290.984.972.9720.000
Note: M-W: Mann-Whitney test; S.D.: Standard Deviation.
Table 5. Descriptive statistics; M.III.
Table 5. Descriptive statistics; M.III.
MEANMEDIANS.D.MINIMUMMAXIMUMM-W TEST
SolvBankrSolvBankrSolvBankrSolvBankrSolvBankrM-WSig.
SIZEVZ15.445.295.175.012.842.9243.986.386.272.3420.000
EFFICIENCYVE15.585.033.923.565.314.970.580.0035.9225.152.0820.000
VE21.861.421.581.141.371.130.150.006.475.430.5440.000
VE317.6414.785.704.7637.3123.140.000.00289.82120.841.5920.019
VC10.210.000.070.011.460.58−1.55−1.5715.294.742.1940.000
VC20.18−0.030.06−0.031.360.58−1.55−1.6014.184.743.4970.000
VC30.160.080.050.071.530.31−1.66−1.4116.171.233.9650.000
LIQUIDITY & CASH-FLOWVL11.710.801.020.631.820.720.000.019.664.112.1950.000
VL21.760.881.100.661.700.750.000.067.893.973.3790.000
VL30.200.000.130.010.240.27−0.05−0.951.390.862.1040.034
VL40.440.130.320.060.410.30−0.03−0.552.231.222.3240.000
VL50.08−0.200.06−0.120.300.43−0.63−1.530.810.691.0690.009
PROFITABILITYVR10.02−0.090.010.000.040.30−0.02−2.290.230.201.3140.000
VR20.130.160.060.170.181.48−0.03−9.541.046.202.4150.000
VR30.03−0.050.02−0.010.040.14−0.02−0.540.180.311.2630.000
VR40.05−0.020.040.000.050.16−0.02−0.500.260.472.4570.000
VR50.04−0.060.030.000.050.31−0.02−2.090.321.002.3640.000
SOLVENCYVS10.250.390.180.330.250.300.000.000.851.211.6060.000
VS211.421.242.300.0029.2916.14−5.23−41.39250.6092.064.1750.000
VS30.120.010.060.000.170.18−0.05−0.430.990.686.3180.000
VS40.240.070.150.050.250.19−0.03−0.341.110.794.5620.022
VS53.370.790.600.088.184.500.00−18.7063.8330.976.5840.000
VS65.399.242.693.525.5025.081.08−77.8130.27107.851.1260.000
VS74.398.241.692.525.5025.080.08−78.8129.27106.853.1770.000
VS80.620.980.630.940.260.370.070.170.972.421.9410.000
Note: M-W: Mann-Whitney test; S.D.: Standard Deviation.
Table 6. Results of the estimated models; M.I.
Table 6. Results of the estimated models; M.I.
LOGITDRCNN
VARIABLESβOdds RatioSig. (Wald)VARIABLESNormalized Importance (%)Expected Sign
VE2−0.4770.628−0.002VZ147-
VR3−13.12800VE262-
VS84.11561.6740VR443-
Constant−2.9540.0590VS871+
VN339-
CLASSIFICATION MATRIX
In-sample (Training)84.10%95.00%
Out-sample (Testing)80.40%93.50%
MODEL SET
RV coefficient0-
Hosmer-Lemeshow0.195-
−2 log likelihood218.440-
R2 Cox-Snell0.515-
R2 Nagelkerke0.68-
ROC Curve0.9270.975
Table 7. Results of the estimated models; M.II.
Table 7. Results of the estimated models; M.II.
LOGITDRCNN
VARIABLESβOdds RatioSig. (Wald)VARIABLESNormalized Importance (%)Expected Sign
VE2−0.3780.681−0.007VZ138-
VR3−17.07700VE277-
VS1−1.7310.172−0.022VR352-
VS84.786119.8140VS163+
Constant−2.6940.0660VS445-
CLASSIFICATION MATRIX
In-sample (Training)81.00%92.70%
Out-sample (Testing)78.60%89.60%
MODEL SET
RV coefficient0-
Hosmer-Lemeshow−0.063-
−2 log likelihood226.372-
R2 Cox-Snell0.445-
R2 Nagelkerke0.572-
ROC Curve0.8950.967
Table 8. Results of the estimated models; M.III.
Table 8. Results of the estimated models; M.III.
LOGITDRCNN
VARIABLESβOdds RatioSig. (Wald)VARIABLESNormalized Importance (%)Expected Sign
VE2−0.2450.781−0.073VE283-
VR1−6.4920.002−0.025VR174-
VS83.834463.4320VR452-
Constant−2.6580.0720VS134+
VS841+
CLASSIFICATION MATRIX
In-sample (Training)71.30%88.80%
Out-sample (Testing)74.20%85.60%
MODEL SET
RV coefficient0-
Hosmer-Lemeshow−0.238-
−2 log likelihood224.285-
R2 Cox-Snell0.324-
R2 Nagelkerke0.426-
ROC Curve0.8290.895

Share and Cite

MDPI and ACS Style

Becerra-Vicario, R.; Alaminos, D.; Aranda, E.; Fernández-Gámez, M.A. Deep Recurrent Convolutional Neural Network for Bankruptcy Prediction: A Case of the Restaurant Industry. Sustainability 2020, 12, 5180. https://doi.org/10.3390/su12125180

AMA Style

Becerra-Vicario R, Alaminos D, Aranda E, Fernández-Gámez MA. Deep Recurrent Convolutional Neural Network for Bankruptcy Prediction: A Case of the Restaurant Industry. Sustainability. 2020; 12(12):5180. https://doi.org/10.3390/su12125180

Chicago/Turabian Style

Becerra-Vicario, Rafael, David Alaminos, Eva Aranda, and Manuel A. Fernández-Gámez. 2020. "Deep Recurrent Convolutional Neural Network for Bankruptcy Prediction: A Case of the Restaurant Industry" Sustainability 12, no. 12: 5180. https://doi.org/10.3390/su12125180

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop