Next Article in Journal
Solving the Nonlinear Heat Equilibrium Problems Using the Local Multiquadric Radial Basis Function Collocation Method
Next Article in Special Issue
Application of Multicriteria Decision Making and Multi-Objective Planning Methods for Evaluating Metropolitan Parks in Terms of Budget and Benefits
Previous Article in Journal
Towards a Better Basis Search through a Surrogate Model-Based Epistasis Minimization for Pseudo-Boolean Optimization
Previous Article in Special Issue
A DEA Resampling Past-Present-Future Comparative Analysis of the Food and Beverage Industry: The Case Study on Thailand vs. Vietnam
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Predicting Audit Opinion in Consolidated Financial Statements with Artificial Neural Networks

by
José Ramón Sánchez-Serrano
1,*,
David Alaminos
2,*,
Francisco García-Lagos
3 and
Angela M. Callejón-Gil
1
1
Department of Finance and Accounting, Campus El Ejido s/n, University of Malaga, 29071 Malaga, Spain
2
Department of Economic Theory and Economic History, Campus El Ejido s/n, University of Malaga, 29071 Malaga, Spain
3
Department of Electronic Technology, Bulevar Louis Pasteur, 35. Campus de Teatinos. University of Malaga, 29071 Malaga, Spain
*
Authors to whom correspondence should be addressed.
Mathematics 2020, 8(8), 1288; https://doi.org/10.3390/math8081288
Submission received: 25 June 2020 / Revised: 1 August 2020 / Accepted: 2 August 2020 / Published: 5 August 2020
(This article belongs to the Special Issue Mathematical Analysis in Economics and Management)

Abstract

:
The models for predicting audit opinion analyze the variables that affect the probability of obtaining a qualified opinion. This helps auditors to plan revision procedures and control their performances. Despite their apparent relevance, existing models have only focused on the context of individual financial statements and none have referred to consolidated financial statements. The consolidated information is essential for decision-making processes and understanding the true financial situation of a company. Our objective is to provide a new audit opinion prediction model for consolidated financial statements. To this end, a sample of group of Spanish companies was chosen and an artificial neural network technique, the multilayer perceptron, was used. The results show that the developed method managed to predict the audit opinion with accuracy above 86%. Moreover, there exist important differences concerning the most significant variables in the audit opinion prediction for individual accounts, since when using consolidated financial statements, the variables referring to industry, group size, auditor, and board members were converted into the main explanatory parameters of the prediction.

1. Introduction

Previous studies have developed models to predict audit opinion. Auditors can use these models to plan audit procedures, as a quality control tool in the stage of review of a commitment, and for the analysis of the variables that affect the probability of obtaining a qualified opinion [1,2]. The existing audit opinion prediction models have only been developed in the context of individual financial statements, and none have referred to consolidated financial statements. However, the literature on audit has been concluded by recognizing the greater relevance of consolidated information [3,4,5,6]. Consolidated information is essential to decision-making processes [7], to report the true financial situation of the economic entity [8], and to obtain the value of a company [9].
Given the importance that the previous literature places upon consolidated information, the present study aims to fill the gap in audit opinion prediction models, providing a new model that is capable of predicting the audit opinion in consolidated financial statements. To this end, a random sample of 298 groups of companies operating in the Spanish market was chosen. The sample was divided into unqualified opinion groups and qualified opinion groups, providing an initial set of explanatory variables of their consolidated financial statements. These variables include financial parameters (efficiency, liquidity, profitability, solvency, productivity, and size), corporate governance measures, and other qualitative parameters.
Artificial neural network (NN) techniques have been applied to the information obtained from the sample, which is the methodology that has provided the best results in the previous literature on audit opinion prediction models [2,10]. Finally, the results obtained have allowed us to obtain a prediction model for consolidated financial statements with an accuracy greater than 82% and to determine the impact of the explanatory variables on the problem under study.
This paper continues as follows. After a review of the literature on audit opinion prediction models and consolidated financial statements, the methods, sample, variables, and main results are presented. We close with a conclusion section, including implications for practice and suggestions for future research.

2. Literature Review

2.1. Audit Opinion Prediction Models

In general, the role played by the auditor and its effect on the markets gives it a dual role: on the one hand, an informative role and, on the other, a role for information security and reliability. The auditor provides independent verification of the financial statements and can discover and report deficiencies in the accounting information system [11]. Furthermore, they provide security to investors by verifying that the audited financial statements conform to the standards required by law and the markets [12]. Two types of opinions are obtained from the accounting audit process: unqualified opinions and qualified opinions. The first is the one in which the auditor does not detect significant differences between the figures presented by the company’s administrators and those verified by the auditor. The second opinion shows significant differences that were not corrected by the company’s administrators and that the auditor reveals in his audit report.
Some authors have contributed to the development of models that help to predict the opinion on audit reports. In this regard, previous studies have applied various methodologies in the search to adjust a model with better predictions. For example, the authors of [13] applied discriminant analysis, the authors of [14] applied probit analysis, and the authors of [15] applied logistic regression. Other studies have used multicriteria decision-making techniques [16,17,18], NN [1,2,10], support vector machines [19], and decision trees [20].
The results obtained have different accuracy levels according to the methodology and the characteristics and location of the sample. The authors of [21] applied a logistic model based on financial information to identify the audit opinion. The study analyses 37 Finnish companies listed on the Helsinki Stock Exchange using a set of 17 explanatory variables. They confirmed that qualified opinions show a greater association with low profitability, low growth, and high indebtedness, but the accuracy of their model was only 62%. The authors of [17] used a sample of 100 Greek companies applying discriminant analysis, logistic regression, and the multicriteria decision method, with a set of economic variables, financial ratios, and non-financial variables. Their results achieved an accuracy of 80% and suggested that the most predictive variables in the model were collection/sales, sales/total assets, net profit/total assets, and working capital/total assets. The authors of [19] used support vector machine methodology on a sample of 1754 large British companies. The model had an accuracy of 73% and the authors noted that credit rating was the most predictive variable. Subsequently, the authors of [22] worked on the Asian financial sector. They verified that Asian banks with qualified audit opinions are smaller, less capitalized, less profitable or efficient, and appear to have excess liquidity. The model rose to 59% accuracy. Likewise, the authors of [2] propose the application of K-nearest neighbors, discriminant analysis, and logistic regression methods to a sample of public and private British companies. The results of this study showed a 74% accuracy using financial and non-financial variables.
The authors of [18] applied the same methodology used in [17] to a sample of British companies. According to their conclusions, the significant variables to predict audit opinion are quick ratio, changes in total assets, Return on assets (ROA), Earnings before interest and tax (EBIT), and credit risk. The authors of [20] apply decision trees, multilayer perceptron, and Bayesian belief networks focused on British and Irish companies. The results show that insolvency and profitability variables are highly related to qualified audit opinions. On the other hand, the authors of [20] selected a sample of listed companies on the London Stock Exchange, showing a greater explanatory power of NN methods. Additionally, profitability and credit rating were the most predictive variables. Subsequently, these same authors replicated this study with a sample of Asian commercial banks [23].
More recently, the authors of [10] worked on companies listed on the Tehran Stock Exchange and their results showed the great capacity of the NN to identify the audit opinion (88% accuracy). The authors of [24] combined support vector machines and decision trees, proving the great predictive capacity of this last algorithm. The authors of [25] used discriminant analysis, logit, and decision trees to predict the audit opinion of a sample of companies from the Istanbul Stock Exchange. The results show that retained earnings/total assets is the most predictive variable. The authors of [2] improved the adjustments of these models by introducing corporate governance variables. This study used a multilayer perceptron and probabilistic neural network, obtaining a 98.10% accuracy for the testing sample. Finally, the authors of [15] carried out a study on the influence of financial variables on the audit opinion. The results showed a positive relationship between liquidity, loss in the current year, loss of the previous year, and qualified audit reports.

2.2. Characteristics of Consolidated Financial Statements

The purpose of the consolidated financial statements is to present the single economic and financial position of the group of companies owned by the parent company. The consolidation process requires the performance of a series of procedures, such as the elimination of transactions between group companies, with the objective that the assets, liabilities, income, and expenses reflected in the consolidated financial statements are finally those made available to third parties. In this way, the individual financial statements are affected by transactions with other group companies, in many cases altering the economic and financial situation intentionally. This situation means that the true result obtained from third parties is not shown in the individual financial statements. In the European Union, the financial statements of companies are addressed in Regulation 1606/2002, which requires International Financial Reporting Standards (IFRS) for consolidated reports and introduces a member state option to apply IFRS to other entities and to separate financial statements.
Consolidated information is widely recognized as essential to support decision-making processes and to ensure public accountability [7,26]. According to the authors of [8], it is important to remember that many economic studies and empirical studies for companies have been based on consolidated data. Two main reasons drive the adoption of the consolidated figures. Firstly, consolidated reports are the true financial statements of the economic entity. Secondly, in most countries, particularly for non-listed companies, only the consolidated financial statements are available to the public; therefore, all research is done on consolidated data. Despite the aforementioned, much has been written about the quality of consolidated financial statements and their differences concerning individual financial statements. Most of these studies have concluded by recognizing the greater relevance and predictive capacity of the consolidated information [3,4,5,6]. According to some authors, the lower relevance of individual financial statements is because the companies formulate their financial statements with an eminently fiscal purpose [27,28,29,30,31,32]. Similarly, the authors of [9], through the analysis of a sample of German companies, concluded by demonstrating the existence of greater predictive capacity in the consolidated data for obtaining the value of the companies, unable to identify any relationship between the value of the companies and the data counters of the parent companies analyzed. Finally, other empirical studies have shown the increase in relevance and greater impact of the consolidated information on the shares’ market value [33,34,35,36,37].

3. Sample and Variables

3.1. Sample

To comply with the empirical objective of this paper, a random sample of 298 groups of companies that operated during 2017 in the Spanish market were chosen. We have not taken the financial sector into account in the selection of companies. The reason that financial institutions have not been selected is due to the special accounting characteristics of these companies. The audit opinion and groups’ financial information in the sample were obtained from the Iberian Balance Sheet System database of Bureau Van Dijk, which contains corporate information on more than two million Spanish companies. Audit opinions are classified broadly into two groups. On the one hand are the reports with an unqualified opinion, which are those that adequately comply with the accounting standards. On the other hand are the reports with a qualified opinion, which are those that do not comply with the accounting standards.
From the sample, 87 financial statements received a qualified opinion and 211 unqualified opinions. Table 1 provides a breakdown of the industry classification of the groups in the sample, according to CNAE-09 (Spanish National Classification of Economic Activities). The sector of activity with greater representation is architectural and engineering technical services (92 groups of companies), followed by manufacture of transport equipment (72 groups of companies) and telecommunications (47 groups of companies).

3.2. Variables

The present study uses 35 independent variables obtained from previous studies on audit opinion prediction models [1,2]. These independent variables are presented in Table 2. The independent variables include financial parameters, non-financial parameters, and other qualitative parameters. The use of the financial parameters related to profitability, liquidity, efficiency, solvency, productivity, and size is justified because previous studies indicate that a high level of financial risk and larger company size is related to a greater probability of receiving an opinion from qualified audit [1,37]. For its part, the previous literature also indicates that the use of non-financial parameters related to number of board members contributed to improving the levels of accuracy of the audit prediction models [2,38,39]. Likewise, other qualitative parameters have significant results in previous models of prediction of audit opinions. For example, the auditor code and audit fees indicate quality differences between audit firms. The authors of [11] hypothesize that larger audit firms provide higher quality audit reports. Finally, the variable of industry is used to denote the industry classification of the companies. The activity of the companies has been significant in previous studies on the prediction of audit opinions [1]. Furthermore, to identify the dependent variable, a dummy variable has been used. This variable takes a value of 1 if the opinion was qualified and 0 if otherwise.

4. Model Research Design

This section presents the details of the NN model used in the present study. As noted, we are facing a problem of binary classification, using a set of explanatory variables as inputs. The NN will try to classify the companies in the samples set as qualified or unqualified. Since the set of patterns contains the target, it is best to use a supervised training model so that it learns from the available patterns. We have tested several different NN models, among which the multilayer perceptron (MLP), the radial base function network (RBF), and the deep networks with convolution layers (CNN) stand out. It is worth mentioning that the use of CNN does not significantly improve the results for this problem and has the disadvantage of being a more complex model than MLP and with a greater resource requirement for training. MLP has also obtained better results than RBF, so MLP has finally been selected to build the model object of the present work. The authors of [40] and [41] confirmed that learning in MLP constituted a special case of a functional approach, where there is no assumption about the underlying model of the analyzed data.
As is well known, one of the drawbacks of using NN to solve classification problems is the need to comprise a set of values in advance for the so-called model hyperparameters. In the case of MLP, the hyperparameters that must be predefined before training are the training algorithm, the initial learning rate, the number of hidden layers, the number of hidden neurons of each hidden layer, the activation functions of each layer, and the number of training epochs. In addition, to improve the capacity of the generalization of the network, some method of regularization must be implemented to avoid overtraining, which in turn also has hyperparameters. To define this set of hyperparameters, we have used two methods: firstly, the so-called dropout [42] and, secondly, training through k-fold cross-validation [43].
As a previous step and considering that the independent variables used have very different magnitudes, the values of them have been normalized using Equation (1) for the set of training patterns and Equation (2) for the testing set.
T r a i n _ s t d   j , i   =   T r a i n j , i μ ( T r a i n ) j   σ ( T r a i n ) j
T e s t _ s t d   j , i   =   T e s t j , i μ ( T e s t ) j   σ ( T e s t ) j
In these equations, Train_stdj,i is the feature j of the training pattern number i, Test_stdj,i is the feature j of the testing patterns number i, μ(Train)j it is the mean value of the feature j in the whole training set, and σ(Train)j is its standard deviation. Note that the set of standardized test patterns does not use the information on the mean value or its standard deviation but only information on training patterns. This allows the evaluation of the results on the testing set to not be polarized (unbiased performance evaluation of our model).
To find the appropriate values for the hyperparameters of the model, a thorough sweep was performed using the following configurations. First, and with respect to training algorithms, different variants of the gradient descent optimization algorithm have been used, specifically Adagrad [44,45,46]; RMSprop [47]; Adadelta [48]; adaptive moment estimation [49]; AdaMax [50]; Nesterov-accelerated adaptive moment estimation [51], and AMSGrad [52]. Besides the above, 1, 2 or 3 hidden layers have been used, varying the number of neurons of each layer from 1 to 200, in steps of 5. As a probability of elimination in the dropout method, the values 0, 0.1, 0.2, 0.3, 0.5, and 0.6 have been used. Hyperbolic tangent and logistic and ReLU activation functions have been tested. The best models have been obtained by using the adaptive moment estimation training algorithm, with 60 neurons in a single hidden layer, with a probability of dropout 0.5, with hyperbolic tangent activation function for hidden neurons and with softmax activation function for output layer neurons.
On the other hand, to implement the k-fold cross-validation, the following process has been repeated N times: (a) split the set of input patterns into i random groups (where i = 1, …, k), and (b) For each i = 1, …k, use pattern set i for testing and the rest (k−1 sets) for training. In addition, 20% of the training pattern set has been chosen as the validation set.
The repetition of the procedure N times minimizes the possible dependence of the results concerning the initial random division of the patterns since each repetition begins with the random selection of the set of patterns. In our case, we have found that k = 5 is a good balance between the diversity of configurations and size of pattern sets. The methodological process used in the present study ends with the evaluation of the results obtained for training, validation, and testing sets. In this evaluation, the percentage of correctly classified patterns (accuracy) and the mean square error have been used.

5. Results

5.1. Exploratory Analysis

In the exploratory analysis, a descriptive study was carried out to determine the main statistical parameters of the independent variables (mean and standard deviation). This was intended to deduce which variables could be relevant in the prediction model to be developed. This analysis will be verified later with a specific confirmatory analysis through the use of the MLP model. Likewise, these results will be contrasted with the models estimated by other authors in previous studies.
Table 3 provides information on the main statistics of the sample. The groups with qualified opinions, in comparison to those that present unqualified opinions, appear to be grouped with a smaller and worse position in terms of financial variables. These results are similar to those obtained by the authors of [1,2,10,18] for individual financial statements. As argued by the authors of [17], the possibility of obtaining qualifications in the reports increases when companies have worse financial health. In this sense, some studies also detected that companies with qualified audit opinions suffered from lower levels of profitability, liquidity, solvency, and productivity [2,18,53,54,55].

5.2. Model Evaluation

To evaluate our system and considering that the number of patterns is not very high, we have implemented a five-fold cross-validation procedure repeated 100 times. For each of the hundred tests, the patterns for training, validation, and testing are chosen randomly, and the model is trained and evaluated. The results of the MLP model developed are shown in Figure 1, which represents the accuracy average value for each of the 100 tests performed. Each test also contains three results (for the training, validation, and testing sets). The continuous blue graph shows the average percentage of correctly classified patterns in the five-fold cross-validation in each of the 100 tests performed. The dashed blue line shows the average value. In the same way, the green curve shows the results for the set of validation patterns and the red one for the set of training patterns.
For its part, Figure 2 shows the standard deviations of the results shown in Figure 1, indicating that, in all tests performed, the standard deviation is very limited (less than 9%).
Table 4 shows a summary of the results for training, validation, and testing. The most used metrics for machine learning techniques for classification problems have been calculated. In particular, the precision indices, F-measure, precision, sensitivity, and specificity are supported. The results obtained indicate the great predictive capacity of MLP, with very similar accuracy to that provided by similar methodologies observed in the previous literature on audit opinion prediction models from individual financial statements. For example, in [2], a successful classification of 74% is reported; in [18], 82.22% is reached; in [42], 73% is reached, and in [15], 80% is reached.

5.3. Sensitivity Analysis

The sensitivity analysis is the technique that is most used for the interpretation of the weights and parameters of a NN model [56,57]. The objective is to determine to what extent the oscillations in input values or parameters influence the output results of this, and it is exactly through the analysis of these variations by which it is possible to determine the importance of each variable, seeing as each one of them has a proportional representation in the model. To carry out this sensitivity analysis, the agnostic interpretability of machine learning [58] model has been implemented. To do this, the accuracy of the MLP has been evaluated, giving a value of 0 to each training pattern of independent variables. Subsequently, MLP has been reassessed, giving the value of 0 to each of the testing patterns of said variables.
The sensitivity results obtained appear in Figure 3. The variables of greatest impact have been those of industry, group size, auditor code, audit fees, and board members, all of which have an impact level above 83%. These variables of greater sensitivity convert, therefore, into the main explicative parameters for the prediction of audit opinion in the consolidated financial statements. In contrast, the developed models for individual financial statements require other types of explicative variables in order to reach an acceptable predictive power, like the financial variables [2,15,25]. Possibly, the aggregation of elements of heterogeneous companies that make up the consolidation perimeter, the homogenization processes, and the accounting adjustments carried out as a consequence of the consolidation mechanics may have led to the least significant of these variables in the consolidated model. Furthermore, the variance inflation factor (VIF) and tolerance value have been used to test multicollinearity and to support the model’s results (Table 5). In cases where the VIF value is under 10 and the tolerance value is not very close to 0, the model is considered to be free from a multicollinearity problem [59]. All variables have good VIF and tolerance values. Therefore, there are no multicollinearity problems or autocorrelation in the model, and this shows the soundness and reliability of the model.

6. Conclusions

This study covers the existing gap in the literature regarding audit opinion prediction models, developing a new exclusive model for consolidated financial statements. The results obtained have permitted us to show that it is possible to predict the audit opinion for consolidated financial statements and to identify the differences and similarities existing in the prediction of both individual and consolidated models.
The results obtained with MLP reached an accuracy of around 82.50% with the testing sample, indicating that the developed model has managed to predict the audit opinion with consolidated financial statements, as occurred in previous studies for individual financial statements. Furthermore, important differences concerning the most significant variables in the prediction of audit opinion pointing to individual financial statements have also been detected. The variables referring to industry, group size, auditor code, audit fees, and board members were converted into the main explicative parameters of the prediction of audit opinion for consolidated financial statements. Economic–financial variables related to liquidity, solvency, profitability, or productivity lost predictive capacity compared to other explanatory and corporate governance variables. In contrast, the developed models for individual financial statements require other types of explicative variables to reach an acceptable predictive power, like financial variables and other qualitative variables. Possibly, the singularity of consolidated financial statements has conditioned the results of this study. In this way, a collection of variables of a very diverse nature has been made evident for the prediction of audit opinions of consolidated financial statements. Therefore, the greater disintegration of heterogeneous activities and the subsequent aggregation as a result of the diversification observed in the consolidation perimeters, as well as the proliferation and constant regulatory adaption of individual and consolidated levels, may have been the factors that provoked the observed characteristics in the set of variables which were significant for the consolidated model.
In addition, the results have important implications for the analysis of the consolidated information. Approximately 20–30 years ago, business groups were practically an extension of a mother or dominating company. There was no group diversification, and real financial differences between the individual companies and the consolidated group were not detected. Consolidated financial statements were simply an aggregation of equal activities under the assumption of a level of risk with similar characteristics. With the passing of time, greater diversification of activities in groups of companies and the assumption of different risk levels according to the activity in concern has come about. A group of companies is no longer an extension of the parent company. The consolidated statements are, at present, the union of a set of activities of a different nature and with a different financing and investment scheme structures, and they provide more relevant and accurate information than individual statements. Hence, groups of companies and financial statements considered individually are, in principle, completely different states. For these reasons, the developed model in this study confirms the singularity of the predictor variables of audit opinion for consolidated groups, in opposition to those observed at the individual level.
The results obtained make it possible to think about an eminent practical application of these tools. Sectors such as the audit of accounts, financial institutions, credit rating agencies, or regulators of the audit activity, among others, could apply these methodologies in their work systems to increase profitability, productivity, and efficiency in their production cycles. Knowing a priori the type of audit opinion would allow the auditor to plan their work in a more orderly, systematic, and accurate way. If the models predict an audit report with a qualified opinion, this would allow the design of work programs with a greater number of tests and expand the samples to be analyzed. These models would help to complete the risk analysis in the planning phase. In addition, they would serve as a decision tool when deciding whether or not to accept certain assignments, a matter of considerable controversy in the profession of auditing accounts. Financial institutions would enjoy new tools to know a priori the audit opinion when they analyze unaudited financial statements or specify in advance the opinion of the auditor when the audit of financial statements is not finalized. This is very common for the segment of small and medium-sized companies that, according to the legal provisions of each country, are not usually subject, on a mandatory basis, to an audit of accounts. Likewise, the granting of loans and lines of financing to companies requires the analysis of a lot of financial information, such as the examination of the financial statements, the analysis, and interpretation of business plans. With the use of these methodologies, analysis times would be reduced, and decision-making would be streamlined. The audit opinion is a measurement of the true image of the financial statements and knowing it in advance would improve the productivity of the work teams and the business profitability in this type of institution. The result would be reflected in a reduction of errors when granting financing, as well as in acceleration towards the achievement of the objectives in these entities. Credit rating agencies would be another sector that would benefit from the use of these methodologies. These agencies handle a lot of information to develop their ratings. Knowing the opinion of these computational tools could enrich and complement the conclusions obtained in the analysis of the documents. In addition, the regulatory bodies that monitor and supervise the auditing sector would have a methodology that could allow them to determine whether the opinion of an auditor in their report coincides with the opinion expressed by these statistical tools. This would have a great impact on the oversight work of these organizations since they would detect afterward whether an auditor has distorted their professional opinion when compared with the opinion provided by these computer models. In this way, the greatest number of indications of possible incidences or errors in the work of the auditor could be detected, for the analysis, inspection, and, where appropriate, the opening of a sanctioning procedure.
On the other hand, our models showed a very high percentage of prediction and these values are similar to the results obtained for predicting the audit opinion in individual financial statements. The auditor’s professional judgment must assess whether these prediction percentages are sufficient to use these computational methodologies. The inherent risk of the sector, the volatility in the market, or the risks detected in the internal control analysis of the company could be the most important factors that influence the auditor to accept the prediction percentages that these models give. In many cases, the auditor may consider this to be an acceptable percentage based on the circumstances outlined above.
Finally, the obtained results suggest future lines of investigation. Firstly, it would be very enlightening to know how the financial cycles can affect audit opinion prediction and consolidated financial statements. Working with time series and differentiating which variables are predictive according to the economic cycle is of an important practical application. Secondly, and looking deeper into the professional field of account auditing, exploring the predictive effect of the financial variables in each type of opinion and/or rating, as the dependent variable used has been dichotomous, qualified opinion, or unqualified opinion, is also important. Achieving these results would add value to the audit sector of financial statements, meaning that one could not only predict whether the opinion is favorable or without ratings but also determine which kind of rating would be reached and which type of opinion the auditor would have. Lastly, it would be interesting to verify for other international legislative environments, which would demonstrate the effect local economies may have on the audit opinion predictions. In this context, the administration of a global database may offer models from which to make international comparisons. The conclusions of these global models may serve as powerful tools for decision-making processes such as adopting international legislative improvements.

Author Contributions

The original draft was written by J.R.S.-S., F.G.-L. and A.M.C.-G., and review & editing were completed by J.R.S.-S., D.A. and A.M.C.-G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Universidad de Málaga.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Gaganis, C.; Pasiouras, F.; Doumpos, M. Probabilistic neural networks for the identification of qualified audit opinions. Expert Syst. Appl. 2007, 32, 114–124. [Google Scholar] [CrossRef]
  2. Fernández-Gámez, M.A.; García-Lagos, F.; Sánchez-Serrano, J.R. Integrating corporate governance and financial variables for the identification of qualified audit opinions with neural networks. Neural Comput. Appl. 2016, 27, 1427–1444. [Google Scholar] [CrossRef]
  3. Darrough, N.; Harris, T. Do Management Forecasts of Earnings Affect Stock Prices in Japan? In Japanese Financial Market Research; North-Holland: Amsterdam, the Netherlands, 1991; pp. 197–229. [Google Scholar]
  4. Harris, T.S.; Lang, M.; Moller, H.P. The Value Relevance of German Accounting Measures: An Empirical Analysis. J. Account. Res. 1994, 32, 187–209. [Google Scholar] [CrossRef]
  5. Niskanen, J.; Kinnunen, J.; Kasanen, E. A note on the information content of parent company versus consolidated earnings in Finland. Eur. Account. Rev. 1998, 7, 31–40. [Google Scholar] [CrossRef]
  6. Abad, C.; Laffarga, J.; García-Borbolla, A.; Larrán, M.; Piñero, J.M.; Garrod, N. An evaluation of the value relevance of consolidated versus unconsolidated accounting information: Evidence from quoted Spanish firms. J. Int. Financ. Manag. Account. 2000, 11, 156–177. [Google Scholar] [CrossRef]
  7. Chow, D.; Humphrey, C.; Moll, J. Developing whole of government accounting in the UK: Grand claims, practical complexities and a suggested future research agenda. Financ. Account. Manag. 2007, 23, 27–54. [Google Scholar] [CrossRef]
  8. Sotti, F. The value relevance of consolidated & separate financial statements: Are non-controlling interests relevant? Afr. J. Bus. Manag. 2018, 12, 329–333. [Google Scholar]
  9. Goncharov, I.; Werner, J.R.; Zimmermann, J. Legislative demands and economic realities: Company and group accounts compared. Int. J. Account. 2009, 44, 334–362. [Google Scholar] [CrossRef]
  10. Pourheydari, O.; Nezamabadi-pour, H.; Aazami, Z. Identifying qualified audit opinions by artificial neural networks. Afr. J. Bussines Manag. 2012, 6, 11077–11087. [Google Scholar]
  11. DeAngelo, L. Auditor size and audit quality. J. Account. Econ. 1981, 3, 183–199. [Google Scholar] [CrossRef]
  12. Mansi, S.A.; Maxwell, W.F.; Miller, D.P. Does auditor quality and tenure matter to investors? Evidence for bond market. J. Account. Res. 2004, 42, 755–793. [Google Scholar] [CrossRef]
  13. Levitan, A.S.; Knobblet, J.A. Indicators of exceptions to the going-concern assumption. Audit. A J. Pract. Theory 1985, 5, 26–39. [Google Scholar]
  14. Lennox, C. Do companies successfully engage in opinion-shopping? Evidence from the UK. J. Account. Econ. 2000, 29, 321–337. [Google Scholar] [CrossRef]
  15. Moalla, H. Audit report qualification/modification: Impact of financial variables in Tunisia. J. Account. Emerg. Econ. 2017, 7, 468–485. [Google Scholar] [CrossRef]
  16. Spathis, C. Detecting false financial statements using published data: Some evidence from Greece. Manag. Audit. J. 2002, 17, 179–191. [Google Scholar] [CrossRef] [Green Version]
  17. Spathis, C.; Doumpos, M.; Zopounidis, C. Using client performance measures to identify pre-engagement factors associated with qualified audit reports in Greece. Int. J. Account. 2003, 38, 267–284. [Google Scholar] [CrossRef]
  18. Pasiouras, F.; Gaganis, C.; Zopounidis, C. Multicriteria decision support methodologies for auditing decisions: The case of qualified audit report in the UK. Eur. J. Oper. Res. 2007, 180, 1317–1330. [Google Scholar] [CrossRef]
  19. Doumpos, M.; Gaganis, C.; Pasiouras, F. Explaining qualifications in audit reports using a support vector machine methodology. Intell. Syst. Acc. Financ. Manag. 2005, 13, 197–215. [Google Scholar] [CrossRef]
  20. Kirkos, E.; Spathis, C.; Nanopolulos, A.; Manolopoulos, Y. Identifying Qualified Auditors´Opinions: A Data Mining Approach. J. Emerg. Technol. Account. 2007, 4, 183–197. [Google Scholar] [CrossRef]
  21. Laitinen, E.K.; Laitinen, T. Qualified audit reports in Finland: Evidence from large companies. Eur. Account. Rev. 1998, 7, 639–653. [Google Scholar] [CrossRef]
  22. Gaganis, C.; Pasiouras, F. A multivariate analysis of the determinants of auditors’ opinions on Asian Banks. Manag. Audit. J. 2007, 22, 268–287. [Google Scholar] [CrossRef]
  23. Gaganis, C.; Pasiouras, F.; Tanna, S.; Zopounidis, C. Binary Choice Models for External Auditors Decisions in Asian Banks. Oper. Res. Int. J. 2008, 8, 123–139. [Google Scholar] [CrossRef] [Green Version]
  24. Ebrahimi, F.; Sarikhani, M.; Mojtaba, S. Finding rules for audit opinions prediction through data mining methods. Eur. Online J. Nat. Soc. Sci. 2012, 1, 28–36. [Google Scholar]
  25. Yasar, A.; Yakut, E.; Gutnu, M. Predicting Qualified Audit Opinions Using Financial Ratios: Evidence from the Istanbul Stock Exchange. Int. J. Bus. Soc. Sci. 2015, 8, 57–67. [Google Scholar]
  26. Heald, D.; Georgiou, G. Consolidation principles and practices for the UK government sector. Account. Bus. Res. 2000, 30, 153–167. [Google Scholar] [CrossRef]
  27. Choi, F.D.S.; Mueller, G.G. International Accounting; Prentice-Hall: Upper Saddle River, NJ, USA, 1992. [Google Scholar]
  28. Delvaille, P.; Ebbers, G.; Saccon, C. International Financial Reporting Convergence: Evidence from Three Continental European Countries. Account. Eur. 2005, 2, 137–164. [Google Scholar] [CrossRef]
  29. Lamb, M.; Nobes, C.; Roberts, A. International Variations in the Connection Between Tax and Financial Reporting. Account. Bus. Res. 1998, 28, 173–188. [Google Scholar] [CrossRef]
  30. Macías, M.; Muiño, F. Examining dual accounting systems in Europe. Int. J. Account. 2011, 46, 51–78. [Google Scholar] [CrossRef] [Green Version]
  31. Nobes, C. Towards a general model of the reasons for international differences in financial reporting. Abacus 1998, 34, 162–187. [Google Scholar] [CrossRef]
  32. Oliveras, E.; Puig, X. The Changing Relationship between Tax and Financial Reporting in Spain: EBSCOhost. Account. Eur. 2005, 2, 195–207. [Google Scholar] [CrossRef]
  33. Bartov, E.; Goldberg, S.; Kim, M. Comparative Value Relevance Among German, U.S., and International Accounting Standards: A German Stock Market Perspective. J. Account. Audit. Financ. 2005, 20, 95–119. [Google Scholar] [CrossRef]
  34. Jermakowicz, E.; Prather-Kinsey, J.; Wulf, I. The Value Relevance of Accounting Income Reported by DAX-30 German Companies. J. Int. Financ. Manag. Account. 2007, 18, 151–191. [Google Scholar] [CrossRef]
  35. Barth, M.E.; Landsman, W.R.; Lang, M.H. International Accounting Standards and Accounting Quality. J. Account. Res. 2008, 46, 467–498. [Google Scholar] [CrossRef] [Green Version]
  36. Paananen, M.; Lin, C. The development of accounting quality of IAS and IFRS over time: The case of Germany. J. Int. Account. Res. 2009, 8, 1–41. [Google Scholar] [CrossRef] [Green Version]
  37. Vuko, T.; Cular, M. Finding determinants of audit delay by pooled OLS regression analysis. Croat. Oper. Res. Rev. 2014, 81, 81–91. [Google Scholar] [CrossRef] [Green Version]
  38. Klein, A. Audit committee, board of director characteristics, and earnings management. J. Acc. Econ. 2002, 33, 375–400. [Google Scholar] [CrossRef] [Green Version]
  39. Peasnell, K.V.; Pope, P.F.; Young, S. Board monitoring and earnings management: Do outside directors influence abnormal accruals? J. Bus. Financ. Acc. 2005, 32, 1311–1346. [Google Scholar] [CrossRef]
  40. Nuñez de Castro, L.; von Zuben, F.J. Optimised training techniques for feedforward neural networks. In Technical Report DCA RT 03/98; Department of Computer Engineering and Industrial Automation. FEE/UNICAMP: São Paulo, Brasil, 1998. [Google Scholar]
  41. Zahedi, F. A meta-analysis of financial application of neural networks. Int. J. Comput. Intell. Organ. 1996, 1, 164–178. [Google Scholar]
  42. Müller, V.O. The impact of IFRS adoption on the quality of consolidated financial reporting. 2nd World Conference On Business, Economics and Management—WCBEM 2013. Procedia Soc. Behav. Sci. 2014, 109, 976–998. [Google Scholar]
  43. Srivastava, N.; Hinton, G.; Krizhevsky, A.; Sutskever, I.; Salakhutdinov, R. Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 2014, 15, 1929–1958. [Google Scholar]
  44. Cawley, G.C.; Talbot, N.L.C. On Over-fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation. J. Mach. Learn. Res. 2010, 11, 2079–2107. [Google Scholar]
  45. Duchi, J.; Hazan, E.; Singer, Y. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. J. Mach. Learn. Res. 2011, 12, 2121–2159. [Google Scholar]
  46. Seising, R. The Emergence of Fuzzy Sets in the Decade of the Perceptron—Lotfi, A. Zadeh’s and Frank Rosenblatt’s Research Work on Pattern Classification. Mathematics 2018, 6, 110. [Google Scholar] [CrossRef] [Green Version]
  47. Jiang, P.; Hu, Y.-C.; Wang, W.; Jiang, H.; Wu, G. Interval Grey Prediction Models with Forecast Combination for Energy Demand Forecasting. Mathematics 2020, 8, 960. [Google Scholar] [CrossRef]
  48. Hinton, G. Neural Networks for Machine Learning—Lecture 6a—Overview of Mini-Batch Gradient Descent. 2012. Available online: http://www.cs.toronto.edu/~hinton/coursera/lecture6/lec6.pdf (accessed on 28 March 2020).
  49. Kingma, D.P.; Ba, J.L. Adam: A Method for Stochastic Optimization. In Proceedings of the International Conference on Learning Representations, San Diego, CA, USA, 7–9 May 2015. [Google Scholar]
  50. Zeiler, M.D. ADADELTA: An Adaptive Learning Rate Method. Available online: http://arxiv.org/abs/1212.5701 (accessed on 28 March 2020).
  51. Dozat, T. Incorporating Nesterov Momentum into Adam. In Proceedings of the ICLR Workshop, (1), 2013–2016, San Juan, Puerto Rico, 2–4 May 2016. [Google Scholar]
  52. Reddi, S.J.; Kale SKumar, S. On the Convergence of Adam and Beyond. In Proceedings of the International Conference on Learning Representations, Vancouver, Canada, 30 April–30 May 2018. [Google Scholar]
  53. Loebbecke, J.K.; Eining, M.M.; Willingham, J.J. Auditor’s experience with material irregularities: Frequency, nature, and detectability. Audit. A J. Pract. Theory 1989, 9, 1–28. [Google Scholar]
  54. Summers, S.L.; Sweeney, J.T. Fraudulently misstated financial statements and insider trading: An empirical analysis. Account. Rev. 1998, 73, 131–146. [Google Scholar]
  55. Beasley, M.; Carcello, J.; Hermanson, D. Fraudulent Financial Reporting (1987–1997). An. Analysis of US Public Companies; Committee of Sponsoring Organizations of the Treadway Commission: New York, NY, USA, 1999. [Google Scholar]
  56. Hashem, S. Sensitivity analysis for feedforward artificial neural networks with differentiable activation functions. Int. Jt. Conf. Neural Netw. 1992, 419–424. [Google Scholar] [CrossRef]
  57. Lisbon, P.; Mehridehnavi, A.; Martin, P. The interpretation of supervised neural networks. Proc. Workshop Neural Netw. Appl. Tools 1994, 11–17. [Google Scholar] [CrossRef]
  58. Ribeiro, M.T.; Singh, S.; Guestrin, C. Model-Agnostic Interpretability of Machine Learning. In Proceedings of the ICML Workshop on Human Interpretability in Machine Learning (WHI 2016), New York, NY, USA, 23 June 2016. [Google Scholar]
  59. Gujarati, N.D. Basic Econometrics, 3rd ed.; McGraw-Hill: New York, NY, USA, 1995. [Google Scholar]
Figure 1. The average percentage of correctly classified patterns for 100 algorithms during k-fold cross-validation (k = 5) tests.
Figure 1. The average percentage of correctly classified patterns for 100 algorithms during k-fold cross-validation (k = 5) tests.
Mathematics 08 01288 g001
Figure 2. Typical percentage deviation of patterns correctly classified for 100 algorithms using k-fold cross-validation (k = 5) tests.
Figure 2. Typical percentage deviation of patterns correctly classified for 100 algorithms using k-fold cross-validation (k = 5) tests.
Mathematics 08 01288 g002
Figure 3. Results of the sensibility analysis.
Figure 3. Results of the sensibility analysis.
Mathematics 08 01288 g003
Table 1. Distribution of the sample by industries.
Table 1. Distribution of the sample by industries.
Industry CodeDescriptionNumber of Groups
0Agriculture5
10Food industry11
11Manufacture of drinks3
12Tobacco6
13Textile industry9
14Clothes manufacturing10
16Wood and cork industry1
17Paper industry6
18Graphic arts3
2Chemical industry2
3Manufacture of transport equipment72
4Building construction6
5Air and maritime transport4
6Telecommunications47
7Architecture and engineering activities92
8Security and research activities13
9Creative, arts and entertainment activities9
Table 2. Independent variables.
Table 2. Independent variables.
VariablesDescription
Financial parameters
ROAReturn on assets (%)
ROEReturn on equity (%)
Working capital103
Working capital per employee103
Sales per employee103
Average cost per employee103
Profit per employee103
Operating income per employee103
Total assets per employee103
Current ratio%
Liquidity ratio%
EBITDA 1/LiabilitiesEBITDA/Total liabilities
Solvency ratio 1Profit of loss for the year + amortization/Current liabilities
Solvency ratio 2Profit of loss for the year + amortization/Current liabilities—creditors
EBIT marginEBIT/Sales
Profit marginProfit/Sales
Debtors’ collection periodNumber of days
Creditors’ payment periodNumber of days
Asset turnoverTotal asset/Sales
Fixed asset turnoverFixed asset/Sales
Salaries/Sales103
EBITDA /Sales103
Cash flow103
Operating cash flow103
Investment cash flow103
Sales variation rate%
Results before tax variation rate%
Results variation rate%
Total assetsLog (total assets 103 €)
Number of employeesLog (number of employees)
Group sizeNumber of companies in the corporate group
Non-financialparameters
Board membersNumber of board members
Qualitativeparameters
Auditor code1 = “Big 4”; 0 = Others
Audit feesLog (audit fees 103 €)
IndustryIndustry classification (CNAE-09)
1: Earnings before interest, taxes, depreciation and amortization
Table 3. Descriptive statistics.
Table 3. Descriptive statistics.
NMeanMedianS.D.
UQQ 1UQQUQQUQQ
Group size2038698.6454.51011.5338.99133.33
Audit fees2118710.8310.6510.5810.591.3421.1
Board members211879.547.05769.545.96
Number of employees211875.95.885.646.011.751.17
Log total assets2118718.5318.318.2218.161.571.12
Total assets per employee211872241.031334.25286.35218.4712,451.036488.92
Working capital2118775,598.0634,535.3121,385.8518,334.31264,536.0756,773.34
Working capital per employee21187245.35112.2966.5855.31872.3512.81
Sales per employee21187785.67892.85277.2246.582820.413964.05
Average cost per employee2118740.2192.2337.3238.8719.36471.32
Profit per employee2118742.5763.086.279.66193.73255.87
Operating income per employee21187806.12901.21277.22259.472872.583981.25
Economic profitability211872.716.892.394.661.846.44
Financial profitability2118713.3417.197.9411.6733.4718.21
Current ratio211871.074.330.951.051.4527.14
Liquidity ratio211872.35.40.961.25.2429.04
EBITDA/Total liability211870.050.10.050.080.020.078
Solvency ratio 1211870.060.250.060.150.020.42
Solvency ratio 2211870.220.680.150.420.2391.39
EBIT margin211877.177.843.246.0612.6612.4
Profit margin211874.547.382.495.577.968.05
Debtors’ collection period21187102.7282.5785.8480.22109.8550.16
Creditors’ payment period2118756.2343.745.141.3246.0230.68
Asset turnover211870.010.050.010.030.0140.04
Fixed asset turnover211870.291.840.040.12.6315.55
Salaries/Sales211870.190.210.140.170.190.16
EBITDA/Sales211870.10.120.050.090.170.12
Cash flow2118738,603.4513,436.963292.745729.42214,364.8322,865.52
Operating cash flow211873.04−0.70.420.1531.8527.7
Investment cash flow21187−2.86−5.9−0.06−0.159.7932.76
Sales variation rate2118714.429.368.118.6946.3315.12
Results before tax variation rate2118743.7163.636.163.12156.03268.55
Results variation rate2118755.92323.80.028.79364.982187.42
1: UQ: unqualified opinion; Q: qualified opinion.
Table 4. Classification results.
Table 4. Classification results.
TrainingValidationTesting
MeanS.D.MeanS.D.MeanS.D.
Overall accuracy (%)0.8650.0150.8250.0430.8250.042
F-measure0.8640.0140.8240.0420.8240.041
Precision0.8920.0160.8500.0440.8500.042
Sensitivity0.8390.0140.8000.0410.8000.040
Specificity0.8910.0150.8510.0440.8510.042
Table 5. Collinearity statistics.
Table 5. Collinearity statistics.
VariableToleranceVIF
Industry0.9801.020
Group size0.7881.268
Auditor code0.6381.567
Audit fees0.5081.967
Board members0.7751.291

Share and Cite

MDPI and ACS Style

Sánchez-Serrano, J.R.; Alaminos, D.; García-Lagos, F.; Callejón-Gil, A.M. Predicting Audit Opinion in Consolidated Financial Statements with Artificial Neural Networks. Mathematics 2020, 8, 1288. https://doi.org/10.3390/math8081288

AMA Style

Sánchez-Serrano JR, Alaminos D, García-Lagos F, Callejón-Gil AM. Predicting Audit Opinion in Consolidated Financial Statements with Artificial Neural Networks. Mathematics. 2020; 8(8):1288. https://doi.org/10.3390/math8081288

Chicago/Turabian Style

Sánchez-Serrano, José Ramón, David Alaminos, Francisco García-Lagos, and Angela M. Callejón-Gil. 2020. "Predicting Audit Opinion in Consolidated Financial Statements with Artificial Neural Networks" Mathematics 8, no. 8: 1288. https://doi.org/10.3390/math8081288

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop