1. Introduction
We investigate whether a significant relationship exists between factors highlighted in a CEO’s message in the sustainable management report and financial indicators of the firm. This study attempts to combine artificial intelligence (AI) technique-based sentiment mining to interpret text-based CEOs’ messages within the framework of the sustainability balanced scorecard (SBSC). The sustainability report is utilized here because it identifies the company’s economic, environmental, and social strategies from a managerial perspective [
1]. Further, the sustainability report includes the company’s financial, as well as non-financial, content [
2]. For instance, the following are examples of 2017 sustainable management reports that comprise textual financial content:
This sustainability report includes both financial and non-financial performance. Some major issues contain recent and past three years’ quantitative data to help readers’ understanding.
(Lotte Engineering and Construction)
In order to effectively respond to environmental changes in financial and non-financial risks that may occur in the entire process of business activities, including project orders, contracts, construction, and delivery, we operate a risk management team. We identified tasks that reduce construction costs, thereby improving profit margins.
(Samsung Heavy Industries)
Using this report, it is possible to assess and evaluate a company’s sustainability. In particular, the CEO message provides a condensed summary of this information, which is implicit in the manager’s beliefs and intentions. This study attempts to resolve several unexplored research issues using these qualitative CEO messages.
The specific procedures of this research are as follows. To analyze unstructured textual data, such as CEO messages, we employ a sentiment mining technique to extract the most frequently repeated keywords from CEO messages in sustainable management reports. To explore the content of CEOs’ messages found in sustainability management reports, we use the SBSC framework. SBSCs, that contain a sustainable management perspective, can facilitate overcoming the shortcomings of the conventional BSC method by taking into account environmental and social management factors. Consequently, to examine our research question most effectively, we utilize the SBSC framework that adds the CSR perspective and external business environmental perspective to the existing four perspectives [
3,
4,
5,
6]. For instance, we classify the keywords of CEO messages using six perspectives (customer, learning and growth, internal process, financial, corporate social responsibility, and the external business environmental perspective). We also elucidate the relationships among each perspective of the CEO messages in the sustainable management report and a variety of corporate financial characteristics.
Our study contributes to the extant literature in the following ways. First, to the best of our knowledge, this is the first investigation to classify CEO messages contained in sustainable management reports by applying the SBSC framework. Although a few studies have examined the text in company disclosures, no study has yet systematically attempted to classify this text in accordance with sentiment mining and scholarly principles. Second, our results demonstrate that CEO messages generally do not possess significant relationships with financial status, meaning that CEOs usually deliver messages using a positive tone without reporting relevant financial performance. Thus, a missing link exists between a firm’s financial and non-financial disclosures. Finally, our findings provide several key policy implications. For instance, regulators should establish clear guidelines for CEOs’ sustainable management reports to mitigate concerns that the unfounded optimism contained in these reports misleads investors and results in poor decisions.
The remainder of this paper is structured as follows. First, we review the related prior works in the literature and develop the paper’s hypothesis. Next, we explain the research design and present the research results. Finally, we discuss empirical results and conclude the paper with implications for future research and practice.
3. Research Design
3.1. Sample Selection
In this study, we use firm-level data from 2016 to 2017. The sample consists of 129 firm-years listed in the Korea Stock Exchange (KSE). We collect sustainability management report data from the Business Institute for Sustainable Development (BISD) website [
50]. We use the KIS-VALUE [
51] and TS-2000 [
52] databases from the National Information and Credit Evaluation (NICE) and Korea Listed Companies Association, respectively, to extract our financial data. After deleting observations for financial industries, non-December year-ends, and missing financial variables, 129 firm-year observations are used for our empirical tests.
3.2. Sentiment Mining Technique for Analyzing Textual Data
Text mining is a methodology aimed at deriving useful information from unstructured or semi-unstructured textual data by utilizing natural language processing (NLP) technology [
53,
54]. This technique enables users to extract meaningful information from big text data, identify links to other information, and discern categories or themes within the text. Using Java-contained functions, the text is collected automatically. Unused words are removed in the process of collecting keywords.
Sentiment mining is a method that extracts keywords and assigns quantified values to them, identifying whether the words have positive, neutral, or negative tone through emotional analysis. This method permits us to determine the main content of the text and, simultaneously, identify the level of positive or negative tones. The specific procedures used in this research for sentiment mining are as follows.
First, we use the bag-of-words (BoW) method [
55,
56,
57,
58] to extract words that are most frequently repeated in the CEO message of the sustainability management report. The term frequency-inverse document frequency (TF-IDF) matrix, which plots the frequency of word repetition in the sustainability report, is created by using the BoW method. The TF-IDF is most commonly employed in text mining vectorizing methods [
59,
60,
61].
Each word of the text derived from BoW text mining is then assigned sentimental values. The sentimental value constitutes the classification of extracted words as being used in positive or negative terms in the texts. Since no prior lexicon exists for the sustainable management report, this study directly determines the sentimental value of the sustainability management report for the first time. Eight experts (two certified public accountants, two professors of business, two management field consultants, and two CEOs) in relevant fields of sustainable management reports perform this task. Each specialist assigns a sentimental value and verifies his or her agreement with the intra-class correlation (ICC) test. Through repeated review and data-sharing, the degree of agreement of the sentimental value exceeded 99%. In this research, the sentimental value of the words is taken to have a total value of seven levels. Specifically, the most positive words are assigned +3 points, the most negative words are assigned −3 points, the neutral words are assigned 0 points, and others are located in the range of −3 to +3. As a final step, the CEO’s message data are arranged based on the lexicon of the sustainability management report. The final sentimental values are measured by a weighted average of the TF-IDF values. To the best of our knowledge, the lexicon for sustainable management reports established in our study constitutes the first approach in this research field.
3.3. Classifying Sustainability Management Perspectives by SBSC Framework
Since Kaplan and Norton introduced the concept of the balanced scorecard (BSC) [
30], numerous studies have performed related empirical and theoretical analyses [
29,
31,
32,
33,
34,
35]. The BSC is also widely utilized in business practice [
33], as it identifies interactions among learning and growth, customers, internal processes, and financial perspectives. The four perspectives of the BSC are linked by cause-and-effect associations [
29]. By extracting key success factors based on these four perspectives, the BSC approach facilitates the achievement of the firm’s strategies and goals [
34]. Indeed, for sustainable business success, BSC can suggest success factors and provide long-term strategies [
37].
During the past decade, the BSC approach has evolved to consider factors for sustainable management. This new framework, i.e., sustainable management with the BSC framework, can support or overcome the shortcomings of the traditional method, which does not consider social management factors. Following recent prior research, we use the SBSC framework that adds a CSR perspective to the existing four perspectives [
3,
4,
5,
6]. In addition to these five factors considered in SBSC, the CEO’s message in the sustainable management report includes a considerable number of keywords on the business environment outside of the company. We classify the keywords of CEO messages using six perspectives (customer, learning and growth, internal process, financial, corporate social responsibility (CSR), and external business environment).
3.4. Financial Indicators
In this study, we examine whether CEO messages predict future financial performance and firm value. Therefore, we utilize the major financial ratios that are generally present in financial statement analysis to assess corporate performance, such as rates of profitability, liquidity, growth, stability, and activity. Further, to investigate potential growth probability, we use a firm value indicator.
Proxies of the firm’s profitability return on assets (ROA), return on equity (ROE), and cash flow operating (CFO). These measures reveal a company’s efficient use of assets and management of its expenses to generate a certain rate of return. Proxies of liquidity comprise the current ratio (CUR), quick-asset ratio (QUICK), and defend interval (DEFINT). These measures show short-term cash usability to pay debts and other expenditures. The proxies of growth are total asset growth rate (ASSGRW), sales growth rate (REVGRW), and tangible asset growth rate (TANGRW). The proxies of the stability ratio comprise debt-to-equity ratio (LEV), borrowings-to-asset ratio (BOR), and average after-tax interest from total borrowings (COD). Activity proxies include total asset turnover (ASSTOV), working capital turnover (WCTOV), and tangible asset turnover (TANTOV). These indicators reveal the firm’s efficiency of given resources to generate profits. The measurements of firm value are price-to-earnings ratio (PER), price-book value ratio (PBR), and Tobin’s Q (TQ). These proxies capture the firm’s potential growth according to market expectations. The above financial ratios are summarized into six categories as shown in
Table 1.
3.5. Research Methodology
Our research framework is as follows. First, we quantify the CEO message into six perspectives. We multiply each word’s TF/IDF with the weight assigned discretionarily (refer to
Section 3.2 for details). Second, we categorize the words extracted from the CEO greeting message in a sustainable management report into five SBSC perspectives, including financial, customer, internal process, learning and growth, and CSR. Here, we face mechanistic problems in applying the original SBSC framework. First, most of the words used in CEO messages are generic, and could not be classified into the SBSC framework. Second, certain word-types, such as adjectives, adverbs, bound nouns, and postpositions depend highly on other words. Third, and more interestingly and importantly, some words are not related to the firm’s inner information, but rather explain the external environment, such as economic policy, international economic conditions, etc. To solve the first and second problems, we omit both generic common words and dependent words. To mitigate the third problem, we add the business environment perspective into the original SBSC’s five perspectives, now constituting six categories.
We next calculate the mean values of weighted TF/IDF words depending on the six perspectives, as follows: financial (FIN), the customer (CUS), internal process (INP), learning and growth (LNG), CSR, and business environment (ENV). We define these mean values as
the SBSC score. In doing so, we are able to classify precisely where the CEO message places emphasis on the six categories.
Table 2 presents variables of six SBSC perspectives based on TF/IDF calculations.
We then divide the sample into two groups by each median of weighted TF/IDF of the abovementioned six indicators. We determine a high SBSC group if an observation has a higher SBSC score than the corresponding median value. We next compare the mean values of financial indicators and firm value proxies between the high BSC and low BSC groups using univariate
t-tests. Subsequently, we classify CEO messages into six perspectives based on the SBSC framework. Finally, we test the associations between CEO messages and financial ratios.
Figure 1 summarizes our research methodology.
4. Empirical Results
4.1. Descriptive Statistics
Table 3 presents the descriptive statistics of our sample. First, mean values of each word’s TF/TDF according to the SBSC framework are all positive, suggesting that the CEO message in a sustainable management report is written using primarily optimistic and positive words. The mean (median) values of return on asset (ROA) is 0.043 (0.033), return on equity (ROE) is 0.075 (0.062), and cash flow from operating ratio is 0.080 (0.046). The profitability of the firm reporting sustainable management report is generally favorable. The mean (median) values of current ratio (CUR) is 2.326 (1.254), quick asset ratio (QUICK) is 1.989 (1.032), and defensive interval (DEFINT) is 0.428 (0.150). The sound thresholds for the current ratio and quick asset ratio are 200% and 100%, respectively. In addition, the quick asset ratio is generally safe for short-term debt coverage because the mean and median exceed the proper ratio. Given that the current assets constitute the sum of current assets and inventories, most of our sample firms have a low proportion of inventories. The mean (median) values of asset growth (ASSGRW) is 0.035 (0.031), sales growth (REVGRW) is 0.068 (0.037), and tangible asset growth (TANGRW) is 0.068 (0.431). From these results, we conclude that most of the firms issuing sustainable management reports are at the growth or mature stage.
The mean (median) values of debt-to-equity ratio (LEV) is 1.186 (0.904), borrowings-to-asset ratio (BORR) is 0.492 (0.306), and average after-tax interest from borrowings (COD) is 0.036 (0.032). Approximately 50% of the sample firms’ capital was raised from debt issues. Considering that the proper debt-to-equity ratio is 100%, even though some firms have a very high debt-to-equity ratio, others possess a sound financial advantage. The mean (median) values of asset turnover (ASSTOV) is 0.819 (0.700), working capital turnover (WCTOV) is 5.250 (3.660), and tangible asset turnover (TANTOV) is 18.967 (3.400). Finally, the mean (median) values of the price-to-earnings ratio (PER) is 32.149 (15.029), the price-book value ratio (PBR) is 1.738 (1.307), and Tobin’s Q (TQ) is 1.423 (1.106).
4.2. CEO Message in Sustainable Management Report and Financial Status
Table 4 shows the
t-test results that examine the mean differences of financial ratio in the year of the sustainable management report disclosure. First, in the financial perspective in the SBSC framework, high SBSC firms’ mean value of the current ratio (CUR) is significantly lower than that of low SBSC firms at the 10% level (
t = −1.92 *). Similarly, the mean value of the high SBSC group’s quick ratio (QUICK) is significantly lower than that of the low SBSC group at the 5% level (
t = −2.00 **). Further, Tobin’s Q (TQ) of the high SBSC group is significantly lower than the low SBSC group at the 5% level (
t = −2.01 **). No statistical significance is found in other mean differences in financial ratios. This result could suggest that firms with low short-term payment ability and low growth potential seek to compensate for their financial weakness by emphasizing financial performance through CEOs’ greeting messages in the sustainable management report.
Second, regarding customer perspective in the SBSC framework, high SBSC firms’ mean values of return on asset (ROA), return on equity (ROE), and defensive interval (DEFINT) are significantly higher than those of low SBSC firms at the 5% level (t = 2.00 **, t = 2.02 **, and t = 2.36 **, respectively). Moreover, all of the stability ratios, including debt-to-equity ratio (LEV), borrowing-to-asset ratio (BORR), and average after-tax interest from borrowings (COD) are higher in the high SBSC group than in the low SBSC group. Similarly, the mean value of asset turnover (ASSTOV) is significantly higher in the high SBSC firms at the 1% level (t = 3.28 ***). Firm value proxies, price-to-book ratio (PBR), and Tobin’s Q (TQ) of the high SBSC group are higher at the 1% and 5% level, respectively (t = 2.77 ***, t = 2.51 **). Collectively, firms that generate high profits by using given assets, and possess a good debt-raising ability and higher growth potential, use customer-friendly words in the sustainable management report.
Third, from the internal process perspective in the SBSC framework, high SBSC firms’ mean value of asset growth (ASSGRW) is lower. However, high SBSC firms’ average after-tax from borrowings (COD) is higher than the low SBSC firms’ average (t = −2.25 **, t = 1.70 *). This finding indicates that companies with decreasing sizes and high-interest rates, due to low credit ratings, would like to emphasize internal firm operational efficiencies.
Fourth, we find no statistically significant differences between high and low SBSC firms in the learning and growth perspective. All of the liquidity ratios of high SBSC firms are lower than those of low SBSC firms, despite their statistical insignificance.
Fifth, similar to the learning and growth perspective, there is no statistical significance in the mean differences of any financial ratio of high and low SBSC firms in the corporate social responsibility (CSR) category. We interpret this finding as firms emphasizing CSR in their sustainable management report not having any systematic differences in their financial status when compared to low SBSC firms.
Sixth, in the business environment perspective, all of the firm value proxies, including price-to-earnings ratio (PER), price-book ratio (PBR) and Tobin’s Q (TQ), are higher in high SBSC firms than in low SBSC firms at the 5% level (t = 2.04 **, t = 2.19 **, t = 2.49 **). These findings suggest that CEOs with high potential for future growth, but no outstanding current financial performance, tend to shed light on corporate external aspects to complement their short-term performance and provide expectations for their future performance.
4.3. One-Year Change in Financial Status after Disclosing the CEO Message in the Sustainable Management Report
In this section, we investigate how the financial ratios change after disclosing CEO messages through a sustainable management report. Specifically, using high and low SBSC group classification of the CEO message in 2016, we track the change in financial ratios from 2016 to 2017.
Table 5 presents the
t-test results comparing the change of the mean values of the financial ratios.
Table 5 also shows univariate mean differences of one-year-ahead changes in financial ratios between high and low SBSC groups. ***, **, and * denote significance levels at 1, 5, and 10%, respectively.
First, concerning the financial perspective in the SBSC framework, only the high SBSC firms’ change of Tobin’s Q (delta TQ) is significantly higher than that of low SBSC firms at the 10% level (t = 1.70 *). Other financial ratio change differences are not statistically significant, meaning that the CEO message related to the financial perspective has little or no impact on the firm’s financial performance. Nevertheless, it does increase potential growth probability, revealing that positive tones in CEO messages are positively perceived by investors.
Second, in the customer perspective in the SBSC framework, we find no statistical significance, suggesting that emphasizing customer perspective through the CEO message does not influence future financial status or even firm value.
Third, in the internal process perspective, high SBSC firms’ change of current ratio (delta CUR), quick asset ratio (delta QUICK), and defensive interval (delta DEFINT) are significantly higher than that of low SBSC firms. These results imply that firms emphasizing the efficiency of internal processes who experienced low activity and a high cost of debt financing in the previous year increase liquidity in order to manage short-term payment ability.
Fourth, concerning the learning and growth perspective, the change of each firm value measurement, including price-to-earnings ratio (delta PER), price-book ratio (delta PBR), and Tobin’s Q (delta TQ) is significantly higher than that of the low group (t = 1.73 *, t = 2.25 **, t = 2.50 **). This finding indicates that certain references made by the CEO, such as education for employees and visions for the future, can provide investors with a positive indication of the company’s prospects, ultimately resulting in a positive impact on firm value.
Fifth, firms whose CEOs focus on CSR in the sustainable report experienced decreased profits. High SBSC firms’ change of return on asset (delta ROA) and return on equity (delta ROE) is lower than that of low SBSC firms. In contrast, liquidity improves at one year after reporting the CSR message. Moreover, the high SBSC firms’ change of current ratio (delta CUR) and quick asset ratio (delta QUICK) is higher than that of the low SBSC firms at the 10% level (t = 1.70 *, t = 1.75 *). These results could indicate that a firm that is expected to decrease profitability aims to mitigate its negative performance by emphasizing social responsibility activities. However, as the liquidity of these firms increases, they decide to retain cash rather than carry out CSR activities.
Sixth, no significant difference exists in financial ratio and firm value change between high and low SBSC firms in the business environment perspective. Thus, a CEO focusing on the external environment has little or no impact on change one-year-ahead of financial status.
4.4. Multi-Regression Analysis
In this section, we report the multi-regression results, which are addressed in
Table 6. Panels show the results of using profit, liquidity, growth, stability, activity, and value indicators as dependent variables. Current ratio (CUR), asset growth (ASSGRW), leverage ratio (LEV), the natural logarithm of total assets (SIZE), the ratio of fixed assets to total assets (PPE), and the firm’s operating years (AGE) are included as control variables. ROA is also used as a control variable but is not used in Panel A because we have the same variable as a dependent variable.
In Panel A, the results demonstrate that the customer relationship perspective relates positively to profitable indicators, such as ROA, ROE, and CFO. In Panel B, CSR relates to higher liquidity levels. In Panel C, we find no statistically significant relationships among the six perspectives and growth indicators. In Panel D, both FIN and CUS are positively correlated with two stability indicators. Moreover, ENV exhibits a marginal relationship with activity indicators in Panel E. Finally, in Panel F, we find a positive association between ENV and value indicators.
To summarize, we find a significant association between CSR and liquidity indicators, which is similar to the results of the univariate test. Moreover, the relations of FIN, CUS, and stability indicators and ENV and value indicators are only significant in the regression analysis. Since multi-regression tests show the coefficient after controlling the effect of other perspectives, as well as controls on the dependent variables, we conclude that considerable numbers of financial ratios relate to our SBSC perspectives.
5. Summary of Results and Discussion
Firms with low short-term payment ability and low growth potential seek to compensate for their financial weakness by emphasizing financial performance through CEO messages in sustainable management reports. Firms that generate high profits by using given assets efficiently, and possess a strong ability to raise debt and good growth potential, utilize customer-friendly words in the sustainable management report. On the other hand, companies with decreasing sizes and high-interest rates, due to low credit ratings, would like to emphasize internal firm operational efficiencies. Firms emphasizing corporate social responsibility in their sustainable management reports possess certain financial characteristics and potential growth probability. CEOs with a high potential for future growth, but no outstanding current financial performance, tend to shed light on corporate external aspects to complement their short-term performance and provide expectations for their future performance.
We now turn to a discussion of the change test. First, based on the results, we cannot reject our null hypothesis, which predicts that no systematic associations exist between perspectives of CEO messages in the sustainable management report and their financial ratios. Second, CEO messages related to financial perspective have little impact on the firm’s financial performance, but they do increase potential growth due to investors accepting the messages positively. In addition, emphasizing the customer perspective through a CEO message does not influence future financial status or even firm value. Corporations seem to emphasize the efficiency of their internal processes when they suffered from a high cost of financing debt in the previous year. References by CEOs, such as education for employees and visions for the future, can provide investors with a favorable indication of the company’s prospects, ultimately resulting in a positive impact on firm value. Moreover, firms that are expected to experience reduced profitability aim to mitigate their negative performance by stressing social responsibility activities. As the liquidity of these companies increases, however, they retain cash rather than carry out CSR activities. Finally, the CEO message, as it is related to the external environment, exerts no impact on future growth.
The results of this study constitute evidence that the text of a qualitative report can provide an indication to predict the financial ratios of the firm. This is believed to be because the manager is already acutely cognizant of the financial performance or financial condition of the firm when he or she composes the CEO message.
6. Conclusions
The results of the association between CEO messages in sustainability management reports and financial indicators provide useful information about a company’s sustainability management. The content of the CEO message in the sustainable management report is systematically classified by using the SBSC, considering the sustainability management perspective. We compare six perspectives of the SBSC with various financial indicators of the company.
Barkemeyer et al., argue that, despite the increasing standardization of sustainable reporting, the CEO message in the sustainability management report focuses more on managing the firm’s impression than it does on the content of its responsibilities [
26]. Our results also demonstrate that the content of the CEO message in the sustainability management report consists largely of positive words. In addition, keywords related to the CSR perspective do not have a significant relationship with financial indicators. Qualitative disclosure data, such as CEO messages, are generally deemed to be unreliable in the context of financial status, and requisite attention and efforts are needed to improve it. Finally, we use 2016 and 2017 data in our tests. The sustainability management report data are collected from the Business Institute for Sustainable Development (BISD) website. To date, it only provides data for those two years. Due to this limitation of data availability, we acknowledge that our results should be generalized with caution.
The main implications of this research are as follows. First, this study quantified unstructured text data using sentiment mining for empirical analysis. This research methodology is anticipated to expand the scope of the field of study by making qualitative data available for empirical analysis. Second, we increased the robustness of our results by connecting the research fields of accounting, finance, and MIS by linking financial ratios to textual mining. We believe that our study and approach will enable new and promising future research directions in a variety of fields.
The results of this paper prompt us to strengthen the supervisory standard for qualitative disclosures in practice. Since our findings reveal that CEO messages generally lack sufficient information about the firm’s financial status, guiding these textual disclosures through regulation is necessary. Second, the results of this study highlight the importance of fair and honest disclosures to corporate managers. It also identifies the importance of qualitative disclosure data to inform users who utilize the firm’s published data. Third, although we found limited evidence for associations between CEO messages in sustainability reports and financial ratios, our research still provides a valuable contribution to related practice. For instance, the United Nations (UN) announced a plan to pursue sustainable development goals (SDGs) by 2030 (
https://www.un.org/sustainabledevelopment/sustainable-development-goals/). Given this international business environment, the importance of a company’s sustainable management report is determined to be more imperative than any other report. Furthermore, the SBSC framework used in this study proved to be a meaningful vehicle for analyzing the qualitative data expressed in the sustainability management report.