Next Article in Journal
Location-Based Tracking Data and Customer Movement Pattern Analysis for Sustainable Fashion Business
Previous Article in Journal
Moving to Private-Car-Restricted and Mobility-Served Neighborhoods: The Unspectacular Workings of a Progressive Mobility Plan
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Identification of Overall Innovation Behavior by Using a Decision Tree: The Case of a Korean Manufacturer

1
Department of Industrial Engineering, Seoul National University, Seoul 08826, Korea
2
R&D Investment and Analysis Center, Korea Institute of Science and Technology Information, Seoul 02456, Korea
Sustainability 2019, 11(22), 6207; https://doi.org/10.3390/su11226207
Submission received: 6 September 2019 / Revised: 1 October 2019 / Accepted: 2 November 2019 / Published: 6 November 2019
(This article belongs to the Section Economic and Business Aspects of Sustainability)

Abstract

:
Based on the two recent consecutive Korean Innovation Surveys in 2014 and 2016, this research empirically identifies the influencing factors and overall behavior of innovation success and failure in the manufacturing industry by using decision-making tree analysis (DT). The influencing factors and behavior of a successful innovator are also investigated from the perspectives of financial contribution, innovation activity, and research and development (R&D) activity. By using DT, this study acquires comprehensive knowledge of the arguments on innovation factors and behaviors in different contexts over time while dealing with all the factors in a single statistical framework based on the Oslo manual. Results with around 80% predictive accuracy show that the role of R&D is crucial for innovation success. The larger the firm size and the older the firm, the higher the success achieved by the firm will be. Firms in a low-technology industry prefer other innovation activities rather than R&D. Concerning a successful innovator’s behavior, target market characteristics that drive a firm to seek market needs influence innovation behavior and the use of information for innovation. Firms prefer implementing low-cost R&D activities across sectors, but firms in low-technology sectors prefer non-R&D activities. Regional characteristics of well-established business environments help firms to focus on R&D activities and reduce costly non-R&D activities. Most firms having R&D institutes focus on conducting in-house R&D using their own information. Cooperative R&D is conducted for closing capability gaps, but absorptive capacity is required to complement cooperative R&D. These empirical findings reaffirm the arguments on innovation behavior and arrange them in the overall perspective; they also provide managerial and political implications. Establishing and strengthening private or public R&D support programs to increase the capability of both in-house and cooperative R&D through funding as well as leveling up the information environment on technology and the market is crucial to the national innovation system.

1. Introduction

Given the fiercely competitive business environment in the globalized economy that has evolved over the years, innovation success plays a crucial role in promoting sustainable growth at the firm, industry, and national levels [1,2,3,4,5,6,7]. Therefore, numerous academic researchers, managers, and policymakers have conducted frequent examinations on the structure of successful innovation in terms of its inherent factors and behaviors in various aspects of political, strategical, or managerial landscapes [8,9,10,11,12,13,14].
The famous Scientific Activity Prediction from Patterns with Heuristic Origins (SAPPHO) project conducted by the Science Policy Research Unit (SPRU) was deliberately designed in the 1970s to test generalizations of innovation based on a comparative analysis of paired successful and unsuccessful innovations on the first large-scale national level [15,16,17]. Since then, innovation studies have mainly focused on factors influencing the success and failure of innovations and their behavior as well as successful innovative firms. Additionally, the focus of these studies has gradually shifted to specific subjects to acquire knowledge of the in-depth mechanism of innovation behavior, thereby leading to a close investigation of the overall structure [18,19,20,21,22,23,24,25].
Despite these efforts that have evolved over the past decades, there is a lack of understanding of the precise prescription of innovation [18,19]. Previous studies have pointed out the following three underlying reasons. First, the intrinsic complex context of innovation makes it difficult to contribute toward a comprehensive and precise prescription of successful innovation [20,21]. Additionally, several variables and behaviors related to innovation have been identified in various empirical studies. These variables have sometimes led to a conflicting conclusion or have failed to exert a significant impact on innovation. Second, the aforementioned gap can be attributed to the difficulty faced by empirical studies in maintaining consistency in measuring innovation based on the existing definition of innovation and by various proxy measures with differing perspectives [22,23]. Third, changes in the business environment and different contexts of innovations over time may have also attributed to the gap [24,25,26].
The aforementioned shortcomings emerge from different contexts of empirical studies and their proxy measures, which have been changed over time. Additionally, the reason studies were conducted on specific subjects can be attributed to innovation data and statistical methodologies. Innovation data have been measured together by various types of ratio, interval, ordinal, and nominal variables. These characteristics of innovation data in terms of type and scale have restricted methodological application. Innovation data are usually measured on a nominal scale (categorical variable). Additionally, they are frequently measured on a binomial scale, such as innovation success and failure, regardless of whether R&D is performed and whether innovation activities are conducted. These kinds of whether or not problems make it difficult to apply advanced statistical methodology. This problem, involving different types of variables, requires well-structured analytical models, which can ensure comprehensive results in a single statistical significance framework. Since previous research results cannot be put in a single frame while retaining the same statistical significance, comprehensive research based on a single frame would be necessary.
The development of data mining methodologies has recently increased the application of these methodologies to studies on innovation [27,28]. Decision-making tree analysis (DT) is one of the predictive modeling techniques commonly employed in the data mining domain. DT produces a robust model that predicts the value of a dependent or target variable from various independent or input variables. Additionally, the DT algorithm provides an accurate prediction model and visualization. It also deals with both numerical and categorical variables. In addition, DT performs very well with large datasets and produces easily comprehensible and interpretable results [28]. In this respect, the application of DT to innovation studies can be considered suitable in terms of the freedom of using various proxy measures together, which are mostly measured categorical variables with numerical variables. Additionally, DT reduces the burden of developing structured analytical scenarios required when employing statistical methodologies due to constraints involving innovation data characteristics. In these regards, DT can present a comprehensive knowledge of factors influencing innovations and their behaviors in an interpretable format through a single and statistically significant predictive framework treating different types of variables together, regardless of them being categorical or numerical variables.
The methodological advancements in the field of data mining and the increased feasibility of using large-scale innovation data have increased the possibility of facilitating a comprehensive understanding of factors influencing innovation and behavior. Given the improved innovation study environment in terms of data and methodology, this study aims to acquire knowledge of sustainable innovation behavior based on evidence from the Korean manufacturing industry. Considering these aspects, this study investigates factors influencing the success and failure of innovation and behavior as well as successful innovative firms from a longitudinal perspective, by using the DT analysis model based on the Korean Innovation Survey (KIS) data on 8075 manufacturing firms for the past two consecutive surveys (in 2014 and 2016).
Accordingly, the first objective of this study is to examine the sustainable behavior for the success and failure of innovation by capturing changes from a longitudinal view in accordance with the guidance from the Oslo Manual, which maintains international principles for measuring innovation. The second objective of this study is to investigate the sustainable behavior of successful innovative manufacturers from the perspectives of innovation activities and contribution. With these research objectives in mind, this study intends to contribute toward mitigating the shortcomings of comprehensive knowledge by treating all the factors, which are used in KIS based on the Oslo Manual, in an analytical and predictive DT model through a single statistical significance framework. As an empirical study on the Korean manufacturing industry, this study reaffirms comprehensive innovation behavior investigated in previous studies by determining factors that significantly influence innovation and behavior. From empirical findings on the Korean business environment, this study provides sustainable implications for the current era.
On the other hand, although the aims of this study focus on the identification of comprehensive innovation behavior by using DT that is highly predictable and easily interpretable, the nature of DT regarding a non-parametric analysis makes it difficult to comprehend the in-depth underlying mechanism of innovation behavior. Thus, it is worthwhile to validate the hypotheses constructed based on the significant findings from DT. In advance, regional and sectoral factors are particularly identified in the success and failure of innovation in this study, in addition to the role of R&D, which is the most significant and important factor, and factors, such as firm size and age, which are intrinsic general factors of the firm involving R&D. In addition, concerning successful innovative firms, these regional and sectoral factors related to the target market are determined to influence the innovation behavior of focal firms. Therefore, this study subsequently tests the hypotheses that there are differences in innovation success according to the region and sector.
The rest of this article is organized as follows. In Section 2, the previous relevant studies in the domain of innovation are introduced. In Section 3, data, variables, research framework, methodology, and the model used in this study are presented. Section 4 presents the empirical results of the DT analysis model and discusses the findings derived from them. Section 5 constructs and verifies hypotheses derived from the findings in Section 4. Section 6 provides the implications drawn from the findings and future directions of the research.

2. Literature Review

Innovation has been understood and defined in different contexts according to the time and circumstances of previous studies as concepts of invention, exploitation, implementation, and commercialization [16,18,19,29]. It has been operationally defined with various proxy measures. This has made it difficult to maintain consistency in innovation measurement and interpret results across empirical studies with different perspectives in different contexts. Previous studies have identified the main influencing factors determining the innovative behavior along with its definition [18,19,30,31,32,33,34]. It is claimed that the definition and measurement of innovation in the literature is highly theoretical [35]. Additionally, it has been claimed that these cannot be straightforwardly applied to businesses [35,36], as they are complex and include diverse influencing factors [18,19,26,37]. It was claimed that a common overall innovation measurement framework does not exist [18,19].
Thus, standardized guidance for measuring innovation needs to be used to maintain consistency and to facilitate comparativeness with another context [19,21,38]. Hence, the Organization for Economic Co-operation and Development (OECD) has provided guidelines through the Oslo Manual for measuring innovation and related factors in the international perspective. It has been standardized and applied empirically worldwide [38]. The KIS has also been developed on the basis of the Oslo Manual. It has been conducted since 2003, biennially or triennially, by the Science and Technology Policy Institute (STEPI). The KIS is the national authorized statistics approved by “Statistics Korea,” which is a central government agency. It has been well-conducted over the past two decades by trained facilitators to measure innovation activities with high quality. The survey questionnaires of “KIS: manufacturing industry” have been consistent over time. Accordingly, this study can design a longitudinal research framework and produce consistent results in the manufacturing industry. Based on the Oslo Manual, related innovation factors involving not only contextual factors, but also intrinsic ones can be considered from theoretical, managerial, and political perspectives.
In this study, innovation is defined as “the implementation of a new or significantly improved product, or process, a new marketing method, or a new organizational method in business practice, workplace organization or external relations,” according to the guidance of the third edition of the Oslo Manual in 2005 (fourth edition was published in 2018 in which the definition of innovation was changed) [38]. The data used in this study are obtained from the “KIS: manufacturing industry” in 2014 and 2016, which are based on the third edition of the Oslo Manual. In this sense, innovation activities are defined as “including all scientific, technological, organizational, financial and commercial steps which actually lead, or are intended lead, to the implementations of innovations,” as per the third edition of the Oslo Manual [38].
Concerning the identification of innovative behavior, extrinsic and intrinsic determinants have been empirically explored in various perspectives. Extrinsic determinants are related to a firm’s business environment. The main extrinsic factors comprise the industry to which the firm belongs and the region where it is located. The other factors are related to the cooperative networking environment involving knowledge or technology flow. Additionally, market-related factors were noticeably examined for innovation behavior.
It is widely accepted that industry and regional characteristics are significant to innovation behavior. Examinations have revealed that the industry factor has significantly affected innovation in terms of technological dynamism, demand growth, and industrial structure. Concerning technological dynamism, it is found that high-tech industries are more innovative than traditional ones [29,39,40,41,42]. Concerning testing the demand-pull theory, demand growth has a significant positive impact on innovation [43,44,45]. Regarding industrial structure, the empirical results are diverse. Industry concentration is found to have a negative [45,46,47] or positive [48,49] effect. Additionally, other studies showed a bell-shaped [50] or an insignificant [43,51,52,53] relationship between innovation and industry concentration. The regional factor is found to have had a significant impact on innovative capacity [29,54,55,56,57,58,59]. Concerning location characteristics of proximity to partners, which increases cooperation with suppliers, customers, and universities, it was found to positively influence innovation [42,58,60,61,62,63]. Proximity facilitates tacit knowledge transfer [64,65] and reduces communication costs [66]. Cooperative networking could be understood as a corporate capability, but it is more reasonable to be considered in relation to the business environment [35,62,67,68,69]. Several studies show that the correlation between innovation and interaction with networking partners is positive [58,62,67,68,69,70,71]. However other studies identified that it is not significant [50,72]. Despite these conflicting findings, it is consciously accepted that cooperative networking helps a firm to bridge gaps in its information, scientific knowledge, resources, and competencies [61]. Market focus plays an important role in product success [18,73,74,75]. Demand and supply determine the success of a business [45,67,74,76]. Hence, target market characteristics, including customer type and customer feedback, affect innovative behavior for product and business success [18,77,78,79]. These market-related factors have driven firms’ innovative behavior, such as detecting customer needs [22,69,80,81,82], advertising [47,83], and elaborating marketing strategies [79,84]. Although there are some negative or insignificant effects of industrial and regional characteristics as well as cooperative networking and market characteristics on innovation, their positive effects are widely accepted from the perspective of promoting innovation [18,19,24,55,61,63,79]. This study considers these extrinsic innovation-related factors, and information on these factors are collected in the KIS.
Intrinsic determinants of innovation have mainly been studied in the view of capability theory by organizational theorists since the late 1960s [69]. It could be categorized into the following: (1) The general characteristics of a firm, (2) innovative capability, and (3) innovative activities.
Although a firm’s general characteristics, size, age, and ownership have been determined, but these have not provided an understanding of the precise prescription of innovation. Concerning the relationship between firm size and innovation, there have been conflicting results. The main arguments are as follows. On the one hand, small firms have an advantage in the management of innovation [85]. On the other hand, large firms have more resources to innovate than small ones [86,87,88,89,90,91]. Another study revealed two different relationships, which are U-shaped and hump-shaped in the case of German, France, and Belgium firms in the 1980s [92]. It is argued that this phenomenon might be influenced by other factors, such as industry condition and structure [92]. The debate on these Schumpeter Mark I and II hypotheses [93,94] is still being explored. There are also arguments about the relationship between firm age and innovation. On the one hand, firms accumulate the experience and knowledge to innovate with age [95,96]. On the other hand, older firms resist innovation by establishing procedures with a stable barrier [97]. This claim of two positions has not been verified sufficiently. Thus, hasty generalization cannot further our understanding. Regarding ownership, results were also mixed. It is revealed that foreign ownership is positively correlated with innovation [44,52,98], whereas it was found that foreign ownership had a rather negative [52,72,99], or insignificant [100,101] impact on innovation. These arguments lie between the viewpoint of a lack of important management in a foreign-owned firm and that of compensation for the advanced management of knowledge for innovation from the foreign parent [18].
Concerning a firm’s innovative capability, R&D capability has been mainly examined. R&D capability is related to the firm’s financial and organizational capacity [51]. The capacity in this sense refers to employees, including R&D personnel, and investment resources, which have a relationship with budget and cost. For example, the R&D personnel ratio and R&D investment (e.g., R&D intensity) have a positive effect on innovation [102,103]. Additionally, the R&D budget is a factor influencing innovation [35,104,105,106]. However, given that R&D cost is limited and secured, these factors are not enough to explain innovation [107]. Although investment in innovation leads to innovation performance [57] and R&D-related factors are good representatives of organizational capacity [61], these cannot contribute toward a firm’s overall innovative capability [18]. It is also argued that all innovations are not based on R&D [19].
Concerning the firm’s innovative activities, R&D activities have been mostly examined. R&D is accepted to be the most important determinant of innovation [18,19,35,57,61,62,67,69,74,102,103,104,105,108,109,110,111,112]. The manner in which R&D activities are performed can be categorized into in-house R&D, cooperative R&D, and external R&D. In-house R&D constitutes the major channel for carrying out R&D activities, and it is considered the most crucial factor of innovation for the manufacturer. In-house R&D naturally supports a firm to develop new products or processes [62,67,110,113]. It also provides the capability to absorb external knowledge and technologies [18,19,50,112,114,115,116] and to cooperate with different organizations, such as universities and research institutions [9,55,62,63,67,69,71,108,109,117]. By engaging in cooperative R&D, firms gain access to complementary technologies or knowledge [114,118,119], and they can improve the probability of success of an innovation project [120,121,122,123]. However, the instability and risks associated with R&D cooperation cannot lead to successful innovation [124,125,126,127,128,129]. Firms that have limited resources and capabilities for internal R&D consider external R&D [130,131,132]. Subsequently, they expand the possibility to develop new products with commercial success [133,134,135]. However, absorption capacity was found to be essential for complementing external R&D [136]. The role of external R&D for innovation by itself and its complementarity with internal R&D remains inconclusive [130,137]. While some findings of the effects of cooperative and external R&D are still being debated, the role of R&D for innovation has been widely accepted. Meanwhile, innovation is not only driven by R&D, and R&D activities cannot reflect the firm’s innovative capability [18,19,107,138]. In terms of business management, non-R&D activities are divided into the following six categories [38]: (1) Acquiring machine, tool, software, and building for operational management; (2) procuring external knowledge to develop new product or to improve process; (3) providing job training for educated, qualified, and experienced personnel; (4) undertaking market launching activities for new product penetration; (5) undertaking design activities for new product development; and (6) performing other activities.
This study considers these intrinsic innovation-related factors along with extrinsic ones to investigate innovative behavior because all these factors have been shown to be important determinants of innovation in the literature. These are summarized in Table 1.
Factors that are shown in the literature as affecting innovation are presented from a viewpoint of factors that affect innovation success or innovation performance. This innovation success or performance is mostly measured by patents [35,139,140,141,142], R&D intensity [105,140], and number of innovations (e.g., new product development or commercialization) [25,31,77,143,144,145,146,147]. These measurements focus entirely on the innovation itself, from mostly a technological perspective. Given the importance of innovation in business management, it is essential to look at the relationship between the firm’s financial performance and innovation [7,148,149,150,151]. Financial performance is defined as the earnings of a business through the sale of innovative products in the market [18]. For financial performance measurement, proxy measures, such as return on investment with innovation [152] and new-to-market and new-to business sales [150], are used. However, these studies examined the impact of technological innovation on financial performance. A study that examines the differences between companies with good financial performance and those with poor financial performance, among successful innovators, is still lacking. In this respect, this study attempts to explore the behavioral difference between groups contributing to sales through innovation and those without a contribution.
Additionally, there is a lack of research on the differences between companies that focus on R&D activities and those that focus on non-R&D activities, among successful innovators. Therefore, it would be worthwhile to identify differences in the innovation behavior among these groups by distinguishing successful innovators based on their R&D and non-R&D activities.

3. Research Design

3.1. Data and Variables

This study aims to identify sustainable influencing factors on innovation and behavior by using DT analysis with various innovation variables, based on a single structured framework, in the Korean business environment. Hence, the “Korean Innovation Survey (KIS): manufacturing industry” in 2014 and 2016 is used to analyze the behavior of manufacturers in Korea from a longitudinal perspective. The survey questionnaires of the “KIS: manufacturing industry” have been consistent over time. Based on this, the longitudinal analytical framework is structured in this study. The “2014 KIS” and “2016 KIS” contain firm-level data on the innovation-related activities from 2011 to 2013 and from 2014 to 2015, respectively.
Since the KIS is well-known for its reliability and the focal point on innovation, it has been used in the field of empirical innovation studies in Korea [153,154,155,156,157]. Concerning the representativeness of the national innovation activities of the KIS sample data on the manufacturing industry, the sample frame comes from the recent nationwide business survey by the National Statistical Office (NSO). It is stratified by the multistage-stratified-systematic-sampling based on the Korea Standard Industry Code (KSIC) and the number of employees in the firm. The Neyman allocation method was used for sample allocation. The 2014 KIS of the manufacturing industry covers 4075 manufacturers taken from a sample frame of 46,101 firms in the period from 2011 to 2013. The 2016 KIS of the manufacturing industry covers 4000 manufacturers taken from a sample frame of 49,704 firms in the period from 2013 to 2015. Manufacturers were categorized into 23 industrial sectors in the ninth version of KSIC, in which KSIC 10 to 33 fall under the manufacturing sector, except KSIC 12 (manufacturers of tobacco products). Firms were defined in 17 regions comprising 7 metropolitan cities, including the capital city, 1 special self-governing city, 8 provinces, and 1 special self-governing province.
In the KIS, firms were asked to indicate their status related to innovation and innovation activities. Basically, they were questioned about the success or failure of the innovation of products and processes. In this study, innovation success is defined as “an implementation of a new or significantly improved product or process.” Regardless of whether firms succeeded in innovation, they were commonly questioned about the following items in each category. In the category of the firm’s general information in terms of corporate capabilities for innovation, the following items were asked: (1) Form of the firm (legal unit); (2) statuary types (by the size of the employees from the sample frame); (3) designation status (in the Korean context); (4) listed status (in the Korean stock market); (5) size (sales, exports, and employee); and (6) age. Additionally, data on the sector to which the firm belonged, in terms of the KSIC at the two-digit-code level, was taken from a sample frame. The firms were also questioned about their regional location. Regarding the general R&D status, data regarding the “ratio of R&D personnel” and “manner of R&D activities” were collected. Concerning external factors that affect innovation, data on the “main target market” and “main customer types” were collected. These variables, measurement responses and descriptions, and scale are shown in Table 2, and their details are shown in Table A1 of Appendix A. Details of the sector variables as KSIC’s industrial codes on the manufacturing industry are listed in Table A3 of Appendix B.
Companies that succeeded in innovation were asked the following items. Concerning innovation activities, the following items were asked: (1) Whether or not eight types of innovation activities were implemented, (2) cost of each innovation activity, and (3) budget source of each innovation activity. In terms of knowledge flow and their relationship, the following items were asked: (1) Information sources used for innovation, (2) whether or not cooperative activity was carried out, (3) cooperative partner if the cooperative activity was carried out, and (4) the best cooperative partner if the firm had a cooperative partner. Concerning innovation outcomes, the firm was questioned about its “contribution of innovation to sales.” These variables, measurement description and responses, and types are shown in Table 3, and their details are shown in Table A2 of Appendix A.

3.2. Methodologies

Traditional statistical methods in innovation research have been restricted by characteristics of the innovation study data, although they intended to consider the overall factors. This study aims to solve this shortcoming by considering the overall factors in innovation by using DT analysis. This method allows the usage of various proxy measures comprising categorical and numerical variables in a single frame statistically.
Classification tree analysis and regression analysis are the two principal types of DT. The classification and regression tree (CART), chi-squared automatic interaction detection (CHAID), quick, unbiased, efficient statistical tree (QUEST), C5.0, and C4.5 are the most commonly used DT algorithms. The CHAID algorithm is capable of processing both continuous and categorical predictive (or independent) variables along with the target (or dependent) variables. Thus, CHAID develops decision trees for both the classification-type and regression-type prediction problems, regardless of whether the dependent variable is a nominal or a continuous numerical variable. Additionally, the CHAID algorithm is a nonparametric procedure that requires no assumption of the underlying data; for example, it does not require the data to be normally distributed [28,158,159,160,161,162].
In the CHAID algorithm, the F test is used if the dependent variable is continuous, and the chi-square test is used if it is categorical. The CHAID algorithm uses a multi-way splitting strategy, thereby creating interpretable models compared to CART [158,159]. Beginning with a root node that includes all cases, the tree branches are divided into different child nodes. CHAID is not a binary tree algorithm, and hence it can produce more than two categories at any level in the tree that differs from other decision tree algorithms. The criterion for branching (or partitioning) is selected after examining all possible values of all available predictive variables (at the Bonferroni-adjusted p-value of the statistical significance level). In the terminal nodes, a grouping of cases is obtained, such that the cases are as homogeneous as possible with respect to the value of the dependent variable.
Based on the advantage of the CHAID algorithm in terms of application and interpretation, this study used the CHAID algorithm by employing IBM SPSS 22. The settings in this study are as follows: (1) The value of the maximum tree depth is set autonomously; (2) both the splitting significant value and the merging significant value are set at 0.05; (3) the maximum number of recursive calculation is set at 100; (4) the misclassification cost is set to the same value for all categories; (5) the missing value is treated as not valid but missing; and (6) the minimum size of the parent and child nodes are set to be 100 and 50 cases, respectively.
In terms of validation, cross-validation is a general method used to estimate the unbiased accuracy of a predictive model’s performance in practice [28,159,162]. Ten-fold cross-validation is widely used in the data mining field since empirical studies have demonstrated that 10 constitutes an “optimal” number of folds [163]. It creates a fine balance between the sampling bias in terms of diversification of training and testing subsamples and demonstrating the time taken to build the model and test activities. In 10-fold cross-validation, the dataset is randomly separated into 10 mutually exclusive subsets of approximately equal sizes. The models are built and trained first and then tested, and the process is repeated 10 times. At each iteration, the model is trained on nine folds, combining training data that includes 90% of the total dataset. Additionally, it is tested on the remaining fold, which is 10% of the total dataset. The estimate of the cross-validation of the overall accuracy of the model is calculated by averaging the 10 individual accuracy measures that come from each fold. For the performance measure of prediction models, a coincidence matrix is used. It contains the actual and predicted classifications created by the model [164]. The overall accuracy is defined as the percentage of records that are correctly predicted by the model. In this study, a 10-fold cross-validation method is used to estimate the performance and overall accuracy. Additionally, the ratio of the number of true positive, which means the ratio of the correctly predicted case, is provided for each model.

3.3. Research Framework

The first research objective is to explore the overall behavior that affects the success and failure of an innovation. The second objective is to investigate the behavior of successful innovative firms in terms of innovation activities and contribution to sales. These two research objectives are presented in the research framework, as shown in Figure 1.
In order to gain recent comprehensive knowledge of factors influencing the innovation and behavior of the manufacturing industry, based on the latest KIS data, a sustainable perspective through a longitudinal analysis framework is developed, as seen in Figure 1. It is structured to examine the longitudinal consistency and variation based on the two consecutive 2014 and 2016 KIS.
The first module (Module 1) consists of two models, and the second module (Module 2) consists of eight models, as shown in Table 4. “Innovation success and failure” is used as a target variable in Module 1. In Module 2, each model has different target variables according to each of their corresponding purposes, which involve innovation contribution and innovation activities. The variables for which data is commonly collected, regardless of whether firms succeeded in innovation, are used in Module 1. In Module 2, variables that were asked only of successful innovative firms and those used in Module 1 are used.

4. Results and Discussion

4.1. Overall Influencing Factors and Behaviors between Innovation Success and Failure

Table 5 summarizes the case statistics and results of the two models of Module 1. This table presents influencing factors at the significance level of 0.05. It also provides the overall accuracy as well as the predicted accuracies of the success and failure classes.
Based on the 10-fold cross-validation, the overall forecasting accuracies of the models in 2014 and 2016 are the same at 79.4%. These accuracy levels are relatively high, close to 80%. Accuracies of the success class of each model are 40.2% and 71.2%, respectively. Accuracies of the failure class are 91.6% and 85.0%, respectively. Basically, based on the general information of firms, it is very complicated to forecast successful innovation. However, the accuracy levels of the classifications between innovation success and failure demonstrate the quality of the model. Additionally, the overall accuracy levels appear stable, coming from cross-validation and the big data scale. Thus, it allows us to conclude that these DTs are rational and sustainable. These results indicate that the general information of firms used in KIS, which are related to the general resources of capability for innovation, can distinguish innovation success from failure. Especially, these significant influencing variables obtained from the results of the DT analysis can effectively filter out firms that are more likely to fail in innovation.
At the national level, in the order of significance, factors affecting innovation success and failure in 2014 are found as follows: Ratio of R&D personnel; manner of R&D activities; size of exports (one year ago); and statuary types. In 2016, the following factors are found to be significant influencing ones: Manner of R&D activities; size of employee (one year ago); sector; firm age; size of sales (two years ago); size of employee (three years ago); region; and listed status. The results of these two models are much different from each other. The success class in 2016 was larger than that in 2014. It could be interpreted that the data in 2016 provides enough evidence for forecasting the success class compared to 2014. Nevertheless, the factor of the manner of R&D activities is identified to be a significant factor influencing successful innovation over 2014 and 2016 from a longitudinal viewpoint.
Concerning the behavior between innovation success and failure, the results of DT in 2014 and 2016 are shown in Figure A1 and Figure A2 in Appendix C. First, examining Figure A1 in 2014, DT starts with the first parent node of the ratio of R&D personnel. In the case wherein the value of the ratio of the R&D personnel is zero, which means an absence of R&D personnel, 98.8% of firms had failed in innovation. In the case wherein no R&D activity was carried out under the above condition (the absence of R&D personnel), entire firms failed in innovation. However, 16.1% of the cases of firms irregularly operating R&D if necessary, succeeded in innovation in the above group. In other cases, wherein the value of ratio of R&D personnel was not zero, factors of statuary types and exports level mostly explained the success and failure of innovation. Especially, the factors of the ratio of R&D personnel and statuary types (in terms of size) are presented in the third layer. These results indicate that these factors mostly explain the behavior of innovation success and failure, given that firms have R&D personnel. Comprehensively, the higher the ratio of R&D personnel and the bigger the firm size, the greater the success realized by firms will be. It reaffirms the arguments that R&D personnel affects positively [102,103] and that large firms have an advantage [86,87,88,89,90,91].
Second, investigating Figure A2 in 2016, DT starts with the first parent node of the manner of R&D activities. Of the 31% of firms with R&D institutes, 73.5% succeeded in innovation. In the case in which no R&D activity was carried out, only 7% of firms succeeded in innovation. This result reaffirms the argument that the role of the R&D organization is very important for the success of innovation, and this role should coincide with the capacity of the firm to perform R&D [18,19,35,57,61,62,67,69,74,102,103,104,105,108,109,110,111,112]. In the case of firms having R&D institutes to carry out R&D, the larger the employee size, the higher the success rate will be. The success rate is 57.6%, 73.1%, and 85.0% in the case of firms with less than 50 employees, 50 and 99 employees, and 99 employees, respectively. In the case of firms having R&D institutes with less than 100 employees, regional differences are identified between innovation success and failure. While in firms having R&D institutes with more than 99 employees, the success rate varies depending on the listed status in the Korean stock market. In these respects, the findings of this study support the observations that firm size positively affects innovation [86,87,88,89,90,91], innovation is influenced by regional differences [42,58,60,61,62,64,65,66], and R&D is crucial for innovation [18,19,35,57,61,62,67,69,74,102,103,104,105,108,109,110,111,112].
Concerning the cases in which R&D activity is not carried out, 18% of firms with 100 to 499 employees were successful. Under the above condition (no R&D activities with 100 to 499 employees), 28.4% of firms over 17 years of age and 10.6% of those under 17 years of age were successful. It indicates that, even though there is no R&D activity, the larger the firm size and the older the firm age, the greater the success of the firms will be. It supports the arguments that large firms have an advantage [86,87,88,89,90,91] and that older firms have an advantage [95,96] with successful innovation. Meanwhile, under the same condition that no R&D activity was carried out, 5.6% of firms with relatively low employees (less than 100) were successful. Among them, 13.6% of the firms belonging to the low-technology industry, such as the food processing (KSIC 10), printing and reproduction of recorded media (KSIC 18), and furniture manufacturing (KSIC 32) industries, were successful. Their success rate was relatively higher than the other industries. Based on this, for the low-technology industry, it can be interpreted that innovation is achieved in a different way from R&D. This behavior is also found in other branches wherein irregular R&D is carried out, if necessary, in the first layer. Under the above condition, firms belonging to middle- and low-technology industries, such as the food processing industry (KSIC 10); apparel, clothing accessories, and fur articles’ manufacturers (KSIC 14); and the manufacturers of leather, luggage, and footwear (KSIC 15), showed a higher success rate of 83% when compared to firms belonging to other industries, such as manufacturers of medical, precision and optical instruments, watches, and clocks (KSIC 27); manufacturers of electrical equipment (KSIC 28); manufacturers of other machinery and equipment (KSIC 29); and manufacturers of pharmaceuticals, medicinal, chemical, and botanical products (KSIC 21), which showed a 43.5% success rate. In this respect, this result identifies that firms belonging to the low-technology industry prefer other innovation activities than R&D. This finding supports the sectoral difference in innovation behavior [29,39,40,41,42,43,44,45].
The primary objective of this article is to find sustainable factors influencing innovation success. From the overall perspective at a national level, longitudinal common influencing factors over the years and variation over time are shown in Table 6. The factor of the manner of R&D activities is determined as a sustainable influencing factor. This finding reaffirms the argument that the role of the R&D organization is very important for the success of innovation, and this role should coincide with the capacity of the firm to perform R&D [18,19,35,57,61,62,67,69,74,102,103,104,105,108,109,110,111,112]. Additionally, the findings of this study confirm the significance of the influencing factors, such as the ratio of R&D personnel [102,103], exports size [61,67,96,108,150], statuary type (in terms of size), employee size [85,86,87,88,89,90,91,92], sector [29,39,40,41,42,43,44,45], firm age [95,96,97], sales size [74,77,78,103,150], and region [29,42,54,55,56,57,58,59,60,61,62,64,65,66], which have been determined in previous studies and have undergone changes over time.

4.2. Factors and Behaviors Influencing Successful Innovative Firms

4.2.1. Contribution of Innovation

To investigate the factors and behavior influencing successful innovative firms, in the order of significance, innovation contribution, case statistics, accuracies, and results at the significance level of 0.05 are presented in Table 7. The overall forecasting accuracies of the models on innovation contribution in 2014 and 2016 are 85.16% and 84.79%, respectively, as seen in Table 7.
These accuracy levels are relatively high. However, accuracies for the contribution and no-contribution cases of the models are 100.00% and 0.00%, respectively. These prediction models clearly identified successful innovative firms based on their contribution to sales in terms of their behavior. However, these models could not identify successful innovative firms that did not contribute to sales. These results indicate that successful innovative firms contribute via innovation to sales [150,152].
Factors influencing innovation contribution in 2014 are as follows, in the order of significance: Market launch activities; using information from the public customer; using information from a higher educational institute; in-house R&D; and using information from the private customer. A DT result examining the behavior between groups with and without a contribution to sales in 2014 is shown in (a) of Figure A3 in Appendix C. The (a) of Figure A3 starts with the first parent node of market launch activities. In the case wherein no market launch activities were carried out, information from the public customer and higher educational institute mainly distinguished the groups. Meanwhile, in the case wherein market-launch activities were carried out, in-house R&D and information from the private customer mainly distinguished the groups. These results, first, indicate that firms carrying out in-house R&D with information from the private customer emphasize more on R&D than on marketing. Second, it indicates that firms emphasize marketing by using information from the public customer. Third, firms, which do not use information from the public customer, focus on information from higher educational institutes. These results imply that an innovation’s contribution to sales is influenced by target market characteristics in terms of the public or private sector, which also affect the behavior of R&D activity [22,47,69,80,81,82,83,84].
In 2016, the significant influencing factors are identified as follows: Cost for acquiring a machine, tool, software, and building (level of percentage); source of budget; and using information from in-house or within the affiliate. A DT result of the innovation contribution model in 2016 is shown in (b) of Figure A3 in Appendix C. The (b) of Figure A3 starts with the first parent node of the cost for acquiring a machine, tool, software, and building; this is followed by branches divided by the nodes of source of budget and using information from in-house or within the affiliate. In the case of the low percentage of the cost for acquiring machine, tool, software, and building, firms that used information from in-house or within the affiliate are more likely to contribute to sales based on innovation. This result indicates that innovation increases the sales contribution to firms, which do not invest heavily in assets and focus on using their own information for innovation. Comprehensively, these results imply that firms’ strategical behavior related to in-house R&D, marketing, and investment on assets based on the characteristics of the target market affects contribution to sales from innovation. It is consistent with the claim that market characteristics drive a firm to seek market needs and to advertise [22,47,69,79,80,81,82,83,84,115] and that R&D investments positively affect innovation [35,104,105,106].
Another objective of this study is to find sustainable factors and behavior influencing successful innovators in terms of their contribution to sales. Among all the variables, intrinsic innovation activity-related factors are identified to significantly influence innovation behavior compared to the extrinsic factors that are related to the general innovation capacity of the firm. Although there have been no precise common factors, over the years, common categorical factors have served as the information source. It indirectly supports the arguments that cooperative networking for bridging information gaps among partners promotes innovation [58,61,62,63,67,68,69,70,71]. These findings are summarized in Table 8.

4.2.2. Innovation Activities

Table 9 presents case statistics, accuracies, and results of the innovation activity models at the significance level of 0.05, in the order of significance. These models aim to identify the behavior of firms by emphasizing a mix of R&D and other R&D activities.
The overall accuracies of the innovation activity models in 2014 and 2016 are 74.7% and 79.0%, respectively, as seen in Table 9. As a result, a total 71.9% (74.2% in 2014 and 70.2% in 2016) of successful innovative firms carried out both R&D and non-R&D activities. In 2014, the model is biased to fit the class of R&D and non-R&D activities; subsequently, the prediction accuracy of this class is 100% and the accuracies for others are 0%. It means that the difference between each class is very small, as seen in Figure A4 in Appendix C; this leads to the prediction that successful innovative firms carried out all innovation activities, including R&D and non-R&D activities, in 2014.
This section aims to identify the sustainable factors and behavior influencing successful innovators in terms of innovation behavior. Although a result of the model in 2014 does not provide sufficient evidence of the behavioral difference between classes of innovation activities, the result of the model in 2016 indicates that successful innovative firms exhibit a different behavior involving R&D and non-R&D activities. As a result of the observation and prediction on each class of the two models, it is reasonable and worthwhile to explore the result of the model in 2016 to identify the difference in behavior and to focus on those between the classes of R&D activities only and non-R&D activities only in 2016.
Factors influencing innovation activities in 2016 are found as follows, in the order of significance: Manner of R&D activities; sector; using information from the private customer; total cost for innovation activities in the last year (level of percentage); and region. The DT result of the model in 2016 is shown in Figure A5 in Appendix C. Figure A5 starts with the first parent node of the manner of R&D activities. In the case of firms having an R&D institute, 78.8% of the firms carried out both R&D and non-R&D activities, 18.4% of the firms carried out only R&D activities, and 2.5% of the firms carried out only non-R&D activities.
Among the firms having R&D institutes, 46.8% of firms, which belong to the middle-technology industry, such as manufacturers of rubber and plastics products (KSIC 22), manufacturers of fabricated metal products, except the manufacturers of machinery and furniture (KSIC 25), and manufacturers of other transport equipment (KSIC 31), carried out only R&D activities. Under the above conditions, 74.3% of the firms carried out only R&D activities, among those that spent less than 0.5 B₩ on the total innovation cost. Meanwhile, under the same conditions, 85.9% of the firms carried out both R&D and non-R&D activities, among those that spent more than 0.5 B₩ on the total innovation cost. Overall, firms spending more than 0.5 B₩ on the total innovation cost carried out both R&D and non-R&D activities, as seen in Figure A5. This finding indicates that even if firms have a research institute, innovation activities vary according to industrial characteristics in coherence with the argument that the technological dynamism of an industry affects innovation [29,39,40,41,42]. It also indicates that firms prefer carrying out only R&D activities at a relatively low cost across the industries. Especially, firms belonging to electronic component and computer manufacturing industries and to visual, sound, and communication equipment industries (KSIC 26) showed different behavior, based on the regional characteristics. In the metropolitan areas, such as Seoul, Incheon, Daejeon, Daegu, Gwangju, and Ulsan of Korea, 39.7% of firms carried out only R&D activities. Whereas 1% of firms in another area carried out only R&D activities, and 99% of the firms carried out both R&D and non-R&D activities. It can be interpreted that regional characteristics in terms of a well-established business environment, such as a metropolitan area, can help firms reduce efforts for non-R&D activities along with cost. Therefore, firms can concentrate on R&D. This finding supports previous findings [42,58,60,61,62,138] that regional characteristics affect a firm’s behavior pertaining to innovation activities.
Examining a branch in which the firms did not conduct any R&D, 69.7% of firms conducted non-R&D activities. However, looking at firms that conducted R&D with a dedicated department or those that carried out R&D irregularly, if necessary, the behavior of innovation activities differed with industrial sub-sectors. Among the firms having a dedicated department for R&D, 53.5% of the firms belonging to the low or middle-technology sectors carried out only R&D activities; these sectors included manufacturers of chemicals and chemical products, except pharmaceuticals and medicinal chemical (KSIC 20) manufacturers, manufacturers of rubber and plastic products (KSIC 22), manufacturers of fabricated metal products, except machinery and furniture (KSIC 25) manufacturers, and manufacturers of electrical equipment (KSIC 28). In other cases, 87.7% of the firms belonging to other sectors carried out both R&D and non-R&D activities. Meanwhile, among the firms that carried out R&D irregularly if necessary, 61% of the firms carrying out only non-R&D activities belonged to low-technology sectors, such as manufacturers of apparel, clothing accessories, and fur articles (KSIC 14); manufacturers of pulp, paper, and paper products (KSIC 17); manufacturers of food products (KSIC 10); and manufacturers of other transport equipment (KSIC 31). These findings indicate and support that firms’ behaviors associated with innovation activities differ according to industrial characteristics in terms of technological dynamism, in line with previous studies [29,39,40,41,42]. Even though it belongs to the low-technology sector, firms with a dedicated department for R&D still conduct R&D activities. However, more than half of the firms have an occasional R&D focus on non-R&D activities. Although a sustainable influencing factor is not identified, it is found that the main mode of conducting R&D [18,19,35,57,61,62,67,69,74,102,103,104,105,108,109,110,111,112], as well as the industrial [29,39,40,41,42] and regional [42,58,60,61,62] differences in technological dynamism, play a major role in the behavior of innovation activities.

4.2.3. R&D Activities

Table 10 presents case statistics, accuracies, and results of R&D activity models at the significance level of 0.05, in the order of significance. These models aim to identify the behavior of firms by emphasizing a mix of R&D activities in terms of in-house and cooperative R&D.
The overall accuracies of the R&D activity models in 2014 and 2016 are 61.8% and 78.5%, respectively, as seen in Table 10. A total 65.6% (52.6% in 2014 and 73.4% in 2016) of the successful innovative firms conducted in-house R&D only, while 2.9% (5.3% in 2014 and 1.5% in 2016) of these firms carried out cooperative R&D only. The 31.9% ratio of firms that carried out both in-house and cooperative R&D in 2014 is relatively higher than the one in 2016 at 12.9%. As a result, both models are biased to fit the class of in-house R&D only; subsequently, the prediction accuracies for this class are 92.3% and 95.8%, respectively. This result means that the firms carrying out in-house R&D exhibit distinctly different behavior when compared to the ones carrying out other R&D activity types. Based on the results of the two models, as seen in Table 10, it is worthwhile to compare the behavior of classes between in-house R&D only and in-house and cooperative R&D in 2014, and to those between in-house R&D only and no-R&D activities in 2016.
DT results on the behavior between groups of the R&D activity class are shown in Figure A6 and Figure A7 in Appendix C. In 2014, Figure A6 started with the first parent node of the manner of R&D activities. In the case of firms having an R&D institute, 41.9% of the firms carried out both in-house and cooperative R&D. Among firms having an R&D institute, 74.1% of the firms using information from institutes of the government, public, and private sector (IGPPS) carried out both in-house and cooperative R&D, while 30.2% of the firms that did not use such information carried out both R&D activities. Under the conditions of having an R&D institute and using information from IGPPS, 83.7% of the firms that used information from a conference, exhibition, and fair (CEF) carried out both in-house and cooperative R&D, while 59.2% of the firms that did not use such information from a CEF carried out both R&D activities. However, 67.7% of the firms using information from in-house or within the affiliate (IHWA) carried out in-house R&D only, under the conditions of having an R&D institute and not using IGPPS. These behaviors indicate that the majority of firms having R&D institutes focused on carrying out in-house R&D only with their own information or from information within the affiliate. However, some firms having R&D institutes carried out cooperative R&D with information from IGPPS and CEF as well as in-house R&D. It can be interpreted that, for conducting innovation, firms that carried out both in-house and cooperative R&D seek to collect other information from external R&D-related institutes and the most contemporary competitive information from CEF rather than market-related information. Additionally, in the case of firms having a dedicated R&D department at the first branch and those not using information from the supplier at the second branch, 80.5% of the firms used information from IHWA. This result also supports the behavior that firms having a dedicated R&D department carried out in-house R&D only with information from IHWA. From the above findings, cooperative R&D activities are carried out to close capability gaps for innovation [61], and it helps innovation [63,118,119,120,121,122,123]. However, R&D institutes or R&D departments are required to complement cooperative R&D [63,130,131,132,136,137].
In 2016, Figure A7 also starts with the first parent node of the manner of R&D activities. In the case of firms having an R&D institute or a dedicated R&D department at the first branch, a majority of those firms (79.9%) carried out in-house R&D only through overall branches without using information from the private customer, private service firms, and professional journal and publications. Firms using this information carried out cooperative R&D. These results indicate that firms having an R&D institute or a dedicated R&D department carried out in-house R&D only based on own capability to innovate without cooperation. It can be interpreted that successful innovative firms do not prefer cooperative R&D due to its instability and risks [124,125,126,127,128,129]. In another case of firms that did not have a channel to carry out R&D at another first branch, the result clearly shows that 72.3% of those firms did not carry out any R&D at all. Additionally, in the case of firms irregularly carrying out R&D, if necessary, at the first branch, 29.8% of those firms did not conduct any R&D activities at all. Especially, under the above condition, 61% of firms belonging to the low-technology sectors did not perform any R&D activity, including food processors (KSIC 10); manufacturers of apparel, clothing accessories, and fur articles (KSIC 14); manufacturers of pharmaceuticals, medicinal chemical, and botanical products (KSIC 21); and manufacturers of pulp, paper, and paper products (KSIC 17). Meanwhile, 81.2% of the firms that belong to other sectors carried out in-house R&D only. This finding indicates that firms’ behavior of R&D activities differ according to industrial characteristics in terms of technological dynamism [29,39,40,41,42]. Even though it belongs to the low-technology sector, 39% of the firms that irregularly carried out R&D if necessary still carried out both in-house and cooperative R&D. Concerning the identification of sustainable influencing factors and behavior in terms of R&D activity, the manner of R&D activities is determined to influence innovation behavior. Additionally, some types of information sources for innovation were examined, such as IHWA, CEF, and IGPPS. The other factors identified comprise the sector, employee size, and statuary type at other local branches. These are shown in Table 11.
Based on the above analyses of DT, it is also found that the main way of carrying out R&D plays a major role in the behavior pertaining to innovation [18,19,35,57,61,62,67,69,74,102,103,104,105,108,109,110,111,112]. Additionally, successful innovative firms prefer to conduct their own in-house R&D rather than cooperative R&D with their own information source. It indirectly supports the characteristics of instability and risks of cooperative R&D for innovation [124,125,126,127,128,129]. However, other findings support that firms carrying out cooperative R&D seek information [62,80,165,166,167] related to, not the market, R&D for the closing of capability gaps [61]. Additionally, it reaffirms that an internal capability for R&D is required to complement cooperative R&D [114,130,131,132,136,137].

5. Regional and Sectoral Differences of Innovation

5.1. Hypotheses on Regional and Sectoral Differences of Innovation

The main goals of this study are the identification of the overall innovation behavior of firms from both the perspectives of success and failure of innovation, and successful innovative firms by considering all innovation activities of a firm with all their intrinsic and extrinsic characteristics by using DT, which is highly predictable and easily interpretable. According to these goals, comprehensive knowledge on innovation behavior is acquired, but the nature of DT involving a non-parametric analysis makes it difficult to comprehend the in-depth underlying mechanism of innovation behavior. Therefore, theoretically and managerially meaningful factors according to the important findings derived from the result of this study can be validated in terms of traditional statistical methodology, and this could provide some grounds for innovation scholars.
From the result of Module 1 in Section 4, the role of R&D involving factors of R&D organization and R&D personnel is determined as the most significant and crucial factor for innovation success; this finding is reasonably and preliminarily natural. In relation to this, firm age and firm size, which are related to the factors of the exports level, statuary type (in terms of firm size), and employee size, are also identified as significant influencing factors, which are intrinsic factors of the firm with regard to its general characteristics. These factors, such as R&D, firm size, and firm age, have been heavily investigated, in relation to their in-depth impact and mechanism on innovation, statistically by scholars and their positive roles in the domain of innovation study are greatly accepted [18,19,35,57,61,62,67,69,74,77,78,85,86,87,88,89,92,95,96,97,102,103,104,105,108,109,110,111,112,150].
On the other hand, regional and sectoral factors are particularly identified to be significant influencing factors on the behavior of innovation success and failure. Additionally, with regard to successful innovative firms, it is found that their innovation behavior is affected by these regional and sectoral factors in relation to the target market. According to the literature review in Section 2 of this study, these regional and sectoral factors were investigated in relation to their characteristics on the impact of innovation. However, there are some negative or insignificant effects of industrial and regional characteristics on innovation. In addition, these factors are mainly considered under their specific relationship with innovation, such as industrial structure and regional proximity. Concerning a sectoral factor, in more detail, sectoral innovation studies were mostly conducted for figuring out the sectoral landscape and its particular characteristics in specific sectors of each country by qualitative and descriptive analysis [168,169,170]. Concerning regional innovation study, the relationship and networks of institutes, such as a university, government, and industry institutions, and their roles in the regional innovation ecosystem under different contexts have been mainly emphasized through qualitative and descriptive analysis [171,172,173,174,175,176], as well as sectoral research approaches. Especially, in those studies, it is preliminarily assumed that there is a significant difference between sectors or regions statistically, but it was not tested.
Therefore, it is worthwhile to identify the differences of the distribution of innovation success and failure regarding the regional and sectoral difference of innovation in light of the significant findings from the DT analysis in this study and the shortcomings of previous studies. For this goal, the following hypotheses are constructed.
Hypothesis 1 (H1).
There is a difference in innovation success and failure between sectors.
Hypothesis 2 (H2).
There is a difference in innovation success and failure between regions.
Hypothesis 3 (H3).
There is a difference in innovation success across sectors and regions.
Although a binomial logistic regression analysis on the innovation success and failure, as a dependent variable, could be used as advanced analysis to clarify the relationship contained in the contingency table, the model cannot be built due to the different independent variable types and scales in KIS. In this regard, to verify the hypotheses, the cross-tabulation analysis (CA) and chi-square (χ2) test are used because both the dependent variable and independent variable are categorical variables measured in the nominal scale, such as success and failure as a dependent variable, and region and sector as an independent variable, respectively. CA is used to aggregate and jointly display the distribution of two or more variables by tabulating their results one against the other in a two-dimensional grid. It uses a process of creating contingency tables from the multivariate frequency distribution of variables, which are presented in a matrix format. Regarding assumptions for usage of the χ2 test, data is satisfied with independent observations, not a biased sample, mutually exclusive on observations in all categories. Regarding H3, when applying CA, the observation of innovation success across the sectors and regions is used because the observation of success and failure of innovation across the sectors and regions cannot be included at the same time.

5.2. Hypotheses Testing Result and Discussion on Regional and Sectoral Differences of Innovation

The summary of CA and χ2 test results are presented in Table 12. The CA results of six models between sectors, between regions, and across sectors and regions in 2014 and 2016 are shown in Table A4, Table A5, Table A6, Table A7, Table A8 and Table A9 in Appendix D. Concerning H1 and H2, the value of χ2 is calculated by an asymptotic method depending on the satisfaction with an assumption of CA through the λ measure according to the dependent and independent variables, which are nominal. Concerning H3, the value of χ2 is computed by the Monte-Carlo method depending on the dissatisfaction, with the assumption that cells with an expected count less than 5 should not exceed 25% of the total.
These results support all hypotheses at a significance level of 0.001 in 2014 and 2016 as seen in Table 12. From these results, it can be concluded that there are significant differences on innovation success and failure between sectors, and between regions over the years. Also, it is affirmed that there is a difference in innovation success across sectors and regions. In addition, when comparing the degree of difference between the sectoral and regional effect of success and failure of innovation, values of the contingency coefficient in each year indicate that the sectoral difference is significantly larger than the regional difference over the years, with a p-value of 0.000. Moreover, the contingency coefficients of the linkage between each sector and region in each year demonstrate a greater impact on the success of innovation than the effects of each continuously at a significance level of 0.01. Based on the overall CA and χ2 test results, it is found that the distributions of success and failure between sectors, and between regions, as well as the distribution of innovation success across sectors and regions, are firmly diverse.
Concerning the sectoral innovation study, previous studies have evolved that mainly focus on how sectoral differences influence innovation and shape its sectoral pattern in terms of technological dynamism involving the technology regime and trajectories, and knowledge flow based on sectoral taxonomy, such as Pavitt’s taxonomy [177,178,179]. Findings of this study statistically provide a rigid ground of sectoral diversity to establish innovation policies, which should take different approaches to design an institutional system to support innovation according to the innovation mechanisms and patterns, and characteristics of innovation players from the perspective of the sectoral innovation system [180]. However, in linkage to regional diversity, findings on sectoral and regional connectivity imply that differentiation of innovation is more magnified in conflict with the prominences of the sectoral regime rather than regional characteristics in the sectoral innovation system [181]. In this respect, this finding is more consistent with the perspective of the regional innovation system, which has focused on network and cooperative learning within the regional ecosystem in the specific sectors, such as the milieu of innovation or innovation clusters [64,182,183,184]. It can be attributed to a well-established local business environment in terms of cooperative networking between innovation actors with government supporting programs for specific regional sectors [57,60,61,62]. Overall, based on the identification of sectoral and regional differences on innovation success and failure across all sectors and regions statistically, their significant impact on innovation is reaffirmed, and it provides a basic ground for the sectoral and regional innovation system in the current business landscape.

6. Implications and Conclusions

After the SAPPHO project for testing generalizations regarding innovation success and failure was conducted by SPRU during the 1970s [15,16,17], innovation studies have evolved and gradually focused on specific subjects to identify in-depth mechanisms of innovation behavior [18,19,20,21,23]. However, previous innovation studies have been tied down by the characteristics, types, and empirical scope of innovation data with statistical methodology; this limitation is also attributed to the various definitions of innovations and proxy measurements on innovation. Although the general consensus on influencing factors and behavior has been widely accepted, there are conflicting arguments or insignificant conclusions drawn in different contexts. They also lack comprehensive and sustainable perspectives.
This study contributes toward expanding the methodological landscape with advanced data mining methodology; it also increases the feasibility of using innovation data on a large scale. It also contributes toward obtaining the overall significant influencing factors in a single framework by considering all the variables together, which are determined from previous studies. It also maintains international consistency based on the guidance of the Oslo manual. Unlike previous studies that focused on micro perspectives with various controversies, this study takes a comprehensive approach toward investigating sustainable factors and behavior, based on a macro and single statistical framework by using DT with 10-cross validation.
Concerning factors and behaviors influencing innovation success and failure at a national level, R&D is crucial for innovation success in terms of the capacity for carrying out R&D. As a result, the role of R&D [18,19,35,57,61,62,67,69,74,102,103,104,105,108,109,110,111,112] and the ratio of R&D personnel [102,103] positively affect the success of innovation. Even if there is no R&D activity, the result of this study supports the arguments that the larger the firm size [86,87,88,89,90,91] and the older the firm age [95,96], the greater the success achieved by firms will be. Concerning firm size, findings in this study are consistent with previous studies that the employee size level [85,86,87,88,89,90,91,92], sales level [74,77,78,103,150], and exports level [61,67,96,108,150] significantly affect the success of innovation. Additionally, it is witnessed that innovation behavior is affected by regional [42,58,60,61,62,64,65,66] and sectoral [29,39,40,41,42,43,44,45] differences. Concerning the industrial differences, it is inferred that firms belonging to a low-technology industry prefer other innovation activities rather than R&D. Concerning managerial or political implications based on the above findings, this study reemphasizes the importance of preparing and strengthening an overall support program for not only implementing R&D in collaboration with R&D institutes or organizations but also for increasing the number of R&D personnel employed for innovating products or processes [1,2,111,134,166]. Additionally, in terms of extrinsic factors of the business environment, the regional and sectoral innovation landscape should be focused on to establish and strengthen the innovation support program [1,2,64,65,66].
Concerning the factors and behaviors of successful innovative firms, this study first observed them in terms of financial contribution. Previous studies have dealt with the financial performance of innovation [7,18,148,149,150,151,152], but they did not cover the factors and behaviors of differences between high and low innovation contributions of groups to financial performance. As a result, this study identified the influencing factors and four types of behavior between those groups. The first type of firms with a financial contribution from innovation focuses on in-house R&D with information from the private customer. The second type focuses on marketing with information from the public customer. The third type focuses on using information from higher educational institutes. The last type focuses on their own information and does not invest heavily in assets. These findings show that the behavior related to activity and information use [62,80,165,166,167] for innovation is influenced by target market characteristics. It is consistent with the argument that market characteristics drive firms to seek market needs and to advertise [22,47,69,79,80,81,82,83,84]. Overall, intrinsic innovation activity-related factors are identified to exert a significant influence on innovation behavior rather than the extrinsic factors related to the general innovation capacity of firms, in terms of innovation’s contribution to financial performance. To increase the contribution of innovation to a firm’s financial performance, a policy should be implemented to level up the information environment and to build a public or private system to provide diverse market information. Additionally, managers should strengthen the activity to seek information corresponding to the target market to which the firm belongs.
To fulfill the lack of studies on the difference in the nature of a firm’s innovation behavior to engage in R&D and non-R&D activities, this study identified their behavioral characteristics in terms of the overall innovation activity. Generally, firms prefer implementing R&D activities at a low cost across sectors. However, in low-technology sectors, firms prefer non-R&D activities. Additionally, well-established business environments, such as metropolitan areas, help firms reduce non-R&D activities as well as associated costs. The aforementioned findings of this study on innovation behavior reaffirm that the main way of carrying out R&D [18,19,35,57,61,62,67,69,74,102,103,104,105,108,109,110,111,112], the industrial difference with the technological dynamism [29,39,40,41,42], and regional characteristics of a well-established business environment [42,58,60,61,62] play a major role in the behavior associated with innovation activities. In terms of the overall R&D activity involving in-house R&D, cooperative R&D, and no R&D with higher resolution, this study found that a majority of firms having R&D institutes focus on carrying out in-house R&D only with their own information. However, it is also witnessed that some firms having R&D institutes carry out cooperative R&D with external R&D-related information. As a result, these findings support the claim that successful innovative firms do not prefer cooperative R&D due to its instability and risks [124,125,126,127,128,129]. This finding is also consistent with claims that cooperative R&D activities are carried out to close the capability gaps for innovation [61]. However, an absorptive capacity, such as R&D institutes or a dedicated R&D department, is required to complement cooperative R&D [114,130,131,132,136,137]. Concerning managerial or political implications, it should mainly prepare and strengthen an R&D support program in terms of the R&D budget as well as establish a business environment for non-R&D activity for both in-house R&D and cooperative R&D [1,2,64,65,66,138].
According to the main objectives, this study reaffirmed the roles of significant factors influencing innovation, such as R&D, size, and age, that are claimed in previous studies, and investigated the firm’s behavior in intrinsic innovation activities from an overall perspective. In addition, sector and region are identified to be significant factors affecting innovation success and failure, and the firm’s behavior is affected by the characteristics of these factors in relation to the target market. Subsequently, the differences of innovation success between sectors, regions, and across the sectors and regions were verified statistically, which was preliminary assumed but was not tested in previous studies. This provides ground for sectoral and regional diversity for scholars studying the sectoral and regional innovation system in the current business landscape. Careful discriminatory approaches should be taken to design an innovation system according to the innovation mechanisms and patterns, and characteristics of innovation players from the perspectives of the sectoral and regional innovation system [182,184].
The findings and implications presented in this study are beneficial to understand factors influencing innovation and behavior, from a comprehensive and sustainable viewpoint; especially, the DT methodology allows various types of innovation data to be addressed together in a single statistical framework. Despite the contribution, this study carries a limitation. The underlying mechanism involving DT as a non-parametric analysis is difficult to comprehend. Additionally, methodologically, there is room for enhancing the predictive power by altering the algorithm conditions in terms of tree depth, recursive calculation level, misclassification cost adjustment, the node scale related to the data class and size, and data balancing to avoid overfitting and underfitting. Even though it can interpret results easily, highly predict performance with 10-fold cross-validation, and allow unrestricted application without requiring underlying assumptions on data distribution, an in-depth scenario-based analysis of DT is required to fathom the ambiguous mechanism of innovation behavior. Theoretically and practically, different categorical classification principles and their levels can be considered to develop a research framework for other research questions. More extended or detailed standards of the innovation spectrum can be applied to specific research scopes from political and managerial viewpoints.
Furthermore, the approach of this study to shed light on the comprehensive knowledge of innovation behavior has important implications for scholars investigating innovation behavior. Most of the existing studies on innovation focus on in-depth behavior with narrow research scopes based on advanced statistical methodologies. Hence, over time, there have been conflicts in innovation behavior in the overall business landscape with different contexts. Additionally, it is important to understand factors influencing innovation and innovation behavior continuously from a contemporary perspective. In this sense, during each contemporary period, future studies can be replicated by applying the DT methodology from a comprehensive perspective. With guidance from the Oslo Manual, such studies, conducted at a global level, must maintain international consistency. For comparativeness, these studies must refer to the revised fourth edition of the Oslo Manual. Future studies should collect and use a large sample in time series and in multiple cross-country settings to improve the sustainability of the results of the analysis and draw a more generalizable consensus.

Funding

This research received no external funding.

Acknowledgments

This study was conducted using the raw data provided by the Korean Innovation Survey (KIS) in the manufacturing industry in 2014 and 2016. This survey is conducted by the Science and Technology Policy Institute (STEPI).

Conflicts of Interest

The author declares no conflicts of interest.

Appendix A

Table A1. Variable codes, description, value, response, and type in Modules 1 and 2.
Table A1. Variable codes, description, value, response, and type in Modules 1 and 2.
Variable CodeMeasurement DescriptionVariable ValueResponseType
KIS 2014KIS 2016
Q 1_1Form of firmIndependent company1Nominal
Affiliates of a domestic company2
Affiliates of a foreign company3
Q 1_2Statuary types
(by the size of employee from sample selection)
Large-sized company1Nominal
Medium-sized company2
Small-sized company3
Q 1_3_1Designation status on corporative certification in KoreaVenture company1Nominal
Q 1_3_2InnoBiz (certificated as innovative small and medium-sized firm)2
Q 1_3_3n/a3
Q 1_4Listed status in Korean stock marketKOSPI1Nominal
KOSDAQ2
n/a3
Q 2_1_1size of salesLevel of actual sales in three years ago0. None
1. ~1 B₩
2. 1 B₩~5 B₩
3. 5 B₩~10 B₩
4. 10 B₩~50 B₩
5. 50 B₩~100 B₩
6. 100 B₩~
d.k. unknown
Ordinal
Q 2_1_2Level of actual sales in two years ago
Q 2_1_3Level of actual sales in one year ago
Q 2_2_1size of exportsLevel of actual exports in three years ago
Q 2_2_2Level of actual exports in two years ago
Q 2_2_3Level of actual exports in one year ago
Q 3_1_1Q 3_1size of employeeLevel of actual employee in three years ago1. ~49
2. 50~99
3. 100~299
4. 300~499
5. 500~
Ordinal
Q 3_1_2Q 3_2Level of actual employee in two years ago
Q 3_1_3Q 3_3Level of actual employee in one year ago
Q 3_1_6Q 3_4_3Ratio of R&D personnelLevel of percentage of R&D personnel in the last year1. none
2. ~5%
3. 5%~10%
4. 10%~20%
5. 20%~30%
6. 30%~50%
7. 50%~
Ordinal
Q 5_1Main regional target market in the world
(multiple response)
DomesticIf yes, 1;
else, blank
Nominal
Q 5_2AsiaIf yes, 2;
else, blank
Q 5_3EuropeIf yes, 3;
else, blank
Q 5_4North AmericaIf yes, 4;
else, blank
Q 5_5Others If yes, 5;
else, blank
Q 6Manner of R&D activities
(main ways performing R&D)
R&D institutes1Nominal
Dedicated department2
Irregular operation if necessary3
Not implemented4
Q8_1Q7Main customer typesPrivate company1Nominal
Government and public sector2
Individual customer3
Overseas market4
Others 5
Ind_midIndustrial code23 codes in the manufacturing industry are in Appendix BCode numberNominal
RegionRegion (17 area)Seoul, busan, daejeon, daegu, incheon, gwangju, sejong, ulsan, Gyeonggi, Chungcheongbuk, ChungCheongnam, Ganwon, Gyeongbuk, Gyeonnam, Jeollabuk, Jeollnam, JejuRegion nameNominal
AgeFirm ageFirm ageNumberInterval
Table A2. Variable codes, description, value, response, and type in Module 2 (added on Module 1).
Table A2. Variable codes, description, value, response, and type in Module 2 (added on Module 1).
Variable CodeMeasurement DescriptionVariable ValueResponseScale
KIS 2014KIS 2016
Q 18_1In-house R&DPerforming in-house R&D in last three yearsIf yes, 1; else, 2Nominal
Q 18_2Cooperative R&DPerforming cooperative R&D in last three years
Q 18_3External R&DPerforming external R&D in last three years
Q 18_4Acquiring machine, tool, software, and buildingAcquiring machine, tool, software, and buildingin last three years
Q 18_5Procuring external knowledgeProcuring external knowledge in last three years
Q 18_6Providing job trainingProviding job training in last three years
Q 18_7Market launching activitiesMarket launching activities in last three years
Q 18_8Design activitiesDesign activities in last three years
Q 18_9OthersOthers in last three years
Q 19 tQ 19Total innovation cost for all innovation activities in the last yearLevel of total cost for innovation activities in the last year0. None
1. ~0.1 B₩
2. 0.1 B₩~0.5 B₩
3. 0.5 B₩~1 B₩
4. 1 B₩~5 B₩
5. 5 B₩~10 B₩
6. 10 B₩~50 B₩
7. 50 B₩~100 B₩
8. 100 B₩~
d.k. unknown
Ordinal
Q 19_1Level of percentage of each innovation activity costLevel of percentage of cost on in-house R&D0. 0%
1. ~25%
2. 26%~50%
3. 51%~75%
4. 76%~100%
d.k. unknown
Ordinal
Q 19_2Level of percentage of cost on external R&D
Q 19_3Level of percentage of cost on acquisition of machine, tool, software, and building
Q 19_4Level of percentage of cost on buying external knowledge
Q 19_5Level of percentage of cost on others
Q 20Source of budget in the last three yearsOwned capital1Nominal
Affiliate fund2
Government fund3
Loan4
Stock Issuance5
Corporate Bond fund6
No expenditure7
Others8
Q 21 a1Q 21_1Information source for innovationIn-house or within the affiliateIn 2014, use or not
If yes, 1;
else, 2
In 2016,
Use and importance
0. No use
1. Use and low importance
2. Use and middle importance
3. Use and high importance
Nominal
Q 21 a2Q 21_2Supplier
Q 21 a3Q 21_3Private customer
Q 21 a4Q 21_4Public customer
Q 21 a5Q 21_5Competitors in the same sector
Q 21 a6Q 21_6Private service firms
Q 21 a7Q 21_7Higher educational institutes
Q 21 a8Q 21_8Institutes of government, public, and private sector
Q 21 a9Q 21_9Conference, exhibition, and fair
Q 21 a10Q 21_10Professional journal and publications
Q 21 a11Q 21_11Industrial association
Q 22Cooperative activitiesWhether or not cooperative activity implementIf yes, 1;
else, 2
Nominal
Q 23_1Cooperative partnerAffiliatesIf yes, 1;
else, 0
Nominal
Q 23_2Supplier
Q 23_3Private customer
Q 23_4Public customer
Q 23_5Competitors in the same sector
Q 23_6Private service firms
Q 23_7Higher educational institutes
Q 23_8Institutes of government, public, and private sector
Q 24Best cooperative partnerAffiliates1Nominal
Supplier2
Private customer3
Public customer4
Competitors in the same sector5
Private service firms6
Higher educational institutes7
Institutes of government, public, and private sector8

Appendix B

Table A3. Industrial code on the manufacturing industry.
Table A3. Industrial code on the manufacturing industry.
The Manufacturing Industry
CodeDescription
10Manufacture of food products
11Manufacture of beverages
13Manufacture of textiles, except apparel
14Manufacture of wearing apparel, clothing accessories and fur articles
15Manufacture of leather, luggage and footwear
16Manufacture of wood and of products of wood and cork; except furniture
17Manufacture of pulp, paper and paper products
18Printing and reproduction of recorded media
19Manufacture of coke, briquettes and refined petroleum products
20Manufacture of chemicals and chemical products; except pharmaceuticals and medicinal chemicals
21Manufacture of pharmaceuticals, medicinal chemical and botanical products
22Manufacture of rubber and plastics products
23Manufacture of other non-metallic mineral products
24Manufacture of basic metals
25Manufacture of fabricated metal products, except machinery and furniture
26Manufacture of electronic components, computer; visual, sounding and communication equipment
27Manufacture of medical, precision and optical instruments, watches and clocks
28Manufacture of electrical equipment
29Manufacture of other machinery and equipment
30Manufacture of motor vehicles, trailers and semitrailers
31Manufacture of other transport equipment
32Manufacture of furniture
33Other manufacturing

Appendix C

Figure A1. DT result of an overall model in 2014.
Figure A1. DT result of an overall model in 2014.
Sustainability 11 06207 g0a1
Figure A2. DT result of an overall model in 2016.
Figure A2. DT result of an overall model in 2016.
Sustainability 11 06207 g0a2
Figure A3. DT results of (a) a contribution model in 2014 and (b) a contribution model in 2016.
Figure A3. DT results of (a) a contribution model in 2014 and (b) a contribution model in 2016.
Sustainability 11 06207 g0a3
Figure A4. DT result of an innovation activities model in 2014.
Figure A4. DT result of an innovation activities model in 2014.
Sustainability 11 06207 g0a4
Figure A5. DT result of an innovation activities model in 2016.
Figure A5. DT result of an innovation activities model in 2016.
Sustainability 11 06207 g0a5
Figure A6. DT result of an R&D activities model in 2014.
Figure A6. DT result of an R&D activities model in 2014.
Sustainability 11 06207 g0a6
Figure A7. DT result of an R&D activities model in 2016.
Figure A7. DT result of an R&D activities model in 2016.
Sustainability 11 06207 g0a7

Appendix D

Table A4. Cross-tabulation between sectors and innovation success and failure in KIS 2014.
Table A4. Cross-tabulation between sectors and innovation success and failure in KIS 2014.
SectorsInnovationTotal
FailureSuccess
CountExpected Count% Within Innovation% Within Sector% of TotalCountExpected Count% Within Innovation% Within Sector% of TotalCountExpected Count% Within Innovation% Within Sector% of Total
10158183.05.1%65.8%3.9%8257.08.5%34.2%2.0%240240.05.9%100.0%5.9%
111213.70.4%66.7%0.3%64.30.6%33.3%0.1%1818.00.4%100.0%0.4%
13145128.14.7%86.3%3.6%2339.92.4%13.7%0.6%168168.04.1%100.0%4.1%
149783.93.1%88.2%2.4%1326.11.3%11.8%0.3%110110.02.7%100.0%2.7%
152727.50.9%75.0%0.7%98.50.9%25.0%0.2%3636.00.9%100.0%0.9%
163330.51.1%82.5%0.8%79.50.7%17.5%0.2%4040.01.0%100.0%1.0%
178170.92.6%87.1%2.0%1222.11.2%12.9%0.3%9393.02.3%100.0%2.3%
185548.11.8%87.3%1.3%814.90.8%12.7%0.2%6363.01.5%100.0%1.5%
191613.00.5%94.1%0.4%14.00.1%5.9%0.0%1717.00.4%100.0%0.4%
20109131.93.5%63.0%2.7%6441.16.6%37.0%1.6%173173.04.2%100.0%4.2%
212541.90.8%45.5%0.6%3013.13.1%54.5%0.7%5555.01.3%100.0%1.3%
22237228.87.6%79.0%5.8%6371.26.5%21.0%1.5%300300.07.4%100.0%7.4%
23136125.84.4%82.4%3.3%2939.23.0%17.6%0.7%165165.04.0%100.0%4.0%
24154137.35.0%85.6%3.8%2642.72.7%14.4%0.6%180180.04.4%100.0%4.4%
25424386.713.6%83.6%10.4%83120.38.6%16.4%2.0%507507.012.4%100.0%12.4%
26218254.07.0%65.5%5.3%11579.011.9%34.5%2.8%333333.08.2%100.0%8.2%
2786109.12.8%60.1%2.1%5733.95.9%39.9%1.4%143143.03.5%100.0%3.5%
28165199.85.3%63.0%4.0%9762.210.0%37.0%2.4%262262.06.4%100.0%6.4%
29436435.514.0%76.4%10.7%135135.514.0%23.6%3.3%571571.014.0%100.0%14.0%
30249244.88.0%77.6%6.1%7276.27.4%22.4%1.8%321321.07.9%100.0%7.9%
31144117.54.6%93.5%3.5%1036.51.0%6.5%0.2%154154.03.8%100.0%3.8%
324545.01.4%76.3%1.1%1414.01.4%23.7%0.3%5959.01.4%100.0%1.4%
335651.11.8%83.6%1.4%1115.91.1%16.4%0.3%6767.01.6%100.0%1.6%
Total31083108.0100.0%76.3%76.3%967967.0100.0%23.7%23.7%40754075.0100.0%100.0%100.0%
Table A5. Cross-tabulation between sectors and innovation success and failure in KIS 2016.
Table A5. Cross-tabulation between sectors and innovation success and failure in KIS 2016.
SectorsInnovationTotal
FailureSuccess
CountExpected Count% Within Innovation% Within Sector% of TotalCountExpected Count% Within Innovation% Within Sector% of TotalCountExpected Count% Within Innovation% Within Sector% of Total
1098124.64.1%46.9%2.5%11184.46.9%53.1%2.8%209209.05.2%100.0%5.2%
111411.90.6%70.0%0.4%68.10.4%30.0%0.2%2020.00.5%100.0%0.5%
1310974.54.6%87.2%2.7%1650.51.0%12.8%0.4%125125.03.1%100.0%3.1%
147868.53.3%67.8%2.0%3746.52.3%32.2%0.9%115115.02.9%100.0%2.9%
151616.10.7%59.3%0.4%1110.90.7%40.7%0.3%2727.00.7%100.0%0.7%
161619.70.7%48.5%0.4%1713.31.1%51.5%0.4%3333.00.8%100.0%0.8%
175654.82.3%60.9%1.4%3637.22.2%39.1%0.9%9292.02.3%100.0%2.3%
183425.01.4%81.0%0.9%817.00.5%19.0%0.2%4242.01.1%100.0%1.1%
191611.30.7%84.2%0.4%37.70.2%15.8%0.1%1919.00.5%100.0%0.5%
209997.74.2%60.4%2.5%6566.34.0%39.6%1.6%164164.04.1%100.0%4.1%
21617.30.3%20.7%0.2%2311.71.4%79.3%0.6%2929.00.7%100.0%0.7%
22226217.59.5%61.9%5.7%139147.58.6%38.1%3.5%365365.09.1%100.0%9.1%
239678.74.0%72.7%2.4%3653.32.2%27.3%0.9%132132.03.3%100.0%3.3%
24158123.46.6%76.3%4.0%4983.63.0%23.7%1.2%207207.05.2%100.0%5.2%
25314240.813.2%77.7%7.9%90163.25.6%22.3%2.3%404404.010.1%100.0%10.1%
26154214.66.5%42.8%3.9%206145.412.7%57.2%5.2%360360.09.0%100.0%9.0%
279499.53.9%56.3%2.4%7367.54.5%43.7%1.8%167167.04.2%100.0%4.2%
28152170.56.4%53.1%3.8%134115.58.3%46.9%3.4%286286.07.2%100.0%7.2%
29258340.310.8%45.2%6.5%313230.719.4%54.8%7.8%571571.014.3%100.0%14.3%
30200238.48.4%50.0%5.0%200161.612.4%50.0%5.0%400400.010.0%100.0%10.0%
3110876.94.5%83.7%2.7%2152.11.3%16.3%0.5%129129.03.2%100.0%3.2%
325140.52.1%75.0%1.3%1727.51.1%25.0%0.4%6868.01.7%100.0%1.7%
333121.51.3%86.1%0.8%514.50.3%13.9%0.1%3636.00.9%100.0%0.9%
Total23842384.0100.0%59.6%59.6%16161616.0100.0%40.4%40.4%40004000.0100.0%100.0%100.0%
Table A6. Cross-tabulation between regions and innovation success and failure in KIS 2014.
Table A6. Cross-tabulation between regions and innovation success and failure in KIS 2014.
RegionInnovationTotal
FailureSuccess
CountExpected Count% Within Innovation% Within Region% of TotalCountExpected Count% Within Innovation% Within Region% of TotalCountExpected Count% Within Innovation% Within Region% of Total
Busan303289.179.9%9.7%7.4%7689.920.1%7.9%1.9%379379.0100.0%9.3%9.3%
Chungcheongbuk133135.075.1%4.3%3.3%4442.024.9%4.6%1.1%177177.0100.0%4.3%4.3%
ChungCheongnam162159.477.5%5.2%4.0%4749.622.5%4.9%1.2%209209.0100.0%5.1%5.1%
Daegu146144.976.8%4.7%3.6%4445.123.2%4.6%1.1%190190.0100.0%4.7%4.7%
Daejeon6977.867.6%2.2%1.7%3324.232.4%3.4%0.8%102102.0100.0%2.5%2.5%
Ganwon4342.776.8%1.4%1.1%1313.323.2%1.3%0.3%5656.0100.0%1.4%1.4%
Gwangju7772.581.1%2.5%1.9%1822.518.9%1.9%0.4%9595.0100.0%2.3%2.3%
Gyeongbuk232212.883.2%7.5%5.7%4766.216.8%4.9%1.2%279279.0100.0%6.8%6.8%
Gyeonggi874900.074.1%28.1%21.4%306280.025.9%31.6%7.5%11801180.0100.0%29.0%29.0%
Gyeonnam283264.781.6%9.1%6.9%6482.318.4%6.6%1.6%347347.0100.0%8.5%8.5%
Incheon139149.570.9%4.5%3.4%5746.529.1%5.9%1.4%196196.0100.0%4.8%4.8%
Jeju35.342.9%0.1%0.1%41.757.1%.4%0.1%77.0100.0%0.2%0.2%
Jeollabuk11096.187.3%3.5%2.7%1629.912.7%1.7%0.4%126126.0100.0%3.1%3.1%
Jeollnam8679.382.7%2.8%2.1%1824.717.3%1.9%0.4%104104.0100.0%2.6%2.6%
Sejong55.371.4%0.2%0.1%21.728.6%.2%0.0%77.0100.0%0.2%0.2%
Seoul315363.866.0%10.1%7.7%162113.234.0%16.8%4.0%477477.0100.0%11.7%11.7%
Ulsan128109.888.9%4.1%3.1%1634.211.1%1.7%0.4%144144.0100.0%3.5%3.5%
Total31083108.076.3%100.0%76.3%967967.023.7%100.0%23.7%40754075.0100.0%100.0%100.0%
Table A7. Cross-tabulation between regions and innovation success and failure in KIS 2016.
Table A7. Cross-tabulation between regions and innovation success and failure in KIS 2016.
RegionInnovationTotal
FailureSuccess
CountExpected Count% Within Innovation% Within Region% of TotalCountExpected Count% Within Innovation% Within Region% of TotalCountExpected Count% Within Innovation% Within Region% of Total
Busan128147.85.4%51.6%3.2%120100.27.4%48.4%3.0%248248.06.2%100.0%6.2%
Chungcheongbuk87103.13.6%50.3%2.2%8669.95.3%49.7%2.2%173173.04.3%100.0%4.3%
ChungCheongnam114133.54.8%50.9%2.9%11090.56.8%49.1%2.8%224224.05.6%100.0%5.6%
Daegu87118.03.6%43.9%2.2%11180.06.9%56.1%2.8%198198.05.0%100.0%5.0%
Daejeon3346.51.4%42.3%0.8%4531.52.8%57.7%1.1%7878.02.0%100.0%2.0%
Ganwon3932.81.6%70.9%1.0%1622.21.0%29.1%0.4%5555.01.4%100.0%1.4%
Gwangju5553.62.3%61.1%1.4%3536.42.2%38.9%0.9%9090.02.3%100.0%2.3%
Gyeongbuk197187.78.3%62.5%4.9%118127.37.3%37.5%3.0%315315.07.9%100.0%7.9%
Gyeonggi887770.637.2%68.6%22.2%406522.425.1%31.4%10.2%12931293.032.3%100.0%32.3%
Gyeonnam272243.211.4%66.7%6.8%136164.88.4%33.3%3.4%408408.010.2%100.0%10.2%
Incheon149193.76.3%45.8%3.7%176131.310.9%54.2%4.4%325325.08.1%100.0%8.1%
Jeju22.40.1%50.0%0.1%21.60.1%50.0%0.1%44.00.1%100.0%0.1%
Jeollabuk6053.02.5%67.4%1.5%2936.01.8%32.6%0.7%8989.02.2%100.0%2.2%
Jeollnam6254.22.6%68.1%1.6%2936.81.8%31.9%0.7%9191.02.3%100.0%2.3%
Sejong712.50.3%33.3%0.2%148.50.9%66.7%0.4%2121.00.5%100.0%0.5%
Seoul115152.64.8%44.9%2.9%141103.48.7%55.1%3.5%256256.06.4%100.0%6.4%
Ulsan9078.73.8%68.2%2.3%4253.32.6%31.8%1.1%132132.03.3%100.0%3.3%
Total23842384.0100.0%59.6%59.6%16161616.0100.0%40.4%40.4%40004000.0100.0%100.0%100.0%
Table A8. Cross-tabulation between regions and sectors in KIS 2014.
Table A8. Cross-tabulation between regions and sectors in KIS 2014.
SectorTotal
1011131415161718192021222324252627282930313233
RegionBusanCount204231000503011322819622176
Expected Count6.40.51.81.00.70.60.90.60.15.02.45.02.32.06.59.04.57.610.65.7.81.10.976.0
% within region2.6%0.0%5.3%2.6%3.9%1.3%0.0%0.0%0.0%6.6%0.0%3.9%0.0%1.3%17.1%2.6%2.6%10.5%25.0%7.9%2.6%2.6%1.3%100.0%
% within sector2.4%0.0%17.4%15.4%33.3%14.3%0.0%0.0%0.0%7.8%0.0%4.8%0.0%3.8%15.7%1.7%3.5%8.2%14.1%8.3%20.0%14.3%9.1%7.9%
% of Total0.2%0.0%0.4%0.2%0.3%0.1%0.0%0.0%0.0%0.5%0.0%0.3%0.0%0.1%1.3%0.2%0.2%0.8%2.0%0.6%0.2%0.2%0.1%7.9%
ChungcheongbukCount12000000007342135004300044
Expected Count3.70.31.00.60.40.30.50.40.02.91.42.91.31.23.85.22.64.46.13.30.50.60.544.0
% within region27.3%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%15.9%6.8%9.1%4.5%2.3%6.8%11.4%0.0%0.0%9.1%6.8%0.0%0.0%0.0%100.0%
% within sector14.6%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%10.9%10.0%6.3%6.9%3.8%3.6%4.3%0.0%0.0%3.0%4.2%0.0%0.0%0.0%4.6%
% of Total1.2%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.7%0.3%0.4%0.2%0.1%0.3%0.5%0.0%0.0%0.4%0.3%0.0%0.0%0.0%4.6%
ChungCheongnamCount7000001003052327119510047
Expected Count4.00.31.10.60.40.30.60.40.03.11.53.11.41.34.05.62.84.76.63.50.50.70.547.0
% within region14.9%0.0%0.0%0.0%0.0%0.0%2.1%0.0%0.0%6.4%0.0%10.6%4.3%6.4%4.3%14.9%2.1%2.1%19.1%10.6%2.1%0.0%0.0%100.0%
% within sector8.5%0.0%0.0%0.0%0.0%0.0%8.3%0.0%0.0%4.7%0.0%7.9%6.9%11.5%2.4%6.1%1.8%1.0%6.7%6.9%10.0%0.0%0.0%4.9%
% of Total0.7%0.0%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.3%0.0%0.5%0.2%0.3%0.2%0.7%0.1%0.1%0.9%0.5%0.1%0.0%0.0%4.9%
DaeguCount1041001200032070358700044
Expected Count3.70.31.00.60.40.30.50.40.02.91.42.91.31.23.85.22.64.46.13.30.50.60.544.0
% within region2.3%0.0%9.1%2.3%0.0%0.0%2.3%4.5%0.0%0.0%0.0%6.8%4.5%0.0%15.9%0.0%6.8%11.4%18.2%15.9%0.0%0.0%0.0%100.0%
% within sector1.2%0.0%17.4%7.7%0.0%0.0%8.3%25.0%0.0%0.0%0.0%4.8%6.9%0.0%8.4%0.0%5.3%5.2%5.9%9.7%0.0%0.0%0.0%4.6%
% of Total0.1%0.0%0.4%0.1%0.0%0.0%0.1%0.2%0.0%0.0%0.0%0.3%0.2%0.0%0.7%0.0%0.3%0.5%0.8%0.7%0.0%0.0%0.0%4.6%
DaejeonCount0210000002101017917000133
Expected Count2.80.20.80.40.30.20.40.30.02.21.02.11.00.92.83.91.93.34.62.50.30.50.433.0
% within region0.0%6.1%3.0%0.0%0.0%0.0%0.0%0.0%0.0%6.1%3.0%0.0%3.0%0.0%3.0%21.2%27.3%3.0%21.2%0.0%0.0%0.0%3.0%100.0%
% within sector0.0%33.3%4.3%0.0%0.0%0.0%0.0%0.0%0.0%3.1%3.3%0.0%3.4%0.0%1.2%6.1%15.8%1.0%5.2%0.0%0.0%0.0%9.1%3.4%
% of Total0.0%0.2%0.1%0.0%0.0%0.0%0.0%0.0%0.0%0.2%0.1%0.0%0.1%0.0%0.1%0.7%0.9%0.1%0.7%0.0%0.0%0.0%0.1%3.4%
GanwonCount2000000001122000301100013
Expected Count1.10.10.30.20.10.10.20.10.00.90.40.80.40.31.11.50.81.31.81.00.10.20.113.0
% within region15.4%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%7.7%7.7%15.4%15.4%0.0%0.0%0.0%23.1%0.0%7.7%7.7%0.0%0.0%0.0%100.0%
% within sector2.4%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%1.6%3.3%3.2%6.9%0.0%0.0%0.0%5.3%0.0%0.7%1.4%0.0%0.0%0.0%1.3%
% of Total0.2%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.1%0.1%0.2%0.2%0.0%0.0%0.0%0.3%0.0%0.1%0.1%0.0%0.0%0.0%1.3%
GwangjuCount1000000000000024332102018
Expected Count1.50.10.40.20.20.10.20.10.01.20.61.20.50.51.52.11.11.82.51.30.20.30.218.0
% within region5.6%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%11.1%22.2%16.7%16.7%11.1%5.6%0.0%11.1%0.0%100.0%
% within sector1.2%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%2.4%3.5%5.3%3.1%1.5%1.4%0.0%14.3%0.0%1.9%
% of Total0.1%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.2%0.4%0.3%0.3%0.2%0.1%0.0%0.2%0.0%1.9%
GyeongbukCount6110011004065125004901047
Expected Count4.00.31.10.60.40.30.60.40.03.11.53.11.41.34.05.62.84.76.63.50.50.70.547.0
% within region12.8%2.1%2.1%0.0%0.0%2.1%2.1%0.0%0.0%8.5%0.0%12.8%10.6%2.1%4.3%10.6%0.0%0.0%8.5%19.1%0.0%2.1%0.0%100.0%
% within sector7.3%16.7%4.3%0.0%0.0%14.3%8.3%0.0%0.0%6.3%0.0%9.5%17.2%3.8%2.4%4.3%0.0%0.0%3.0%12.5%0.0%7.1%0.0%4.9%
% of Total0.6%0.1%0.1%0.0%0.0%0.1%0.1%0.0%0.0%0.4%0.0%0.6%0.5%0.1%0.2%0.5%0.0%0.0%0.4%0.9%0.0%0.1%0.0%4.9%
GyeonggiCount12033227401752297235421433924171306
Expected Count25.91.97.34.12.82.23.82.50.320.39.519.99.28.226.336.418.030.742.722.83.24.43.5306.0
% within region3.9%0.0%1.0%1.0%0.7%0.7%2.3%1.3%0.0%5.6%1.6%7.2%2.9%2.3%7.5%17.6%6.9%14.1%12.7%7.8%0.3%2.3%0.3%100.0%
% within sector14.6%0.0%13.0%23.1%22.2%28.6%58.3%50.0%0.0%26.6%16.7%34.9%31.0%26.9%27.7%47.0%36.8%44.3%28.9%33.3%10.0%50.0%9.1%31.6%
% of Total1.2%0.0%0.3%0.3%0.2%0.2%0.7%0.4%0.0%1.8%0.5%2.3%0.9%0.7%2.4%5.6%2.2%4.4%4.0%2.5%0.1%0.7%0.1%31.6%
GyeonnamCount70203000050814810412630064
Expected Count5.40.41.50.90.60.50.80.50.14.22.04.21.91.75.57.63.86.48.94.80.70.90.764.0
% within region10.9%0.0%3.1%0.0%4.7%0.0%0.0%0.0%0.0%7.8%0.0%12.5%1.6%6.3%12.5%1.6%0.0%6.3%18.8%9.4%4.7%0.0%0.0%100.0%
% within sector8.5%0.0%8.7%0.0%33.3%0.0%0.0%0.0%0.0%7.8%0.0%12.7%3.4%15.4%9.6%0.9%0.0%4.1%8.9%8.3%30.0%0.0%0.0%6.6%
% of Total0.7%0.0%0.2%0.0%0.3%0.0%0.0%0.0%0.0%0.5%0.0%0.8%0.1%0.4%0.8%0.1%0.0%0.4%1.2%0.6%0.3%0.0%0.0%6.6%
IncheonCount400002010604114531010201357
Expected Count4.80.41.40.80.50.40.70.50.13.81.83.71.71.54.96.83.45.78.04.20.60.80.657.0
% within region7.0%0.0%0.0%0.0%0.0%3.5%0.0%1.8%0.0%10.5%0.0%7.0%1.8%1.8%7.0%8.8%5.3%17.5%17.5%3.5%0.0%1.8%5.3%100.0%
% within sector4.9%0.0%0.0%0.0%0.0%28.6%0.0%12.5%0.0%9.4%0.0%6.3%3.4%3.8%4.8%4.3%5.3%10.3%7.4%2.8%0.0%7.1%27.3%5.9%
% of Total0.4%0.0%0.0%0.0%0.0%0.2%0.0%0.1%0.0%0.6%0.0%0.4%0.1%0.1%0.4%0.5%0.3%1.0%1.0%0.2%0.0%0.1%0.3%5.9%
JejuCount300000000100000000000004
Expected Count0.30.00.10.10.00.00.00.00.00.30.10.30.10.10.30.50.20.40.60.30.00.10.04.0
% within region75.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%25.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%100.0%
% within sector3.7%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%1.6%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.4%
% of Total0.3%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.4%
JeollabukCount5011000001010101022001016
Expected Count1.40.10.40.20.10.10.20.10.01.10.51.00.50.41.41.90.91.62.21.20.20.20.216.0
% within region31.3%0.0%6.3%6.3%0.0%0.0%0.0%0.0%0.0%6.3%0.0%6.3%0.0%6.3%0.0%6.3%0.0%12.5%12.5%0.0%0.0%6.3%0.0%100.0%
% within sector6.1%0.0%4.3%7.7%0.0%0.0%0.0%0.0%0.0%1.6%0.0%1.6%0.0%3.8%0.0%0.9%0.0%2.1%1.5%0.0%0.0%7.1%0.0%1.7%
% of Total0.5%0.0%0.1%0.1%0.0%0.0%0.0%0.0%0.0%0.1%0.0%0.1%0.0%0.1%0.0%0.1%0.0%0.2%0.2%0.0%0.0%0.1%0.0%1.7%
JeollnamCount4100000002011230012100018
Expected Count1.50.10.40.20.20.10.20.10.01.20.61.20.50.51.52.11.11.82.51.30.20.30.218.0
% within region22.2%5.6%0.0%0.0%0.0%0.0%0.0%0.0%0.0%11.1%0.0%5.6%5.6%11.1%16.7%0.0%0.0%5.6%11.1%5.6%0.0%0.0%0.0%100.0%
% within sector4.9%16.7%0.0%0.0%0.0%0.0%0.0%0.0%0.0%3.1%0.0%1.6%3.4%7.7%3.6%0.0%0.0%1.0%1.5%1.4%0.0%0.0%0.0%1.9%
% of Total0.4%0.1%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.2%0.0%0.1%0.1%0.2%0.3%0.0%0.0%0.1%0.2%0.1%0.0%0.0%0.0%1.9%
SejongCount100000000000000000010002
Expected Count0.20.00.00.00.00.00.00.00.00.10.10.10.10.10.20.20.10.20.30.10.00.00.02.0
% within region50.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%50.0%0.0%0.0%0.0%100.0%
% within sector1.2%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%1.4%0.0%0.0%0.0%0.2%
% of Total0.1%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.0%0.2%
SeoulCount152761021182033314221218153105162
Expected Count13.71.03.92.21.51.22.01.30.210.75.010.64.94.413.919.39.516.322.612.11.72.31.8162.0
% within region9.3%1.2%4.3%3.7%0.6%0.0%1.2%0.6%0.6%4.9%12.3%1.9%1.9%1.9%8.6%13.6%7.4%11.1%9.3%1.9%0.6%0.0%3.1%100.0%
% within sector18.3%33.3%30.4%46.2%11.1%0.0%16.7%12.5%100.0%12.5%66.7%4.8%10.3%11.5%16.9%19.1%21.1%18.6%11.1%4.2%10.0%0.0%45.5%16.8%
% of Total1.6%0.2%0.7%0.6%0.1%0.0%0.2%0.1%0.1%0.8%2.1%0.3%0.3%0.3%1.4%2.3%1.2%1.9%1.6%0.3%0.1%0.0%0.5%16.8%
UlsanCount0000010002010212011320016
Expected Count1.40.10.40.20.10.10.20.10.01.10.51.00.50.41.41.90.91.62.21.20.20.20.216.0
% within region0.0%0.0%0.0%0.0%0.0%6.3%0.0%0.0%0.0%12.5%0.0%6.3%0.0%12.5%6.3%12.5%0.0%6.3%6.3%18.8%12.5%0.0%0.0%100.0%
% within sector0.0%0.0%0.0%0.0%0.0%14.3%0.0%0.0%0.0%3.1%0.0%1.6%0.0%7.7%1.2%1.7%0.0%1.0%0.7%4.2%20.0%0.0%0.0%1.7%
% of Total0.0%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.0%0.2%0.0%0.1%0.0%0.2%0.1%0.2%0.0%0.1%0.1%0.3%0.2%0.0%0.0%1.7%
TotalCount8262313971281643063292683115579713572101411967
Expected Count82.06.023.013.09.07.012.08.01.064.030.063.029.026.083.0115.057.097.0135.072.010.014.011.0967.0
% within region8.5%.6%2.4%1.3%0.9%0.7%1.2%0.8%0.1%6.6%3.1%6.5%3.0%2.7%8.6%11.9%5.9%10.0%14.0%7.4%1.0%1.4%1.1%100.0%
% within sector100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%
% of Total8.5%0.6%2.4%1.3%0.9%0.7%1.2%0.8%0.1%6.6%3.1%6.5%3.0%2.7%8.6%11.9%5.9%10.0%14.0%7.4%1.0%1.4%1.1%100.0%
Table A9. Cross-tabulation between regions and sectors in KIS 2016.
Table A9. Cross-tabulation between regions and sectors in KIS 2016.
SectorTotal
1011131415161718192021222324252627282930313233
RegionBusanCount1111032201611317751133010320120
Expected Count8.2.41.22.7.81.32.7.6.24.81.710.32.73.66.715.35.410.023.214.91.61.3.4120.0
% within region9.2%0.8%0.8%0.0%2.5%1.7%1.7%0.0%0.8%5.0%0.8%10.8%0.8%5.8%5.8%4.2%0.8%10.8%25.0%8.3%2.5%1.7%0.0%100.0%
% within sector9.9%16.7%6.3%0.0%27.3%11.8%5.6%0.0%33.3%9.2%4.3%9.4%2.8%14.3%7.8%2.4%1.4%9.7%9.6%5.0%14.3%11.8%0.0%7.4%
% of Total0.7%0.1%0.1%0.0%0.2%0.1%0.1%0.0%0.1%0.4%0.1%0.8%0.1%0.4%0.4%0.3%0.1%0.8%1.9%0.6%0.2%0.1%0.0%7.4%
ChungcheongbukCount1112010200731421493711701086
Expected Count5.9.3.92.0.6.91.9.4.23.51.27.41.92.64.811.03.97.116.710.61.1.9.386.0
% within region12.8%1.2%2.3%0.0%1.2%0.0%2.3%0.0%0.0%8.1%3.5%16.3%2.3%1.2%4.7%10.5%3.5%8.1%12.8%8.1%0.0%1.2%0.0%100.0%
% within sector9.9%16.7%12.5%0.0%9.1%0.0%5.6%0.0%0.0%10.8%13.0%10.1%5.6%2.0%4.4%4.4%4.1%5.2%3.5%3.5%0.0%5.9%0.0%5.3%
% of Total0.7%0.1%0.1%0.0%0.1%0.0%0.1%0.0%0.0%0.4%0.2%0.9%0.1%0.1%0.2%0.6%0.2%0.4%0.7%0.4%0.0%0.1%0.0%5.3%
ChungCheongnamCount142000020052931312562422000110
Expected Count7.6.41.12.5.71.22.5.5.24.41.69.52.53.36.114.05.09.121.313.61.41.2.3110.0
% within region12.7%1.8%0.0%0.0%0.0%0.0%1.8%0.0%0.0%4.5%1.8%8.2%2.7%0.9%2.7%10.9%4.5%5.5%21.8%20.0%0.0%0.0%0.0%100.0%
% within sector12.6%33.3%0.0%0.0%0.0%0.0%5.6%0.0%0.0%7.7%8.7%6.5%8.3%2.0%3.3%5.8%6.8%4.5%7.7%11.0%0.0%0.0%0.0%6.8%
% of Total0.9%0.1%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.3%0.1%0.6%0.2%0.1%0.2%0.7%0.3%0.4%1.5%1.4%0.0%0.0%0.0%6.8%
DaeguCount402001230208011713742422010111
Expected Count7.6.41.12.5.81.22.5.5.24.51.69.52.53.46.214.15.09.221.513.71.41.2.3111.0
% within region3.6%0.0%1.8%0.0%0.0%0.9%1.8%2.7%0.0%1.8%0.0%7.2%0.0%0.9%15.3%11.7%6.3%3.6%21.6%19.8%0.0%0.9%0.0%100.0%
% within sector3.6%0.0%12.5%0.0%0.0%5.9%5.6%37.5%0.0%3.1%0.0%5.8%0.0%2.0%18.9%6.3%9.6%3.0%7.7%11.0%0.0%5.9%0.0%6.9%
% of Total0.2%0.0%0.1%0.0%0.0%0.1%0.1%0.2%0.0%0.1%0.0%0.5%0.0%0.1%1.1%0.8%0.4%0.2%1.5%1.4%0.0%0.1%0.0%6.9%
DaejeonCount20000010032323281025200045
Expected Count3.1.2.41.0.3.51.0.2.11.8.63.91.01.42.55.72.03.78.75.6.6.5.145.0
% within region4.4%0.0%0.0%0.0%0.0%0.0%2.2%0.0%0.0%6.7%4.4%6.7%4.4%6.7%4.4%17.8%22.2%4.4%11.1%4.4%0.0%0.0%0.0%100.0%
% within sector1.8%0.0%0.0%0.0%0.0%0.0%2.8%0.0%0.0%4.6%8.7%2.2%5.6%6.1%2.2%3.9%13.7%1.5%1.6%1.0%0.0%0.0%0.0%2.8%
% of Total0.1%0.0%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.2%0.1%0.2%0.1%0.2%0.1%0.5%0.6%0.1%0.3%0.1%0.0%0.0%0.0%2.8%
GanwonCount2100000001121000331100016
Expected Count1.1.1.2.4.1.2.4.1.0.6.21.4.4.5.92.0.71.33.12.0.2.2.016.0
% within region12.5%6.3%0.0%0.0%0.0%0.0%0.0%0.0%0.0%6.3%6.3%12.5%6.3%0.0%0.0%0.0%18.8%18.8%6.3%6.3%0.0%0.0%0.0%100.0%
% within sector1.8%16.7%0.0%0.0%0.0%0.0%0.0%0.0%0.0%1.5%4.3%1.4%2.8%0.0%0.0%0.0%4.1%2.2%0.3%0.5%0.0%0.0%0.0%1.0%
% of Total0.1%0.1%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.1%0.1%0.1%0.1%0.0%0.0%0.0%0.2%0.2%0.1%0.1%0.0%0.0%0.0%1.0%
GwangjuCount20000010001201232271100135
Expected Count2.4.1.3.8.2.4.8.2.11.4.53.0.81.11.94.51.62.96.84.3.5.4.135.0
% within region5.7%0.0%0.0%0.0%0.0%0.0%2.9%0.0%0.0%0.0%2.9%5.7%0.0%2.9%5.7%8.6%5.7%5.7%20.0%31.4%0.0%0.0%2.9%100.0%
% within sector1.8%0.0%0.0%0.0%0.0%0.0%2.8%0.0%0.0%0.0%4.3%1.4%0.0%2.0%2.2%1.5%2.7%1.5%2.2%5.5%0.0%0.0%20.0%2.2%
% of Total0.1%0.0%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.0%0.1%0.1%0.0%0.1%0.1%0.2%0.1%0.1%0.4%0.7%0.0%0.0%0.1%2.2%
GyeongbukCount415001200301026911472525030118
Expected Count8.1.41.22.7.81.22.6.6.24.71.710.12.63.66.615.05.39.822.914.61.51.2.4118.0
% within region3.4%0.8%4.2%0.0%0.0%0.8%1.7%0.0%0.0%2.5%0.0%8.5%1.7%5.1%7.6%9.3%3.4%5.9%21.2%21.2%0.0%2.5%0.0%100.0%
% within sector3.6%16.7%31.3%0.0%0.0%5.9%5.6%0.0%0.0%4.6%0.0%7.2%5.6%12.2%10.0%5.3%5.5%5.2%8.0%12.5%0.0%17.6%0.0%7.3%
% of Total0.2%0.1%0.3%0.0%0.0%0.1%0.1%0.0%0.0%0.2%0.0%0.6%0.1%0.4%0.6%0.7%0.2%0.4%1.5%1.5%0.0%0.2%0.0%7.3%
GyeonggiCount19031121520207341312176923498425253406
Expected Count27.91.54.09.32.84.39.02.0.816.35.834.99.012.322.651.818.333.778.650.25.34.31.3406.0
% within region4.7%0.0%0.7%0.2%0.2%0.5%3.7%0.5%0.0%4.9%1.7%8.4%3.2%3.0%4.2%17.0%5.7%12.1%20.7%6.2%0.5%1.2%0.7%100.0%
% within sector17.1%0.0%18.8%2.7%9.1%11.8%41.7%25.0%0.0%30.8%30.4%24.5%36.1%24.5%18.9%33.5%31.5%36.6%26.8%12.5%9.5%29.4%60.0%25.1%
% of Total1.2%0.0%0.2%0.1%0.1%0.1%0.9%0.1%0.0%1.2%0.4%2.1%0.8%0.7%1.1%4.3%1.4%3.0%5.2%1.5%0.1%0.3%0.2%25.1%
GyeonnamCount140000000120132186483533900136
Expected Count9.3.51.33.1.91.43.0.7.35.51.911.73.04.17.617.36.111.326.316.81.81.4.4136.0
% within region10.3%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.7%1.5%0.0%9.6%1.5%0.7%5.9%4.4%2.9%5.9%25.7%24.3%6.6%0.0%0.0%100.0%
% within sector12.6%0.0%0.0%0.0%0.0%0.0%0.0%0.0%33.3%3.1%0.0%9.4%5.6%2.0%8.9%2.9%5.5%6.0%11.2%16.5%42.9%0.0%0.0%8.4%
% of Total0.9%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.1%0.1%0.0%0.8%0.1%0.1%0.5%0.4%0.2%0.5%2.2%2.0%0.6%0.0%0.0%8.4%
IncheonCount70100900062203711322154017040176
Expected Count12.1.71.74.01.21.93.9.9.37.12.515.13.95.39.822.48.014.634.121.82.31.9.5176.0
% within region4.0%0.0%0.6%0.0%0.0%5.1%0.0%0.0%0.0%3.4%1.1%11.4%1.7%4.0%6.3%18.2%1.1%8.5%22.7%9.7%0.0%2.3%0.0%100.0%
% within sector6.3%0.0%6.3%0.0%0.0%52.9%0.0%0.0%0.0%9.2%8.7%14.4%8.3%14.3%12.2%15.5%2.7%11.2%12.8%8.5%0.0%23.5%0.0%10.9%
% of Total0.4%0.0%0.1%0.0%0.0%0.6%0.0%0.0%0.0%0.4%0.1%1.2%0.2%0.4%0.7%2.0%0.1%0.9%2.5%1.1%0.0%0.2%0.0%10.9%
JejuCount100000000000100000000002
Expected Count.1.0.0.0.0.0.0.0.0.1.0.2.0.1.1.3.1.2.4.2.0.0.02.0
% within region50.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%50.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%100.0%
% within sector0.9%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%2.8%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.1%
% of Total0.1%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.1%
JeollabukCount8000001000010011025820029
Expected Count2.0.1.3.7.2.3.6.1.11.2.42.5.6.91.63.71.32.45.63.6.4.3.129.0
% within region27.6%0.0%0.0%0.0%0.0%0.0%3.4%0.0%0.0%0.0%0.0%3.4%0.0%0.0%3.4%3.4%0.0%6.9%17.2%27.6%6.9%0.0%0.0%100.0%
% within sector7.2%0.0%0.0%0.0%0.0%0.0%2.8%0.0%0.0%0.0%0.0%0.7%0.0%0.0%1.1%0.5%0.0%1.5%1.6%4.0%9.5%0.0%0.0%1.8%
% of Total0.5%0.0%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.1%0.1%0.0%0.1%0.3%0.5%0.1%0.0%0.0%1.8%
JeollnamCount5000010003120221035121029
Expected Count2.0.1.3.7.2.3.6.1.11.2.42.5.6.91.63.71.32.45.63.6.4.3.129.0
% within region17.2%0.0%0.0%0.0%0.0%3.4%0.0%0.0%0.0%10.3%3.4%6.9%0.0%6.9%6.9%3.4%0.0%10.3%17.2%3.4%6.9%3.4%0.0%100.0%
% within sector4.5%0.0%0.0%0.0%0.0%5.9%0.0%0.0%0.0%4.6%4.3%1.4%0.0%4.1%2.2%0.5%0.0%2.2%1.6%0.5%9.5%5.9%0.0%1.8%
% of Total0.3%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.0%0.2%0.1%0.1%0.0%0.1%0.1%0.1%0.0%0.2%0.3%0.1%0.1%0.1%0.0%1.8%
SejongCount0000002001103002120200014
Expected Count1.0.1.1.3.1.1.3.1.0.6.21.2.3.4.81.8.61.22.71.7.2.1.014.0
% within region0.0%0.0%0.0%0.0%0.0%0.0%14.3%0.0%0.0%7.1%7.1%0.0%21.4%0.0%0.0%14.3%7.1%14.3%0.0%14.3%0.0%0.0%0.0%100.0%
% within sector0.0%0.0%0.0%0.0%0.0%0.0%5.6%0.0%0.0%1.5%4.3%0.0%8.3%0.0%0.0%1.0%1.4%1.5%0.0%1.0%0.0%0.0%0.0%0.9%
% of Total0.0%0.0%0.0%0.0%0.0%0.0%0.1%0.0%0.0%0.1%0.1%0.0%0.2%0.0%0.0%0.1%0.1%0.1%0.0%0.1%0.0%0.0%0.0%0.9%
SeoulCount602366163052421433610121001141
Expected Count9.7.51.43.21.01.53.1.7.35.72.012.13.14.37.918.06.411.727.317.51.81.5.4141.0
% within region4.3%0.0%1.4%25.5%4.3%0.7%4.3%2.1%0.0%3.5%1.4%2.8%1.4%0.7%2.8%23.4%4.3%7.1%8.5%0.7%0.0%0.0%0.7%100.0%
% within sector5.4%0.0%12.5%97.3%54.5%5.9%16.7%37.5%0.0%7.7%8.7%2.9%5.6%2.0%4.4%16.0%8.2%7.5%3.8%0.5%0.0%0.0%20.0%8.7%
% of Total0.4%0.0%0.1%2.2%0.4%0.1%0.4%0.2%0.0%0.3%0.1%0.2%0.1%0.1%0.2%2.0%0.4%0.6%0.7%0.1%0.0%0.0%0.1%8.7%
UlsanCount10000000110416312151330042
Expected Count2.9.2.41.0.3.4.9.2.11.7.63.6.91.32.35.41.93.58.15.2.5.4.142.0
% within region2.4%0.0%0.0%0.0%0.0%0.0%0.0%0.0%2.4%2.4%0.0%9.5%2.4%14.3%7.1%2.4%4.8%2.4%11.9%31.0%7.1%0.0%0.0%100.0%
% within sector0.9%0.0%0.0%0.0%0.0%0.0%0.0%0.0%33.3%1.5%0.0%2.9%2.8%12.2%3.3%0.5%2.7%0.7%1.6%6.5%14.3%0.0%0.0%2.6%
% of Total0.1%0.0%0.0%0.0%0.0%0.0%0.0%0.0%0.1%0.1%0.0%0.2%0.1%0.4%0.2%0.1%0.1%0.1%0.3%0.8%0.2%0.0%0.0%2.6%
TotalCount1116163711173683652313936499020673134313200211751616
Expected Count111.06.016.037.011.017.036.08.03.065.023.0139.036.049.090.0206.073.0134.0313.0200.021.017.05.01616.0
% within region6.9%0.4%1.0%2.3%0.7%1.1%2.2%0.5%0.2%4.0%1.4%8.6%2.2%3.0%5.6%12.7%4.5%8.3%19.4%12.4%1.3%1.1%0.3%100.0%
% within sector100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%100.0%
% of Total6.9%0.4%1.0%2.3%0.7%1.1%2.2%0.5%0.2%4.0%1.4%8.6%2.2%3.0%5.6%12.7%4.5%8.3%19.4%12.4%1.3%1.1%0.3%100.0%

References

  1. Cho, C.; Park, S.Y.; Son, J.K.; Lee, S. R&D support services for small and medium-sized enterprises: The different perspectives of clients and service providers, and the roles of intermediaries. Sci. Public Policy 2016, 43, 859–871. [Google Scholar]
  2. Cho, C.; Park, S.Y.; Son, J.K.; Lee, S. Comparative analysis of R&D-based innovation capabilities in SMEs to design innovation policy. Sci. Public Policy 2017, 44, 403–416. [Google Scholar]
  3. Radas, S.; Božić, L. The antecedents of SME innovativeness in an emerging transition economy. Technovation 2009, 29, 438–450. [Google Scholar] [CrossRef]
  4. Zhang, Y.; Khan, U.; Lee, S.; Salik, M. The Influence of Management Innovation and Technological Innovation on Organization Performance. A Mediating Role of Sustainability. Sustainability 2019, 11, 495. [Google Scholar] [CrossRef]
  5. Michelino, F.; Cammarano, A.; Celone, A.; Caputo, M. The Linkage between Sustainability and Innovation Performance in IT Hardware Sector. Sustainability 2019, 11, 4275. [Google Scholar] [CrossRef]
  6. Wehnert, P.; Kollwitz, C.; Daiberl, C.; Dinter, B.; Beckmann, M. Capturing the Bigger Picture? Applying Text Analytics to Foster Open Innovation Processes for Sustainability-Oriented Innovation. Sustainability 2018, 10, 3710. [Google Scholar] [CrossRef]
  7. Shin, J.; Kim, C.; Yang, H. The Effect of Sustainability as Innovation Objectives on Innovation Efficiency. Sustainability 2018, 10, 1966. [Google Scholar] [CrossRef]
  8. Bessant, J.; Lamming, R.; Noke, H.; Phillips, W. Managing innovation beyond the steady state. Technovation 2005, 25, 1366–1376. [Google Scholar] [CrossRef]
  9. Hall, L.A.; Bagchi-Sen, S. An analysis of firm-level innovation strategies in the US biotechnology industry. Technovation 2007, 27, 4–14. [Google Scholar] [CrossRef]
  10. Kapsali, M. How to implement innovation policies through projects successfully. Technovation 2011, 31, 615–626. [Google Scholar] [CrossRef]
  11. Hobday, M.; Boddington, A.; Grantham, A. Policies for design and policies for innovation: Contrasting perspectives and remaining challenges. Technovation 2012, 32, 272–281. [Google Scholar] [CrossRef]
  12. Samara, E.; Georgiadis, P.; Bakouros, I. The impact of innovation policies on the performance of national innovation systems: A system dynamics analysis. Technovation 2012, 32, 624–638. [Google Scholar] [CrossRef]
  13. Aubert, B.A.; Kishore, R.; Iriyama, A. Exploring and managing the “innovation through outsourcing” paradox. J. Strateg. Inf. Syst. 2015, 24, 255–269. [Google Scholar] [CrossRef]
  14. Soetanto, D.; Jack, S. The impact of university-based incubation support on the innovation strategy of academic spin-offs. Technovation 2016, 50, 25–40. [Google Scholar] [CrossRef]
  15. Curnow, R.C.; Moring, G.G. ‘Project sappho’: A study in industrial innovation. Futures 1968, 1, 82–90. [Google Scholar] [CrossRef]
  16. Rothwell, R.; Freeman, C.; Horlsey, A.; Jervis, V.T.P.; Robertson, A.B.; Townsend, J. SAPPHO updated-project SAPPHO phase II. Res. Policy 1974, 3, 258–291. [Google Scholar] [CrossRef]
  17. Freeman, C.; Soete, L. Success and Failure in Industrial Innovation. In The Economics of Industrial Innovation, 3rd ed.; MIT Press: Boston, MA, USA, 1997; pp. 197–226. [Google Scholar]
  18. Dziallas, M.; Blind, K. Innovation indicators throughout the innovation process: An extensive literature analysis. Technovation 2019, 80, 3–29. [Google Scholar] [CrossRef]
  19. Becheikh, N.; Landry, R.; Amara, N. Lessons from innovation empirical studies in the manufacturing sector: A systematic review of the literature from 1993–2003. Technovation 2006, 26, 644–664. [Google Scholar] [CrossRef]
  20. Rothwell, R. Successful industrial innovation: Critical factors for the 1990s. R D Manag. 1992, 22, 221–240. [Google Scholar] [CrossRef]
  21. Coombs, R.; Narandren, P.; Richards, A. A literature-based innovation output indicator. Res. Policy 1996, 25, 403–413. [Google Scholar] [CrossRef]
  22. Souitaris, V. External communication determinants of innovation in the context of a newly industrialised country: A comparison of objective and perceptual results from Greece. Technovation 2001, 21, 25–34. [Google Scholar] [CrossRef]
  23. Wolfe, R.A. Organizational innovation: Review, critique and suggested research directions. J. Manag. Stud. 1994, 31, 405–431. [Google Scholar] [CrossRef]
  24. Asheim, B.T.; Isaksen, A. Location, agglomeration and innovation: Towards regional innovation systems in Norway? Eur. Plan. Stud. 1997, 5, 299–330. [Google Scholar] [CrossRef] [Green Version]
  25. Michie, J. Introduction. The Internationalisation of the Innovation Process. Int. J. Econ. Bus. 1998, 5, 261–277. [Google Scholar] [CrossRef]
  26. Amitrano, C.C.; Tregua, M.; Russo Spena, T.; Bifulco, F. On Technology in Innovation Systems and Innovation-Ecosystem Perspectives: A Cross-Linking Analysis. Sustainability 2018, 10, 3744. [Google Scholar] [CrossRef]
  27. Wang, C.-H.; Chin, Y.-C.; Tzeng, G.-H. Mining the R&D innovation performance processes for high-tech firms based on rough set theory. Technovation 2010, 30, 447–458. [Google Scholar]
  28. Bastı, E.; Kuzey, C.; Delen, D. Analyzing initial public offerings’ short-term performance using decision trees and SVMs. Decis. Support Syst. 2015, 73, 15–27. [Google Scholar] [CrossRef]
  29. Evangelista, R.; Perani, G.; Rapiti, F.; Archibugi, D. Nature and impact of innovation in manufacturing industry: Some evidence from the Italian innovation survey. Res. Policy 1997, 26, 521–536. [Google Scholar] [CrossRef]
  30. Roberts, E.B. Managing Invention and Innovation. Res. Technol. Manag. 2007, 50, 35–54. [Google Scholar] [CrossRef]
  31. Dewangan, V.; Godse, M. Towards a holistic enterprise innovation performance measurement system. Technovation 2014, 34, 536–545. [Google Scholar] [CrossRef]
  32. Freeman, C.; Soete, L. Developing science, technology and innovation indicators: What we can learn from the past. Res. Policy 2009, 38, 583–589. [Google Scholar] [CrossRef] [Green Version]
  33. Evanschitzky, H.; Eisend, M.; Calantone, R.J.; Jiang, Y. Success factors of product innovation: An updated meta-analysis. J. Prod. Innov. Manag. 2012, 29, 21–37. [Google Scholar] [CrossRef]
  34. Archibugi, D.; Planta, M. Measuring technological change through patents and innovation surveys. Technovation 1996, 16, 451–519. [Google Scholar] [CrossRef]
  35. Adams, R.; Bessant, J.; Phelps, R. Innovation management measurement: A review. Int. J. Manag. Rev. 2006, 8, 21–47. [Google Scholar] [CrossRef]
  36. Cruz-Cázares, C.; Bayona-Sáez, C.; García-Marco, T. You can’t manage right what you can’t measure well: Technological innovation efficiency. Res. Policy 2013, 42, 1239–1250. [Google Scholar] [CrossRef]
  37. Dodgson, M.; Hinze, S. Indicators used to measure the innovation process: Defects and possible remedies. Res. Eval. 2000, 9, 101–114. [Google Scholar] [CrossRef]
  38. OECD. Oslo Manual: The Measurement of Scientific and Technological Activities: Proposed Guidelines for Collecting and Interpreting Technological Innovation Data, 3rd ed.; OECD: Paris, France, 2005; p. 46. [Google Scholar]
  39. Kalantaridis, C. Processes of innovation among manufacturing SMEs: The experience of Bedfordshire. Entrep. Reg. Dev. 1999, 11, 57–78. [Google Scholar] [CrossRef]
  40. Kam, W.P.; Kiese, M.; Singh, A.; Wong, F. The pattern of innovation in Singapore’s manufacturing sector. Singap. Manag. Rev. 2003, 25, 1–34. [Google Scholar]
  41. Quadros, R.; Furtado, A.; Bernardes, R.; Franco, E. Technological innovation in Brazilian industry: An assessment based on the São Paulo innovation survey. Technol. Forecast. Soc. Chang. 2001, 67, 203–219. [Google Scholar] [CrossRef]
  42. Uzun, A. Technological innovation activities in Turkey: The case of manufacturing industry, 1995–1997. Technovation 2001, 21, 189–196. [Google Scholar] [CrossRef]
  43. Baptista, R.; Swann, P. Do firms in clusters innovate more? Res. Policy 1998, 27, 525–540. [Google Scholar] [CrossRef]
  44. Michie, J.; Sheehan, M. Labour market deregulation,‘flexibility’and innovation. Camb. J. Econ. 2003, 27, 123–143. [Google Scholar] [CrossRef]
  45. Zahra, S.A. Environment, corporate entrepreneurship, and financial performance: A taxonomic approach. J. Bus. Ventur. 1993, 8, 319–340. [Google Scholar] [CrossRef]
  46. Blundell, R.; Griffith, R.; Van Reenen, J. Market share, market value and innovation in a panel of British manufacturing firms. Rev. Econ. Stud. 1999, 66, 529–554. [Google Scholar] [CrossRef]
  47. Koeller, C.T. Innovation, market structure and firm size: A simultaneous equations model. Manag. Decis. Econ. 1995, 16, 259–269. [Google Scholar] [CrossRef]
  48. Nielsen, A.O. Patenting, R&D and market structure: Manufacturing firms in Denmark. Technol. Forecast. Soc. Chang. 2001, 66, 47–58. [Google Scholar]
  49. Smolny, W. Determinants of innovation behaviour and investment estimates for West-German manufacturing firms. Econ. Innov. New Technol. 2003, 12, 449–463. [Google Scholar] [CrossRef]
  50. Debackere, K.; Clarysse, B.; Rappa, M.A. Dismantling the ivory tower: The influence of networks on innovative output in emerging technologies. Technol. Forecast. Soc. Chang. 1996, 53, 139–154. [Google Scholar] [CrossRef]
  51. Beneito, P. Choosing among alternative technological strategies: An empirical analysis of formal sources of innovation. Res. Policy 2003, 32, 693–713. [Google Scholar] [CrossRef]
  52. Love, J.H.; Ashcroft, B. Market versus corporate structure in plant-level innovation performance. Small Bus. Econ. 1999, 13, 97–109. [Google Scholar] [CrossRef]
  53. González-Blanco, J.; Coca-Pérez, J.; Guisado-González, M. The Contribution of Technological and Non-Technological Innovation to Environmental Performance. An Analysis with a Complementary Approach. Sustainability 2018, 10, 4014. [Google Scholar] [CrossRef]
  54. Brouwer, E.; Budil-Nadvornikova, H.; Kleinknecht, A. Are urban agglomerations a better breeding place for product innovation? An analysis of new product announcements. Reg. Stud. 2010, 33, 541–549. [Google Scholar] [CrossRef]
  55. Kaufmann, A.; Tödtling, F. Science–industry interaction in the process of innovation: The importance of boundary-crossing between systems. Res. Policy 2001, 30, 791–804. [Google Scholar] [CrossRef]
  56. Wang, L. A study on innovation performance measurement of college students’ venture enterprise based on SFA model. J. Comput. 2012, 7, 1974–1981. [Google Scholar] [CrossRef]
  57. De Fuentes, C.; Dutrenit, G.; Santiago, F.; Gras, N. Determinants of innovation and productivity in the service sector in Mexico. Emerg. Mark. Financ. Trade 2015, 51, 578–592. [Google Scholar] [CrossRef]
  58. Kamasak, R. Determinants of innovation performance: A resource-based study. Procedia-Soc. Behav. Sci. 2015, 195, 1330–1337. [Google Scholar] [CrossRef]
  59. Frey, M.; Iraldo, F.; Testa, F. The determinants of innovation in green supply chains: Evidence from an Italian sectoral study. R D Manag. 2013, 43, 352–364. [Google Scholar] [CrossRef]
  60. MacPherson, A.D. Academic-industry linkages and small firm innovation: Evidence from the scientific instruments sector. Entrep. Reg. Dev. 1998, 10, 261–276. [Google Scholar] [CrossRef]
  61. Romijn, H.; Albaladejo, M. Determinants of innovation capability in small electronics and software firms in southeast England. Res. Policy 2002, 31, 1053–1067. [Google Scholar] [CrossRef]
  62. Keizer, J.A.; Dijkstra, L.; Halman, J.I. Explaining innovative efforts of SMEs. An exploratory survey among SMEs in the mechanical and electrical engineering sector in The Netherlands. Technovation 2002, 22, 1–13. [Google Scholar] [CrossRef]
  63. Trąpczyński, P.; Puślecki, Ł.; Staszków, M. Determinants of Innovation Cooperation Performance: What Do We Know and What Should We Know? Sustainability 2018, 10, 4517. [Google Scholar] [CrossRef]
  64. Cooke, P.; Uranga, M.G.; Etxebarria, G. Regional innovation systems: Institutional and organisational dimensions. Res. Policy 1997, 26, 475–491. [Google Scholar] [CrossRef]
  65. Storper, M.; Harrison, B. Flexibility, hierarchy and regional development: The changing structure of industrial production systems and their forms of governance in the 1990s. Res. Policy 1991, 20, 407–422. [Google Scholar] [CrossRef]
  66. Dicken, P.; Forsgren, M.; Malmberg, A. The local embeddness of transnational corporations. In Globalization, Institutions, and Regional Development in Europe; Amin, A., Thrift, N., Eds.; Oxford University Press: New York, NY, USA, 1995; pp. 23–45. [Google Scholar]
  67. Landry, R.; Amara, N.; Lamari, M. Does social capital determine innovation? To what extent? Technol. Forecast. Soc. Chang. 2002, 69, 681–701. [Google Scholar] [CrossRef]
  68. Ritter, T.; Gemünden, H.G. Network competence: Its impact on innovation success and its antecedents. J. Bus. Res. 2003, 56, 745–755. [Google Scholar] [CrossRef]
  69. Souitaris, V. Technological trajectories as moderators of firm-level determinants of innovation. Res. Policy 2002, 31, 877–898. [Google Scholar] [CrossRef]
  70. Beugelsdijk, S.; Cornet, M. ‘A far friend is worth more than a good neighbour’: Proximity and innovation in a small country. J. Manag. Gov. 2002, 6, 169–188. [Google Scholar] [CrossRef]
  71. Coombs, R.; Tomlinson, M. Patterns in UK company innovation styles: New evidence from the CBI innovation trends survey. Technol. Anal. Strateg. Manag. 1998, 10, 295–310. [Google Scholar] [CrossRef]
  72. Love, J.H.; Roper, S. Location and network effects on innovation success: Evidence for UK, German and Irish manufacturing plants. Res. Policy 2001, 30, 643–661. [Google Scholar] [CrossRef]
  73. Avermaete, T.; Viaene, J.; Morgan, E.J.; Pitts, E.; Crawford, N.; Mahon, D. Determinants of product and process innovation in small food manufacturing firms. Trends Food Sci. Technol. 2004, 15, 474–483. [Google Scholar] [CrossRef]
  74. Åstebro, T.; Michela, J.L. Predictors of the survival of innovations. J. Prod. Innov. Manag. 2005, 22, 322–335. [Google Scholar] [CrossRef]
  75. Bullinger, H.-J.; Bannert, M.; Brunswicker, S. Managing innovation capability in SMEs. The Fraunhofer three-stage approach. Tech Monit. 2007, 24, 17–27. [Google Scholar]
  76. Freeman, C. The economics of technical change. Camb. J. Econ. 1994, 18, 463–514. [Google Scholar] [CrossRef]
  77. Griffin, A.; Page, A.L. An interim report on measuring product development success and failure. J. Prod. Innov. Manag. 1993, 10, 291–308. [Google Scholar] [CrossRef]
  78. Hollenstein, H. Innovation modes in the Swiss service sector: A cluster analysis based on firm-level data. Res. Policy 2003, 32, 845–863. [Google Scholar] [CrossRef]
  79. Thongsri, N.; Chang, A. Interactions Among Factors Influencing Product Innovation and Innovation Behaviour: Market Orientation, Managerial Ties, and Government Support. Sustainability 2019, 11, 2793. [Google Scholar] [CrossRef]
  80. Darroch, J.; McNaughton, R. Examining the link between knowledge management practices and types of innovation. J. Intell. Cap. 2002, 3, 210–222. [Google Scholar] [CrossRef] [Green Version]
  81. Koberg, C.S.; Uhlenbruck, N.; Sarason, Y. Facilitators of organizational innovation: The role of life-cycle stage. J. Bus. Ventur. 1996, 11, 133–149. [Google Scholar] [CrossRef]
  82. Koschatzky, K.; Bross, U.; Stanovnik, P. Development and innovation potential in the Slovene manufacturing industry: Analysis of an industrial innovation survey. Technovation 2001, 21, 311–324. [Google Scholar] [CrossRef]
  83. Koeller, C.T. Union membership, market structure, and the innovation output of large and small firms. J. Labor Res. 1996, 17, 683–699. [Google Scholar] [CrossRef]
  84. Baldwin, J.R.; Johnson, J. Business strategies in more-and less-innovative firms in Canada. Res. Policy 1996, 25, 785–804. [Google Scholar] [CrossRef]
  85. Bughin, J.; Jacques, J.-M. Managerial efficiency and the Schumpeterian link between size, market structure and innovation revisited. Res. Policy 1994, 23, 653–659. [Google Scholar] [CrossRef]
  86. Damanpour, F. Organizational size and innovation. Organ. Stud. 1992, 13, 375–402. [Google Scholar] [CrossRef]
  87. Majumdar, S.K. The determinants of investment in new technology: An examination of alternative hypotheses. Technol. Forecast. Soc. Chang. 1995, 50, 235–247. [Google Scholar] [CrossRef]
  88. Tsai, W. Knowledge transfer in intraorganizational networks: Effects of network position and absorptive capacity on business unit innovation and performance. Acad. Manag. J. 2001, 44, 996–1004. [Google Scholar]
  89. González-Benito, Ó.; Muñoz-Gallego, P.A.; García-Zamora, E. Entrepreneurship and market orientation as determinants of innovation: The role of business size. Int. J. Innov. Manag. 2015, 19, 1550035. [Google Scholar] [CrossRef]
  90. Aldieri, L.; Vinci, C. Firm Size and Sustainable Innovation: A Theoretical and Empirical Analysis. Sustainability 2019, 11, 2775. [Google Scholar] [CrossRef]
  91. Andries, P.; Stephan, U. Environmental Innovation and Firm Performance: How Firm Size and Motives Matter. Sustainability 2019, 11, 3585. [Google Scholar] [CrossRef]
  92. Bertschek, I.; Entorf, H. On nonparametric estimation of the Schumpeterian link between innovation and firm size: Evidence from Belgium, France, and Germany. Empir. Econ. 1996, 21, 401–426. [Google Scholar] [CrossRef]
  93. Schumpeter, J.A. The Theory of Economic Development: An Inquiry into Profits, Capital, Credit, Interest and the Business Cycle; Harvard University Press: Cambridge, MA, USA, 1934. [Google Scholar]
  94. Schumpeter, J.A. Socialism, Capitalism and Democracy; Harper and Brothers: New York, NY, USA, 1942. [Google Scholar]
  95. Sørensen, J.B.; Stuart, T.E. Aging, obsolescence, and organizational innovation. Adm. Sci. Q. 2000, 45, 81–112. [Google Scholar] [CrossRef]
  96. Krasniqi, B.A.; Kutllovci, E.A. Determinants of innovation: Evidence from Czech Republic, Poland and Hungary. Int. J. Technoentrep. 2008, 1, 378–404. [Google Scholar] [CrossRef]
  97. Freel, M. External linkages and product innovation in small manufacturing firms. Entrep. Reg. Dev. 2000, 12, 245–266. [Google Scholar] [CrossRef]
  98. Love, J.H.; Ashcroft, B.; Dunlop, S. Corporate structure, ownership and the likelihood of innovation. Appl. Econ. 1996, 28, 737–746. [Google Scholar] [CrossRef]
  99. Martinez-Ros, E. Explaining the decisions to carry out product and process innovations: The Spanish case. J. High Technol. Manag. Res. 1999, 10, 223–242. [Google Scholar] [CrossRef]
  100. Bishop, P.; Wiseman, N. External ownership and innovation in the United Kingdom. Appl. Econ. 1999, 31, 443–450. [Google Scholar] [CrossRef]
  101. Propris, L.D. Innovation and inter-firm co-operation: The case of the West Midlands. Econ. Innov. New Technol. 2000, 9, 421–446. [Google Scholar] [CrossRef]
  102. Song, C.; Oh, W. Determinants of innovation in energy intensive industry and implications for energy policy. Energy Policy 2015, 81, 122–130. [Google Scholar] [CrossRef]
  103. Arvanitis, S.; Sydow, N.; Woerter, M. Is there any impact of university–industry knowledge transfer on innovation and productivity? An empirical analysis based on Swiss firm data. Rev. Ind. Organ. 2008, 32, 77–94. [Google Scholar] [CrossRef]
  104. Jacobsson, S.; Oskarsson, C.; Philipson, J. Indicators of technological activities-comparing educational, patent and R&D statistics in the case of Sweden. Res. Policy 1996, 25, 573–585. [Google Scholar]
  105. Flor, M.L.; Oltra, M.J. Identification of innovating firms through technological innovation indicators: An application to the Spanish ceramic tile industry. Res. Policy 2004, 33, 323–336. [Google Scholar] [CrossRef]
  106. Sosnowski, J. Precipitating innovations by academia and industry feedback. Procedia-Soc. Behav. Sci. 2014, 109, 113–119. [Google Scholar] [CrossRef]
  107. Kleinknecht, A. Why do we need new innovation output indicators? An introduction. In New Concepts in Innovation Output Measurement; Kleinknecht, A., Bain, D., Eds.; Palgrave Macmillan: London, UK, 1993; pp. 1–9. [Google Scholar]
  108. Cavdar, S.C.; Aydin, A.D. An empirical analysis about technological development and innovation indicators. Procedia-Soc. Behav. Sci. 2015, 195, 1486–1495. [Google Scholar] [CrossRef]
  109. Raymond, L.; St-Pierre, J. R&D as a determinant of innovation in manufacturing SMEs: An attempt at empirical clarification. Technovation 2010, 30, 48–56. [Google Scholar]
  110. Sternberg, R.; Arndt, O. The firm or the region: What determines the innovation behavior of European firms? Econ. Geogr. 2001, 77, 364–382. [Google Scholar] [CrossRef]
  111. Pekovic, S.; Lojpur, A.; Pejic-Bach, M. Determinants of innovation intensity in developed and in developing economies: The case of France and Croatia. Int. J. Innov. Manag. 2015, 19, 1550049. [Google Scholar] [CrossRef]
  112. Cohen, W.M.; Levinthal, D.A. Innovation and learning: The two faces of R&D. Econ. J. 1989, 99, 569–596. [Google Scholar]
  113. Graves, S.B.; Langowitz, N.S. R&D productivity: A global multi-industry comparison. Technol. Forecast. Soc. Chang. 1996, 53, 125–137. [Google Scholar]
  114. Kim, C.Y.; Lim, M.S.; Yoo, J.W. Ambidexterity in External Knowledge Search Strategies and Innovation Performance: Mediating Role of Balanced Innovation and Moderating Role of Absorptive Capacity. Sustainability 2019, 11, 5111. [Google Scholar] [CrossRef]
  115. Loredo, E.; Mielgo, N.; Pineiro-Villaverde, G.; García-Álvarez, M.T. Utilities: Innovation and Sustainability. Sustainability 2019, 11, 1085. [Google Scholar] [CrossRef]
  116. Hastuti, W.; Mardani, A.; Streimikiene, D.; Sharifara, A.; Cavallaro, F. The Role of Process Innovation between Firm-Specific Capabilities and Sustainable Innovation in SMEs: Empirical Evidence from Indonesia. Sustainability 2018, 10, 2244. [Google Scholar] [CrossRef]
  117. Pisano, G.P.; Shan, W.; Teece, D.J. Joint ventures and collaboration in the biotechnology industry. In International Collaborative Ventures in US Manufacturing; Mowery, D., Ed.; Ballinger Publishing Company: Cambridge, MA, USA, 1988. [Google Scholar]
  118. Mohnen, P.; Hoareau, C. What type of enterprise forges close links with universities and government labs? Evidence from CIS 2. Manag. Decis. Econ. 2003, 24, 133–145. [Google Scholar] [CrossRef] [Green Version]
  119. Miotti, L.; Sachwald, F. Co-operative R&D: Why and with whom?: An integrated framework of analysis. Res. Policy 2003, 32, 1481–1499. [Google Scholar]
  120. Becker, W.; Dietz, J. R&D cooperation and innovation activities of firms-evidence for the German manufacturing industry. Res. Policy 2004, 33, 209–223. [Google Scholar]
  121. Sampson, R.C. R&D alliances and firm performance: The impact of technological diversity and alliance organization on innovation. Acad. Manag. J. 2007, 50, 364–386. [Google Scholar]
  122. Abramovsky, L.; Kremp, E.; López, A.; Schmidt, T.; Simpson, H. Understanding co-operative innovative activity: Evidence from four European countries. Econ. Innov. New Technol. 2009, 18, 243–265. [Google Scholar] [CrossRef]
  123. Freel, M.S.; Harrison, R.T. Innovation and cooperation in the small firm sector: Evidence from ‘Northern Britain’. Reg. Stud. 2006, 40, 289–305. [Google Scholar] [CrossRef]
  124. Harrigan, K.R. Joint ventures and competitive strategy. Strateg. Manag. J. 1988, 9, 141–158. [Google Scholar] [CrossRef]
  125. Kogut, B. Joint ventures: Theoretical and empirical perspectives. Strateg. Manag. J. 1988, 9, 319–332. [Google Scholar] [CrossRef]
  126. Kesteloot, K.; Veugelers, R. Stable R&D cooperation with spillovers. J. Econ. Manag. Strategy 1995, 4, 651–672. [Google Scholar]
  127. Barkema, H.G.; Vermeulen, F. What differences in the cultural backgrounds of partners are detrimental for international joint ventures? J. Int. Bus. Stud. 1997, 28, 845–864. [Google Scholar] [CrossRef]
  128. Mora-Valentin, E.M.; Montoro-Sanchez, A.; Guerras-Martin, L.A. Determining factors in the success of R&D cooperative agreements between firms and research organizations. Res. Policy 2004, 33, 17–40. [Google Scholar]
  129. Lhuillery, S.; Pfister, E. R&D cooperation and failures in innovation projects: Empirical evidence from French CIS data. Res. Policy 2009, 38, 45–57. [Google Scholar]
  130. Mata, J.; Woerter, M. Risky innovation: The impact of internal and external R&D strategies upon the distribution of returns. Res. Policy 2013, 42, 495–501. [Google Scholar]
  131. Ozman, M. Inter-firm networks and innovation: A survey of literature. Econ. Innov. New Technol. 2009, 18, 39–67. [Google Scholar] [CrossRef]
  132. Oliver, C. Determinants of interorganizational relationships: Integration and future directions. Acad. Manag. Rev. 1990, 15, 241–265. [Google Scholar] [CrossRef]
  133. Okamuro, H. Determinants of successful R&D cooperation in Japanese small businesses: The impact of organizational and contractual characteristics. Res. Policy 2007, 36, 1529–1544. [Google Scholar] [Green Version]
  134. Cassiman, B.; Veugelers, R. In search of complementarity in innovation strategy: Internal R&D and external knowledge acquisition. Manag. Sci. 2006, 52, 68–82. [Google Scholar]
  135. Beneito, P. The innovative performance of in-house and contracted R&D in terms of patents and utility models. Res. Policy 2006, 35, 502–517. [Google Scholar]
  136. Lokshin, B.; Belderbos, R.; Carree, M. The productivity effects of internal and external R&D: Evidence from a dynamic panel data model. Oxf. Bull. Econ. Stat. 2008, 70, 399–413. [Google Scholar]
  137. Hagedoorn, J.; Wang, N. Is there complementarity or substitutability between internal and external R&D strategies? Res. Policy 2012, 41, 1072–1083. [Google Scholar] [Green Version]
  138. Hou, J.; Chen, J.; Song, H.; Wang, G. Are Non-R&D Innovation Activities Actually Effective for Innovation Sustainability? Empirical Study from Chinese High-Tech Industry. Sustainability 2018, 11, 174. [Google Scholar] [Green Version]
  139. Blind, K.; Edler, J.; Frietsch, R.; Schmoch, U. Motives to patent: Empirical evidence from Germany. Res. Policy 2006, 35, 655–672. [Google Scholar] [CrossRef]
  140. Kleinknecht, A.; Van Montfort, K.; Brouwer, E. The non-trivial choice between innovation indicators. Econ. Innov. New Technol. 2002, 11, 109–121. [Google Scholar] [CrossRef]
  141. Hagedoorn, J.; Cloodt, M. Measuring innovative performance: Is there an advantage in using multiple indicators? Res. Policy 2003, 32, 1365–1379. [Google Scholar] [CrossRef]
  142. Acs, Z.J.; Audretsch, D.B. Patents as a measure of innovative activity. Kyklos 1989, 42, 171–180. [Google Scholar] [CrossRef]
  143. Cooper, R.G.; Kleinschmidt, E.J. New-product success in the chemical industry. Ind. Mark. Manag. 1993, 22, 85–99. [Google Scholar] [CrossRef]
  144. Chiesa, V.; Frattini, F.; Lazzarotti, V.; Manzini, R. Performance measurement in R&D: Exploring the interplay between measurement objectives, dimensions of performance and contextual factors. R D Manag. 2009, 39, 487–519. [Google Scholar]
  145. Tohidi, H.; Jabbari, M.M. Providing a framework for measuring innovation within companies. Procedia Technol. 2012, 1, 583–585. [Google Scholar] [CrossRef]
  146. Edison, H.; bin Ali, N.; Torkar, R. Towards innovation measurement in the software industry. J. Syst. Softw. 2013, 86, 1390–1407. [Google Scholar] [CrossRef] [Green Version]
  147. Ivanov, C.-I.; Avasilcăi, S. Performance measurement models: An analysis for measuring innovation processes performance. Procedia-Soc. Behav. Sci. 2014, 124, 397–404. [Google Scholar] [CrossRef]
  148. Griffin, A.; Page, A.L. PDMA success measurement project: Recommended measures for product development success and failure. J. Prod. Innov. Manag. 1996, 13, 478–496. [Google Scholar] [CrossRef]
  149. Kaplan, R.S.; Norton, D.P. The balanced scorecard: Measures that drive performance. Harv. Bus. Rev. 1992, 70, 71–79. [Google Scholar] [PubMed]
  150. Caird, S.; Hallett, S.; Potter, S. The Open2-Innova8ion Tool—A software tool for rating organisational innovation performance. Technovation 2013, 33, 381–385. [Google Scholar] [CrossRef]
  151. Chiesa, V.; Frattini, F.; Lazzarotti, V.; Manzini, R. An exploratory study on R&D performance measurement practices: A survey of Italian R&D-intensive firms. Int. J. Innov. Manag. 2009, 13, 65–104. [Google Scholar]
  152. Kim, S.-K. Explicit design of innovation performance metrics by using analytic hierarchy process expansion. Int. J. Math. Math. Sci. 2014, 2014, 125950. [Google Scholar] [CrossRef]
  153. Seo, H.; Chung, Y.; Yoon, H. R&D cooperation and unintended innovation performance: Role of appropriability regimes and sectoral characteristics. Technovation 2017, 66, 28–42. [Google Scholar]
  154. Eom, B.-Y.; Lee, K. Determinants of industry–academy linkages and, their impact on firm performance: The case of Korea as a latecomer in knowledge industrialization. Res. Policy 2010, 39, 625–639. [Google Scholar] [CrossRef]
  155. Kang, K.H.; Kang, J. Do external knowledge sourcing modes matter for service innovation? Empirical evidence from South Korean service firms. J. Prod. Innov. Manag. 2014, 31, 176–191. [Google Scholar] [CrossRef]
  156. Chun, H.; Mun, S.-B. Determinants of R&D cooperation in small and medium-sized enterprises. Small Bus. Econ. 2012, 39, 419–436. [Google Scholar]
  157. Seo, H.; Chung, Y.; Chun, D.; Woo, C. Value capture mechanism: R&D productivity comparison of SMEs. Manag. Decis. 2015, 53, 318–337. [Google Scholar]
  158. Bozkir, A.S.; Sezer, E.A. Predicting food demand in food courts by decision tree approaches. Procedia Comput. Sci. 2011, 3, 759–763. [Google Scholar] [CrossRef] [Green Version]
  159. Delen, D.; Kuzey, C.; Uyar, A. Measuring firm performance using financial ratios: A decision tree approach. Expert Syst. Appl. 2013, 40, 3970–3983. [Google Scholar] [CrossRef]
  160. Breiman, L. Statistical modeling: The two cultures. Stat. Sci. 2001, 16, 199–231. [Google Scholar] [CrossRef]
  161. Horner, S.B.; Fireman, G.D.; Wang, E.W. The relation of student behavior, peer status, race, and gender to decisions about school discipline using CHAID decision trees and regression modeling. J. Sch. Psychol. 2010, 48, 135–161. [Google Scholar] [CrossRef] [PubMed]
  162. You, Z.; Si, Y.-W.; Zhang, D.; Zeng, X.; Leung, S.C.; Li, T. A decision-making framework for precision marketing. Expert Syst. Appl. 2015, 42, 3357–3367. [Google Scholar] [CrossRef]
  163. Kohavi, R. A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI), Montreal, QC, Canada, 20–25 August 1995; pp. 1137–1145. [Google Scholar]
  164. Provost, F.; Kohavi, R. Glossary of terms. Editorial for the special issue on applications of machine learning and the knowledge discovery process. J. Mach. Learn. 1998, 30, 271–274. [Google Scholar] [CrossRef]
  165. Veugelers, R.; Cassiman, B. Make and buy in innovation strategies: Evidence from Belgian manufacturing firms. Res. Policy 1999, 28, 63–80. [Google Scholar] [CrossRef]
  166. Katz, R.; Allen, T.J. Investigating the Not Invented Here (NIH) syndrome: A look at the performance, tenure, and communication patterns of 50 R&D project groups. R D Manag. 1982, 12, 7–20. [Google Scholar]
  167. Gopalakrishnan, S.; Bierly, P.; Kessler, E.H. A reexamination of product and process innovations using a knowledge-based view. J. High Technol. Manag. Res. 1999, 1, 147–166. [Google Scholar] [CrossRef]
  168. Weber, K.M.; Schaper-Rinkel, P. European sectoral innovation foresight: Identifying emerging cross-sectoral patterns and policy issues. Technol. Forecast. Soc. Chang. 2017, 115, 240–250. [Google Scholar] [CrossRef]
  169. Hansen, U.E.; Gregersen, C.; Lema, R.; Samoita, D.; Wandera, F. Technological shape and size: A disaggregated perspective on sectoral innovation systems in renewable electrification pathways. Energy Res. Soc. Sci. 2018, 42, 13–22. [Google Scholar] [CrossRef] [Green Version]
  170. Huergo, E. The role of technological management as a source of innovation: Evidence from Spanish manufacturing firms. Res. Policy 2006, 35, 1377–1388. [Google Scholar] [CrossRef]
  171. Lau, A.K.W.; Lo, W. Regional innovation system, absorptive capacity and innovation performance: An empirical study. Technol. Forecast. Soc. Chang. 2015, 92, 99–114. [Google Scholar] [CrossRef]
  172. Kiuru, J.; Inkinen, T. Predicting innovative growth and demand with proximate human capital: A case study of the Helsinki metropolitan area. Cities 2017, 64, 9–17. [Google Scholar] [CrossRef]
  173. Diez, J.R. Innovative networks in manufacturing: Some empirical evidence from the metropolitan area of Barcelona. Technovation 2000, 20, 139–150. [Google Scholar] [CrossRef]
  174. Sable, M. The impact of the biotechnology industry on local economic development in the Boston and San Diego metropolitan areas. Technol. Forecast. Soc. Chang. 2007, 74, 36–60. [Google Scholar] [CrossRef]
  175. Blind, K.; Grupp, H. Interdependencies Between the Science and Technology Infrastructure and Innovation Activities in German Regions. Res. Policy 1999, 28, 451–468. [Google Scholar] [CrossRef]
  176. Chung, S. Building a national innovation system through regional innovation systems. Technovation 2002, 22, 485–491. [Google Scholar] [CrossRef]
  177. Pavitt, K. Sectoral patterns of technical change: Towards a taxonomy and a theory. Res. Policy 1984, 13, 343–373. [Google Scholar] [CrossRef]
  178. Castellacci, F. Technological paradigms, regimes and trajectories: Manufacturing and service industries in a new taxonomy of sectoral patterns of innovation. Res. Policy 2008, 37, 978–994. [Google Scholar] [CrossRef] [Green Version]
  179. Malerba, F. Sectoral dynamics and structural change: Stylized facts and “system of innovation” approaches. In Sectoral Systems of Innovation: Concepts, Issues and Analyses of Six Major Sectors in Europe; Malerba, F., Ed.; Cambridge University Press: Cambridge, UK, 2004; pp. 42–70. [Google Scholar]
  180. Malerba, F. Sectoral systems of innovation and production. Res. Policy 2002, 31, 247–264. [Google Scholar] [CrossRef]
  181. Breschi, S.; Malerba, F.; Orsenigo, L. Technological Regimes and Schumpeterian Patterns of Innovation. Econ. J. 2000, 110, 388–410. [Google Scholar] [CrossRef]
  182. Cooke, P. Regional innovation systems: Origin of the species. Int. J. Technol. Learn. Innov. Dev. 2008, 1, 393–409. [Google Scholar] [CrossRef]
  183. Camagni, R.P. The concept of innovative milieu and its relevance for public policies in European lagging regions. Pap. Reg. Sci. 1995, 74, 317–340. [Google Scholar] [CrossRef]
  184. Asheim, B.; Oughton, C.; Lawton Smith, H. Regional Innovation Systems: Theory, Empirics and Policy. Reg. Stud. 2011, 45, 875–891. [Google Scholar] [CrossRef]
Figure 1. A research framework for the investigation of innovation behavior.
Figure 1. A research framework for the investigation of innovation behavior.
Sustainability 11 06207 g001
Table 1. Examples of the main determinants of innovation in the literature.
Table 1. Examples of the main determinants of innovation in the literature.
CategorySub-CategoryMain Determinants Main Results and ArgumentsRelevant References
Extrinsic determinantsIndustry
Technological dynamism
High-tech industries are more innovative than the traditional one
[29,39,40,41,42]
Demand growth
Positive
[43,44,45]
Industrial structure (industry concentration)
Negative
Positive
Bell-shaped
Insignificant
[45,46,47]
[48,49]
[50]
[43,51,52,53]
Region
Location characteristics of proximity to partners
Positive
It promotes knowledge transfer and reduces communication costs
[42,58,60,61,62]
[64,65,66]
Cooperative networking environment
Cooperative networking environment
Positive
Insignificant
[58,62,63,67,68,69,70,71]
[50,72]
It promotes interaction and helps for closing capability gaps
[61]
Market
Demand and supply
Positive
[45,67,74,76]
Target market characteristics involving customer type and feedback
Positive
[18,77,78]
It drives seeking market needs, advertising, and elaborating market strategies
[22,47,69,79,80,81,82,83,84]
Intrinsic determinants General characteristics of a firm
Size
Small firms have an advantage
Large firms have an advantage
U- or hump-shaped
[85]
[86,87,88,89,90,91]
[92]
Age
Older firms have an advantage
Younger firms have an advantage
[95,96]
[97]
Ownership
Positive
Negative
Insignificant
[44,52,98]
[52,72,99]
[100,101]
Innovative capability
R&D capability
R&D personnel affects positive
[102,103]
R&D investment (budget and cost) affects positive
[35,104,105,106]
It is crucial, but it does not reflect overall innovation capability
[18]
Innovative activities
In-house R&D
In-house R&D is crucial
[18,19,35,57,61,62,67,69,74,102,103,104,105,108,109,110,111,112]
Cooperative R&D
Positive
Unstable and negative
[63,114,118,119,120,121,122,123]
[124,125,126,127,128,129]
External R&D
Positive but complementary
[133,134,135] [115,130,136,137]
Table 2. Summary of the variables in the general information of 2014 Korean Innovation Survey (KIS) and 2016 KIS.
Table 2. Summary of the variables in the general information of 2014 Korean Innovation Survey (KIS) and 2016 KIS.
CategoryVariableMeasurement Responses and DescriptionType
General statusForm of firm
Independent company
Affiliates of a domestic company
Affiliates of a foreign company
Nominal
Statuary types
(by the size of employee from sample selection)
Large-sized company
Medium-sized company
Small-sized company
Nominal
Designation status
(in Korean context)
Venture company
InnoBiz (certificated as innovative small and medium-sized firm)
n/a
Nominal
Listed status
(in Korean stock market)
KOSPI
KOSDAQ
n/a
Nominal
Size statusSize of sales and exports
Level of actual annual value over the last three years
Ordinal
Size of employee
Level of actual annual value over the last three years
Ordinal
R&D statusRatio of R&D personnel
Level of the percentage of R&D personnel in the last year
Ordinal
Manner of R&D activities
Operation by R&D institutes
Dedicated department
Irregular operation if necessary
Not implemented
Nominal
Market statusMain target market
Domestic
Asia
Europe
North America
Others
Nominal
Main customer types
Private company
Government and public sector
Individual customer
Overseas market
Others
Nominal
Another statusSector
Industrial code (23 codes)
Nominal
Region
Region (17 areas)
Nominal
Age
Age
Interval
Table 3. Summary of the variables for the successful innovative firm.
Table 3. Summary of the variables for the successful innovative firm.
VariableMeasurement Responses and DescriptionType
Success of innovation
Success on the innovation of product or process
Nominal
Contribution to the sales
Percentage of contribution from innovation for the sales of the last year
Ratio
Innovation activitiesR&D activities
(whether or not)
Performing in-house R&D
Performing cooperative R&D
Performing external R&D
Nominal
Non-R&D activities
(whether or not)
Acquisition of machine, tool, software, and building
Buying external knowledge
Performing job training
Performing market launching activities
Performing design activities
Performing others
Nominal
Innovation CostLevel of total innovation cost
Level of the total cost for innovation activities performed in the last year
Ordinal
Level of the percentage of cost on each innovation activities
% level for In-house R&D
% level for External R&D
% level for Acquisition of machine, tool, software, and building
% level for Buying external knowledge
% level for Others
Ordinal
Source of budget
Owned capital
Affiliate fund
Government fund
Loan
Stock Issuance
Corporate Bond fund
No expenditure
Nominal
Information source for innovation
In-house or within the affiliate
Supplier
Private customer
Public customer
Competitors in the same sector
Private service firms
Higher educational institutes
Institutes of government, public, and private sector
Conference, exhibition, and fair
Professional journal and publications
Industrial association
Nominal
Cooperative activitiesImplementation
Whether or not
Nominal
Cooperative partner
Affiliates
Supplier
Private customer
Public customer
Competitors in the same sector
Private service firms
Higher educational institutes
Institutes of government, public, and private sector
Nominal
Best cooperative partnerNominal
Table 4. Models with target and input variables.
Table 4. Models with target and input variables.
ModulePerspectiveYearModelTarget VariableInput Variable
1
(success and failure)
Overall2014Overall in 2014Innovation success and failureAll variables in Table 2
2016Overall in 2016
2
(successful innovative firm)
Contribution to salesWhether or not2014Contribution in 2014Contribution to sales (Y/N)All variables in Table 2 and Table 3
(without the variable of success of innovation)
2016Contribution in 2016
Innovation
activity
Innovation activity a2014Innovation activity in 2014Class of innovation activity manners
2016Innovation activity in 2016
R&D activity a2014R&D activity in 2014Class of R&D activity manners
2016R&D activity in 2016
Notes: a Independent variables related to innovation activities in Table 3 are excluded.
Table 5. Case statistics and DT results of Module 1.
Table 5. Case statistics and DT results of Module 1.
YearNumber of CasesResultAccuracy
TotalSuccessFailureOverallSuccessFailure
201440759673108Ratio of R&D personnel; Manner of R&D activities; Size of exports (one year ago); Statuary types79.4%40.2%91.6%
2016400016162384Manner of R&D activities; Size of employee (one year ago; Sector; Firm age; Size of sales (two years ago); Size of employee (three years ago); Region; Listed status (Korean stock market)79.4%71.2%85.0%
Table 6. Summary of sustainable influencing factors and variations over time from an overall perspective.
Table 6. Summary of sustainable influencing factors and variations over time from an overall perspective.
CategoryYearSustainable Influencing FactorsVariation over Time
Overall2014
Manner of R&D activities
Ratio of R&D personnel
Exports level
Statuary type
2016
Employee size level
Sectors
Age
Sales level
Region
Listed status
Table 7. Case statistics and DT results of innovation contribution models.
Table 7. Case statistics and DT results of innovation contribution models.
ModelYearNumber of CasesMissingResultsAccuracy
TotalContributionNo contributionOverallContributionNo contribution
Contribution to sales2014856729127111Market launching activities; Using information from Public customer; Using information from higher educational institutes; In-house R&D; Using information from private customer85.16%100.00%0.00%
201612361048188380Cost on acquisition of machine, tool, software, and building; Source of budget; Using information from in-house or within the affiliate84.79%100.00%0.00%
Table 8. Summary of the influencing factors from the perspective of innovation’s contribution to sales.
Table 8. Summary of the influencing factors from the perspective of innovation’s contribution to sales.
CategoryYearSustainable FactorsVariation over Time
Contribution to sales2014n/a
Information activity (market launching activity, in-house R&D)
Information source (private customer; public customer; higher educational institutes)
2016
Level of activity cost (acquisition of machine, tool, software, and building)
Source of budget
Information source (in-house or within the affiliate)
Table 9. Case statistics and DT results of innovation activity models.
Table 9. Case statistics and DT results of innovation activity models.
ModelYearNumber of Cases
TotalR&D and Non-R&D ActivitiesR&D Activities onlyNon-R&D onlyNo Activities
Innovation activity 20149677221467623
2016161611342851898
YearResultsAccuracy
Over-AllR&D and Non-R&D ActivitiesR&D Activities OnlyNon-R&D OnlyNo Activities
2014Manner of R&D activities; Using information from competitors in the same sector; Statuary types; Using information from professional journal and publications; Using information from in-house or within the affiliate; Using information from conference, exhibition, and fair74.7%100.0%0.0%0.0%0.0%
2016Manner of R&D activities; Sector; Using information from private customer; Total Innovation cost (level of one year ago); Region79.0%89.1%48.1%68.8%0.0%
Table 10. Case statistics and DT results of R&D activity models.
Table 10. Case statistics and DT results of R&D activity models.
ModelYearNumber of Cases
TotalIn-House R&D onlyIn-House and Cooperative R&DCooperative R&D onlyNo R&D Activities
R&D activity 20149675093085199
20161616118620924197
YearResultsAccuracy
Over-AllIn-House R&D onlyIn-House and Cooperative R&DCooperative R&D onlyNo R&D Activities
2014Manner of R&D activities; Using information from institutes of government, public, and private sector; Using information from conference, exhibition, and fair; Using information from in-house or within the affiliate; Using information from supplier61.8%92.3%35.4%0.0%19.2%
2016Manner of R&D activities; Sector; Using information from private customer; Using information from professional journal and publications; Size of employee (level of one year ago), Statuary types, Using information from private service firms78.5%95.8%0.0%0.0%67.5%
Table 11. Summary of influencing factors from the perspective of the R&D activity class.
Table 11. Summary of influencing factors from the perspective of the R&D activity class.
CategoryYearSustainable FactorsVariation over Time
R&D activity2014
Manner of R&D activities
Information source (institutes of government, public, and private sector; conference, exhibition, and fair; in-house or within the affiliate; supplier)
2016
Sector
Employee size level
Statuary type
Information source (private customer; private service firm; professional journal and publications)
Table 12. Summary of hypotheses testing results.
Table 12. Summary of hypotheses testing results.
HypothesisPerspectiveYearTotal Valid CasePearson χ2Sig.Contingency CoefficientSig.Result
H1Sectoral difference20144075 1216.766 *0.000 **0.2250.000 **Accepted
20164000 1340.875 *0.000 **0.2800.000 **Accepted
H2Regional difference 120144075 183.008 *0.000 **0.1410.000 **Accepted
20164000 1169.460 *0.000 **0.2020.000 **Accepted
H3Sectoral and regional difference 22014967 2616.200 *0.000 ***0.6240.003 ***Accepted
20161616 21123.935 *0.000 ***0.6020.000 ***Accepted
1 analysis value: success and failure of innovation; 2 analysis value: success case; * p-value < 0.001; ** asymptotic significance; *** Monte Carlo significance.

Share and Cite

MDPI and ACS Style

Park, S. Identification of Overall Innovation Behavior by Using a Decision Tree: The Case of a Korean Manufacturer. Sustainability 2019, 11, 6207. https://doi.org/10.3390/su11226207

AMA Style

Park S. Identification of Overall Innovation Behavior by Using a Decision Tree: The Case of a Korean Manufacturer. Sustainability. 2019; 11(22):6207. https://doi.org/10.3390/su11226207

Chicago/Turabian Style

Park, Sunyoung. 2019. "Identification of Overall Innovation Behavior by Using a Decision Tree: The Case of a Korean Manufacturer" Sustainability 11, no. 22: 6207. https://doi.org/10.3390/su11226207

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop