Abstract
The vigorous development of electric vehicles (EVs) can promote the green and low-carbon development of society and the environment. However, the research and development of EVs technology in China started late, and there are some problems such as relatively backward technology. In order to promote the decarbonization process of transportation systems, there is an urgent need for appropriate methods to identify promising technologies in the EVs field to guide the efficient development of innovation activities. This study proposes a novel approach to integrate the perspective of market and technical attributes to identify promising EVs technologies. Firstly, text mining tools are applied to extract review and technical keywords from online reviews and patents, and technical topics are summarized. Secondly, sentiment analysis is conducted to calculate user satisfaction based on online reviews, and then market demand of technical topics is obtained. Thirdly, social network centrality analysis, DEA–Malmquist model, and CRITIC method are employed to obtain technical features of technical topics based on patents. Finally, a portfolio map is constructed to analyze technical topics and identify promising EVs technologies. As the main driving force for the development and transformation of the automotive industry, the efficient identification of promising technologies in this field can provide strategic decision support for the development of EVs. This study aims to provide objective data and scientific guidance for related enterprises to carry out technological innovation activities.
1. Introduction
In recent years, the rapid development of industry made the problem of global energy shortage more prominent. In addition, rapid urbanization and increased fossil fuel consumption have led to excessive greenhouse gas emissions and environmental pollution, which pose a major threat to global energy efficiency [1,2]. According to the Paris agreement, the global temperature will increase by 3% in this century [3]. In this case, electric vehicles (EVs) are increasingly favored by the market for their energy-saving, clean, and environmentally friendly characteristics [4]. In addition, advances in battery technology, power grid management, and the urgent environmental need to reduce greenhouse gas emissions have led to a major shift toward the production of EVs [1]. Many countries have put forward the electric vehicle promotion goals and technology development strategies [5]. Driven by various preferential policies, electric vehicle sales have been booming recently. However, electric vehicle technology is not mature enough, and there are still some problems to be solved, such as lack of the capability of long travel range and long battery charging. Therefore, with the increasing awareness of environmental protection, technological innovation and product development of EVs have gradually become the focus of social attention.
Promising technologies refer to those with development potential that may become the main driving force for technology development in specific fields in the future. Currently, identifying promising technologies in EVs can efficiently drive the development of this field. However, they often require valuable information to assess [6]. Since patents contain abundant technical intelligence and frontier information [7], many studies aim to extract useful information based on them and then identify promising technologies from the perspective of technical attributes. For example, through the collation and analysis of patents related to EVs, technologies such as batteries, charging facilities, and power control systems are considered to be research topics of great concern in this field, and wireless charging technology and fuel cell technology are identified as promising technologies in this field [5,8]. In addition, with the booming of online shopping, online reviews contain plentiful user preference information [9]. The research and analysis of this information will help companies to understand the market dynamics of technologies and grasp the market demand trend promptly [10]. Therefore, online reviews provide a new perspective to evaluate technological superiority and then identify promising technologies.
In the existing research, through the review and analysis of EV charging methods, standards, and optimization techniques, the research status of EV charging methods in recent years was introduced, and some promising optimization techniques in the scale and layout of charging stations were identified [11]. In addition, the SPC algorithm and visualization mapping were applied to analyze the technological evolution process in the field of EVs from patent texts and to identify promising technologies in the field of EV batteries [8]. However, relatively little attention has been paid to identifying promising technologies in EVs, and there are some limitations. Firstly, most of the research on EVs has focused on specific aspects such as batteries, charging stations, and control systems [12,13]; the research methods are mainly based on experiments and investigations; and less systematic analysis of promising EVs technologies has been carried out from an overall perspective. Secondly, from the research perspective, previous studies on EVs rarely link technical attributes with market attributes for multi-perspective analysis [14,15]. This may affect the comprehensiveness and objectivity of the analysis results and make it difficult to accurately guide companies’ technological innovation activities.
In response, this study combines the perspectives of market and technical attributes to identify promising EVs technologies. Online reviews and patent data are integrated to characterize the market demand and technical features of technologies. Sentiment analysis is applied to the analysis process of market demand in this study. In addition, in the analysis of technical features, social network centrality analysis and the data envelopment analysis–Malmquist (DEA–Malmquist) model are integrated to fully consider the relationship between technical keywords and the dynamic changes of them. The Criteria Importance Though Inter-criteria Correlation (CRITIC) method is applied to improve the objectivity of analytical results. The framework proposed in this study can effectively assist in identifying promising technologies in the field of EVs and guide enterprises’ technological innovation.
This study is composed as follows. Section 2 reviews the literature on electric vehicles, identification of promising technologies, and methods involved. Section 3 explains the research framework and process in this study. Section 4 analyzes the identification results of promising technologies. Section 5 and Section 6 provide discussions and conclusions of the research by including contributions and directions for future study.
2. Literature Review
2.1. Electric Vehicles
EVs are referred to new energy vehicles that rely on electric powertrain and plug-in charging approaches [16]. According to different forms of powertrain, EVs can be classified into battery electric vehicles (BEVs), extended-range electric vehicles (EREVs), and plug-in hybrid electric vehicles (PHEVs) [17]. Due to the increasing pressure from the environment and energy, the state and society have taken many measures to promote the development of EVs. It is worth noting that technological innovation is a key factor in the future success of the industry of EVs [12]. China, South Korea, and other countries have successively introduced policies to encourage technological innovation in EVs [18]. Therefore, industry and academia have made a lot of exploration in the technological innovation of EVs.
The existing research on the technological innovation of EVs focuses on the improvement and optimization of specific sub-fields such as batteries and charging stations in combination with quantitative analysis methods. The role of battery and charging technologies in the diffusion of EVs was explored, and an agent-based spatial integrated model (SelfSim-EV) was applied to simulate consumers’ responses to these technological innovations [13]. A machine learning-based text mining model and co-occurrence network analysis were employed to analyze the impact of artificial intelligence on technological innovation in EV automation [19]. The field of EV was decomposed into subdomains, which are power electronics, battery, electric motor, and charging and discharging, and emerging topics in each subdomain were identified [12]. Field research methods and interpretive structural modeling (ISM) were adopted to study the constraints of EV charging stations [20]. These explorations have contributed to the technological innovation and development of EVs.
However, previous studies still have some limitations. These studies have given less consideration to systematically identifying promising technologies for EVs at an overall level to improve the efficiency of technological innovation. This study focuses on the field of EVs, combined with quantitative analysis methods and objective data, to accurately identify promising technologies.
2.2. Identification of Promising Technologies
Many scholars have devoted themselves to exploring the term of promising (or emerging) technology in recent years. Although there are various ways to define it, no consensus has been reached. Reference [21] defined promising technologies as those with fast-growing, novelty, untapped market potential. Reference [22] considered technologies with the features of novelty, rapid growth, coherence, prominent impact, and uncertainty as promising technologies. Based on these definitions, this study regards promising technologies as technologies with high uncertainty and high market and technology impact. Therefore, it is necessary to use suitable databases in this study to evaluate technological superiority from the perspective of market and technical attributes and then identify promising technologies.
Scholars have conducted a lot of explorations on applying various databases to evaluate technological superiority. As one of the common databases of technological innovation, patents were widely used to identify promising technologies [23]. Scientific articles [24] and online community reports [25] were also employed in the process of technical analysis. Further, some studies tried to combine multi-source databases to improve the comprehensiveness of analysis results. In order to synthetically consider technological and social impacts, patents and online articles were integrated to develop a framework for identifying promising technologies [26]. Patents and government reports were also combined to analyze the matching relationship between the supply and demand of technology [27]. These databases from various sources provide abundant information and decision support in the identification process of promising technologies.
However, although the usage of these databases has made some contributions to the identification of promising technologies, there are still some limitations. In addition to the commonly used patent data, previous studies have also focused on using online articles, government reports, and online community reports to consider the market and technical impacts. These types of data may have problems such as insufficient quantity and content and difficulty in access. With the rapid development of online shopping, the number and content of online reviews have been greatly enriched [28], which can largely compensate for the deficiencies of the above database. Further, since online reviews contain abundant and diverse user preference information [29], they can be regarded as an essential source of information to identify promising technologies from the perspective of market attributes. Therefore, online reviews and patent data are applied to identify promising technologies from the perspective of market and technical attributes.
2.3. Patent-Based Evaluation of Technological Superiority
Among the existing database of technological superiority evaluation, patent data are the most frequently used data. They provide affluent and objective technical information and are widely used in the process of technical analysis [30,31]. Some studies were committed to the usage of patent citation analysis [32,33] and patent indicators analysis [34]. Some research focused on semantic analysis of patent information, such as topic modeling [35] and similarity measurement [36]. In recent years, with the rise of artificial intelligence, the combination of machine learning and patent analysis [37] has also attracted more attention.
In these patent-based studies, the construction of patent indicators can intuitively and accurately clarify the technical features. Scholars have made many attempts at applying patent indicators analysis to evaluate technological superiority. The indicators of technology impact, applicability, and sustainability were constructed and analyzed based on bibliometric information in patents [38]. A deep learning model was applied to analyze outlier patents [26], and the indicator of technology impact was measured by the number of patent forward citations [39]. Forward citations were also used to divide patents into promising and non-promising ones; then, semi-supervised learning and active learning were combined [34] to identify promising technologies. These proposed patent indicators have contributed to identifying promising technologies by providing quantitative references.
However, most of the existing patent indicators focus more on the self and static features of technologies and less on exploring their relationship and dynamic change features. It may affect the comprehensiveness and accuracy of the analysis results. The social network is introduced as an available tool to measure the relationship between nodes [40,41]. The relationship between technologies can be fully considered by calculating the centrality indicators in the network [42,43]. Moreover, in order to explore the dynamic changes of technologies, the DEA–Malmquist model is conducted in this study. DEA, as a data-driven method to provide efficiency measurement and benchmark, has been widely applied in various fields for efficiency analysis [44,45,46]. The commonly used DEA models include CCR, BCC, and DEA–Malmquist models [47]. Among them, the Malmquist production index can be employed to evaluate the dynamic efficiency change of decision-making units (DMUs) in continuous time [48]. Therefore, social network centrality analysis and DEA–Malmquist model are combined in this study to make up for the deficiency of existing patent indicators. Firstly, social network centrality analysis is used to consider the relationship between technologies. Then, the obtained centrality indicator values as input can be integrated into the DEA–Malmquist model to analyze the dynamic features of technologies.
2.4. Sentiment Analysis for Online Reviews
Online reviews containing plenty of user preference information can be applied to evaluate technological superiority from the perspective of market attributes. Due to its complexity, text mining techniques need to be used to effectively obtain information [49]. As a tool in natural language processing (NLP), sentiment analysis can accurately extract users’ attitudes and opinions from online reviews [50]. The principle of sentiment analysis is to capture users’ positive, negative, or neutral attitudes towards products or services [51] at three granularity levels, including phrase level, sentence level, and document level.
Many scholars have concentrated on the application of sentiment analysis to extract online reviews information. Sentiment analysis and an intuitionistic fuzzy TODIM method were combined to construct a product selection model [49]. The Kano model and sentiment analysis based on fine-grained were integrated to extract consumer demands for product attributes from online reviews [52]. Further, the emotion classifier based on deep learning and neural network was developed to improve the efficiency and accuracy of sentiment analysis [53,54]. As shown by the above studies, sentiment analysis has made many contributions in mining useful information from online reviews. Therefore, in the identification process of promising technologies from the perspective of market attributes, sentiment analysis is employed in this study to obtain user satisfaction based on online reviews.
3. Materials and Methods
The proposed identification method is based on a UNISON framework of data-driven innovation [55] as illustrated in Figure 1. The framework applied in this study can clearly show the path of integrating the perspective of market and technology attributes to identify promising EVs technologies. The overall research process considers the market and companies, the promising technologies, and the technical environment in six phases, including: (1) understand and define the problem, (2) identify the niche for promising technologies identification, (3) structure the objective hierarchy and influence relationship, (4) sense and describe expected outcomes, (5) overall judgments and value assessments, and (6) trade-off and decision. A detailed explanation is provided as follows.
Figure 1.
UNISON framework for identifying promising technologies.
3.1. Understand and Define the Problem
The proposed approach begins with understanding and defining the problem. With the rapid development of technology, innovation ability has become a critical standard to measure the competitiveness of companies. In the product development stage of EVs, the correct direction of technological innovation can launch the products to meet market demand. Companies and R&D personnel urgently need to discover promising EVs technologies to improve product performance and competitiveness.
Many scholars have attempted to analyze the technical features of specific fields to achieve technological innovation in recent years. In addition, in terms of the perspective of market attributes, market demand analysis has gradually become a crucial step in assisting technological innovation. It can facilitate user purchase behavior and product or service improvement [49,56]. Therefore, this study integrates the market demand and technical features to consider this issue regarding EVs.
3.2. Identify the Niche for Promising Technologies Identification
The niche for promising technologies identification is determined in this section. Understanding current market demand can contribute to identifying the niches. Market demand is a factor that can reflect the user preference information of related products. Analysis of market demand can help to improve related products or services accurately from the perspective of market attributes. Benefited from the Internet and web 3.0 technology, users increasingly post online reviews of products or services on the Internet. Online review information can largely reflect the comparison between users’ consumption experience and expectations. At the same time, with the continuous improvement of enterprise management and data monitoring, the authenticity and reliability of online reviews are also increasing. Compared with traditional market demand research, online reviews are not affected by differences in time, region, and occupation, and users’ demand for products or services improvement and future demand can be greatly demonstrated [57]. Since online reviews can objectively and comprehensively reflect the market demand information of specific products or services, they are valuable for companies and R&D personnel to understand market demand. The text mining technology was used in this study to extract critical review keyword information in the field of EVs to efficiently understand the core users’ preference information, and then to calculate the market demand with the help of quantitative analysis tools. Therefore, the strategic objectives can be structured.
In addition, the technical features are a factor that can reflect the current state of specific technologies. Analyzing technical features can help to clarify the development trend of technical environment. Patents are widely used in the analysis of technical fields since they contain affluent technical and frontier information [58]. By extracting and analyzing the technical keywords in patents, the core information of massive patent texts can be efficiently understood, and the technical features can be calculated by quantitative analysis methods such as social network centrality analysis. Therefore, this study focuses on obtaining technical features by analyzing the development trend of critical technical information in electric vehicle-related patents.
It is worth noting that text mining of keywords extracted from online reviews and patents is a feasible method to help understand market demand and technical features information in the field of EVs [38,59]. In terms of online reviews, the word frequency of review keywords can accurately reflect users’ preferences for EVs. In terms of patents, the word frequency of technical keywords can accurately reflect the research hotspots and development directions of EVs. Therefore, review keywords and technical keywords need to be extracted from online reviews and patents. However, it is far from enough to rely only on the review keywords and technical keywords extracted from the above two data sources to analyze the market demand and technical features in the field of EVs, and some additional information needs to be obtained to provide more details. In this way, sentiment analysis is applied in this study to calculate the users’ satisfaction on review keywords, and then combine user attention to comprehensively analyze the market demand in the field of EVs. In addition, in the analysis of technical features, social network centrality analysis, the data envelopment analysis–Malmquist (DEA–Malmquist) model, and the CRITIC method are integrated to fully consider the relationship between technical keywords and the dynamic changes of them.
The core issue to be addressed is to determine factors that affect promising EVs technologies. In recent years, EVs have been widely welcomed in the automotive market with their advantages of high energy efficiency and green environmental protection. There is already abundant online review data. Scholars have also conducted many explorations of EVs technology and published many related patents. Therefore, this study analyzes the market demand and technical features of EVs based on online reviews and patent data. This study chooses an automobile evaluation website that contains plenty of user online reviews—www.cars.com (accessed on 22 November 2021) as the online reviews database. The website is ranked within the top five global automobile evaluation websites and is expected to provide reliable data [39]. In terms of analyzing technical features, this study selects the DII database as the patent database. The titles and abstracts of patents related to EVs technology are extracted for further analysis.
3.3. Structure the Objective Hierarchy and Influence Relationship
Data collection is the first step in obtaining market and technology information in the EVs field. For market data, the advancement of information technology makes it easy to acquire massive reviews via web crawler. In this study, the review data collection period was set to 2017–2021, and 6571 valid review data were obtained from the website, www.cars.com. For patent data, keywords such as “electric car”, “electric vehicle”, or “electric automobile” were used to search related patents in the DII database. The search time range was also from 2017 to 2021, and 63,231 patents were collected after preliminary screening. Review and patent data were collected on 22 November 2021.
In this section, the objectives are structured into a hierarchy. The strategic objective of this study is to obtain market demand from online reviews. Based on previous research, user satisfaction and attention can be extracted to comprehensively measure market demand of EVs. The strategic objective can be divided into two fundamental objectives: extracting user satisfaction and attention from online reviews. The NLTK algorithm is applied in the study to extract the review keywords of EVs from collected online reviews. Then, after cleaning and pretreatment of them, review keywords that appear more than 100 times are selected as the final dataset for further analysis. The extraction results of review keywords in the EVs field are shown in Table 1.
Table 1.
Review keywords in the field of EVs in 2017–2021.
The object of technical features is determined by comparing the importance level of technical keywords. This study applies the NLTK algorithm in python to extract technical keywords and their co-occurrence relationships from patents related to EVs. Then, the data are filtered and cleaned, and the technical keywords are sorted according to the frequency of each year. Finally, the top 40 technical keywords are determined as the object of further analysis based on expert opinions in this field. The extraction results of technical keywords in the EVs field are shown in Table 2. The importance of technical keywords is measured by the frequency of their occurrence in patents. High frequency of technical keywords will be selected for further research and analysis of their technical features.
Table 2.
Technical keywords in the field of EVs in 2017–2021.
3.4. Sense and Describe Expected Outcomes
The phase of sense and describe expected outcomes involves the definition of expected market demand, data preparation, and the description of technical features state. At the stage of data preparation, it is necessary to further process the review keywords and technical keywords of EVs identified in the last step. It can be clearly seen that these two types of keywords have great differences in semantic expression. Review keywords extracted from online reviews are more colloquial, while technical keywords obtained from patent data are more professional. These two types of keywords need to be mapped and the technical topics are summarized in combination with expert opinions, as shown in Table 3. In this way, the market demand of technical topics in the field of EVs can be represented by the market demand of corresponding review keywords. The technical features of technical topics can be represented by the technical features of corresponding technical keywords.
Table 3.
Technical topics classification of review and technical keywords in the EVs field.
Based on the two clarified fundamental objectives, this study aims to analyze the review keywords extracted from online review data to obtain the market demand of EVs. Specifically, user satisfaction is defined as a subjective evaluation of products or services provided based on expectations and actual performance [60]. It is usually expressed in positive and negative emotions. User attention refers to the degree of users’ concern about the specific attributes of products or services [61]. If a user reviews on one attribute of a product or service, it is considered that he/she is concerned about this attribute. Therefore, the definition of user satisfaction and user attention can be determined.
After that, the sentiment analysis tool textblob is employed to calculate the sentiment score of review keywords. User satisfaction () with each review keyword is represented by the calculation result, as shown in Formula (1), where refers to the number of reviews on the review keyword . Secondly, user attention () to review keywords can be quantitatively measured by the proportion of the number of times that a user mentions a review keyword in all reviews. The specific calculation process is shown in Formula (2), where refers to the number of all reviews. Accordingly, market demand () is calculated by the Formula (3), which means that lower user satisfaction and higher user attention will form higher market demand.
In terms of the technological environment, this section presents the calculation method of technical features of EVs. Firstly, the co-occurrence matrix of each year is constructed based on technical keywords and co-occurrence relationships. Secondly, social network centrality analysis is applied to calculate the network features of technical keywords. This study uses the following three centrality indicators [43], as explained in Table 4.
Table 4.
Three centrality indicators for measuring network features of technical keywords.
Thirdly, the central indicator value obtained as the input data of DEA–Malmquist model and run the model to calculate the importance and increase rate of technical keywords. Since there is no output data, an output-oriented BCC model with no inputs is adopted in this study for applying DEA [14]. This process is repeated once a year to obtain the efficiency of all years. The importance of technical keywords () is calculated by averaging the efficiency scores of all years, as shown in Formula (4). The increase rate of () is obtained by the average value of the ratio of importance in the current year to importance in the previous year, as shown in Formula (5), where represents the number of years, and represents the technical efficiency of technical keyword in year . After that, the CRITIC method [62] is introduced. Its principle is to determine the objective weight of each indicator by comparing the size of the value gap between the evaluation scheme of the same indicator and the conflict between the evaluation indicators. This method is applied to objectively assign weights to the importance and growth rate of technical keywords to obtain the technical features.
3.5. Overall Judgments and Value Assessments
According to the given Formulas (1) and (2), the user satisfaction and attention indicator values of review keywords are calculated. The two indicator values of review keywords in the field of EVs are shown in Table 5. The positive and negative values of user satisfaction indicate that users have positive and negative attitudes towards the corresponding review keywords.
Table 5.
User satisfaction and attention of review keywords in the EVs field.
Technical features are jointly determined by the importance and increase rate of technical keywords. Social network centrality analysis and DEA–Malmquist model are applied in this study to calculate the importance and increase rate of technical keywords. Firstly, a co-occurrence matrix for each year is constructed based on 40 high-frequency technical keywords, and their co-occurrence relationships are extracted from patents of EVs. Appendix A shows the technical keyword co-occurrence matrix in 2017.
Secondly, three centrality indicators of social network centrality analysis are calculated based on the constructed co-occurrence matrix in each year. The calculation results of degree centrality in each year are shown in Appendix B.
Similar to the degree centrality, the calculation results of betweenness centrality in each year are shown in Appendix C.
Similarly, the calculation results of closeness centrality in each year are shown in Appendix D.
Thirdly, DEAP2.1 software is employed in the DEA–Malmquist model of the three centrality indicators values obtained of each year. These three indicator values are used as output data for the output-oriented BCC model with no inputs, and constants are used as input data. It needs to be noted that the output data should be arranged in chronological order. The comprehensive technical efficiency change index (effch) in each year of technical keywords can be obtained after the operation. Then, according to Formulas (4) and (5), the importance and increase rate of technical keywords are calculated, as shown in Table 6.
Table 6.
The importance and increase rate of technical keywords in the EVs field.
Based on the two indicator values of market demand and technical features, the portfolio map is constructed to identify the promising EVs technologies. The identification path of promising technologies constructed in this study considers both market and technical attributes. It can identify promising EVs technologies more comprehensively and accurately.
3.6. Trade-Off and Decision
Key technological innovation factors can be obtained and analyzed in this study from the following three aspects to identify promising EVs technologies. From the market aspect, key technological innovation factors in the field of EVs can come from technological improvements that cater to market demand. From the technical aspect, the key factors in the field of EVs can also be those that occupy an essential position in technological development and can produce more technological innovation. From the comprehensive aspect, innovation factors in the field of EVs with both technological development potential and market demand can also improve the competitiveness of companies.
This study aims to use a series of quantitative analysis methods, considering the perspective of market and technical attributes, to provide accurate and objective key technological innovation factors for companies in the field of EVs. The R&D direction can be obtained from the above three aspects.
4. Results
4.1. Results of Promising Technologies Identification
In terms of market demand, based on the calculated user satisfaction and attention, the market demand of review keywords in the EVs field is obtained according to Formula (3). The calculation results are shown in Table 7. The greater the indicator value of market demand, that the more the corresponding technological improvement can satisfy users.
Table 7.
Market demand indicator of review keywords in the EVs field.
In terms of technical features, the CRITIC method is used in this study to objectively analyze the importance and increase rate of technical keywords and assign reasonable weights to them. The weight of importance indicator is 0.4865, and the weight of increase rate indicator is 0.5135. In this way, the technical features of technical keywords can be comprehensively calculated, as shown in Table 8.
Table 8.
Technical features of technical keywords in the EVs field.
Therefore, the market demand and technical features indicator values of technical topics are shown in Table 9.
Table 9.
Technical features and market demand of technology topics.
In order to identify promising technology of EVs, this study takes technical features as abscissa and market demand as ordinate to construct a portfolio map. Based on the average value of technical features and market demand indicators, 9.402 is set as the median of x axis, and 0.064 is set as the median of y axis. The technical topics in the EVs field can be divided into four types by quadrants in Figure 2.
Figure 2.
Portfolio map in the EVs field.
As shown in Figure 2, technical topics in the first quadrant are promising technologies from the comprehensive perspective. Because of their relatively high market demand values and technical features values, they can be considered as technologies that are important and have high market demand in the EVs field. Improvements and innovations in these technologies will enhance the market competitiveness and technological superiority of companies. The technical topics in the second quadrant are promising technologies from the perspective of market attributes. For companies that focus on gain market, emphasis on improving such technologies can accurately develop EVs that meet market demand. The technical topics in the third quadrant are relatively unpromising technologies. Since their market demand values and technical features values are relatively low, they will not be analyzed and considered in this study. The technical topics in the fourth quadrant are promising technologies from the perspective of technical attributes. For companies in the field of EVs that focus on technological development, innovation of such critical technologies can achieve better innovation effects.
4.2. Analysis of Promising Technologies
The findings from the constructed portfolio map can provide some useful insights into the innovation in the EVs field. From the perspective of market attributes, innovation can come from improving the key areas where the users are troubled and thus want improvements. In this study, those areas include: (1) seat (I3); (2) alarm (SD1); (3) detector (C3); (4) storage (I4); (5) lock (SD5); and so on. Based on the above analysis, the two technical topics with the highest market demand are interior decoration and safety devices, especially in the seat, internal storage space, alarm system, and lock system. In addition, the detector is also a technology that needs to be urgently improved. Targeted optimization of these aspects can greatly improve user satisfaction and help obtain market superiority. Therefore, from the market perspective, the identified promising technologies are as follows. First of all, in terms of interior decoration, lightweight and high-strength new composite materials are used as much as possible in the body structure manufacturing process, with less body mass and increased internal space, thereby improving user comfort and improving the overall performance of the vehicle. Secondly, in terms of safety devices, when the vehicle is running normally, the vehicle terminal device establishes a communication connection with the integrated monitoring platform, sets up a multi-level alarm mechanism at the terminal, and performs different levels of alarm prompts according to different information anomalies.
From the perspective of technical attributes, further technology development is expected to emerge to yield more subsequent innovation in such areas as (1) accelerator (PS1); (2) chassis (SC2); (3) inner (I5); (4) remote monitoring (SD6); and so on. Firstly, the technologies of accelerator and chassis have occupied an important position in EVs in recent years. Companies focusing on technology development should give priority to improving these two technologies. In addition, the upgrading of Internal placement and remote monitoring functions can also improve the technical impact of EVs. Therefore, from the market perspective, the identified promising technologies are as follows. In terms of power systems, first of all, new synthetic materials can be used to further reduce the quality of the cooling system and control device of the drive motor. Secondly, a wide range of speed adjustments can be completed in the case of only setting the first-stage reducer to obtain a higher driving speed. In terms of safety devices, the vehicle equipment is composed of a communication module and a Bluetooth module, which has the function of obtaining real-time operation data of EVs and transmitting the data to smartphones.
From the comprehensive perspective, companies and R&D personnel can also improve competitiveness by innovating in areas that have technical prospects and meet market demand, including the following areas: (1) solar (PC6); (2) BMS (PC2); and (3) automation (M1). Accordingly, the technical topic of power consumption is the most promising. The application of clean energy such as solar energy of EVs and the battery management system (BMS) should be particularly concerned. In addition, the automation level of EVs should be improved. Therefore, from the comprehensive perspective, the identified promising technologies are as follows. Firstly, the battery pack technology should be developed to produce a battery pack with a larger capacity and larger charging current to improve charging efficiency. Secondly, creating a fully automatic battery swapping process, increasing the construction of battery swapping stations, automatically collecting the disassembled feed batteries to the designated location for charging, and cycling to complete the battery swapping work are future research directions. Finally, optimizing the automotive circuit system, reducing the energy consumption of electronic components, introducing energy recovery and storage technology, and improving energy efficiency are also future research directions.
It is worth noting that the identification results in this study are different from the results of direct statistics of keywords extracted from online reviews and patents. The reasons are as follows. In terms of review keywords, the higher the word frequency, the higher the users’ preference for specific components of EV products. However, it is difficult to analyze users’ satisfaction with specific components only based on attention preference. The market demand should be measured by users’ satisfaction and attention. In terms of technical keywords, the higher the word frequency, the more frequently these keywords are mentioned in the patents. However, it is not comprehensive and objective enough to measure their technical features only by the times of occurrence. Social network centrality analysis is introduced in this study to fully analyze the relationship between keywords. In addition, the DEA–Malmquist model and CRITIC method are applied to improve the objectivity of the calculation results of technical features. Therefore, compared with the results of direct statistics of keywords, the identification results are more accurate, comprehensive, and objective.
Companies can carry out innovation activities in the field of EVs based on the above identification results to improve technological innovation capability and product competitiveness. The R&D direction can be developed based on three important perspectives of market, technical, and comprehensive attributes.
5. Discussion
This study combines the perspectives of market and technical attributes to identify promising EVs technologies. Market demand and technical features in specific fields are obtained from online reviews and patent data to provide more sufficient evidence and richer research perspectives for identifying promising technologies. The research framework proposed is based on a recursive decision analysis process, which aims to identify the problem essence and clarify the problem from different aspects. The data-driven innovation method proposed can provide sufficient information for companies and R&D personnel. Meanwhile, the research framework proposed in this study is a dynamic system process. Since this study is based on the analysis of existing information on market and technical aspects, the identification of promising technologies may be less practical over time. With the new inputs of online reviews and patent data, the identification results can be improved and updated to provide the latest insights for companies and R&D personnel in the field of EVs.
This study identifies promising technologies from the market perspective, technical perspective, and comprehensive perspective, and describes them in detail. In general, promising technologies mainly involve technical topics such as interior decoration, safety devices, power systems, and power consumption. Different EV manufacturers can choose different perspectives to carry out technological innovation activities according to their focus. Specifically, manufacturers that focus on market attributes and focus on key areas that are troublesome to users should combine promising technologies identified from the market perspective with improvements and innovations in interior decoration and safety devices. Manufacturers that focus on technical attributes and are committed to promoting technological development through innovation should combine promising technologies identified from the technical perspective to improve and innovate from aspects such as power systems and safety devices. In addition, manufacturers considering both market and technical attributes should combine promising technologies identified from the comprehensive perspective to improve and innovate in the aspects such as power consumption and automation.
The research on identifying promising technologies for EVs from the perspective of market attributes and technical attributes in this study extends the research of Song et al. [38]. Their research mainly focused on measuring the prospect degree and technical features of patents using the accumulated patent bibliometric information and the patent bibliometric information as its first appearance and paid less attention to the text information of patents. In addition, a technology is represented by a patent in their research, and the identified promising technology is represented by a patent title and application in the field of automobile door systems. They emphasized the combination of a retrospective technological features analysis and a prospective market-needs analysis to identify promising technologies. It provides a reference for us to integrate market and technical attributes to identify promising technologies. Based on existing research, the text information of patent data was fully considered in this study, and social network centrality analysis and the DEA–Malmquist model were applied to fully consider the correlation between technical keywords and their dynamic changes. The promising technologies identified in this study have been more specifically explained to provide clearer innovation guidance for EV manufacturers. In addition, the research framework proposed is based on a recursive decision analysis process, which aims to identify the essence of the problem and clarify the problem from different aspects. Therefore, this study provides more sufficient evidence and richer research perspectives for identifying promising technologies.
In terms of research methods and techniques, in order to illustrate the feasibility and advantages of the methods and techniques used in this study, their comparative analysis with other methods needs to be discussed. In the existing literature, patent maps [63], abnormal value detection [64], and index analysis are often applied to identify promising technologies from the technical perspective. Among them, the patent map and abnormal value detection method intuitively present the identification results, and the index analysis method measures the identification results quantitatively and objectively. However, the above methods focus on the self and static features of technologies and less on the relationship between them and dynamic change features. To our best knowledge, social network centrality analysis can fully consider the relationship between technologies by calculating the centrality indicators of each technical node in the network. The DEA–Malmquist model can be used to evaluate the dynamic efficiency changes of centrality indicators in continuous time, and the CRITIC method can objectively assign weights to multiple output indicators of the DEA–Malmquist model. Therefore, these methods and techniques are applied in this study to improve the comprehensiveness and accuracy of the analysis results.
6. Conclusions
This study develops a novel approach to identify promising EVs technologies from the perspective of market and technical attributes. The review and technical keywords are extracted from online reviews and patent data using text mining tools. Further, a series of quantitative analysis methods such as sentiment analysis and the DEA–Malmquist model were applied to analyze and calculate market demand and technical features values. Promising technologies were identified by constructing a portfolio map based on these two indicators. The identification results can provide innovative ideas for companies and R&D personnel in the field of EVs.
The contributions of this study are as follows. From the aspect of perspective, this study attempts to integrate the market attributes into the process of identifying promising EVs technologies, while most of the existing literature on EVs only relies on a single perspective of technical attributes, and less systematically analyzes the promising EVs technologies from the overall level. Meanwhile, the UNISON framework developed provides a systematic approach for promising technology identification by integrating market and technical attributes. From the aspect of methodology, in the stage of technical features analysis, social network centrality analysis and the DEA–Malmquist model are employed. This can compensate for the previous studies focusing on the self and static technical keywords while ignoring their correlations and dynamic changes. In addition, the application of the CRITIC method enhances the objectivity of technical features calculation results. From the perspective of application, the method proposed in this study can provide an objective and comprehensive reference for EV-related enterprises to analyze technology trends and opportunities. In addition, the promising technologies identified in this study can provide relevant enterprises with innovative improvement directions for EVs, thus contributing to global energy efficiency and environmental protection.
Despite the contribution, this study has some limitations, and further study is required. Firstly, in order to map the review keywords and technical keywords and summarize the technical topics, this study has employed the opinions of experts in the field of EVs. However, the mapping relationship between the two can be determined by combining quantitative and qualitative analysis to improve the efficiency and objectivity of the analysis process. In addition, since the market demand in this study is analyzed based on online reviews, it can work well only in the field where enough user reviews have accumulated to offer reliable and trustworthy information on market demand. Finally, the proposed framework based on the perspective of market and technical attributes focuses on short-term technological innovation. A rolling collection of online reviews and patent data in specific fields should be required to update and improve the innovation ideas in time.
Author Contributions
L.F.: conceptualization, methodology, resources. K.L.: data curation, writing—original draft. J.W.: supervision, funding acquisition. K.-Y.L.: methodology, writing—review and editing. K.Z.: formal analysis, investigation. L.Z.: software, validation. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by Innovation Method Fund of China, grant number 2018IM020300, 2019IM020200; Joint Funds of the National Natural Science Foundation of China, grant number U1904210-4; Shanghai Science and Technology Program, grant number 20040501300; National Key Research and Development Program, grant number 2022YFF0608700; Research Subject of Federation of Social Sciences for Henan Province, grant number SKL-2022-2312 and National Natural Science Foundation of China, grant number 62173253.
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Appendix A
Table A1.
Co-occurrence matrix for technical keywords in the EVs field in 2017.
Appendix B
Table A2.
Degree centrality of technical keywords in the EVs field in 2017–2021.
Appendix C
Table A3.
Betweenness centrality of technical keywords in 2017–2021.
Appendix D
Table A4.
Closeness centrality of technical keywords in 2017–2021.
References
- Mutavdžija, M.; Kovačić, M.; Buntak, K. Assessment of Selected Factors Influencing the Purchase of Electric Vehicles—A Case Study of the Republic of Croatia. Energies 2022, 15, 5987. [Google Scholar] [CrossRef] [Scilit]
- Allahmoradi, E.; Mirzamohammadi, S.; Naeini, A.B.; Maleki, A.; Mobayen, S.; Skruch, P. Policy Instruments for the Improvement of Customers’ Willingness to Purchase Electric Vehicles: A Case Study in Iran. Energies 2022, 15, 4269. [Google Scholar] [CrossRef] [Scilit]
- Yuvaraja, S.; Narayanamoorthi, R.; Ali, J.S.M.; Almakhles, D. A Comprehensive Review of the On-Road Wireless Charging System for E-Mobility Applications. Front. Energy Res. 2022, 10, 926270. [Google Scholar] [CrossRef] [Scilit]
- Zhang, L.; Liu, W.; Qi, B. Energy optimization of multi-mode coupling drive plug-in hybrid electric vehicles based on speed prediction. Energy 2020, 206, 118126. [Google Scholar] [CrossRef] [Scilit]
- Ma, S.-C.; Xu, J.-H.; Fan, Y. Characteristics and key trends of global electric vehicle technology development: A multi-method patent analysis. J. Clean. Prod. 2022, 338, 130502. [Google Scholar] [CrossRef] [Scilit]
- Cho, H.P.; Lim, H.; Lee, D.; Cho, H.; Kang, K.-I. Patent analysis for forecasting promising technology in high-rise building construction. Technol. Forecast. Soc. Chang. 2018, 128, 144–153. [Google Scholar] [CrossRef] [Scilit]
- Lee, J.; Ko, N.; Yoon, J.; Son, C. An approach for discovering firm-specific technology opportunities: Application of link prediction to F-term networks. Technol. Forecast. Soc. Chang. 2021, 168, 120746. [Google Scholar] [CrossRef] [Scilit]
- Yan, D.; Deng, X.; Mei, X. Evolution of Global EV Battery Technology Based on the Main Path of Patent Citation. J. Phys. Conf. Ser. 2021, 1955, 012096. [Google Scholar] [CrossRef] [Scilit]
- Yakubu, H.; Kwong, C. Forecasting the importance of product attributes using online customer reviews and Google Trends. Technol. Forecast. Soc. Chang. 2021, 171, 120983. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Y.; Zhao, C.; Liang, Z. Frills and product pricing with online reviews. Comput. Ind. Eng. 2021, 159, 107461. [Google Scholar] [CrossRef] [Scilit]
- Arif, S.; Lie, T.; Seet, B.; Ayyadi, S.; Jensen, K. Review of Electric Vehicle Technologies, Charging Methods, Standards and Optimization Techniques. Electronics 2021, 10, 1910. [Google Scholar] [CrossRef] [Scilit]
- Feng, S.; Magee, C.L. Technological development of key domains in electric vehicles: Improvement rates, technology trajectories and key assignees. Appl. Energy 2020, 260, 114264. [Google Scholar] [CrossRef] [Scilit]
- Zhuge, C.; Dong, C.; Wei, B.; Shao, C. Exploring the role of technology innovations in the diffusion of electric vehicle with an agent-based spatial integrated model. Resour. Conserv. Recycl. 2021, 174, 105806. [Google Scholar] [CrossRef] [Scilit]
- Kim, C.; Lee, H. A patent-based approach for the identification of technology-based service opportunities. Comput. Ind. Eng. 2020, 144, 106464. [Google Scholar] [CrossRef] [Scilit]
- Kim, G.; Bae, J. A novel approach to forecast promising technology through patent analysis. Technol. Forecast. Soc. Chang. 2017, 117, 228–237. [Google Scholar] [CrossRef] [Scilit]
- Cao, J.; Chen, X.; Qiu, R.; Hou, S. Electric vehicle industry sustainable development with a stakeholder engagement system. Technol. Soc. 2021, 67, 101771. [Google Scholar] [CrossRef] [Scilit]
- Yong, J.Y.; Ramachandaramurthy, V.K.; Tan, K.M.; Mithulananthan, N. A review on the state-of-the-art technologies of electric vehicle, its impacts and prospects. Renew. Sustain. Energy Rev. 2015, 49, 365–385. [Google Scholar] [CrossRef] [Scilit]
- Ma, S.-C.; Fan, Y.; Feng, L. An evaluation of government incentives for new energy vehicles in China focusing on vehicle purchasing restrictions. Energy Policy 2017, 110, 609–618. [Google Scholar] [CrossRef] [Scilit]
- Lee, M. An analysis of the effects of artificial intelligence on electric vehicle technology innovation using patent data. World Pat. Inf. 2020, 63, 102002. [Google Scholar] [CrossRef] [Scilit]
- Zhang, C.; Zhao, Y.; Zhao, H.; Wang, Q. Research on Restrictive Factors and Planning of Charging Piles for Electric Vehicles in the Park Based on the Interpretative Structural Model. Front. Energy Res. 2022, 10, 922766. [Google Scholar] [CrossRef] [Scilit]
- Cozzens, S.; Gatchair, S.; Kang, J.; Kim, K.-S.; Lee, H.J.; Ordóñez, G.; Porter, A. Emerging technologies: Quantitative identification and measurement. Technol. Anal. Strateg. Manag. 2010, 22, 361–376. [Google Scholar] [CrossRef] [Scilit]
- Rotolo, D.; Hicks, D.; Martin, B.R. What is an emerging technology? Res. Policy 2015, 44, 1827–1843. [Google Scholar] [CrossRef] [Scilit]
- Yun, S.; Song, K.; Kim, C.; Lee, S. From stones to jewellery: Investigating technology opportunities from expired patents. Technovation 2021, 103, 102235. [Google Scholar] [CrossRef] [Scilit]
- Ante, L. The relationship between readability and scientific impact: Evidence from emerging technology discourses. J. Inf. 2022, 16, 101252. [Google Scholar] [CrossRef] [Scilit]
- Jang, W.; Park, Y.; Seol, H. Identifying emerging technologies using expert opinions on the future: A topic modeling and fuzzy clustering approach. Scientometrics 2021, 126, 6505–6532. [Google Scholar] [CrossRef] [Scilit]
- Zhou, Y.; Dong, F.; Liu, Y.; Ran, L. A deep learning framework to early identify emerging technologies in large-scale outlier patents: An empirical study of CNC machine tool. Scientometrics 2021, 126, 969–994. [Google Scholar] [CrossRef] [Scilit]
- Mi, L.; Huang, L.-C.; Han, Z.-X.; Miao, H.; Wu, F. Forecasting and evaluating emerging technologies based on supply and demand matching—A case study of China’s gerontechnology. Technol. Anal. Strat. Manag. 2021, 34, 290–306. [Google Scholar] [CrossRef] [Scilit]
- Darko, A.P.; Liang, D. Modeling customer satisfaction through online reviews: A FlowSort group decision model under probabilistic linguistic settings. Expert Syst. Appl. 2022, 195, 116649. [Google Scholar] [CrossRef] [Scilit]
- Goldberg, D.M.; Abrahams, A.S. Sourcing product innovation intelligence from online reviews. Decis. Support Syst. 2022, 157, 113751. [Google Scholar] [CrossRef] [Scilit]
- Choi, J.; Lee, J.; Yoon, J. Anticipating promising services under technology capability for new product-service system strategies: An integrated use of patents and trademarks. Comput. Ind. 2021, 133, 103542. [Google Scholar] [CrossRef] [Scilit]
- Liu, L.; Li, Y.; Xiong, Y.; Cavallucci, D. A new function-based patent knowledge retrieval tool for conceptual design of innovative products. Comput. Ind. 2021, 115, 103154. [Google Scholar] [CrossRef] [Scilit]
- Jang, H.J.; Woo, H.-G.; Lee, C. Hawkes process-based technology impact analysis. J. Inf. 2017, 11, 511–529. [Google Scholar] [CrossRef] [Scilit]
- Kyebambe, M.N.; Cheng, G.; Huang, Y.; He, C.; Zhang, Z. Forecasting emerging technologies: A supervised learning approach through patent analysis. Technol. Forecast. Soc. Chang. 2017, 125, 236–244. [Google Scholar] [CrossRef] [Scilit]
- Choi, Y.; Park, S.; Lee, S. Identifying emerging technologies to envision a future innovation ecosystem: A machine learning approach to patent data. Scientometrics 2021, 126, 5431–5476. [Google Scholar] [CrossRef] [Scilit]
- Ebadi, A.; Tremblay, S.; Goutte, C.; Schiffauerova, A. Application of machine learning techniques to assess the trends and alignment of the funded research output. J. Inf. 2020, 14, 101018. [Google Scholar] [CrossRef] [Scilit]
- Kreutz, C.K.; Sahitaj, P.; Schenkel, R. Evaluating semantometrics from computer science publications. Scientometrics 2020, 125, 2915–2954. [Google Scholar] [CrossRef] [Scilit]
- Zhou, Y.; Dong, F.; Liu, Y.; Li, Z.; Du, J.; Zhang, L. Forecasting emerging technologies using data augmentation and deep learning. Scientometrics 2020, 123, 1–29. [Google Scholar] [CrossRef] [Scilit]
- Song, K.; Kim, K.; Lee, S. Identifying promising technologies using patents: A retrospective feature analysis and a prospective needs analysis on outlier patents. Technol. Forecast. Soc. Chang. 2018, 128, 118–132. [Google Scholar] [CrossRef] [Scilit]
- Noh, H.; Lee, S. What constitutes a promising technology in the era of open innovation? An investigation of patent potential from multiple perspectives. Technol. Forecast. Soc. Chang. 2020, 157, 120046. [Google Scholar] [CrossRef] [Scilit]
- Ba, Z.; Mao, J.; Ma, Y.; Liang, Z. Exploring the effect of city-level collaboration and knowledge networks on innovation: Evidence from energy conservation field. J. Inf. 2021, 15, 101198. [Google Scholar] [CrossRef] [Scilit]
- Gao, Q.; Liang, Z.; Wang, P.; Hou, J.; Chen, X.; Liu, M. Potential index: Revealing the future impact of research topics based on current knowledge networks. J. Inf. 2021, 15, 101165. [Google Scholar] [CrossRef] [Scilit]
- Behrouzi, S.; Sarmoor, Z.S.; Hajsadeghi, K.; Kavousi, K. Predicting scientific research trends based on link prediction in keyword networks. J. Inf. 2020, 14, 101079. [Google Scholar] [CrossRef] [Scilit]
- Yang, Z.; Zhang, W.; Yuan, F.; Islam, N. Measuring topic network centrality for identifying technology and technological development in online communities. Technol. Forecast. Soc. Chang. 2021, 167, 120673. [Google Scholar] [CrossRef] [Scilit]
- Chen, X.; Liu, Z.; Zhu, Q. Performance evaluation of China’s high-tech innovation process: Analysis based on the innovation value chain. Technovation 2018, 74–75, 42–53. [Google Scholar] [CrossRef] [Scilit]
- Luo, S.; Sun, Y.; Yang, F.; Zhou, G. Does fintech innovation promote enterprise transformation? Evidence from China. Technol. Soc. 2022, 68, 101821. [Google Scholar] [CrossRef] [Scilit]
- Wang, S.; Zhang, J.; Fan, F.; Lu, F.; Yang, L. The symbiosis of scientific and technological innovation efficiency and economic efficiency in China—An analysis based on data envelopment analysis and logistic model. Technol. Anal. Strat. Manag. 2018, 31, 67–80. [Google Scholar] [CrossRef] [Scilit]
- Quan, C.; Yu, S.; Cheng, X.; Liu, F. Comprehensive efficiency evaluation of social responsibility of Chinese listed logistics enterprises based on DEA-Malmquist model. Oper. Manag. Res. 2022. [Google Scholar] [CrossRef] [Scilit]
- Zhu, W.; Zhu, Y.; Lin, H.; Yu, Y. Technology progress bias, industrial structure adjustment, and regional industrial economic growth motivation—Research on regional industrial transformation and upgrading based on the effect of learning by doing. Technol. Forecast. Soc. Chang. 2021, 170, 120928. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Z.; Guo, J.; Zhang, H.; Zhou, L.; Wang, M. Product selection based on sentiment analysis of online reviews: An intuitionistic fuzzy TODIM method. Complex Intell. Syst. 2022, 8, 3349–3362. [Google Scholar] [CrossRef] [Scilit]
- Wu, J.; Ma, X.; Chiclana, F.; Liu, Y.; Wu, Y. A consensus group decision making method for hotel selection with online reviews by sentiment analysis. Appl. Intell. 2022, 52, 10716–10740. [Google Scholar] [CrossRef] [Scilit]
- Dahooie, J.H.; Raafat, R.; Qorbani, A.R.; Daim, T. An intuitionistic fuzzy data-driven product ranking model using sentiment analysis and multi-criteria decision-making. Technol. Forecast. Soc. Chang. 2021, 173, 121158. [Google Scholar] [CrossRef] [Scilit]
- Zhang, J.; Zhang, A.; Liu, D.; Bian, Y. Customer preferences extraction for air purifiers based on fine-grained sentiment analysis of online reviews. Knowledge-Based Syst. 2021, 228, 107259. [Google Scholar] [CrossRef] [Scilit]
- Safder, I.; Mahmood, Z.; Sarwar, R.; Hassan, S.; Zaman, F.; Nawab, R.M.A.; Bukhari, F.; Abbasi, R.A.; Alelyani, S.; Aljohani, N.R.; et al. Sentiment analysis for Urdu online reviews using deep learning models. Expert Syst. 2021, 38, e12751. [Google Scholar] [CrossRef] [Scilit]
- Wang, P.; Li, J.; Hou, J. S2SAN: A sentence-to-sentence attention network for sentiment analysis of online reviews. Decis. Support Syst. 2021, 149, 113603. [Google Scholar] [CrossRef] [Scilit]
- Lin, K.-Y. User experience-based product design for smart production to empower industry 4.0 in the glass recycling circular economy. Comput. Ind. Eng. 2018, 125, 729–738. [Google Scholar] [CrossRef] [Scilit]
- Olmedilla, M.; Martínez-Torres, M.R.; Toral, S. Prediction and modelling online reviews helpfulness using 1D Convolutional Neural Networks. Expert Syst. Appl. 2022, 198, 116787. [Google Scholar] [CrossRef] [Scilit]
- König, T.M.; Hein, N.; Nimsgern, V. A value perspective on online review platforms: Profiling preference structures of online shops and traditional companies. J. Bus. Res. 2022, 145, 387–401. [Google Scholar] [CrossRef] [Scilit]
- Evangelista, A.; Ardito, L.; Boccaccio, A.; Fiorentino, M.; Petruzzelli, A.M.; Uva, A.E. Unveiling the technological trends of augmented reality: A patent analysis. Comput. Ind. 2020, 118, 103221. [Google Scholar] [CrossRef] [Scilit]
- Nasar, Z.; Jaffry, S.W.; Malik, M.K. Textual keyword extraction and summarization: State-of-the-art. Inf. Process. Manag. 2019, 56, 102088. [Google Scholar] [CrossRef] [Scilit]
- Vishkaei, B.M.; Fathi, M.; Khakifirooz, M.; De Giovanni, P. Bi-objective optimization for customers’ satisfaction improvement in a Public Bicycle Sharing System. Comput. Ind. Eng. 2021, 161, 107587. [Google Scholar] [CrossRef] [Scilit]
- Yang, C.; Wu, L.; Tan, K.; Yu, C.; Zhou, Y.; Tao, Y.; Song, Y. Online User Review Analysis for Product Evaluation and Improvement. J. Theor. Appl. Electron. Commer. Res. 2021, 16, 1598–1611. [Google Scholar] [CrossRef] [Scilit]
- Song, W.; Niu, Z.; Zheng, P. Design concept evaluation of smart product-service systems considering sustainability: An integrated method. Comput. Ind. Eng. 2021, 159, 107485. [Google Scholar] [CrossRef] [Scilit]
- Teng, F.; Sun, Y.; Chen, F.; Qin, A.; Zhang, Q. Technology opportunity discovery of proton exchange membrane fuel cells based on generative topographic mapping. Technol. Forecast. Soc. Chang. 2021, 169, 120859. [Google Scholar] [CrossRef] [Scilit]
- Kim, B.; Gazzola, G.; Jeong, M.K.; Yang, J.; Lee, J.-M.; Coh, B.-Y. Two-phase edge outlier detection method for technology opportunity discovery. Scientometrics 2017, 113, 1–16. [Google Scholar] [CrossRef] [Scilit]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).

