Next Article in Journal
The Characteristics of the Financially Vulnerable Groups Impacted by COVID-19 and Other Factors
Previous Article in Journal
A Hybrid Photovoltaic/Diesel System for Off-Grid Applications in Lubumbashi, DR Congo: A HOMER Pro Modeling and Optimization Study
Previous Article in Special Issue
Capabilities Analysis of Electricity Energy Conservation and Carbon Emissions Reduction in Multi-Level Battery Electric Passenger Vehicle in China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Future Smart Logistics Technology Based on Patent Analysis Using Temporal Network

1
Department of Shipping and Air Cargo & Drone Logistics, Youngsan University, 142, Bansong-sunhwan-ro, Haeundae-gu, Busan 48015, Republic of Korea
2
Department of Industrial Engineering, Seoul National University, 1, Gwanak-ro, Gwanak-gu, Seoul 08826, Republic of Korea
*
Author to whom correspondence should be addressed.
Sustainability 2023, 15(10), 8159; https://doi.org/10.3390/su15108159
Submission received: 25 February 2023 / Revised: 28 April 2023 / Accepted: 12 May 2023 / Published: 17 May 2023
(This article belongs to the Special Issue New Trends in Sustainable Supply Chain and Logistics Management)

Abstract

:
This study aims to predict new technologies by analyzing patent data and identifying key technology trends using a Temporal Network. We have chosen big data-based smart logistics technology as the scope of our analysis. To accomplish this, we first extract relevant patents by identifying technical keywords from prior literature and industry reports related to smart logistics. We then employ a technology prospect analysis to assess the innovation stage. Our findings indicate that smart logistics technology is in a growth stage characterized by continuous expansion. Moreover, we observe a future-oriented upward trend, which quantitatively confirms its classification as a hot technology domain. To predict future advancements, we establish an IPC Temporal Network to identify core and converging technologies. This approach enables us to forecast six innovative logistics technologies that will shape the industry’s future. Notably, our results align with the logistics technology roadmaps published by various countries worldwide, corroborating our findings’ reliability. The methodology presents in this research provides valuable data for developing R&D strategies and technology roadmaps to advance the smart logistics sector.

1. Introduction

As the 4th Industrial Revolution unfolds, many advanced technologies have emerged, catalyzing significant transformations in the logistics industry [1]. Driven by big data, a core component of the revolution, the logistics sector has shifted its focus from suppliers to consumers [2,3]. This shift has accelerated the adaptation of various fields to swiftly accommodate consumer requirements, including providing tailored services, enhanced reliability, customized mass transportation, and automated logistics warehouses. Consequently, companies have maximized profits by improving customer satisfaction and resource efficiency. The COVID-19 pandemic has further underscored the importance of addressing uncertainties, such as global supply chain vulnerabilities, transportation disruptions, and rapid volume changes [4]. In response, logistics companies increasingly employ intelligent technologies to minimize supply chain uncertainties in the post-pandemic era [5].
Innovative logistics systems, encompassing advanced technologies such as artificial intelligence (AI), blockchain, robots, and intelligent mobility, have gained prominence [6]. The common thread among smart logistics technologies, such as the Internet of Things (IoT), AI, and cloud computing, is their ability to collect and analyze data, enabling real-time tracking and prediction [7]. These technologies have spurred novel developments in logistics, including supply chain management, demand management, and quality management. Big data is widely recognized as the cornerstone of smart logistics [8]. Companies are increasingly implementing projects such as Mega Hub, which leverages customer purchase history and pattern data to enable predictive delivery systems, manages supply chain risks using risk databases, and forecasts resource needs through big data analysis [9,10,11,12].
In the era of Logistics 4.0, technology development roadmaps are being announced, and R&D efforts are actively underway to secure advanced technologies [13,14]. Developing a system that offers services based on big data analysis or a new logistics technology utilizing 4th Industrial Revolution technologies necessitates the convergence and integration of multiple technologies [15]. Patent document analysis is crucial for identifying technology convergence relationships and informing future development strategies [16]. Patents encompass novel technologies and market attributes, enabling trend prediction and technology development planning through prior patent investigation and analysis [17]. Moreover, new technologies and relationships between technologies can be anticipated through various analyses, such as past and present technology trend analysis and interrelated technology analysis using patent documents. Technology forecasting studies have been conducted on patent data using various methodologies [18,19,20,21]. However, there have yet to be technology prediction studies using Temporal Network. We show that Temporal Network can be used to conduct technology forecasting research. This study aims to predict big data-driven logistics technologies using Temporal Network, informing R&D direction through trend and network analysis of patent documents and preventing redundant research efforts.

2. Previous Research

2.1. 4th Industrial Revolution Technology and Logistics Technology

The logistics industry refers to the overall process of the supply chain, including product production, inventory management, product distribution, and delivery [22]. It is possible to optimize the logistics process by establishing plans through accurate demand forecasting and automating logistics using machines, which leads to minimizing logistics costs and improving consumer satisfaction [23]. It is possible to derive optimized logistics processes with new technologies composed of 4th industrial revolution technologies such as artificial intelligence, extensive data analysis, and automated robots [24]. Based on the above, some countries, including the Netherlands, Germany, and Japan, and logistics-related companies are establishing data-based Information and Communications Technology (ICT) logistics technology development strategies using the 4th Industrial Revolution technology for future logistics competitiveness.
The European Union plans to improve efficiency by 30% in the logistics supply chain by 2030 via the Alliance for Logistics Innovation in Europe (Alice) project. The project aims to secure flexibility in logistics processes and design eco-friendly logistics chains by establishing a physical Internet, an information system that integrates logistics supply chains, and optimizing links between means of transportation [25]. Germany has tried digitalizing logistics supply chains through the Logistics 2030 Innovation Programme and High-Tech Strategy 2025. In this manner, they expect to build a fast and safe logistics process by digitally managing all transportation methods and establishing intelligent railroads, ports, and aviation systems [26]. Japan revised the “Comprehensive Logistics Policy” to apply the Internet of Things and artificial intelligence to the logistics system and announced establishment of a sustainable logistics system. In addition, automation technology is used as a solution to solve the shortage of workers in the logistics industry and the shortage of truck drivers due to the aging, low birth rate [27]. South Korea confirmed the “5th National Framework Plan for Logistics (2021–2030)”. It selected “Growth of Smart Digital Innovation in the Logistics Industry and Created a Win-Win Ecosystem” as its key theme. Based on this, the ten critical tasks announced include establishing a logistics system in preparation for the autonomous driving era, establishing an efficient, intelligent city logistics system, activating cold-chain, building only high-tech smart airports, innovating an eco-friendly shipping logistics system, and building a platform to distribute national logistics big data [28]. The logistics supply chain has a wide range, including logistics creation to delivery to consumers [29].
To apply the smart logistics system to the logistics supply chain, systematic development of various technologies and convergence between technologies are necessary [30]. For example, logistics centers that perform product storage, packaging, and classification, and Last Mile, where products are delivered to consumers, require classification automation robots and delivery optimal route technology to maximize efficiency individually. However, from the perspective of the overall logistics process, it is necessary to accurately predict the demand for products using advanced technologies such as artificial intelligence and big data. Finally, the optimization of the supply chain is designed by connecting the logistics center and Last Mile. In other words, data collection, extensive data analysis, and automation technologies should be applied to improve overall process efficiency and individual factors [31,32]. As mentioned above, since the scope of the logistics supply chain is broad, it is difficult to derive a systematic technology development strategy using a general technology development method. Therefore, to preoccupy excellent technologies in logistics technology, it is necessary to systematically predict technologies by applying analysis technologies based on accurate technology status surveys.

2.2. Patent Analysis

2.2.1. Technology Development Status Analysis

To predict technology, thorough investigation and analysis of technology development status are required [33]. There are two methods used to analyze the current status of technology development. One is a qualitative method, and the other is the quantitative method [34]. Qualitative analysis methods include Delphi, scenario composition, and brainstorming analysis methods. Significantly, the Delphi method is one of the methods of deriving problems based on expert empirical knowledge, presenting solutions through them, and finally predicting the future, and is widely used in various fields [35]. However, there is a possibility that qualitative analysis methods will be interpreted as false results because conclusions are drawn based on the researcher’s questionnaire form and combination and expert subjective opinions [36,37].
Quantitative analysis methods are used to analyze the current technology development status to overcome the limitations of qualitative analysis methods that can be interpreted as subjective opinions. Quantitative analysis methods encompass various methods, such as technology growth curve and technology level analysis. The technology growth curve was developed based on the growth curve. The growth curve is a model initially used in biology to measure the growth of living things over time, and a typical form is an S-curved sigmoid function [38]. It is known that this form is similar to the growth process of technology, and based on this, it was used as a technology growth curve [39]. After that, a method of evaluating the level of technology between countries using the technology growth curve, which is a method of analyzing the stage of technology development over time, was proposed [40]. In addition, it has been used to determine the current location of the technology using patent data. From a technical point of view, there is a case of identifying the stage of technology growth using patents filed in hydrogen energy, Radio-Frequency Identification (RFID), and transportation system [41,42,43]. Technology-level analysis is a method of analyzing the current status of technology development between technology fields. The number of patent applications and the number of applicants were analyzed in a two-dimensional graph on two axes [44]. However, technology-level analysis is unsuitable for the research because it compares relative technologies.
Therefore, this research identifies the development location of the technology using the technology growth curve and finally identifies the need for technology prediction.

2.2.2. Network Analysis

Network analysis derived from the technical analysis of graph theory is a methodology used to analyze interactions between nodes [45]. Relationships and relative locations between nodes in a network can identify characteristics in individual units and throughout the system [46]. Network analysis has been developed in social science and used to analyze various social networks, including politics and people [47]. Network analysis was used for technology analysis beyond the field of social science. Network analysis has also been performed to achieve visualization and analysis of citation networks and inventor–patent networks between light-emitting and laser diodes patents [48]. However, since patent citation analysis shows only the citation relationship between the two patents, it is difficult to grasp the overall context and internal relationship, and only citations and citation information are considered. Therefore, various network analyses have been developed to compensate for these limitations. In this analysis, a patent classification code, International Patent Classification (IPC), is used to analyze relationships between technical fields [49]. More specifically, to analyze the relationship between technical elements, the core words of the patent were extracted using text mining techniques, and network analysis was performed based on the keyword [50].
The network analysis used in the past is a type of static network, and it is challenging to express interactions between elements that change frequently. It was confirmed that the Temporal Network was devised and had excellent efficiency in simulation with the natural world compared to the static network to overcome the limitations of the above static network. [51,52]. In the Temporal Network, the characteristics to which the axis of time is applied were conducted in many studies. Studies were conducted to predict the spread of infectious diseases and explore infectious diseases concerning population movement over time through time series data [53], and to analyze temporary interaction patterns between people caused by information and communication technology [54]. In addition, research was conducted to analyze changes in investment groups over time by expressing venture capital (VC) and venture companies that received investment in the venture investment market as a kind of network (Temporal Network) [55]. These preceding studies reveal that changes in industrial technology over time can be analyzed through the Temporal network. Therefore, this research aims to identify the flow of technology development over time using the Temporal network for patent analysis and analyze the future direction of technology.

3. Methodological Framework

3.1. Overall Framework

The methodological framework performed in this paper consists of three major steps as shown in Figure 1. The first step is to extract patents through a search from the patent database and select valid patents suitable for analysis in this study. After that, patent data for technology analysis is preprocessed. The technology growth curve is expressed as an effective patent in the second step. Currently, a technology importance evaluation consisting of technology prospect analysis using technology innovation stage analysis and time series analysis is performed. In the last and third steps, the future technology is predicted by building a Temporal Network using the IPC code of the patent and analyzing the IPC network structure that changes over time. Detailed descriptions of each step are described below.

3.2. Detailed Explanation

3.2.1. Step 1: Collecting Patents and Preprocessing Data for Technology Analysis

The first phase is the initial step for technology analysis, as shown in Figure 2, and consists of patent collection and data preprocessing. This research starts with the collection of patent documents in a specific field, and patents can be collected from various patent institutions. Significantly, the United States Patent and Trademark Office (USPTO) stores, manages, and supervises world patents, so it is practical to use the USPTO database to produce reliable results [56]. In addition, a patent search formula is constructed for more reliable patent extraction by combining keywords consisting of analysis targets, purposes, and means [57]. Patents extracted through the above process confirm valid patents from experts in the relevant technology field.
Patents contain various information, including patent names, patent information, technical field, drawings, inventors, and applicants. However, this study uses only technical fields, application dates, and inventor information. One or more IPC codes, an internationally unified patent classification system, are assigned for systematic classification in the technology field. The IPC code has a hierarchical structure of section, class, subclass, main group, and subgroup, and is shown in Table 1. In order to analyze the technology field with IPC code, four digits must be used up to the subclass level [58]. Therefore, this study also extracts and analyzes IPC codes up to four digits.
Since there are one or more IPC codes in the patent, many IPC codes are in the extracted valid patent. Therefore, during the data preprocessing step, the patent-IPC matrix is derived using only the frequency of the IPC code and the IPC used above average. The patent-IPC matrix is configured by expressing the presence of IPC for each patent as 0 and 1, as shown in Table 2.

3.2.2. Step 2: Technology Development Status Analysis

Researching the characteristics and trends of a specific technology field for accurate technology prediction is essential [6,44]. Technology research should analyze the current status of technology and identify future trends. Therefore, in this step, the importance of technology consisting of technology prospect analysis is evaluated as a technology growth curve using effective patents as technology innovation stage analysis and time series analysis.
The technology growth curve, which analyzes the stages of technological innovation, is a graph of the number of applications and applicants divided over time and recognizes essential information about technology [59,60]. Since this curve can differentiate the characteristics of each stage, it checks the level of technological growth and maturity [61,62]. The technology growth curve is classified into five stages. It has two axes: patent applications and patent applicants. The number of patent applications is an indicator of the IP creation environment, which can be used to understand whether a technology group is able to mobilize funding to support IP creation. The number of patent applications is one of the most commonly used indicators in patent analysis, as it shows whether the research is continuing [63].
In this curve, innovation of new technologies begins in the first stage. Although the number is small, it is interpreted as the time of introduction when applicants and patents increase simultaneously. In the second stage, the number of applicants and patents increases rapidly simultaneously, and expectations for new technologies expand. The third stage is the maturity stage, and the rate of increase in patent applicants decreases. In the fourth stage, technology’s market size decreases as the number of patents and applicants decreases. In the fifth stage, as new technologies emerge that surpass existing ones, the market that shrinks in the fourth stage gradually grows as the number of patents and patent applicants increases. In this study, the stage and location of the current technology can be identified from a macro perspective with a patent-based technology growth curve [59].
Technology prospect analysis predicts the direction of future technologies through time series analysis. Time series data prediction is a representative method of trend analysis as an analysis method for predicting the future based on past data [64]. This analysis regularly groups patents, calculates the number, and processes them as time series data. There are several algorithms used to predict the future with time series data [65]. In this research, trend analysis is conducted using Authentic Integrated Moving Average (ARIMA), an algorithm for predicting time series. ARIMA is a model that considers both differences between observations for explaining autocorrelation, moving average, and non-stationary time series data in which previous values affect subsequent values [64]. Based on the direction of the time series prediction results, as shown in Figure 3, they are hot when the trend rises, cold when it falls, and active when the trend is maintained [49,66].

3.2.3. Step 3: Future Technology Prediction

The final step is network analysis with a patent–IPC matrix. Patent Temporal Network analysis visualizes the interrelationship between technologies and the combination of technologies over time. The IPC of the patent–IPC matrix is set as a node, and if one patent contains two or more IPCs, they are linked together. In this case, unlike the original static network analysis, the Temporal Network is used to examine changes in the network over time [67].
Unlike static networks, Temporal Network can analyze network changes over time by adding one dimension of time to existing networks. The left side of the Figure 4 is the Static Network, and the right side is the Temporal Network. For example, it is possible to express a dynamic system, such as the path through which the patient’s pathogen spreads over time in the network and the path through which the e-mail is delivered. Since the link is activated only at a specific time, changes in the connection state and weight of the link over time can be identified [68,69].
The time dimension plays a vital role in network analysis. In the existing static network, if node A and node B are connected, and node B and node C are connected, then node A and node C are indirectly connected to form a link between nodes. However, assuming that node A and node B, and node C are connected at different times in the Temporal Network, then it shows that node A and node C are not connected. It reveals that network analysis and analysis vary according to the time axis [70].
Technology development is well detected because development trends change over time, while public static networks have limitations that make detection more difficult because there is little change. Therefore, this study analyzes technology development trends by establishing an IPC network over time.

4. Future Logistics Technology Predicition Using Big Data

4.1. Logistics Patent Data Collection and Data Preprocessing

This research involves extracting patent data from the USPTO database to analyze logistics patents related to big data. The search period is from 1977 to 2021, and data from more than 75 countries, including the Republic of Korea, the United States, Japan, China, and PCT, were collected. The search keyword was composed of a patent search formula by dividing national policy and logistics-related terms, fields, targets, and purposes related to the 4th industrial revolution technology, and extracted a total of 2169 patents. In addition, 963 valid patents were selected through analysis of valid patents with logistics experts.
As a result of analyzing the four-digit IPCs (subclass) for 963 logistics-related valid patents, a total of 129 IPCs were identified. In the context of network analysis, interpreting the results can be challenging if the weight of links—representing connections between IPCs—consists predominantly of small values or has a value of one. Therefore, we limited our analysis to IPCs with above-average connectivity, i.e., the number of patents with two IPCs was above average when we plotted the connectivity graph for the IPCs of 963 patents. As a result of the analysis, out of 129 IPCs, 22 IPCs were used more than average, and the patent × IPC matrix of 963 × 22 was finally designed, as shown in Table 3.

4.2. Logistics Technology Development Status Analysis Based on Big Data

After analyzing the current status of technology development of 963 data based on valid logistics-related patents, big data is used to check the development stage and prospects of logistics technology. The purpose of the analysis is to secure the validity of technology prediction. Since patent data will not be released until one and a half years after filing, analysis of the technology innovation stage and technology outlook will be analyzed using only data until December 2020.

4.2.1. Technology Innovation Stage Analysis

The technology innovation stage analysis is performed to confirm the current location of technology development. If the technology development market is already deteriorating, technology prediction is unnecessary, but it is essential if it is a growing technology development market. Therefore, this analysis is applied before predicting future logistics technologies related to big data.
The analysis of the technology innovation stage visualizes the technology growth curve by dividing it into five sections for each period. Figure 5 is a graph representing the number of patent applications and the number of applicants in a two-dimensional chart from 1977 to 2020. When analyzing the trend of the technology growth curve, the current position of big data-related logistics technology is confirmed to be in the first two stages of entering the development stage after the introduction period.

4.2.2. Technology Prospect Analysis

The technology prospect analysis identifies future technology development trends, and a time series analysis based on the number of applications can confirm prospects. Technology prediction is necessary for promising technologies, so this analysis is applied before predicting big data-related logistics technologies.
It performs a time series analysis based on the number of patent applications by year of valid patents. Time series analysis can predict the prospect of the number of patents applied in the future using the ARIMA algorithm. Therefore, in this study, the ’auto.arima’ function of the ’forecast’ package of R software used the ARIMA algorithm. Figure 6 shows the results of technology prospect analysis using time series data. In big data-related logistics technology, Arima’s p, q, and r variables were derived as 0, 2, and 2. The graph is upward trending, indicating that the future of big data technology in logistics is a hot area that continues to rise.

4.2.3. Summary

The technology innovation stage analysis is an analysis of the current status of technology development. Technology prospect analysis is based on quantitative indicators and can be used as valid evidence for technology prediction establishment. As a step before predicting technology, the technology growth stage of big data-related logistics technology was confirmed, and the direction of future technology was grasped through trend analysis based on time series data.
Since logistics technology is growing from the introductory period, it is progressing from the first to the second stage of the technology growth curve. Therefore, it is expected to be in a transitional period that continues to develop soon. Because the current and prospects mean the growth of technology, big data-based logistics technology requires market interest and investment. Therefore, countries and companies should focus on and develop big data-based logistics technologies. Below, we will predict future technologies in this regard.

4.3. Future Logistics Technology Prediction Based on Big Data

It is necessary to identify future logistics technology changes by analyzing changes in big data-based logistics technologies from the past to predict future technologies. To confirm changes in logistics technology over time, a Temporal Network is established to confirm changes in logistics technology. In addition, the “teneto” package of R and the patent x IPC matrix designed in the data preprocessing process is used for this network. Table 4 shows the definitions of 22 IPCs for network analysis.

4.3.1. Logistics Technology Network Transition

Since not all 2021 patents have been released, we can design a Temporal Network based on meaningful data-driven logistics patents through 2020 to see technology convergence starting in 2016. This means that the logistics and big data industries will converge in 2017. The results of the Temporal Network are shown in Table 5 and Figure 7.
Table 5 represents the connection weights of IPC 1 and IPC 2 differently at the time. We find the links connected to G06Q and H04L in 2017, two links connected to G06Q-G06F, G06Q-H04L in 2018, three links connected to G06Q-H04L, G06Q-G06F, and G05B-H04L in 2019, and eight links connected to G06Q-G06K, G06Q-G06F, G06Q-G06N, G06Q-H04W, G06Q-H04L, G06F-G06K, G06Q-G06T, and G01S-H04W in 2020. This confirms the development of full-fledged big data-driven logistics technology since 2017. In particular, explosive logistics technology development took place in 2020.
As a result of network analysis and patent analysis, in 2017, wireless communication network technology was developed to apply IoT technology. In 2018, technology was developed to transmit and utilize digital data based on previously developed technology. In 2019, technologies for controlling and coordinating digital data over time are being developed. In 2020, computing technologies for effectively processing collected data, data collection and processing using video communication and speed, rather than simple data acquisition.

4.3.2. Network Analysis/Major IPC Selection

The IPC code of G06Q is identified as the core code by analyzing the Temporal Network. Figure 8 is an intuitive visualization of IPC code fusion from 2017 to 2020. The weights in the graph show how many years in total there were such connections between 2017 and 2020. Looking at the figure, IPC codes that have not yet been fused with the G06Q code are G05B and G01S codes. The previous four IPCs are relatively easily integrated with technology because they are networked with one or two IPCs. Therefore, corresponding IPC codes must be included to predict big data-based future logistics technology.
As shown in Table 6, we extract the IPC codes that appeared in 2021 patents and sort them according to their frequency of appearance. In Table 6, appearance is organized by examining whether the IPC codes extracted from 2021 patents appeared in patent IPC codes up to 2020. X is an IPC code that appeared for the first time in 2021 and O is an IPC code that appeared in a patent in the past. The new IPC codes in 2021 mean that they can be combined with past IPC codes to create new technologies. According to Table 6, the IPC analysis results of patents filed in 2021, the IPC of G06Q, G06K, and G06F were derived as high-frequency IPCs. Eight out of fourteen IPCs overlap with the derived IPCs up to 2020, so IPCs other than these should be selected. Since six IPCs are not duplicated, future logistics technologies can be predicted, including these technologies.

4.3.3. Future Logistics Technology Prediction

Detailed topic selection is possible with four essential IPCs and six IPCs that do not overlap to predict future logistics technologies. Since nonoverlapping IPCs are still in a difficult stage of convergence between technologies, the IPCs must be included individually. Therefore, the complicated topic is defined as one IPC that does not overlap with the required IPC when selecting the detailed topic. This study predicts future logistics technologies, as shown in Table 7 and Table 8. Table 7 shows that six innovations can be derived from our IPC code extraction. IPC 1 is a new code that emerged in 2021. IPC 2, IPC 3, and IPC 4 refer to the core patent derived in Figure 8 and the two IPC codes not directly linked to the core patent by 2020, respectively. This means that the core IPC codes, unconnected IPC codes, and newly emerged IPC codes that are centered on existing patents will converge to create new technologies. Table 8 provides a detailed description of the technologies that will emerge from the combination of IPC codes derived in Table 7.

5. Conclusions/Discussion

The transformation of the logistics supply chain process is expected to begin by establishing an integrated digital system of smart logistics technology that incorporates advanced technologies. Since the logistics supply chain process is a process that encompasses a wide range, it is not easy to develop a convergence technology that combines major technologies if the development level is different for each detailed technology field. Innovative logistics technology should be predicted based on systematic technology status analysis to solve the above problems. This research presents a methodology using patent analysis to present the direction of technology development by predicting future innovative logistics technologies. Technology innovation stage analysis and technology prospect analysis were constructed through valid patents. Technology status analysis was conducted to quantitatively analyze the hot technology field, showing an upward trend and that logistics technology is in the growth phase. To predict the logistics technologies that will evolve in the future, we designed a Temporal Network based on the IPC code to extract critical technologies. Based on this, the final future smart logistics technology through convergence with core technologies was predicted through IPC analysis of recent patents.
The six future smart logistics technologies derived in this study have many things in common with the logistics technology roadmap announced in countries worldwide. Table 9 is a comparative analysis table of national roadmaps and prediction technologies. The table shows ⊚ for direct application and ∘ for indirect application. Comparing and analyzing the results of this study with the eight areas, we can see that the predicted smart logistics technologies are included. In addition, compared to the national logistics technology roadmap with a comprehensive concept, the results of this study can be confirmed in a more detailed technology field. In other words, when we conducted technology forecasting using Temporal Network based on patent data, we found that it was consistent with the existing roadmap for developing big data-based logistics technology. This shows that our methodology can derive the same results as the existing technology development roadmap. Furthermore, since this study presents a methodology for conducting technology prediction from IPC codes of patents, it can be utilized to propose specific tasks for establishing technology development roadmaps and government policy roadmaps.
Predicting new technologies is crucial for providing ideas to researchers and policymakers and establishing policies or research plans. This study shows that applying Temporal Network to IPC codes can predict innovative logistics technologies. In addition, it is shown that the predicted technology could design more specific technology development roadmaps and policy roadmaps through analysis of technology factors. In general, technology development roadmap design requires a lot of time and effort because it consists of extensive research and analysis of corporate, market, and technology development trends. However, it has been shown that quantitative analysis using published patents alone can produce results similar to the existing technology development roadmap. As a methodology of this research, it will help derive a roadmap for technology development and predict future technologies by using it in various fields beyond smart logistics technology.

Author Contributions

Conceptualization, J.S.; methodology, J.S.; formal analysis, J.S.; data curation, J.S.; writing—original draft preparation, K.K.; writing—review and editing, K.K.; supervision, J.S.; project administration, K.K.; funding acquisition, K.K. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by Youngsan University Research Fund of 2022.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data on patents can be found at the United States Patent and Trademark Office USPTO.

Acknowledgments

The authors would like to thank Seongchan Jeon for giving detailed feedback on the paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Skapinyecz, R.; Illés, B.; Bányai, Á. Logistic aspects of Industry 4.0. In Proceedings of the IOP Conference Series: Materials Science and Engineering; IOP Publishing: Bristol, UK, 2018; Volume 448, p. 012014. [Google Scholar]
  2. Kitchens, B.; Dobolyi, D.; Li, J.; Abbasi, A. Advanced customer analytics: Strategic value through integration of relationship-oriented big data. J. Manag. Inf. Syst. 2018, 35, 540–574. [Google Scholar] [CrossRef]
  3. Spiess, J.; T’Joens, Y.; Dragnea, R.; Spencer, P.; Philippart, L. Using big data to improve customer experience and business performance. Bell Labs Tech. J. 2014, 18, 3–17. [Google Scholar] [CrossRef]
  4. Shen, C.Y. Logistic growth modelling of COVID-19 proliferation in China and its international implications. Int. J. Infect. Dis. 2020, 96, 582–589. [Google Scholar] [CrossRef]
  5. Liu, W.; Liang, Y.; Bao, X.; Qin, J.; Lim, M.K. China’s logistics development trends in the post COVID-19 era. Int. J. Logist. Res. Appl. 2022, 25, 965–976. [Google Scholar] [CrossRef]
  6. Lee, C.K.; Lv, Y.; Ng, K.; Ho, W.; Choy, K.L. Design and application of Internet of things-based warehouse management system for smart logistics. Int. J. Prod. Res. 2018, 56, 2753–2768. [Google Scholar] [CrossRef]
  7. Zhong, R.Y.; Newman, S.T.; Huang, G.Q.; Lan, S. Big Data for supply chain management in the service and manufacturing sectors: Challenges, opportunities, and future perspectives. Comput. Ind. Eng. 2016, 101, 572–591. [Google Scholar] [CrossRef]
  8. Wang, G.; Gunasekaran, A.; Ngai, E.W.; Papadopoulos, T. Big data analytics in logistics and supply chain management: Certain investigations for research and applications. Int. J. Prod. Econ. 2016, 176, 98–110. [Google Scholar] [CrossRef]
  9. Jin, D.H.; Kim, H.J. Integrated understanding of big data, big data analysis, and business intelligence: A case study of logistics. Sustainability 2018, 10, 3778. [Google Scholar] [CrossRef]
  10. Hewage, T.N.; Halgamuge, M.N.; Syed, A.; Ekici, G. Big Data Techniques of Google, Amazon, Facebook and Twitter. J. Commun. 2018, 13, 94–100. [Google Scholar] [CrossRef]
  11. Martin, J.; Moritz, G.; Frank, W. Big data in logistics a DHL perspective on how to move beyond the hype. In DHL Customer Solutions & Innovation; DHL Customer Solutions & Innovation: Plantation, FL, USA, 2013; pp. 1–30. [Google Scholar]
  12. Robak, S.; Franczyk, B.; Robak, M. Applying big data and linked data concepts in supply chains management. In Proceedings of the 2013 Federated Conference on Computer Science and Information Systems, Krakow, Poland, 8–11 September 2013; IEEE: New York, NY, USA, 2013; pp. 1215–1221. [Google Scholar]
  13. Facchini, F.; Oleśków-Szłapka, J.; Ranieri, L.; Urbinati, A. A maturity model for logistics 4.0: An empirical analysis and a roadmap for future research. Sustainability 2019, 12, 86. [Google Scholar] [CrossRef]
  14. Bessis, N.; Dobre, C. Big Data and Internet of Things: A Roadmap for Smart Environments; Springer: Heidelberg, Germany, 2014; Volume 546. [Google Scholar]
  15. Diez-Olivan, A.; Del Ser, J.; Galar, D.; Sierra, B. Data fusion and machine learning for industrial prognosis: Trends and perspectives towards Industry 4.0. Inf. Fusion 2019, 50, 92–111. [Google Scholar] [CrossRef]
  16. Caviggioli, F. Technology fusion: Identification and analysis of the drivers of technology convergence using patent data. Technovation 2016, 55, 22–32. [Google Scholar] [CrossRef]
  17. Park, Y.; Yoon, B.; Lee, S. The idiosyncrasy and dynamism of technological innovation across industries: Patent citation analysis. Technol. Soc. 2005, 27, 471–485. [Google Scholar] [CrossRef]
  18. Wenfeng, Z.; Xin, F.; Hongmei, Y. Research on Technology Opportunity Identification of Small and Medium-sized Vaccine Enterprises Based on Patent Analysis. Asian Soc. Pharm. 2020, 15, 97–107. [Google Scholar]
  19. Leydesdorff, L.; Kushnir, D.; Rafols, I. Interactive overlay maps for US patent (USPTO) data based on International Patent Classification (IPC). Scientometrics 2014, 98, 1583–1599. [Google Scholar] [CrossRef]
  20. Chun, E.; Jun, S.; Lee, C. Identification of Promising Smart Farm Technologies and Development of Technology Roadmap Using Patent Map Analysis. Sustainability 2021, 13, 10709. [Google Scholar] [CrossRef]
  21. Kwon, K.; Jun, S.; Lee, Y.J.; Choi, S.; Lee, C. Logistics technology forecasting framework using patent analysis for technology roadmap. Sustainability 2022, 14, 5430. [Google Scholar] [CrossRef]
  22. Comelli, M.; Fenies, P.; Tchernev, N. A combined financial and physical flows evaluation for logistic process and tactical production planning: Application in a company supply chain. Int. J. Prod. Econ. 2008, 112, 77–95. [Google Scholar] [CrossRef]
  23. Ayed, A.B.; Halima, M.B.; Alimi, A.M. Big data analytics for logistics and transportation. In Proceedings of the 2015 4th international conference on advanced logistics and transport (ICALT), Valenciennes, France, 20–22 May 2015; IEEE: New York, NY, USA, 2015; pp. 311–316. [Google Scholar]
  24. Bucki, R.; Suchánek, P. The Method of Logistic Optimization in E-commerce. J. Univers. Comput. Sci. 2012, 18, 1238–1258. [Google Scholar]
  25. Zijm, W.; Klumpp, M. Future Logistics: What to Expect, How to Adapt; Springer: Cham, Germany, 2017; pp. 365–379. [Google Scholar]
  26. Charoenporn, P. Smart logistic system by IOT technology. In Proceedings of the 6th International Conference on Information and Education Technology, Osaka, Japan, 6–8 January 2018; pp. 149–153. [Google Scholar]
  27. Dekle, R. Robots and industrial labor: Evidence from Japan. J. Jpn. Int. Econ. 2020, 58, 101108. [Google Scholar] [CrossRef]
  28. Shin, H. A Study on Trends in the Use of Logistics Technology based on the 4th Industrial Revolution. E-Bus. Stud. 2020, 21, 17–27. [Google Scholar] [CrossRef]
  29. Lambert, D.M.; Cooper, M.C. Issues in supply chain management. Ind. Mark. Manag. 2000, 29, 65–83. [Google Scholar] [CrossRef]
  30. Cooper, D.P.; Tracey, M. Supply chain integration via information technology: Strategic implications and future trends. Int. J. Integr. Supply Manag. 2005, 1, 237–257. [Google Scholar] [CrossRef]
  31. Chu, H.; Zhang, W.; Bai, P.; Chen, Y. Data-driven optimization for last-mile delivery. Complex Intell. Syst. 2021, 1–14. [Google Scholar] [CrossRef]
  32. Halldórsson, Á.; Wehner, J. Last-mile logistics fulfilment: A framework for energy efficiency. Res. Transp. Bus. Manag. 2020, 37, 100481. [Google Scholar] [CrossRef]
  33. Kahng, A.B. The ITRS design technology and system drivers roadmap: Process and status. In Proceedings of the 50th Annual Design Automation Conference, Austin, TX, USA, 29 May–7 June 2013; pp. 1–6. [Google Scholar]
  34. Haegeman, K.; Marinelli, E.; Scapolo, F.; Ricci, A.; Sokolov, A. Quantitative and qualitative approaches in Future-oriented Technology Analysis (FTA): From combination to integration? Technol. Forecast. Soc. Chang. 2013, 80, 386–397. [Google Scholar] [CrossRef]
  35. Woudenberg, F. An evaluation of Delphi. Technol. Forecast. Soc. Chang. 1991, 40, 131–150. [Google Scholar] [CrossRef]
  36. Ekström, T. The Delphi Technique–Limitations and Possibilities. In Proceedings of the 32nd Annual NOFOMA Conference, Online, 17–18 September 2020. [Google Scholar]
  37. Goodman, C.M. The Delphi technique: A critique. J. Adv. Nurs. 1987, 12, 729–734. [Google Scholar] [CrossRef]
  38. Pearl, R.; Reed, L.J. A further note on the mathematical theory of population growth. Proc. Natl. Acad. Sci. USA 1922, 8, 365–368. [Google Scholar] [CrossRef] [PubMed]
  39. Oh, H.S.; Cho, J.H. Development of Survivor Models Using Technological Growth Models. J. Soc. Korea Ind. Syst. Eng. 2010, 33, 167–177. [Google Scholar]
  40. Ryu, J.; Byeon, S.C. Technology level evaluation methodology based on the technology growth curve. Technol. Forecast. Soc. Chang. 2011, 78, 1049–1059. [Google Scholar] [CrossRef]
  41. Chen, Y.H.; Chen, C.Y.; Lee, S.C. Technology forecasting and patent strategy of hydrogen energy and fuel cell technologies. Int. J. Hydrog. Energy 2011, 36, 6957–6969. [Google Scholar] [CrossRef]
  42. Trappey, C.V.; Wu, H.Y.; Taghaboni-Dutta, F.; Trappey, A.J. Using patent data for technology forecasting: China RFID patent analysis. Adv. Eng. Inform. 2011, 25, 53–64. [Google Scholar] [CrossRef]
  43. Jun, S.C.; Han, S.H.; Kim, S.B. Technology Development Strategy of Piggyback Transportation System Using Topic Modeling Based on LDA Algorithm. J. Korea Soc. Comput. Inf. 2020, 25, 261–270. [Google Scholar]
  44. Yoon, B.; Park, I.; Yun, D.; Park, G. Exploring promising vacant technology areas in a technology-oriented company based on bibliometric analysis and visualisation. Technol. Anal. Strateg. Manag. 2019, 31, 388–405. [Google Scholar] [CrossRef]
  45. Borgatti, S.P.; Mehra, A.; Brass, D.J.; Labianca, G. Network analysis in the social sciences. Science 2009, 323, 892–895. [Google Scholar] [CrossRef] [PubMed]
  46. Hage, P.; Harary, F. Eccentricity and centrality in networks. Soc. Netw. 1995, 17, 57–63. [Google Scholar] [CrossRef]
  47. Rhodes, R. Policy networks. In The Oxford Handbook of Public Policy; Oxford University Press: Oxford, UK, 2006; pp. 425–447. [Google Scholar]
  48. Sternitzke, C.; Bartkowski, A.; Schramm, R. Visualizing patent statistics by means of social network analysis tools. World Pat. Inf. 2008, 30, 115–131. [Google Scholar] [CrossRef]
  49. Jun, S.; Han, S.H.; Yu, J.; Hwang, J.; Kim, S.; Lee, C. Identification of promising vacant technologies for the development of truck on freight train transportation systems. Appl. Sci. 2021, 11, 499. [Google Scholar] [CrossRef]
  50. Yoon, B.; Park, Y. A text-mining-based patent network: Analytical tool for high-technology trend. J. High Technol. Manag. Res. 2004, 15, 37–50. [Google Scholar] [CrossRef]
  51. Li, A.; Cornelius, S.P.; Liu, Y.Y.; Wang, L.; Barabási, A.L. The fundamental advantages of temporal networks. Science 2017, 358, 1042–1046. [Google Scholar] [CrossRef] [PubMed]
  52. Holme, P.; Saramäki, J. Temporal networks. Phys. Rep. 2012, 519, 97–125. [Google Scholar] [CrossRef]
  53. Masuda, N.; Holme, P. Predicting and controlling infectious disease epidemics using temporal networks. F1000prime Rep. 2013, 5, 6. [Google Scholar] [CrossRef] [PubMed]
  54. Zhang, Y.Q.; Li, X.; Xu, J.; Vasilakos, A. Human Interactive Patterns in Temporal Networks. IEEE Trans. Syst. Man Cybern. Syst. 2015, 45, 214–222. [Google Scholar] [CrossRef]
  55. Zhang, X.; Feng, L.; Zhu, R.; Stanley, H.E. Applying temporal network analysis to the venture capital market. Eur. Phys. J. B 2015, 88, 260. [Google Scholar] [CrossRef]
  56. Kim, J.; Lee, S. Patent databases for innovation studies: A comparative analysis of USPTO, EPO, JPO and KIPO. Technol. Forecast. Soc. Chang. 2015, 92, 332–345. [Google Scholar] [CrossRef]
  57. Tseng, Y.H.; Lin, C.J.; Lin, Y.I. Text mining techniques for patent analysis. Inf. Process. Manag. 2007, 43, 1216–1247. [Google Scholar] [CrossRef]
  58. Gao, L.; Porter, A.L.; Wang, J.; Fang, S.; Zhang, X.; Ma, T.; Wang, W.; Huang, L. Technology life cycle analysis method based on patent documents. Technol. Forecast. Soc. Chang. 2013, 80, 398–407. [Google Scholar] [CrossRef]
  59. Kim, K.H.; Han, Y.J.; Lee, S.; Cho, S.W.; Lee, C. Text mining for patent analysis to forecast emerging technologies in wireless power transfer. Sustainability 2019, 11, 6240. [Google Scholar] [CrossRef]
  60. Huang, J.Y. Patent portfolio analysis of the cloud computing industry. J. Eng. Technol. Manag. 2016, 39, 45–64. [Google Scholar] [CrossRef]
  61. O’Leary, D.E. Technology life cycle and data quality: Action and triangulation. Decis. Support Syst. 2019, 126, 113139. [Google Scholar] [CrossRef]
  62. Cho, H.P.; Lim, H.; Lee, D.; Cho, H.; Kang, K.I. Patent analysis for forecasting promising technology in high-rise building construction. Technol. Forecast. Soc. Chang. 2018, 128, 144–153. [Google Scholar] [CrossRef]
  63. Ryu, T.; Jung, C.; Kim, B.; Lim, S.; Lim, H.; Choo, Y.; Park, J.; Kim, J.; Kim, H.; Joung, D.; et al. Development of Indicators for IP Competitiveness and Characteristics. 2012. Available online: https://www.kiip.re.kr/en/research_report/view.do?bd_gb=ereport&bd_cd=1&bd_item=0&po_item_gb=regb_10&currentPage=8&po_no=R0359 (accessed on 24 February 2023).
  64. Zhang, G. Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 2003, 50, 159–175. [Google Scholar] [CrossRef]
  65. Xu, L.; Chen, W.; Lv, Z. Construction and Simulation of Economic Statistics Measurement Model Based on Time Series Analysis and Forecast. Complexity 2021, 2021, 5963516. [Google Scholar] [CrossRef]
  66. Daud, A.; Abbas, F.; Amjad, T.; Alshdadi, A.A.; Alowibdi, J.S. Finding rising stars through hot topics detection. Future Gener. Comput. Syst. 2021, 115, 798–813. [Google Scholar] [CrossRef]
  67. Li, H.; Zhang, X.; Zhao, C. Explaining social events through community evolution on temporal networks. Appl. Math. Comput. 2021, 404, 126148. [Google Scholar] [CrossRef]
  68. Enright, J.; Meeks, K.; Mertzios, G.B.; Zamaraev, V. Deleting edges to restrict the size of an epidemic in temporal networks. J. Comput. Syst. Sci. 2021, 119, 60–77. [Google Scholar] [CrossRef]
  69. Thompson, W.H.; Brantefors, P.; Fransson, P. From static to temporal network theory: Applications to functional brain connectivity. Netw. Neurosci. 2017, 1, 69–99. [Google Scholar] [CrossRef] [PubMed]
  70. Liu, P.; Guarrasi, V.; Sarıyüce, A.E. Temporal network motifs: Models, limitations, evaluation. IEEE Trans. Knowl. Data Eng. 2021, 35, 945–957. [Google Scholar] [CrossRef]
Figure 1. Overall Framework.
Figure 1. Overall Framework.
Sustainability 15 08159 g001
Figure 2. Data Collection and Preprocessing.
Figure 2. Data Collection and Preprocessing.
Sustainability 15 08159 g002
Figure 3. Analysis of Technology Prospects.
Figure 3. Analysis of Technology Prospects.
Sustainability 15 08159 g003
Figure 4. Static Network and Temporal Network. The left side is the Static Network, and the right side is the Temporal Network.
Figure 4. Static Network and Temporal Network. The left side is the Static Network, and the right side is the Temporal Network.
Sustainability 15 08159 g004
Figure 5. Result of the Technological Innovation Stage.
Figure 5. Result of the Technological Innovation Stage.
Sustainability 15 08159 g005
Figure 6. Result of Trend Analysis.
Figure 6. Result of Trend Analysis.
Sustainability 15 08159 g006
Figure 7. Result of Temporal Network.
Figure 7. Result of Temporal Network.
Sustainability 15 08159 g007
Figure 8. Results of the IPC network. The numbers in the graph represent connection weights. Each number represents how many years each connection appeared.
Figure 8. Results of the IPC network. The numbers in the graph represent connection weights. Each number represents how many years each connection appeared.
Sustainability 15 08159 g008
Table 1. Example of IPC code.
Table 1. Example of IPC code.
ClassificationSymbolDetailed Explanation
SectionGPhysics
ClassG01Measurement; Test
SubclassG01BLength, Thickness or Similar Straight Line, Angle Measurement
Main GroupG01B7An electrical or magnetic measuring device
Sub GroupG01B7/14For measuring the length or width of a moving object
Table 2. Example of Patent-IPC Matrix.
Table 2. Example of Patent-IPC Matrix.
IPC 1IPC 2IPC M
Patent 1101
Patent 2000
Patent 3000
Patent N−1000
Patent N111
Table 3. Patent-IPC Matrix (963 × 22).
Table 3. Patent-IPC Matrix (963 × 22).
IPC 1IPC 2IPC 22
B07CB25JH04W
Patent 1000
Patent 2011
Patent 3000
Patent 962001
Patent 963111
Table 4. Contents of the IPC code (Summary).
Table 4. Contents of the IPC code (Summary).
IPCContents
B07CClassification of individual items
B25JManipulator
B65BItem/Material packaging machine and equipment
B65GTransportation or storage
G01CA rotating device with vibration mass
G01SWireless defense decision
G05BControl or adjustment system
G05DNon-electrical variance control
G06FElectrical digital data processing
G06KData recognition, data display
G06NSpecific computational model computer system
G06TData processing system
G07CImage data processing or generating
G07FMachine work registration or display
G08BCoin-input operating device
G08GSignal or calling system
G09BTraffic control system
G16YEducational or teaching equipment
H04LIoT communication technology
H04NMultiple communication
H04WVideo communication
G06QWireless communication network
Table 5. Result of Temporal Network’s Arc.
Table 5. Result of Temporal Network’s Arc.
NumIPC 1IPC 2TimeDefinition
1G06QH04L2017Internet of Things wireless communication
2G06QG06F2018Digital data processing wireless communication
3G06QH04L2018Internet of Things wireless communication
4G06QH04L2019Internet of Things wireless communication
5G06QG06F2019Digital data processing wireless communication
6G05BH04L2019IoT data control technology
7G06QG06K2020Data recognition and communication through external sensors
8G06QG06F2020Digital data processing wireless communication
9G06QG06N2020Computing technology for data calculation
10G06QH04W2020Video wireless communication
11G06QH04L2020Internet of Things wireless communication
12G06FG06K2020Digital data display system
13G06QG06T2020Wireless data processing system
14G01SH04W2020Video communication using speed and 3D position sensor
Table 6. Result of Patent’s IPC in 2021. Appearance indicates whether the subclass appeared in the subclass network of pre-2021 patents. O and X in Appearance indicate that the IPC code did or did not appear in a patent prior to 2021, respectively.
Table 6. Result of Patent’s IPC in 2021. Appearance indicates whether the subclass appeared in the subclass network of pre-2021 patents. O and X in Appearance indicate that the IPC code did or did not appear in a patent prior to 2021, respectively.
IPCCountAppearance
1G06Q9X
2G06K7X
3G06F5X
4G06T4X
5G01S3X
6G06N3X
7G07C3O
8B25J2O
9B07C2O
10B65G2X
11G08G2O
12G05D2O
13G08B1O
14H04W1X
Table 7. Result of Future Logistics Technology.
Table 7. Result of Future Logistics Technology.
IPC 1IPC 2IPC 3IPC 4
Technology 1G07CG06QG05BG01S
Technology 2B25JG06QG05BG01S
Technology 3B07CG06QG05BG01S
Technology 4G08GG06QG05BG01S
Technology 5G05DG06QG05BG01S
Technology 6G08BG06QG05BG01S
Table 8. Technology descriptions.
Table 8. Technology descriptions.
TechnologyDescription
Technology 1Wireless communicating image data generation system (IDGS) and control system using IDGS
Technology 2A wireless control system using video communication
Technology 3Automatic classification system using 3D position sensors and other sensors attached machines
Technology 4An alarm system that collects and analyzes various data through sensors
Technology 5Automatic control system using data analysis technology
Technology 6A system that recognizes certain conditions through sensors and automation technology based on specific conditions
Table 9. Comparative Analysis with National Roadmaps.
Table 9. Comparative Analysis with National Roadmaps.
Technology 1Technology 2Technology 3Technology 4Technology 5Technology 6
Digital Logistics
Eco-friendly Logistics
Safe Logistics
IoT Logistics
Smart-city Logistics
Smart Airport/Harbor
Cold Chain
Worker Shortage Solution
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kwon, K.; So, J. Future Smart Logistics Technology Based on Patent Analysis Using Temporal Network. Sustainability 2023, 15, 8159. https://doi.org/10.3390/su15108159

AMA Style

Kwon K, So J. Future Smart Logistics Technology Based on Patent Analysis Using Temporal Network. Sustainability. 2023; 15(10):8159. https://doi.org/10.3390/su15108159

Chicago/Turabian Style

Kwon, Koopo, and Jaeryong So. 2023. "Future Smart Logistics Technology Based on Patent Analysis Using Temporal Network" Sustainability 15, no. 10: 8159. https://doi.org/10.3390/su15108159

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop