Next Article in Journal
Cybersecurity and Cyber Forensics for Smart Cities: A Comprehensive Literature Review and Survey
Next Article in Special Issue
EFFNet-CA: An Efficient Driver Distraction Detection Based on Multiscale Features Extractions and Channel Attention Mechanism
Previous Article in Journal
A Multi-Attention Approach for Person Re-Identification Using Deep Learning
Previous Article in Special Issue
Evaluating Synthetic Medical Images Using Artificial Intelligence with the GAN Algorithm
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Real-Time Context-Aware Recommendation System for Tourism

Department of Computer Engineering, Gachon University, 1342 Seongnam-daero, Sujeong-gu, Seongnam-si 13120, Gyeonggi-do, Republic of Korea
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(7), 3679; https://doi.org/10.3390/s23073679
Submission received: 3 March 2023 / Revised: 25 March 2023 / Accepted: 1 April 2023 / Published: 2 April 2023
(This article belongs to the Special Issue Application of Semantic Technologies in Sensors and Sensing Systems)

Abstract

:
Recently, the tourism trend has been shifting towards the Tourism 2.0 paradigm due to increased travel experiences and the increase in acquiring and sharing information through the Internet. The Tourism 2.0 paradigm requires developing intelligent tourism service tools for positive effects such as time savings and marketing utilization. Existing tourism service tools recommend tourist destinations based on the relationship between tourists and tourist destinations or tourism patterns, so it is difficult to make recommendations in situations where information is insufficient or changes in real time. In this paper, we propose a real-time recommendation system for tourism (R2Tour) that responds to changing situations in real time, such as external factors and distance information, and recommends customized tourist destinations according to the type of tourist. R2Tour trains a machine learning model with situational information such as temperature and precipitation and tourist profiles such as gender and age to recommend the top five nearby tourist destinations. To verify the recommendation performance of R2Tour, six machine learning models, including K-NN and SVM, and information on tourist attractions in Jeju Island were used. As a result of the experiment, R2Tour was verified with accuracy of 77.3%, micro-F1 0.773, and macro-F1 0.415. Since R2Tour trains tourism patterns based on situational information, it is possible to recommend new tourist destinations and respond to changing situations in real time. In the future, R2Tour can be installed in vehicles to recommend nearby tourist destinations or expanded to tasks in the tourism industry, such as a smart target advertising system.

1. Introduction

Recently, there has been a change in the tourism trend towards the Tourism 2.0 paradigm due to the increase in travel experience worldwide and the spread of information acquisition and sharing through the Internet. The Tourism 2.0 paradigm seeks to create new value for the tourism industry by valuing the vitalization of information and communication and participatory cultural experiences, rather than simple travel and consumption activities [1]. In addition, Tourism 2.0 aims to give new value to the new tourism industry by developing information and technology, providing various experiences and cultures to tourists, and promoting the development of the local economy and environment by pursuing sustainable tourism. The free/foreign independent tour (FIT) is one of the representative tours of the Tourism 2.0 paradigm, and the demand for non-face-to-face services is increasing due to COVID-19 [2]. Due to FIT, tourists search, reserve and pay, and share information through online travel platforms and mobile applications, and the influence of social media and online platforms on the overall tourism industry is increasing [3]. FIT is required to develop intelligent tourism service tools with positive effects such as an improved understanding of tourist destinations and revisit rates, the development of tourism information technology, and improved marketing efficiency [4]. Travel planning and guidebook applications and tourism recommendation services, which are tourism service tools for FIT in the Tourism 2.0 paradigm, have advantages such as improved customer experiences, time and cost savings, data analysis, and marketing utilization [5]. For tourism service tools, research is being conducted on a system that recommends tourist destinations according to the relevance of tourists or tourist destinations [6]. Collaborative filtering (CF)-based recommendation, which recommends tourist destinations according to tourist relevance, is a method of finding similarities between users using information between users and items [7]. Content filtering (CB)-based recommendation, which recommends tourist destinations according to their relevance, is a method for determining the similarity between items using item information [8]. Handling new data without information is difficult for filtering-based tourist destination recommendation systems (RS) because of the required data size and cold start problem. Therefore, research on an RS using artificial intelligence (AI) is being conducted [9]. An AI-based RS is recognized as a key element capable of targeting marketing and personalized recommendations by providing appropriate information or products that users may prefer by subdividing them by user inclination and type [10].
Tourism service tools include a CF-based RS method that recommends tourist attractions according to their relevance to tourists and a CB-based RS method that recommends tourist attractions according to their relevance to tourist destinations [11]. The CF-based RS assumes that similar tourists have similar preferences for a specific tourist destination based on interaction data between tourists and tourist destinations [12]. Because CF is performed based on interactions between tourists and tourist destinations, recommendations can be made even if the similarity between tourist destinations is not high. However, new tourist destinations cannot be applied because no tourist information is available [13]. To solve the cold start problem, a CB-based RS that recommends tourist destinations according to their relevance can also recommend similar tourist destinations using tourist destination information [14]. CB can provide recommendations without interaction data between tourists and tourist destinations. However, its performance deteriorates compared with CF-based RS when sufficient data are collected [15]. An RS using AI can dynamically utilize the data size or characteristics because they use tourism patterns rather than the similarity between items, and they have achieved remarkable recognition performance with the development of algorithms and computation power [16]. However, RS based on tourism patterns using AI have limitations in dynamic situations because they do not reflect real-time changes in external factors and distance information, such as temperature or precipitation [17].
In this study, we proposed a real-time recommendation system for tourism (R2Tour) to respond to dynamic situations by reflecting real-time changing external factors and distance information and recommend customized tours according to the type of tourist. R2Tour recommends the top five nearby tourist destinations by learning a real-time context that includes real-time situational information and a tourist profile that includes the type of tourist using a machine learning (ML) model. The real-time context includes weather information, such as temperature and precipitation, and sequential information, such as season and location. The tourist profile includes gender, age, companion, and tour type. In this study, electric vehicle information (EVGPS) provided by the Korea Electric Power Corporation Knowledge Data Network (KEPCO KDN), the Visit Korea data lab, and Korea Meteorological Administration data were used to evaluate R2Tour. The results of evaluating R2Tour using information on tourist attractions, situations, and tourist profiles on Jeju Island, created by combining EVGPS, Visit Korea Data Lab, and Korea Meteorological Administration data, were verified with accuracy of 77.3%, micro-F1 0.773, and macro-F1 0.415. Our updated code, dataset, and trained models are available at https://github.com/junhoy00n/Real-time-Recommendation-for-Tourism (accessed on 3 March 2023).
The objectives and contributions of this thesis are summarized as follows.
  • Development of a customized travel destination RS according to real-time context changes: It is common for existing tourism service tools to recommend destinations based on the relationship between tourists and tourist attractions or tourism patterns. However, recommendations are complex when there is insufficient information or situations that change in real time. In this paper, we try to overcome these limitations by proposing a real-time RS that recommends customized travel destinations according to external factors, distance information, and types of tourists.
  • Travel pattern analysis and prediction using ML models: In this study, an ML model is trained using traveler profiles and contextual information to analyze and predict travel patterns. Through this, we can understand travelers’ preferences and behavior patterns and contribute to implementing a personalized RS.
  • Data collection and analysis for smart advertising system development: In this study, the important process is to collect and analyze the data necessary to implement the RS. Through this, it is possible to understand the traveler’s preferences and behavioral patterns and derive useful information that can be utilized in the tourism industry, such as smart advertising systems.
The remainder of this paper is organized as follows. The related work is mentioned in Section 2 and consists of a filtering-based RS, ML model, and AI-based RS. The architecture of R2Tour is presented in Section 3. The experiment is mentioned in Section 4; the description of the data and environment used in the experiment and the experimental results are discussed; finally, the conclusions and future work are addressed in Section 5.

2. Related Work

Tourism service tools include a CF method that recommends tourist destinations according to the relevance to tourists and a CB method that recommends tourist destinations according to the relevance of tourist destinations. As it is difficult to handle the size of the required data and the cold start problem, research is being conducted to recommend tourist destinations based on tourism patterns using AI. The AI-based RS ignores the similarity between items and recommends tourist destinations based on tourism patterns. It has achieved excellent recognition performance with the advancement of algorithms and computation power. AI-based RS are recognized as critical elements capable of targeting marketing and personalized recommendations by providing appropriate information or products that users may prefer by subdividing them according to the user’s inclinations and types. The following section describes the AI model and AI-based RS presented in Table 1, and the filtering-based RS.

2.1. Filtering-Based Recommendation System

Tourism service tools include a CF method that recommends tourist destinations according to the relevance to tourists and a CB method that recommends tourist destinations according to the relevance of tourist destinations. The filtering-based RS analyzes the data input by tourists; learns their preferences, interests, and history of visits; and recommends travel destinations highly likely to be preferred [24]. Generally, a filtering-based RS collects and learns user profile information such as visited tourist attractions and travel styles. Hence, the RS matches tourist profiles and travel destination information to recommend new travel destinations. In other words, the filtering-based tourist destination RS is a system that filters and provides recommended tourist destinations according to the criteria preferred by tourists [25]. The CF-based RS is a method of recommending new tourist destinations by analyzing the similarity between tourists based on the evaluation information of the tourist destinations evaluated in the past by tourists. A CF-based RS can consider the preferences of tourists because it uses the information of a large number of tourists. In addition, when new tourist information is added, it is possible to recommend travel destinations preferred by other tourists with similar preferences to the current tourist. Moreover, since CF is performed based on interactions between tourists and tourist destinations, recommendations can be made even if the similarity between tourist destinations is not high. However, if the data evaluated by tourists are small or if the past evaluation information is different from the current preference, the recommendation result may not be accurate. Nonetheless, new tourist destinations cannot be applied because there is no tourist information. On the other hand, the CB-based RS recommends tourist attractions with characteristics similar to those reserved by tourists. The CB-based RS can provide recommendation results considering the tourist’s personal preferences. The recommendation can be made even if the data that the tourist evaluates are minimal. However, the recommendation result may be limited when the tourist’s preference information changes or the information input by the tourist is insufficient. In addition, since the CF-based RS utilizes the evaluation information of a large number of tourists, it is difficult to obtain appropriate recommendation results when the data are less dispersed. The CB-based RS utilizes the characteristic information of tourist destinations, so it is suitable for calculating the similarity between travel destinations. However, the recommendation results may be distorted if a statement that has not been used previously is used. Therefore, studying an RS using AI that can dynamically utilize the data size or characteristics is necessary because it uses tourism patterns rather than similarities between items [26].

2.2. Machine Learning Used for Recommendation System

ML is a technique for developing algorithms and statistical models that computer systems use to perform tasks without explicit instructions by relying on patterns and reasoning. Because ML focuses on predicting the behavior of a specific target based on learning from data using algorithms such as K-NN and support vector machine (SVM), it has been widely used in RS for particular information [27]. K-NN is an ML algorithm that assumes that data with similar characteristics belong to similar categories, and it predicts labels based on the K-nearest neighbors [28]. SVM defines a decision boundary or reference line and predicts labels based on the decision boundary [29]. Random forest creates a decision tree by randomly selecting only some features and predicting the label based on the most labels or the average value based on several decision trees produced by repeating it [30]. Voting is an ensemble ML algorithm that predicts the most significant number of labels based on multiple classifiers [31]. XGBoost combines several level-wise decision trees and learns a robust prediction model by applying a weight to the learning error and sequentially reflecting it in the next learning model [32]. Similar to XGBoost, LightGBM uses a combination of decision trees. In contrast to XGBoost, LightGBM uses a leafwise method to create decision trees [33]. ML algorithms such as K-NN and SVM enable computer systems to process historical data and identify their patterns. This enables us to predict the outcomes more accurately using a given input dataset [34].

2.3. AI-Based Recommendation System

RS is an information filtering technology that helps users to find the required information. With the increase in information, the importance of RS is increasing, and the technology of RS is advancing with the development of AI-based technology. Anwar et al. [18] proposed a K-NN-based RS using the user–item matrix of a Movie Trust dataset and verified it with an RMSE of 0.822. Elbir et al. [19] proposed an SVM-based RS using the acoustic features of the GTZAN dataset and verified it with accuracy of 97.6%. Guo et al. [20] proposed a random-forest-based RS that used subscriber information, such as age, education, relationship, and occupation, from an insurance company dataset and verified it with an error rate of 0.16. Jain et al. [21] proposed a voting-based RS using airline reviews on the SKYTRAX dataset and verified it with accuracy of 82.7%. Shahbazi et al. [22] proposed an XGBoost-based RS using user-clicked information from an online shopping mall dataset, and verified it with accuracy of 89.6%. Luo et al. [23] proposed a LightGBM-based RS using fashion items, such as color and length, from the Dressipi dataset and verified it with an MRR of 0.206. In contrast to conventional filtering-based RS, AI-based RS can dynamically utilize the data size or features because they use patterns that are not similar between items [35]. Pattern-based RS that use AI have limitations in dynamic situations that change in real time, such as temperature or precipitation. Therefore, conducting research that responds to dynamic situations by reflecting real-time changing external factors and distance information, and subdividing them according to user types, is necessary [36].

3. Real-Time Recommendation System for Tourism

Handling new data without information is challenging for filtering-based tourist destination RS because of the required data size and the cold start problem. Therefore, research on RS using AI is being conducted [37]. RS using AI can dynamically utilize the size or characteristics of data because they use tourism patterns, ignoring the similarity between items, and achieve remarkable recognition performance with the development of algorithms and computation power [38]. However, RS based on tourism patterns using AI have limitations in dynamic situations because they do not reflect real-time changes in external factors or distance information, such as temperature or precipitation. In this paper, we propose a tourist destination RS using R2Tour to respond to dynamic situations by reflecting real-time changing external factors and distance information and recommending customized tours according to tourist types. As shown in Figure 1, R2Tour recommends the top five nearby tourist destinations by learning a real-time context, including real-time situation information, and tourist profiles, including tourist types, through an ML model. The following section describes the configuration of the tourist attraction corresponding to the dependent variable R2Tour, and the real-time context and tourist profile corresponding to the independent variable.

3.1. Tourist Attraction Used for R2Tour

R2Tour’s independent variable, tourist attraction, consists of information on the central tourist attraction. The top five nearby tourist attractions are obtained according to the current location, which uses the EVGPS and the Korea data lab. The central and related tourist destination information of the Visit Korea data lab consists of information on the main monthly tourist destinations and nearby tourist attractions. The EVGPS measured the movement routes in 1-min units using 52 electric vehicles in the Jeju Smart City pilot city project for three years at KEPCO KDN. The numbers of driving records for each vehicle are listed in Table 2. The central-related tourist attraction information of the Visit Korea data lab used for tourist attractions uses information on the top 10 central tourist attractions and the top five tourist attractions by month, corresponding to Jeju. As shown in Figure 2, the EVGPS sets the error range (50 m) based on the latitude/longitude lines because it is classified as driving owing to positioning errors, even if no actual movement exists. The EVGPS was used in the visiting state if no movement for more than 10 min occurred within the error range. If no movement occurred for more than 200 min, it was excluded from the experiment as a long-term parking state. In addition, the EVGPS classified as visited was used as the visit to the nearest tourist destination within the error range based on the Visit Korea data lab.

3.2. Real-Time Context Used for R2Tour

Circumstantial information, such as temperature, precipitation, or season, is a significant factor while visiting tourist destinations, and it changes in real time according to the location [39]. However, existing AI-based RS do not reflect dynamic situations that change in real time because they use tourism patterns. R2Tour learns tourism patterns by reflecting the real-time context and tourism patterns to respond to dynamic situations, addressing the limitations of existing RS. The real-time context, a dependent variable of R2Tour, was extracted from the Korea Meteorological Administration data based on tourist attractions, generated by combining the Visit Korea data lab and EVGPS. The real-time context includes seasonal information on the visit date or measurement date, as well as temperature and precipitation information using Meteorological Agency data.

3.3. Tourist Profile Used for R2Tour

R2Tour responds to dynamic situations and uses tourist profiles as a dependent variable to segment customized tour recommendations according to tourist types. Because a tourist profile comprises information on age, sex, companion, and tour type, recommending segmented tourist destinations is possible. Tourist profiles were analyzed based on mobile communication data and keywords on social media. It uses current information for each tourist destination in the Visit Korea data lab. The value corresponding to the highest value based on the data analysis was used as the tourist profile of the destination. The tourist attraction extracted from EVGPS uses similar profile information (error range: −1 to +1) based on the measurement date and time.

4. Experimental Results

In this study, we verified the performance of R2Tour using the Jeju tourism dataset in the Python 3.8 environment using an Intel Core i9 processor and an NVIDIA TITAN RTX. The Jeju tourism dataset combines EVGPS, Visit Korea data lab, and Korea Meteorological Administration data and consists of dependent variables for the real-time context and tourist profiles and independent variables for the top five nearby tourist destinations. The real-time context includes weather information such as temperature and precipitation, and time zone information such as season and location. The tourist profiles include gender, age, companion, and tour type. R2Tour applies and evaluates the ML model used in the existing AI-based RS using the real-time context and tourist profiles of the Jeju tourism dataset. R2Tour uses the last year as test data and the rest as learning data to learn past information and predict the future. The following section describes the experimental method, Jeju tourism dataset, and recommendation performance.

4.1. Experimental Settings and Jeju Tourism Dataset

R2Tour responds to dynamic situations and compares real-time contexts and tourist profiles by learning several AI models to provide customized tour recommendations according to the tourist type. In this study, K-NN, SVM, random forest, voting, XGBoost, and LightGBM ML models were used in the AI-based RS. The tourist destination RS by R2Tour uses an Intel Core i9 processor and NVIDIA TITAN RTX to learn past information in a Python 3.8 environment and evaluates it by predicting the past year. The Jeju tourism dataset combines EVGPS, Visit Korea data lab, and Korea Meteorological Administration data and consists of dependent variables for the real-time context and tourist profiles and independent variables for the top five nearby tourist destinations. R2Tour’s independent variable, tourist attraction, consists of information on the central tourist attraction, as shown in Section 3.1: the top five nearby tourist attractions according to the current location, which uses the EVGPS and visits the Korea Data Lab. EVGPS only uses ten or more than 200 min of the visit state in the error range (50m), considering the vehicle operating data characteristics. The Visit Korea data lab uses information on the top ten, a monthly tourist destination corresponding to Jeju and Seogwipo, and the top five related to tourist attractions. The real-time context, a dependent variable of R2Tour, is extracted from the Meteorological Agency data based on tourist attractions, as shown in Section 3.2. The real-time context includes seasonal information based on a visit or measurement date and contains temperature and precipitation information using the Meteorological Agency data. The tourist profile, a dependent variable of R2Tour, uses the current status of Visit Korea data lab tourism branches. The tourist profile includes gender, age, companion, and tourism type, as shown in Section 3.3. Tourist attraction extracted from EVGPS uses a tourist profile corresponding to similar values (error range: −1 +1) based on the measurement date and time. The values of each feature are listed in Table 3. To verify the recommendation performance of the model, we utilized Equation (1), which measures the accuracy and the F1-score, which are used when the data are imbalanced. The F1-score evaluation index uses the micro-F1 corresponding to Equation (2) and macro-F1 corresponding to Equation (3) to prove its effectiveness in a data imbalance problem [40].
A c c u r a c y = T P + T N T N + T N + F P + F N
M i c r o F 1 S c o r e = 2 × T P 2 × T P + F P + F N
M a c r o F 1 S c o r e = 1 N i = 0 N F 1 S c o r e

4.2. Recommendation System for Tourism

In the Jeju tourism dataset, 2055 cases (excluding the previous year) were used as the training dataset, and 176 cases corresponding to the latest year were used as the test dataset. Therefore, R2Tour learns past information and is capable of predicting future events. Table 4 lists the results of the evaluation of the RS using R2Tour with the Jeju tourism dataset. When applied to LightGBM, R2Tour was verified with accuracy of 77.3%, micro-F1 of 0.773, and macro-F1 of 0.415. Based on the EVGPS, Jeju tourist destinations were classified into 11 categories, and the results of classifying tourist activity patterns according to weather, season, and time are listed in Table 5. When XGBoost was used, the results of the experiment were verified with accuracy of 80.6%, micro-F1 of 0.806, and macro-F1 of 0.73. The results of the experiment confirmed that real-time situation information, such as weather, season, and time zone information, is a significant factor while visiting tourist destinations. In this paper, the proposed R2Tour trains tourism patterns to recommend tourist destinations according to real-time context and tourist profile information, not the interaction between tourists and tourist destinations. Therefore, even if a tourist has no preference for a new tourist destination, it is possible to recommend it according to tourism patterns such as weather, distance, and tourism type. In addition, unlike existing AI-based RS, it learns tourist destinations according to weather and distance information, so it is possible to respond to changing situational information in real time.

5. Conclusions

Recently, there has been a change in the tourism trend towards the Tourism 2.0 paradigm due to the increase in travel experience worldwide and the spread of information acquisition and sharing through the Internet. Tourism 2.0 aims to give new value to the new tourism industry by developing information and technology, providing various experiences and cultures to tourists, and promoting the development of the local economy and environment by pursuing sustainable tourism [41]. FIT is one of the representative tours of the Tourism 2.0 paradigm; travel planning and guidebook applications and tourism recommendation services, which are tourism service tools for FIT in the Tourism 2.0 paradigm, have advantages such as improved customer experiences, time and cost savings, data analysis, and marketing utilization. For tourism service tools, the tourism RS is filtering-based research that recommends tourist destinations according to the relevance of tourists or tourist destinations [42]. Because handling new data without information is challenging for filtering-based RS owing to the required data size and cold start problem, research on RS using AI is being conducted [43]. AI-based RS use tourism patterns, ignoring the similarities between items. It can dynamically utilize the data size or features and achieve remarkable recognition performance by developing algorithms and computation power [44]. However, RS based on tourism patterns using AI have limitations in dynamic situations because they do not reflect real-time changes in external factors or distance information such as temperature or precipitation.
In this study, we proposed a tourist destination RS using R2Tour to respond to dynamic situations by reflecting real-time changing external factors and distance information and recommending customized tours according to tourist types. R2Tour recommends the top five nearby tourist destinations by training an ML model with the real-time context, real-time situation information, and tourist profiles that include tourist types. R2Tour trains tourism patterns to recommend tourist destinations according to real-time context and tourist profile information, not the interaction between tourists and tourist destinations. Therefore, even if a tourist has no preference for a new tourist destination, it is possible to recommend it according to tourism patterns such as weather, distance, and tourism type. In addition, unlike existing AI-based RS, it learns tourist destinations according to weather and distance information, so it is possible to respond to changing situational information in real time. We evaluated R2Tour using the Jeju tourism dataset created by combining EVGPS, Visit Korea data lab, and Korea Meteorological Administration data, and it was verified with accuracy of 77.3%, micro-F1 of 0.773, and macro-F1 of 0.415 in LightGBM. R2Tour responded to dynamic situations and recommended customized tours according to the type of tourist. In addition, classifying tourist activity patterns using XGBoost according to situational information based on EVGPS achieved accuracy of 80.6%, micro-F1 of 0.806, and macro-F1 0.73. The results of the experiment confirmed that real-time situation information, such as weather, season, and time zone information, is a significant factor while visiting tourist destinations. In the future, R2Tour can be expanded to other tasks such as recommending tour schedules [45], travel routes [46], and nearby tourist destinations based on location information. Moreover, R2Tour can be installed in vehicles to recommend nearby tourist destinations or expanded to tasks for the tourism industry, such as a smart target advertising system. The applicability of R2Tour has advantages such as improved customer experiences, time and cost savings, data analysis, and marketing utilization.

Author Contributions

Conceptualization, C.C.; software, J.Y.; Data curation, C.C.; Formal analysis, C.C.; Funding acquisition, C.C.; Methodology, J.Y.; Visualization, J.Y.; Project administration, C.C.; Supervision, C.C.; Writing—original draft, J.Y.; Writing—review and editing, J.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by a National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (2021R1A2B5B02087169).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Restrictions apply to the availability of these data. Data was obtained from Visit Korea Data Lab and are available https://datalab.visitkorea.or.kr/ with the permission of Visit Korea Data Lab.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

FITFree/Foreign Independent
CFCollaborative Filtering
CBContent Filtering
RSRecommendation System
AIArtificial Intelligence
R2TourReal-Time Recommendation System for Tourism
MLMachine Learning
EVGPSElectric Vehicle Information
KEPCO KDNKorea Electric Power Corporation Knowledge Data Network

References

  1. Valeri, M. Blockchain technology: Adoption perspectives in tourism. In Entrepreneurship and Organizational Change: Managing Innovation and Creative Capabilities; Springer: Cham, Switzerland, 2020; pp. 27–35. [Google Scholar]
  2. Fu, Y.; Timothy, D.J. Social media constraints and destination images: The potential of barrier-free internet access for foreign tourists in an internet-restricted destination. Tour. Manag. Perspect. 2021, 37, 100771. [Google Scholar] [CrossRef]
  3. Lin, S.Y.; Juan, P.J.; Lin, S.W. A tam framework to evaluate the effect of smartphone application on tourism information search behavior of foreign independent travelers. Sustainability 2020, 12, 9366. [Google Scholar] [CrossRef]
  4. Jung, T.M.; Joe, I. An AI-Based Platform Architecture with Situational Awareness for Travel Plans. In Software Engineering Application in Systems Design: Proceedings of 6th Computational Methods in Systems and Software 2022; Springer: Berlin/Heidelberg, Germany, 2023; Volume 1, pp. 376–384. [Google Scholar]
  5. Lv, M.; Wang, L.; Yan, K. Research on Cultural Tourism Experience Design Based on Augmented Reality. In Proceedings of the Culture and Computing: 8th International Conference, C&C 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, 19–24 July 2020; Proceedings 22. Springer: Berlin/Heidelberg, Germany, 2020; pp. 172–183. [Google Scholar]
  6. Javed, U.; Shaukat, K.; Hameed, I.A.; Iqbal, F.; Alam, T.M.; Luo, S. A review of content-based and context-based recommendation systems. Int. J. Emerg. Technol. Learn. (iJET) 2021, 16, 274–306. [Google Scholar] [CrossRef]
  7. Zhou, X.; Tian, J.; Peng, J.; Su, M. A Smart Tourism Recommendation Algorithm Based on Cellular Geospatial Clustering and Multivariate Weighted Collaborative Filtering. ISPRS Int. J. Geo-Inf. 2021, 10, 628. [Google Scholar] [CrossRef]
  8. Muneer, M.; Rasheed, U.; Khalid, S.; Ahmad, M. Tour Spot Recommendation System via Content-Based Filtering. In Proceedings of the 2022 16th International Conference on Open Source Systems and Technologies (ICOSST), Lahore, Pakistan, 14–15 December 2022; pp. 1–6. [Google Scholar]
  9. Fayyaz, Z.; Ebrahimian, M.; Nawara, D.; Ibrahim, A.; Kashef, R. Recommendation systems: Algorithms, challenges, metrics, and business opportunities. Appl. Sci. 2020, 10, 7748. [Google Scholar] [CrossRef]
  10. Batmaz, Z.; Yurekli, A.; Bilge, A.; Kaleli, C. A review on deep learning for recommender systems: Challenges and remedies. Artif. Intell. Rev. 2019, 52, 1–37. [Google Scholar] [CrossRef]
  11. Feng, C.; Liang, J.; Song, P.; Wang, Z. A fusion collaborative filtering method for sparse data in recommender systems. Inf. Sci. 2020, 521, 365–379. [Google Scholar] [CrossRef]
  12. Nan, X.; Kanato, K.; Wang, X. Design and Implementation of a Personalized Tourism Recommendation System Based on the Data Mining and Collaborative Filtering Algorithm. Comput. Intell. Neurosci. 2022, 2022, 1424097. [Google Scholar] [CrossRef]
  13. Shao, Y.; Xie, Y.H. Research on cold-start problem of collaborative filtering algorithm. In Proceedings of the 3rd International Conference on Big Data Research, Cergy-Pontoise, France, 20–22 November 2019; pp. 67–71. [Google Scholar]
  14. Bentaleb, A.; El Bouzekri El Idrissi, Y.; Ait Lahcen, A. A Review on Content Based Recommender Systems in Tourism. In Proceedings of the International Conference on Digital Technologies and Applications, Fez, Morocco, 29–30 January 2021; pp. 527–541. [Google Scholar]
  15. Gund, G.S.; Park, J.H.; Harpalsinh, R.; Kota, M.; Shin, J.H.; Kim, T.i.; Gogotsi, Y.; Park, H.S. MXene/polymer hybrid materials for flexible AC-filtering electrochemical capacitors. Joule 2019, 3, 164–176. [Google Scholar] [CrossRef] [Green Version]
  16. Vincent, D.R.; Deepa, N.; Elavarasan, D.; Srinivasan, K.; Chauhdary, S.H.; Iwendi, C. Sensors driven AI-based agriculture recommendation model for assessing land suitability. Sensors 2019, 19, 3667. [Google Scholar] [CrossRef] [Green Version]
  17. Guo, Q.; Zhuang, F.; Qin, C.; Zhu, H.; Xie, X.; Xiong, H.; He, Q. A survey on knowledge graph-based recommender systems. IEEE Trans. Knowl. Data Eng. 2020, 34, 3549–3568. [Google Scholar] [CrossRef]
  18. Anwar, T.; Uma, V.; Hussain, M.I.; Pantula, M. Collaborative filtering and kNN based recommendation to overcome cold start and sparsity issues: A comparative analysis. Multimed. Tools Appl. 2022, 81, 35693–35711. [Google Scholar] [CrossRef]
  19. Elbir, A.; Aydin, N. Music genre classification and music recommendation by using deep learning. Electron. Lett. 2020, 56, 627–629. [Google Scholar] [CrossRef]
  20. Guo, Y.; Zhou, Y.; Hu, X.; Cheng, W. Research on recommendation of insurance products based on random forest. In Proceedings of the 2019 International Conference on Machine Learning, Big Data and Business Intelligence (MLBDBI), Taiyuan, China, 8–10 November 2019; pp. 308–311. [Google Scholar]
  21. Jain, P.K.; Pamula, R.; Yekun, E.A. A multi-label ensemble predicting model to service recommendation from social media contents. J. Supercomput. 2022, 78, 5203–5220. [Google Scholar] [CrossRef]
  22. Shahbazi, Z.; Byun, Y.C. Product recommendation based on content-based filtering using XGBoost classifier. Int. J. Adv. Sci. Technol 2019, 29, 6979–6988. [Google Scholar]
  23. Luo, J.; Zhao, W.; Tang, Y.; Zhou, Z.; Xiong, H.; Tao, Z. LightGBM using Enhanced and De-biased Item Representation for Better Session-based Fashion Recommender Systems. In Proceedings of the Recommender Systems Challenge 2022, Seattle, WA, USA, 18–23 September 2022; pp. 24–28. [Google Scholar]
  24. Wang, W.; Kumar, N.; Chen, J.; Gong, Z.; Kong, X.; Wei, W.; Gao, H. Realizing the potential of the internet of things for smart tourism with 5G and AI. IEEE Netw. 2020, 34, 295–301. [Google Scholar] [CrossRef]
  25. Al Fararni, K.; Nafis, F.; Aghoutane, B.; Yahyaouy, A.; Riffi, J.; Sabri, A. Hybrid recommender system for tourism based on big data and AI: A conceptual framework. Big Data Min. Anal. 2021, 4, 47–55. [Google Scholar] [CrossRef]
  26. Hassannia, R.; Vatankhah Barenji, A.; Li, Z.; Alipour, H. Web-based recommendation system for smart tourism: Multiagent technology. Sustainability 2019, 11, 323. [Google Scholar] [CrossRef] [Green Version]
  27. Liu, B.; Ding, M.; Shaham, S.; Rahayu, W.; Farokhi, F.; Lin, Z. When machine learning meets privacy: A survey and outlook. ACM Comput. Surv. (CSUR) 2021, 54, 1–36. [Google Scholar] [CrossRef]
  28. Ali, M.; Jung, L.T.; Abdel-Aty, A.H.; Abubakar, M.Y.; Elhoseny, M.; Ali, I. Semantic-k-NN algorithm: An enhanced version of traditional k-NN algorithm. Expert Syst. Appl. 2020, 151, 113374. [Google Scholar] [CrossRef]
  29. Kurani, A.; Doshi, P.; Vakharia, A.; Shah, M. A comprehensive comparative study of artificial neural network (ANN) and support vector machines (SVM) on stock forecasting. Ann. Data Sci. 2023, 10, 183–208. [Google Scholar] [CrossRef]
  30. Speiser, J.L.; Miller, M.E.; Tooze, J.; Ip, E. A comparison of random forest variable selection methods for classification prediction modeling. Expert Syst. Appl. 2019, 134, 93–101. [Google Scholar] [CrossRef] [PubMed]
  31. Atallah, R.; Al-Mousa, A. Heart disease detection using machine learning majority voting ensemble method. In Proceedings of the 2019 2nd International Conference on New Trends in Computing Sciences (ICTCS), Amman, Jordan, 9–11 October 2019; pp. 1–6. [Google Scholar]
  32. Ogunleye, A.; Wang, Q.G. XGBoost model for chronic kidney disease diagnosis. IEEE/ACM Trans. Comput. Biol. Bioinform. 2019, 17, 2131–2140. [Google Scholar] [CrossRef] [PubMed]
  33. Zhang, D.; Gong, Y. The comparison of LightGBM and XGBoost coupling factor analysis and prediagnosis of acute liver failure. IEEE Access 2020, 8, 220990–221003. [Google Scholar] [CrossRef]
  34. Janiesch, C.; Zschech, P.; Heinrich, K. Machine learning and deep learning. Electron. Mark. 2021, 31, 685–695. [Google Scholar] [CrossRef]
  35. Vultureanu-Albişi, A.; Bădică, C. Recommender systems: An explainable AI perspective. In Proceedings of the 2021 International Conference on INnovations in Intelligent SysTems and Applications (INISTA), Kocaeli, Turkey, 25–27 August 2021; pp. 1–6. [Google Scholar]
  36. Wang, S.; Cao, L.; Wang, Y.; Sheng, Q.Z.; Orgun, M.A.; Lian, D. A survey on session-based recommender systems. ACM Comput. Surv. (CSUR) 2021, 54, 1–38. [Google Scholar] [CrossRef]
  37. Tavakoli, M.; Faraji, A.; Vrolijk, J.; Molavi, M.; Mol, S.T.; Kismihók, G. An AI-based open recommender system for personalized labor market driven education. Adv. Eng. Inform. 2022, 52, 101508. [Google Scholar] [CrossRef]
  38. Verma, P.; Sharma, S. Artificial Intelligence based Recommendation System. In Proceedings of the 2020 2nd International Conference on Advances in Computing, Communication Control and Networking (ICACCCN), Greater Noida, India, 18–19 December 2020; pp. 669–673. [Google Scholar]
  39. Jannach, D.; Manzoor, A.; Cai, W.; Chen, L. A survey on conversational recommender systems. ACM Comput. Surv. (CSUR) 2021, 54, 1–36. [Google Scholar] [CrossRef]
  40. Iwendi, C.; Ibeke, E.; Eggoni, H.; Velagala, S.; Srivastava, G. Pointer-based item-to-item collaborative filtering recommendation system using a machine learning model. Int. J. Inf. Technol. Decis. Mak. 2022, 21, 463–484. [Google Scholar] [CrossRef]
  41. Ballesteros-López, L.; Peñaherrera-Zambrano, S.; Armas-Arias, S.; López-Pérez, S. Web 2.0 Digital Marketing Tools in the Ecuadorian Tourism Sector Against of the COVID-19 Pandemic. In New Realities, Mobile Systems and Applications, Proceedings of the 14th IMCL Conference, Thessaloniki, Greece, 4–5 November 2021; Springer: Cham, Switzerland, 2022; pp. 615–626. [Google Scholar]
  42. Gazdar, A.; Hidri, L. A new similarity measure for collaborative filtering based recommender systems. Knowl.-Based Syst. 2020, 188, 105058. [Google Scholar] [CrossRef]
  43. Natarajan, S.; Vairavasundaram, S.; Natarajan, S.; Gandomi, A.H. Resolving data sparsity and cold start problem in collaborative filtering recommender system using linked open data. Expert Syst. Appl. 2020, 149, 113248. [Google Scholar] [CrossRef]
  44. Zhang, Y.; Chen, X. Explainable recommendation: A survey and new perspectives. Found. Trends Inf. Retr. 2020, 14, 1–101. [Google Scholar] [CrossRef] [Green Version]
  45. Torres-Ruiz, M.; Mata, F.; Zagal, R.; Guzmán, G.; Quintero, R.; Moreno-Ibarra, M. A recommender system to generate museum itineraries applying augmented reality and social-sensor mining techniques. Virtual Real. 2020, 24, 175–189. [Google Scholar] [CrossRef]
  46. Bin, C.; Gu, T.; Sun, Y.; Chang, L. A personalized POI route recommendation system based on heterogeneous tourism data and sequential pattern mining. Multimed. Tools Appl. 2019, 78, 35135–35156. [Google Scholar] [CrossRef]
Figure 1. Architecture of real-time recommendation system for tourism.
Figure 1. Architecture of real-time recommendation system for tourism.
Sensors 23 03679 g001
Figure 2. Criteria for EVGPS error range setting.
Figure 2. Criteria for EVGPS error range setting.
Sensors 23 03679 g002
Table 1. AI-based recommendation system.
Table 1. AI-based recommendation system.
ModelDatasetPerformanceReference
K-NNMovie TrustRMSE 0.822[18]
Support Vector MachineGTZANAccuracy 0.976[19]
Random ForestInsurance CompaniesError Rate 0.16[20]
VotingSKYTRAXAccuracy 0.827[21]
XGBoostOnline Shopping MallAccuracy 0.896[22]
LightGBMDresspiMRR 0.206[23]
Table 2. Central and related tourist attraction information of Visit Korea data lab.
Table 2. Central and related tourist attraction information of Visit Korea data lab.
EV_MRIDCOUNTEV_MRIDCOUNTEV_MRIDCOUNTEV_MRIDCOUNT
150004788,894140032109,78114001539,6351300635431
150005788,89314001767,25814001439,6351300735396
150003755,78914004664,93815000639,6331300744784
150002755,78915000951,03214006821,3161400233430
15E005202,06215000851,03213006519,0571500013084
15E003202,06215000751,03213006217,9231400691724
15E004202,06214002748,50713006717,600140070922
15E001202,06214002846,40313006617,106140067248
15E008202,06214001339,92713006016,46814002460
15E009202,06214001239,88813007511,54913005240
15E002202,06214001939,644130076953214007232
15E007202,06214001839,63513007791571400208
15E006202,06214000739,635130055781714null7
Table 3. Input and output feature values and details of R2Tour.
Table 3. Input and output feature values and details of R2Tour.
FeatureValueDetail
Temperature4.8∼29.44.8∼29.4 (a monthly average)
Precipitation9.1∼610.6 (mm)9.1∼610.6 (a monthly average)
SeasonSpring ∼WinterSpring, Winter, Autumn, Winter
Age10∼5010, 20, 30, 40, 50
SexMale, FemaleMale, Female
CompanionAlone∼SpouseAlone, Children, Couple, Family, Friend, Parents, Spouse
Tour TypeCultural Tourism∼ShoppingCultural Tourism, Mature Tourism, Other Tourism, Shopping
LocationLocationVisit or Plan to Visit Tourist Attractions
Tourist AttractionTourist AttractionTop Five Tourist Attractions Nearby
Table 4. R2Tour results for AI-based recommendation system.
Table 4. R2Tour results for AI-based recommendation system.
MODELResult
F1-Score (Macro)F1-Score (Micro)Accuracy
K-NN0.0920.3180.318
SVM0.0240.1650.165
Random Forest0.3380.6880.688
Voting0.4070.7610.761
XGBoost0.40.750.75
LightGBM0.4150.7730.773
Table 5. Tourist activity pattern classification results according to real-time context.
Table 5. Tourist activity pattern classification results according to real-time context.
MODELResult
F1-Score (Macro)F1-Score (Micro)Accuracy
K-NN0.7140.7940.794
SVM0.2980.520.52
Random Forest0.6950.7780.778
Voting0.2820.5140.514
XGBoost0.7310.8060.806
LightGBM0.5830.710.71
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yoon, J.; Choi, C. Real-Time Context-Aware Recommendation System for Tourism. Sensors 2023, 23, 3679. https://doi.org/10.3390/s23073679

AMA Style

Yoon J, Choi C. Real-Time Context-Aware Recommendation System for Tourism. Sensors. 2023; 23(7):3679. https://doi.org/10.3390/s23073679

Chicago/Turabian Style

Yoon, JunHo, and Chang Choi. 2023. "Real-Time Context-Aware Recommendation System for Tourism" Sensors 23, no. 7: 3679. https://doi.org/10.3390/s23073679

APA Style

Yoon, J., & Choi, C. (2023). Real-Time Context-Aware Recommendation System for Tourism. Sensors, 23(7), 3679. https://doi.org/10.3390/s23073679

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop