You are currently viewing a new version of our website. To view the old version click .
Algorithms
  • Article
  • Open Access

22 July 2020

Towards Cognitive Recommender Systems

,
,
,
,
and
Department of Computing, Macquarie University, Macquarie Park 2109, Australia
*
Author to whom correspondence should be addressed.
This article belongs to the Special Issue Algorithms for Personalization Techniques and Recommender Systems

Abstract

Intelligence is the ability to learn from experience and use domain experts’ knowledge to adapt to new situations. In this context, an intelligent Recommender System should be able to learn from domain experts’ knowledge and experience, as it is vital to know the domain that the items will be recommended. Traditionally, Recommender Systems have been recognized as playlist generators for video/music services (e.g., Netflix and Spotify), e-commerce product recommenders (e.g., Amazon and eBay), or social content recommenders (e.g., Facebook and Twitter). However, Recommender Systems in modern enterprises are highly data-/knowledge-driven and may rely on users’ cognitive aspects such as personality, behavior, and attitude. In this paper, we survey and summarize previously published studies on Recommender Systems to help readers understand our method’s contributions to the field in this context. We discuss the current limitations of the state of the art approaches in Recommender Systems and the need for our new approach: A vision and a general framework for a new type of data-driven, knowledge-driven, and cognition-driven Recommender Systems, namely, Cognitive Recommender Systems. Cognitive Recommender Systems will be the new type of intelligent Recommender Systems that understand the user’s preferences, detect changes in user preferences over time, predict user’s unknown favorites, and explore adaptive mechanisms to enable intelligent actions within the compound and changing environments. We present a motivating scenario in banking and argue that existing Recommender Systems: (i) do not use domain experts’ knowledge to adapt to new situations; (ii) may not be able to predict the ratings or preferences a customer would give to a product (e.g., loan, deposit, or trust service); and (iii) do not support data capture and analytics around customers’ cognitive activities and use it to provide intelligent and time-aware recommendations.

1. Introduction

A Recommender System (RS), that is, a program which attempts to recommend the most suitable products/services to a user, aims at providing personalized services by retrieving the most relevant information and services from the big data generated on open, private, social and IoT (Internet of Things) data islands [,,,,]. Traditionally, Recommender Systems have been recognized as playlist generators for video/music services (e.g., Netflix (https://www.netflix.com/) and Spotify (https://www.spotify.com/)), e-commerce product recommenders (e.g., Amazon (https://www.amazon.com/) and eBay (https://www.ebay.com/)), or social content recommenders (e.g., Facebook (https://www.facebook.com/) and Twitter (https://twitter.com/)). Today, almost every organization leverages Recommender Systems to better understand their customers and to suggest their products and services. For example, in financial sectors, Recommender Systems are used to suggest novel products from the long-tail region; or in governments, Recommender Systems aim to personalize the advertisements in elections or improve customer relationship management.
A Recommender System is a subclass of information filtering system that seeks to predict the rating/preference a user would give to an item, where the goal is to predict a user’s interest, narrow down the set of choices, and mitigate the information overload problem [,,,,]. Recommender Systems are vital in business processes as they play an important role in today’s electronic markets, and helping businesses to understand their customers’ needs and preferences []. Recommender Systems in modern enterprises are highly data-driven and rely on users’ cognitive aspects such as personality, behavior, and attitude. For example, let us focus on a motivating scenario in financial sectors, where most existing Recommender Systems employ the collaborative or community-based approach—which makes it difficult to recommend products to new customers who have no preference at all (i.e., cold-start problem). Complementary to these conventional Recommender Systems, Sequential Recommender Systems [,,,] put the first step towards understanding and modeling the sequential user behaviors, the interactions among users and items, and the evolution of users’ preferences and item popularity over time. However, Sequential Recommender Systems do not consider cognitive science (analysis of Personality, Behaviour and Attitude over time) and cognitive computing (encompass machine learning, natural language processing and Crowdsouricng) as first-class citizens. In this context, advances in cognitive technology combined with evolutionary progress in areas such as Artificial Intelligence [] (including Machine Learning, Deep Learning and Natural Language Processing), knowledge representation [], user experience technologies [] and crowdsourcing [], have the potential to transform Recommender Systems in a fundamental way.
In this paper, we survey and summarize previously published studies in Recommender Systems to help readers understand our method’s contributions to the field in this context. We discuss the current limitations of the state of the art approaches in Recommender Systems and the need for our new approach: A vision and a general framework for a new type of data-driven, knowledge-driven, and cognition-driven Recommender Systems, that is, Cognitive Recommender Systems (Figure 1):
Figure 1. Three main Dimensions of a Cognitive Recommender System—(i) knowledge-driven []—which enables mimicking the knowledge of domain experts using crowdsourcing techniques; (ii) data-driven []: which enables leveraging Artificial Intelligence and Machine Learning technologies to understand the Big Data generated on Open, Private and Social platforms/systems to improve the accuracy of recommendations; and (iii) cognition-driven []: which enables understanding the end-users personality and Analyze their behaviour and attitude over time.
  • data-driven—which enables leveraging Artificial Intelligence and Machine Learning technologies to contextualize the Big Data generated on Open, Private and Social platforms/systems to improve the accuracy of recommendations []. The goal is to facilitate the use of content and collaborative filtering, and focus on the shift from statistical modeling to deep learning-based modeling (Deep Learning Recommendation Models) to improve correlations between features and attributes to generate better predictions;
  • knowledge-driven—which enables mimicking the knowledge of domain experts using crowdsourcing techniques []. The goal is to leverage techniques such as reinforcement learning [] to strengthen desirable and accurate recommendations and minimize or eliminate undesirable recommendations; and
  • cognition-driven—which enables understanding the users’ personality and analyze their behaviour and attitude over time. The goal is to improve recommendation performance with cognitive science and Neural Magic by leveraging neural embedding frameworks, include our previous work, Personality2Vec [], to design mechanisms for personalized task recommendation.
We present a framework to employ users’ cognitive aspects, knowledge management, and analytics in Cognitive Recommender Systems to intelligently assess and proactively adapt the recommendations based on the results of cognitive analytics and continuous learning from the actions taken. We present a motivating scenario in finance industry and argue that existing Recommender Systems—(i) may not be able to predict the ratings or preferences a customer would give to a product (e.g., loan, deposit, or trust service); and (ii) do not support data capture and analytics around customers’ cognitive activities and using it to provide intelligent and time-aware recommendations.
Cognitive Recommender Systems can be used in various scenarios such as Understanding the Customer Journey, improving government services, Personalizing Teaching and Learning, personalizing the advertisements in elections and more. The rest of the paper is organized as follows—in Section 2 we provide the background and related work. We present a general framework for Cognitive Recommender Systems in Section 3. In Section 4, we present evaluation results before concluding the paper with remarks for future directions in Section 5.

3. A General Framework for Cognitive Recommender Systems

Figure 3 illustrates a general framework for cognitive RSs. In the following, we explain the main elements of the framework: data-driven, knowledge-driven, and cognition-driven.
Figure 3. A General Framework for Cognitive Recommender Systems.

3.1. Data-Driven: Curation Services

The continuous improvement in connectivity, storage and data processing capabilities allow access to a data deluge from the big data, that is, the data generated on various islands of data, from social (e.g., on Twitter and Facebook) and Internet of Things (e.g., CCTVs and smart cars) to private (e.g., personal and business data) and open (e.g., news and Websites) data islands [,]. One of the main challenges in understanding big data is the data curation process, that is, to transform raw data into actionable insights.
At this level we organize the big data (generated on private business/personal, open and social data islands) in a data lake [] (i.e., a centralized repository that supports various data capture and management technologies that facilitate dealing with a collection of independently-managed datasets, from relational to NoSQL). We provide a set of data curation services to turn the raw private/open/social data into a contextualize data and knowledge. The data curation services, leveraging AI and ML technologies, for extracting, classifying, linking, merging, enriching, sampling, and the summarization of data and knowledge. This will enable us to automatically add features (such as extracting keyword, part of speech, and named entities such as Persons, Locations, Organizations), enrich the extracted features (by linking them to external knowledge sources such as Wikidata or WordNet to provide synonyms and stems, or use learning techniques such as word2vec, entity2vec, or grapch2vec to find similar keywords or items), discovering similarity among the extracted information items, such as calculating similarity between string and numbers; and sorting and categorizing data into various types, forms or any other distinct class.
In particular, the data curation services will facilitate the following tasks: (i) Data Cleaning—to amend or remove data in a database that is incorrect, incomplete, improperly formatted or duplicated; (ii) Data Integration—to combines data from multiple sources and deal with schema integration, detecting and resolving data value conflicts, and removing duplicates and redundant data; (iii) Data Transformation—to smooth the noisy data, summarize, generalize, or normalize the data scale falls within a small, specified range; and (iv) Adding Value—to support extraction, enrichment, annotation, linking (to domain knowledge, and other external Knowledge Bases) and summarization tasks.
The contextualized data lake (i.e., Knowledge Lake) will facilitate the content and context analytics for the RSs, as it contains virtually inexhaustible amounts of both data and contextualized data that is readily made available anytime to anyone authorized to perform analytical activities. In this context, a Knowledge Lake will provide the foundation for content and context-aware recommendations by automatically curating the raw data in the Data Lake and to prepare them for deriving insights. Figure 4 illustrates the Knowledge Lake Architecture.
Figure 4. Knowledge Lake Architecture [].

3.2. Knowledge-Driven: Intelligent Knowledge Lakes

Intelligence is the ability to learn from experience and use domain experts’ knowledge to adapt to new situations. In this context, an intelligent Recommender System should be able to learn from domain experts’ knowledge and experience, as it is vital to know the domain (e.g., retail, finance, health, education) that the items will be recommended. To achieve this goal, a cognitive recommender system would benefit from the domain knowledge (i.e., the knowledge of a specific, specialized discipline or field) as well as the crowdsourcing techniques.

3.2.1. Domain Knowledge

As discussed in Section 3.1, Knowledge Lakes are used to facilitate the content and context analytics for the RSs, as they contain virtually inexhaustible amounts of both data and contextualized data that is readily made available anytime to anyone authorized to perform analytical activities. Intelligent Knowledge Lakes [] to facilitate linking Artificial Intelligence (AI) and Data Analytics, to enable learning from domain expert’s experience, and use this knowledge to annotate the contextualized information stored in a knowledge lake. The goal is to enable RSs to learn from contextualized data and use them to develop cognitive assistance for RSs’ users for: facilitating the recommendation processes and learning from the users’ cognition over time (by generating new rules for future predictions). Accordingly, Intelligent Knowledge Lakes can help RSs to understand the big data, use it in a smart way, and feed it into its (Intelligence) engine. One of the main challenges to build an Intelligent Knowledge Lake is to mimic the knowledge of domain experts using techniques such as feedback, surveys, and interviews; to build a domain-specific Knowledge Base. A Knowledge Base (KB) typically consists of a set of concepts organized into a taxonomy, instances for each concept, and relationships among the concepts.
As an example, a domain knowledge can be a crucial source of data when optimizing a Recommender System when personalizing digital government services, that is, to decide what a user sees. It should be highlighted that, this would different from customization, where the user decides what they want to see. In building a domain knowledge, we need to capture all important entities, relationships, and events that are happening in real time in the specialized discipline or field, such as health, education, retail and financial domain. For example, to construct a domain-specific Knowledge Base in banking, the Concepts may include products (e.g., accounts, cards, checks, loans, etc.), customers (e.g., Personal, Business, Government, etc.), processes (e.g., sales, customer service, risk management, debt management, product management, campaign management), analytics (Customer Analytics, Credit Card Analytics, Loan Analytics, Economy Analytics, etc.), and more. The instances of such concepts would be, for example, the list of customers (instances of the concept Customer) or different Fraud detection operations (instances of the concept Process, e.g., operations such as data analysis algorithms to detect patterns and anomalies). To identify the instances, it is also important to consider the entities related to those concepts and instances. For example, fraud detection can be applied to several entities such as credit cards or insurance. In this context, connected entities will form a (Knowledge) graph including financial transactions, location, devices used, initiated sessions and authentication systems.

3.2.2. Crowdsourcing

Crowdsourcing, that is, the process of obtaining information or input into a task by enlisting the services of a large number of people (paid or unpaid) via cloud-based platforms [], has the potential to bring solution to two main challenges in RSs:
  • Cold-start problem—existing work has been suggesting a user-item rating matrix and users/items information such as user profiles and item contents. However, this information are primarily biased and it will be challenging to identify reliable item neighbors relevant to the cold-start items. In this context, Crowdsourcing has the potential to bring the knowledge of the crowd for new items recommendations. As illustrated in Figure 3, in our proposed approach there are two feedback loops to the crowdsourcing platforms: (i) Data Curation Services Feedback Loop, at this level the Data Curation Services benefits from annotating and enriching the extracted information items from the crowd workers. In particular, we leverage Crowdsourcing techniques to mimic the domain expert knowledge using feedback, surveys, interviews and more, to build a domain specific knowledge base and use that knowledge to improve correlations between features and attributes to generate better predictions. An interesting motivating scenario, would be in risk-aware Recommender Systems, where it would be important to understand the risk level of the customer’s situation (e.g., during the COVID-19 pandemic (https://en.wikipedia.org/wiki/COVID-19_pandemic)), where it may be dangerous to recommend items the user may not desire in her current situation if the risk level is high. Accordingly, the aim of a Cognitive Recommender System is to use rules together with techniques such as learning and crowdsourcing to strengthen desirable and accurate recommendations and minimize or eliminate undesirable recommendations;
    (ii) Personality2vec Analysis Feedback Loop, at this level we will leverage the knowledge of the crowd to understand changes in user’s behaviour and feedback, such as ratings and clicks, as well as detecting information about environment changes, such as changes in location and time, while the user is travelling.
  • Bias and Variance—Given that the features and related data used for training recommendations generated by algorithms and gathered by humans, biases may get into data preparation and training phases. This is mainly because the big data generated on a large scale, never-ending, and ever-changing. To address this challenge we leverage our previous work [,] which combines the crowdsourcing techniques and link them back to rule-based systems to generate feedback loops that can be adopted over-time to deal with Biases (i.e., the simplifying assumptions made by the model to make the target function easier to approximate) and Variance (i.e., the amount that the estimate of the target function will change given different training data).
Figure 5 illustrates how we leveraging crowdsourcing to deal with biases and the cold-start problem. To construct a domain mediated model, we use Amazon Mechanical Turk (Amazon Mechanical Turk is a crowdsourcing website for businesses to hire remotely located “crowdworkers" to perform discrete on-demand tasks that computers are currently unable to do. It is operated under Amazon Web Services (https://www.mturk.com/).) to construct a set of crowd microtasks, to manage the two feedback loops in our proposed model (Figure 3). The main goal is to support the ongoing quality requirements, by developing a set of microtasks (i.e., a short, independent, self-contained request for a piece of work such as rating, opinion, comment, idea, and advice, to be completed.) sent to domain experts, who can quickly write a set of rules that capture obvious patterns, correcting learning mistakes, or covering cases that learning cannot handle.
Figure 5. Leveraging crowdsourcing to deal with biases and the cold-start problem.

3.3. Cognition-Driven: Personality2Vec

One of the main shortcomings of existing RSs is that they are not able to identify similar users based on their cognitive thinking and activities. For example, in retail or finance sector, if a RS would be able to find similarity between a new user and an existing user, then there would be opportunities to predict the user needs from product sales and upgrade point of views. Examples include identifying similar—students in education domain, patients in health domain, or similar customers in a finance sector. In this context, it would be important to understand the various dimensions for the student, patient, or the customer. Let us focus on customers’ dimensions in a banking scenario. In this scenario, the similarity between two customers can be discovered from various dimensions such as demography, health, social activities, and/or engagements, as illustrated in Figure 6.
Figure 6. Recommender Systems: users’ dimensions in a banking scenario.
To enable identifying similar customers, we leverage our previous works, Personality2Vec [] and Graph-based OLAP analytics [,] to automatically identify and match similar users (e.g., based on various dimensions illustrated in Figure 6). We introduce a graph-based data model. The nodes in the graph represent customers (and their domain-specific dimensions illustrated in Figure 6) as well as the products. We use mathematical embedding from a space with a dimension per feature to a continuous vector space which can be mapped to classes of cognitive activities in a specific domains such as retail, finance, health, and education. For example, in the finance industry scenario, the classes would be banks (e.g., Central, Retail, Commercial, Shadow, Investment, and Cooperative organizations), customers (e.g., Individuals, Partnership Firms, Limited Liability Companies, or Trusts), services (e.g., Loans, Overdraft, and Consultancy), products (e.g., Current/Savings/Credit accounts, Debit/Credit cards, Checks), and/or insights (fraud detection, money laundering). The edges in the graph will be relationships among the nodes as well as the above-mentioned classes. Following we present some examples of such relationships:
  • c u s t o m e r [ i d ] ( a p p l i e d f o r [ t i m e s t a m p : T 1 ] ) l o a n [ t y p e : c a r ] : which specifies that a customer applied for a car loan on a specific date T1 (YY/MM/DD).
  • c u s t o m e r [ i d ] ( W e a l t h a s s e t s [ t i m e s t a m p : T 1 ] ) h e a l t h y : which specifies that at timestamp T1 the customers wealth and assets analysis shows a healthy sign. This can be done through an automatic trigger for Wealth-assets analysis (see the demography category in Figure 6) when the customer applies for a loan.
  • c u s t o m e r [ i d ] ( H e a l t h I n s u r a n c e [ t i m e s t a m p : T 1 ] ) v a l i d : which specifies that at timestamp T1 the customer has a valid health insurance. This can be done through an automatic trigger for health analysis (see the category health in Figure 6) when the customer applies for a loan.
  • c u s t o m e r [ i d ] ( C r e d i t C h e c k [ t i m e s t a m p : T 1 ] ) v a l i d : which specifies that at timestamp T1 the customer has a valid credit card with no background issue (e.g., late payments, fraudulent card applications, or skimming). This can be done through an automatic trigger for a credit check process (see the ontology in Figure 6) when the customer applies for a loan.
  • c u s t o m e r [ i d ] ( T r a n s a c t i o n s C h e c k [ t i m e s t a m p : T 1 ] ) v a l i d : which specifies that at timestamp T1 the customers’ transactions involved no risks or frauds such as suspicious transactions to blacklisted partners/countries. This can be done through an automatic trigger for a transaction check process (see the ontology in Figure 6) when the customer applies for a loan.
  • c u s t o m e r [ i d ] ( S o c i a l a c t i v i t i e s [ t i m e s t a m p : T 1 ] ) v a l i d : which specifies that at timestamp T1 the customers’ social activities does not include any risks such as radicalization, money laundering or child pornography. This can be done through an automatic trigger for a social activity check process (Figure 6) when the customer applies for a loan.
Figure 7 illustrates a snapshot of a user’s personality graph. The next step, will be to facilitate the classification of the personality graph, to enable matching similar customers. At this stage, we leverage the graph2vec [] neural embedding framework to identify and group similar personality graphs. The advantage of the graph2vec approach is that the model will learn graph embeddings in a completely unsupervised manner that is, class labels of personality graphs are not required for learning their embeddings. In particular, we view the entire personality graphs (of all users) as a document (similar to the word2vec [] neural network) and the rooted subgraphs around every node in the graph as words that compose the document and extend document embedding neural networks to learn representations of entire graphs. Afterward, using the time-aware neural embedding framework presented in Personality2Vec [], and taking into consideration the uses’ dimensions presented in Figure 6, we construct a personality Graph (pGraph) model for each customer in the RS. The pGraph is time-aware and includes all the activities (e.g., payment patterns, transactions context and content, geographical changes in payments, products purchases and updates, and more. This will enable the cognitive RSs to find similar customers, better understand their requirements and needs, and providing more intelligent and time-aware recommendations.
Figure 7. A snapshot of a user’s personality graph.
For example, considering the COVID-19 pandemic (https://en.wikipedia.org/wiki/COVID-19_pandemic), a bank may need to understand the likely impact of COVID-19 (https://en.wikipedia.org/wiki/Coronavirus_disease_2019) on the finance sector and its customers. In this context, identifying similar customers would be vital for organizations and provide insights for credit management (e.g., which consumers and businesses may not be able to make loan payments) and revenue compression (e.g., which customers may be affected by rate cuts as well as a collapse in demand). This, in turn, will also enable organizations to focus on the quality of their business processes, such as customer service and advice provision (e.g., restrictions on personal interactions will push customers toward digital channels for service and sales), operating model adjustments, cost control and innovation (e.g., misaligned revenues and cost will require finance sectors to improve operational flexibility and rethink short-term priorities).
We should highlight that, Figure 6 specifically demonstrates the dimensions that can be used as features in the neural embedding framework (i.e., personalit2vec). As illustrated in this figure, dimensions such as Transactions and Loans can help us extract features to identify customers with financial risks. As another example, dimension such as Social Activities or Health Records can help us extract features to identify customers with psychological risks or safety risks. Accordingly, our proposed model will enable analysts to use different features for different goals, as for example risk assessment process could be a subjective task and highly relied on the knowledge of the business analysts.

4. Experimental Settings and Analysis

In this paper, we proposed a vision and a framework for a Cognitive RS that enables leveraging the knowledge of domain experts, benefits from crowdsourcing systems, uses the curated content and context of big data (generated on private, social, open and IoT data islands), and facilitates the user experience and KYC (Know Your Customer) Analytics (i.e., the discovery, interpretation, and communication of meaningful patterns in customers data, which can be understood as the connection between all new customers on-boarded at an organization and for existing customers on a periodic basis, as well as effective decision making within an organization) by constructing a time-aware personality graph.
We have discussed that, the three main Dimensions of a Cognitive RS include: (i) knowledge-driven: which enables mimicking the knowledge of domain experts using crowdsourcing techniques and building domain specific Knowledge Bases (KBs); (ii) data-driven: which enables leveraging AI and ML technologies to curate and contextualize the data; and (iii) cognition-driven: which enables understanding the end-users personality and Analyze their behaviour and attitude over time. In our previous work, we have evaluated the feasibility and performance of the Personality2Vec technique, data curation Services, and the knowledge-driven approach (i.e., intelligent knowledge lakes [,,,]).
In this paper, we focus on evaluating the effects of enabling the analysis of personality aspects in RSs. We use a set of Amazon reviewer’s dataset [,] and explain how we curate the reviews (e.g., by leveraging curations services to extract keywords, phrases and topics) and then link them to external knowledge services such as LIWC (https://liwc.wpengine.com/) to detect users’ personality types. We will then discuss the results of our experiment to demonstrate the effect of integrating the personality factor into a RSs.

4.1. Users’ Personality Acquisition

Personality as “consistent behavior pattern and interpersonal processes originating within the individual” [], which can be detected either explicitly by filling a questionnaire or implicitly through observing users’ behavioral patterns. According to psychologists, personality can introduce a person’s “patterns of thought, emotion, and behavior” []. Among all traits, we select Five Factor Model (FFM) which is a well-known personality model. FFM can describe people personality into five main factors as follows []:
  • “Openness to Experience: creative, open-minded, curious, reflective, and not conventional”.
  • “Agreeableness: cooperative, trusting, generous, helpful, nurturing, not aggressive or cold”.
  • “Extroversion: Assertive, amicable, outgoing, sociable, active, not reserved or shy”.
  • “Conscientiousness: preserving, organized, and responsible”.
  • “Neuroticism (Emotional Stability): relaxed, self-confident, not moody, easily upset, or easily stressed”.
In this experiment, we detect users’ personality types implicitly through analyzing their provided textual contents. It is shown by psychologists that people with similar personality types tend to share similar interests. If we take movies domain as an example, due to its strong relations with users’ preferences, the Openness personality type users may prefer to watch comedy and fantasy genre of movies, while Neurotic personality type users are more likely to watch romantic movies []. Therefore, we select a movie-related subset of the Amazon dataset to test our model. This dataset contains a huge amount of reviews that mining them can help us to better understand users’ behaviours. Since people may differ in their selected words because of their personality characteristics, we first collect all users’ reviews and then feed them to Linguistic Inquiry and Word Count (LIWC), which is a popular text-analysis tool. LIWC can categorize the words related to more than 88 psychological. LIWC is able to find the percentages of words related to each of which 88 categories like positive emotions, cognitive process, and social processes. Next, based on the relation of each of extracted category from LIWC and FFM personality traits, we employ a linear regression model to compute the score of each user’s personality type, named PerSc, as follows:
P e r S c = α A + β B + γ C + ,
where in Equation (1), A, B, and C are the LIWC categories, and α , β , and γ are their corresponding weights.

4.2. Dataset

We test our proposed model on the Amazon dataset, which has been widely used in RSs [,]. Amazon dataset provides a wide range of useful information (e.g., ratings, reviews), which consists of 2000 of users, 1500 items, 86,690 reviews, 7219 number ratings, 3.6113 average number of rates per user, 0.2166 average number of rates per item and user ratings density is 0.0024. Figure 8 is a sample of this data set, where reviewerID is the id of the reviewer, for example, A2SUAM1J3GNN3B, asin is an id of the product, for example, 0000013714, reviewerName is a name of the reviewer, helpful denotes the helpfulness rating of the review, for example, 2/3, reviewText is the text of the review, overall is the given rating to the product, summary is a summary of the review, unixReviewTime is the time of the review (unix time), and reviewTime is the time of the review (raw) (http://jmcauley.ucsd.edu/data/amazon/). This information can be an important source of knowledge that need to be extracted for a different purpose. According to the strong relations between a person’s personality type and her/his choices of video, we select a subset of Amazon dataset, Instantvideos, to work on and leave other domains for our future works. Furthermore, we select users who leave more than three reviews in this dataset in order to have a better analysis of their provided content.
Figure 8. A Sample of Amazon Dataset.

4.3. Evaluation Metrics

We use two standard metrics to measure and compare the performance of our proposed approach with the various RS models: Mean Absolute Error (MAE) and Root Mean Square Error (RMSE), which are defined through Equation (2). The smaller MAE and RMSE demonstrate a better recommendation accuracy;
M A E = ( u , i ) R t e s t | R u i R u i | | R t e s t | R M S E = ( u , i ) R t e s t | R u i R u i | | R t e s t | ,
where R u i and R u i are the real and estimated ratings values, respectively, and R t e s t is the total number of ratings in the test dataset. In order to show the performance of cognitive RSs compared to the traditional recommenders, we compare our proposed approach with three following categories of recommenders: (i) Classic collaborative filtering which only considers user-item matrix such as SVD++ [], UserMean and ItemMean, measuring the mean of all ratings that a user has given to items and the mean of all ratings that an item has been given by users, respectively, and Random method which randomly assigns rated values; (ii) Auxiliary information-based recommender such as CTR [] which is the state-of-the-art model, using topic modeling to combine the contents of documents with traditional collaborative filtering in order to recommend scientific articles; and (iii) Intelligent-based RS which only discover users’ personality type explicitly by providing a questionnaire to the users, which is overwhelming and a time-consuming task (e.g., TWIN Recommender System []).

4.4. Performance Analysis and Comparison

In this section, we compare the performance of our proposed method with other approaches regarding RMSE and MAE. As is shown in Figure 9, we use different sets of the training data size (60%, 70%, 80%, and 90%). According to Figure 9, while we increase the amount of trained data we will have better accuracy for all methods. All approaches reach to their best performance in both metrics when training data size is 90%. Therefore, in order to have a fair comparison, we consider the results of models when they train 90% training size. Our proposed model achieves the best performance in terms of both RMSE and MAE compared to all baselines. While SVD++ performs better compared to the approaches in the first category, as UserMean and ItemMean simply compute the mean rating values of users and items, respectively. However, the recommendation performance of UserMean is higher than that of ItemMean, as the average number of ratings per user is more than the average number of ratings per item, in this dataset. CTR performs better than SVD++ by 11% and 14% in terms of MAE and RMSE, respectively. This can explain by using the extra information in CTR. In the third category of approaches, TWIN suppresses Hu, since Hu mostly depends on the ratings information which may suffer from data sparsity problem. In the end, our model reaches the best performance compared to all other methods. In addition, our model outperforms the recommendation performance of CTR by 39%, 42% and TWIN by 11%, 31% in terms of MAE and RMSE, respectively.
Figure 9. A Performance analysis on the Amazon dataset.

5. Conclusions and Future Work

In this paper, we presented a vision and a general framework for Cognitive RSs, that is, a new type of knowledge-driven, data-driven and cognition-driven RSs, where users’ cognitive aspects, knowledge management, and analytics are employed to intelligently assess and proactively adapt the recommendations based on the results of cognitive analytics and continuous learning from the actions taken. Although recommender systems (RSs) have been well studied and broadly applied, a cognitive-based RS is a relative emerging area in RSs. We introduce a set of challenges in this domain which may open a collection of future research directions:
  • A future direction in context-aware recommendations would be to build users’ personality graph for different contexts, such as time, location, health and education. Considering this important factor into account may result in enhancing the accuracy of RSs, since users usually make different decisions in different situations.
  • A future direction in Cross-domain recommendations would be to build the users’ personality graph in the source domain and then make a recommendation in the target domain. This is important as in related domains such as movies and books, users’ behaviour may be similar. This can help us to not only improve the recommendation performance but also deal with the cold-start problem when new user joins a system and there is a lack of available information about him/her.
  • Time-aware Cognitive RSs is another opening research domain. The main goal of cognitive RSs is to use state-of-the-art models and techniques to be able to understand human’s behaviour and make smart recommendations. However, in real-world scenarios, users’ behaviours may change over time. Hence, detecting changes in users’ activities and behaviours may open the door to various potential research directions.
  • Group-aware Cognitive RSs can be another interesting future work. In this context, relating users’ personality graphs may discover similar interests and thus helping to overcome data sparsity problem in RSs.
  • Another interesting line of work would be a Multi-step interactive Cognitive RS. Usually, the users’ decision-making process may contain multiple steps rather than just one step. Interact with users through a feedback loop at each step can help RSs to fully understand the users’ needs and interests.
  • Another future work direction would focus on using gamification techniques (e.g., BitLife (https://bitlife-life-simulator.fandom.com/)) to learn from the RS users’ activities as well as decision making (how they choose the best next steps in specific situations) and enable the Cognitive RS to think and learn like a human, led to more humanized recommendations.

Author Contributions

Conceptualization, A.B.; Data curation, A.B. and S.Y.; Formal Analysis, A.B. and S.Y.; Methodology, A.B., S.M. and S.R.G.; Software, S.Y.; Supervision, A.B.; Validation, S.Y.; Visualization, A.B., S.Y., S.M. and M.A.E.; Writing—original draft, A.B. and S.Y.; Writing—review and editing, A.B., S.Y. and S.M.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

We acknowledge the AI-enabled Processes (AIP (https://aip-research-center.github.io/)) Research Centre for funding this research.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ricci, F.; Rokach, L.; Shapira, B. (Eds.) Recommender Systems Handbook; Springer: Berlin/Heidelberg, Germany, 2015. [Google Scholar]
  2. Jannach, D.; Zanker, M.; Felfernig, A.; Friedrich, G. Recommender Systems—An Introduction; Cambridge University Press: Cambridge, UK, 2010. [Google Scholar]
  3. Wang, S.; Hu, L.; Wang, Y.; Cao, L.; Sheng, Q.Z.; Orgun, M.A. Sequential Recommender Systems: Challenges, Progress and Prospects. arXiv 2020, arXiv:2001.04830. [Google Scholar]
  4. Adomavicius, G.; Tuzhilin, A. Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions. IEEE Trans. Knowl. Data Eng. 2005, 17, 734–749. [Google Scholar] [CrossRef]
  5. Wang, S.; Cao, L.; Wang, Y. A Survey on Session-based Recommender Systems. arXiv 2019, arXiv:1902.04864. [Google Scholar]
  6. Beheshti, S.; Benatallah, B.; Sakr, S.; Grigori, D.; Motahari-Nezhad, H.R.; Barukh, M.C.; Gater, A.; Ryu, S.H. Process Analytics—Concepts and Techniques for Querying and Analyzing Process Data; Springer: Berlin/Heidelberg, Germany, 2016. [Google Scholar] [CrossRef]
  7. Ying, H.; Zhuang, F.; Zhang, F.; Liu, Y.; Xu, G.; Xie, X.; Xiong, H.; Wu, J. Sequential Recommender System based on Hierarchical Attention Networks. In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, Stockholm, Sweden, 13–19 July 2018; pp. 3926–3932. [Google Scholar]
  8. Chen, X.; Xu, H.; Zhang, Y.; Tang, J.; Cao, Y.; Qin, Z.; Zha, H. Sequential Recommendation with User Memory Networks. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, Marina Del Rey, CA, USA, 5–9 February 2018; pp. 108–116. [Google Scholar]
  9. Huang, J.; Zhao, W.X.; Dou, H.; Wen, J.; Chang, E.Y. Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks. In Proceedings of the41st International ACM SIGIR Conference on Research & Development in Information Retrieval, Ann Arbor, MI, USA, 8–12 July 2018; pp. 505–514. [Google Scholar]
  10. Nilsson, N.J. Principles of Artificial Intelligence; Morgan Kaufmann: Burlington, MA, USA, 2014. [Google Scholar]
  11. Markman, A.B. Knowledge Representation; Psychology Press: London, UK, 2013. [Google Scholar]
  12. Hassenzahl, M.; Tractinsky, N. User experience-a research agenda. Behav. Inf. Technol. 2006, 25, 91–97. [Google Scholar] [CrossRef]
  13. Howe, J. The rise of crowdsourcing. Wired Mag. 2006, 14, 1–4. [Google Scholar]
  14. Beheshti, A.; Benatallah, B.; Tabebordbar, A.; Motahari-Nezhad, H.R.; Barukh, M.C.; Nouri, R. DataSynapse: A Social Data Curation Foundry. Distrib. Parallel Databases 2019, 37, 351–384. [Google Scholar] [CrossRef]
  15. Beheshti, A.; Benatallah, B.; Sheng, Q.Z.; Schiliro, F. Intelligent Knowledge Lakes: The Age of Artificial Intelligence and Big Data. In Proceedings of the Web Information Systems Engineering—WISE 2019 Workshop, Demo, and Tutorial, Hong Kong and Macau, China, 19–22 January 2020; U, L.H., Yang, J., Cai, Y., Karlapalem, K., Liu, A., Huang, X., Eds.; Revised Selected Papers; Communications in Computer and Information Science. Springer: Berlin/Heidelberg, Germany, 2019; Volume 1155, pp. 24–34. [Google Scholar] [CrossRef]
  16. Sutton, R.S.; Barto, A.G. Reinforcement Learning: An Introduction; MIT Press: Cambridge, MA, USA, 2018. [Google Scholar]
  17. Beheshti, A.; Hashemi, V.M.; Yakhchi, S.; Motahari-Nezhad, H.R.; Ghafari, S.M.; Yang, J. personality2vec: Enabling the Analysis of Behavioral Disorders in Social Networks. In Proceedings of the WSDM ’20: The Thirteenth ACM International Conference on Web Search and Data Mining, Houston, TX, USA, 3–7 February 2020; pp. 825–828. [Google Scholar] [CrossRef]
  18. Salton, G. Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer; Addison-Wesley: Boston, MA, USA, 1989. [Google Scholar]
  19. Pelikán, E. Principles of Forecasting—A Short Overview. In Proceedings of the SOFSEM ’99, Theory and Practice of Informatics, 26th Conference on Current Trends in Theory and Practice of Informatics, Milovy, Czech Republic, 27 November–4 December 1999; Pavelka, J., Tel, G., Bartosek, M., Eds.; Lecture Notes in Computer Science. Springer: Berlin/Heidelberg, Germany, 1999; Volume 1725, pp. 311–327. [Google Scholar]
  20. Lilien, G.L.; Rao, A.G. A Model for Allocating Retail Outlet Building Resources across Market Areas. Oper. Res. 1976, 24, 1–14. [Google Scholar] [CrossRef][Green Version]
  21. Rich, E. User Modeling via Stereotypes. Cogn. Sci. 1979, 3, 329–354. [Google Scholar] [CrossRef]
  22. Fernández-Tobías, I.; Cantador, I.; Kaminskas, M.; Ricci, F. Cross-domain recommender systems: A survey of the State of the Art. In Proceedings of the 2nd Spanish Conference on Information Retrieval, Valencia, Spain, 17–19 June 2012. [Google Scholar]
  23. Baeza-Yates, R.A.; Ribeiro-Neto, B.A. Modern Information Retrieval; ACM Press/Addison-Wesley: Boston, MA, USA, 1999. [Google Scholar]
  24. Si, L.; Jin, R. Flexible Mixture Model for Collaborative Filtering. In Proceedings of the 20th International Conference on Machine Learning (ICML 2003), Washington, DC, USA, 21–24 August 2003; pp. 704–711. [Google Scholar]
  25. Singhal, A. Modern Information Retrieval: A Brief Overview. IEEE Data Eng. Bull. 2001, 24, 35–43. [Google Scholar]
  26. Pazzani, M.J. A Framework for Collaborative, Content-Based and Demographic Filtering. Artif. Intell. Rev. 1999, 13, 393–408. [Google Scholar] [CrossRef]
  27. Zhao, W.X.; Guo, Y.; He, Y.; Jiang, H.; Wu, Y.; Li, X. We know what you want to buy: A demographic-based system for product recommendation on microblogs. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’14, New York, NY, USA, 24–27 August 2014; pp. 1935–1944. [Google Scholar]
  28. Balabanovic, M.; Shoham, Y. Content-Based, Collaborative Recommendation. Commun. ACM 1997, 40, 66–72. [Google Scholar] [CrossRef]
  29. Cotter, P.; Smyth, B. PTV: Intelligent Personalised TV Guides. In Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on on Innovative Applications of Artificial Intelligence, Austin, TX, USA, 30 July–3 August 2000; Kautz, H.A., Porter, B.W., Eds.; AAAI Press/The MIT Press: Cambridge, MA, USA, 2000; pp. 957–964. [Google Scholar]
  30. Sahebi, S.; Brusilovsky, P. Cross-Domain Collaborative Recommendation in a Cold-Start Context: The Impact of User Profile Size on the Quality of Recommendation. In User Modeling, Adaptation, and Personalization, Proceedings of the 21th International Conference, UMAP 2013, Rome, Italy, 10–14 June 2013; Carberry, S., Weibelzahl, S., Micarelli, A., Semeraro, G., Eds.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2013; Volume 7899, pp. 289–295. [Google Scholar]
  31. Shapira, B.; Rokach, L.; Freilikhman, S. Facebook single and cross domain data for recommendation systems. User Model. User-Adapt. Interact. 2013, 23, 211–247. [Google Scholar] [CrossRef]
  32. Berkovsky, S.; Kuflik, T.; Ricci, F. Mediation of user models for enhanced personalization in recommender systems. User Model. User-Adapt. Interact. 2008, 18, 245–286. [Google Scholar] [CrossRef]
  33. Berkovsky, S.; Kuflik, T.; Ricci, F. Distributed collaborative filtering with domain specialization. In Proceedings of the 2007 ACM Conference on Recommender Systems, RecSys 2007, Minneapolis, MN, USA, 19–20 October 2007; pp. 33–40. [Google Scholar]
  34. Givon, S.; Lavrenko, V. Predicting social-tags for cold start book recommendations. In Proceedings of the 2009 ACM Conference on Recommender Systems, RecSys 2009, New York, NY, USA, 23–25 October 2009; pp. 333–336. [Google Scholar]
  35. Chung, R.; Sundaram, D.; Srinivasan, A. Integrated personal recommender systems. In Proceedings of the 9th International Conference on Electronic Commerce: The Wireless World of Electronic Commerce, University of Minnesota, Minneapolis, MN, USA, 19–22 August 2007; Volume 258, pp. 65–74. [Google Scholar]
  36. Koren, Y. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, NV, USA, 24–27 August 2008; pp. 426–434. [Google Scholar]
  37. Pan, W.; Xiang, E.W.; Liu, N.N.; Yang, Q. Transfer Learning in Collaborative Filtering for Sparsity Reduction. In Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2010, Atlanta, GA, USA, 11–15 July 2010. [Google Scholar]
  38. Pan, W.; Liu, N.N.; Xiang, E.W.; Yang, Q. Transfer Learning to Predict Missing Ratings via Heterogeneous User Feedbacks. In Proceedings of the 22nd International Joint Conference on Artificial Intelligence, Barcelona, Spain, 16–22 July 2011; pp. 2318–2323. [Google Scholar]
  39. Abel, F.; Bittencourt, I.I.; Henze, N.; Krause, D.; Vassileva, J. A Rule-Based Recommender System for Online Discussion Forums. In Adaptive Hypermedia and Adaptive Web-Based Systems, 5th International Conference, AH 2008, Hannover, Germany, 29 July–1 August 2008. Proceedings; Nejdl, W., Kay, J., Pu, P., Herder, E., Eds.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2008; Volume 5149, pp. 12–21. [Google Scholar]
  40. Lin, W.; Alvarez, S.A.; Ruiz, C. Efficient Adaptive-Support Association Rule Mining for Recommender Systems. Data Min. Knowl. Discov. 2002, 6, 83–105. [Google Scholar] [CrossRef]
  41. Huang, Z.; Chen, H.; Zeng, D.D. Applying associative retrieval techniques to alleviate the sparsity problem in collaborative filtering. ACM Trans. Inf. Syst. 2004, 22, 116–142. [Google Scholar] [CrossRef]
  42. Song, W.; Yang, K. Personalized Recommendation Based on Weighted Sequence Similarity. In Practical Applications of Intelligent Systems; Springer: Berlin/Heidelberg, Germany, 2014; pp. 657–666. [Google Scholar]
  43. Le, D.; Fang, Y.; Lauw, H.W. Modeling Sequential Preferences with Dynamic User and Context Factors. In Machine Learning and Knowledge Discovery in Databases, Proceedings of the European Conference, ECML PKDD 2016, Riva del Garda, Italy, 19–23 September 2016, Proceedings, Part II; Frasconi, P., Landwehr, N., Manco, G., Vreeken, J., Eds.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2016; Volume 9852, pp. 145–161. [Google Scholar]
  44. Zhang, Z.; Nasraoui, O. Efficient Hybrid Web Recommendations Based on Markov Clickstream Models and Implicit Search. In Proceedings of the 2007 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2007, Silicon Valley, CA, USA, 2–5 November 2007; IEEE Computer Society: Washington, DC, USA, 2007; pp. 621–627. [Google Scholar]
  45. Chen, S.; Moore, J.L.; Turnbull, D.; Joachims, T. Playlist prediction via metric embedding. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD’12, Beijing, China, 12–16 August 2012; pp. 714–722. [Google Scholar]
  46. Hidasi, B.; Tikk, D. General factorization framework for context-aware recommendations. Data Min. Knowl. Discov. 2016, 30, 342–371. [Google Scholar] [CrossRef]
  47. Rendle, S.; Freudenthaler, C.; Schmidt-Thieme, L. Factorizing personalized Markov chains for next-basket recommendation. In Proceedings of the 19th International Conference on World Wide Web, WWW 2010, Raleigh, NC, USA, 26–30 April 2010; pp. 811–820. [Google Scholar]
  48. Goth, G. Deep or shallow, NLP is breaking out. Commun. ACM 2016, 59, 13–16. [Google Scholar] [CrossRef]
  49. Zhang, S.; Yao, L.; Sun, A.; Tay, Y. Deep Learning Based Recommender System: A Survey and New Perspectives. ACM Comput. Surv. 2019, 52, 5:1–5:38. [Google Scholar] [CrossRef]
  50. Wu, C.; Ahmed, A.; Beutel, A.; Smola, A.J.; Jing, H. Recurrent Recommender Networks. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, WSDM 2017, Cambridge, UK, 6–10 February 2017; pp. 495–503. [Google Scholar]
  51. Yuan, F.; Karatzoglou, A.; Arapakis, I.; Jose, J.M.; He, X. A Simple Convolutional Generative Network for Next Item Recommendation. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, WSDM 2019, Melbourne, Australia, 11–15 February 2019; pp. 582–590. [Google Scholar]
  52. Wu, S.; Tang, Y.; Zhu, Y.; Wang, L.; Xie, X.; Tan, T. Session-Based Recommendation with Graph Neural Networks. In Proceedings of the The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, Honolulu, HI, USA, 27 January–1 February 2019; pp. 346–353. [Google Scholar]
  53. Wang, S.; Hu, L.; Cao, L.; Huang, X.; Lian, D.; Liu, W. Attention-Based Transactional Context Embedding for Next-Item Recommendation. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, LA, USA, 2–7 February 2018; pp. 2532–2539. [Google Scholar]
  54. Tang, J.; Belletti, F.; Jain, S.; Chen, M.; Beutel, A.; Xu, C.; Chi, E.H. Towards Neural Mixture Recommender for Long Range Dependent User Sequences. In Proceedings of the World Wide Web Conference, WWW 2019, San Francisco, CA, USA, 13–17 May 2019; pp. 1782–1793. [Google Scholar]
  55. Adomavicius, G.; Tuzhilin, A. Context-Aware Recommender Systems. In Recommender Systems Handbook; Ricci, F., Rokach, L., Shapira, B., Kantor, P.B., Eds.; Springer: Berlin/Heidelberg, Germany, 2011; pp. 217–253. [Google Scholar]
  56. Wilson, E. Corpora as Expert Knowledge Domains: The Oxford Advanced Learner’s Dictionary. In Database and Expert Systems Applications, 4th International Conference, DEXA’93, Prague, Czech Republic, 6–8 September 1993, Proceedings; Marík, V., Lazanský, J., Wagner, R.R., Eds.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 1993; Volume 720, pp. 428–435. [Google Scholar]
  57. Webster, M. Merriam-Webster. 2006. Available online: https://www.docketalarm.com/cases/PTAB/IPR2013-00342/Inter_Partes_Review_of_U.S._Pat._8323060/11-21-2014-Board/Exhibit-3001-Exhibit_3001/ (accessed on 1 July 2020).
  58. Lieberman, H.; Selker, T. Out of context: Computer systems that adapt to, and learn from, context. IBM Syst. J. 2000, 39, 617–632. [Google Scholar] [CrossRef]
  59. Hong, J.; Suh, E.; Kim, S. Context-aware systems: A literature review and classification. Expert Syst. Appl. 2009, 36, 8509–8522. [Google Scholar] [CrossRef]
  60. Schilit, B.N.; Theimer, M.M. Disseminating active map information to mobile hosts. Netw. IEEE 1994, 8, 22–32. [Google Scholar] [CrossRef]
  61. del Carmen Rodríguez-Hernández, M.; Ilarri, S.; Lado, R.T.; Hermoso, R. Location-Aware Recommendation Systems: Where We Are and Where We Recommend to Go. In Proceedings of the Workshop on Location-Aware Recommendations, LocalRec 2015, Co-Located with the 9th ACM Conference on Recommender Systems (RecSys 2015), Vienna, Austria, 19 September 2015; Volume 1405, pp. 1–8. [Google Scholar]
  62. Baltrunas, L.; Amatriain, X. Towards time-dependant recommendation based on implicit feedback. In Proceedings of the Third ACM Conference on Recommender Systems; ACM: New York, NY, USA, 2009. [Google Scholar]
  63. Daly, E.M.; Haahr, M. Social Network Analysis for Information Flow in Disconnected Delay-Tolerant MANETs. IEEE Trans. Mob. Comput. 2009, 8, 606–621. [Google Scholar] [CrossRef]
  64. Shi, Y.; Larson, M.A.; Hanjalic, A. Collaborative Filtering beyond the User-Item Matrix: A Survey of the State of the Art and Future Challenges. ACM Comput. Surv. 2014, 47, 3:1–3:45. [Google Scholar] [CrossRef]
  65. Agarwal, D.; Chen, B. Regression-based latent factor models. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Paris, France, 28 June–1 July 2009; IV, J.F.E., Fogelman-Soulié, F., Flach, P.A., Zaki, M.J., Eds.; ACM: New York, NY, USA, 2009; pp. 19–28. [Google Scholar]
  66. Koenigstein, N.; Dror, G.; Koren, Y. Yahoo! music recommendations: Modeling music ratings with temporal dynamics and item taxonomy. In Proceedings of the 2011 ACM Conference on Recommender Systems, RecSys 2011, Chicago, IL, USA, 23–27 October 2011; Mobasher, B., Burke, R.D., Jannach, D., Adomavicius, G., Eds.; ACM: New York, NY, USA, 2011; pp. 165–172. [Google Scholar]
  67. Moshfeghi, Y.; Piwowarski, B.; Jose, J.M. Handling data sparsity in collaborative filtering using emotion and semantic based features. In Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, 25–29 July 2011; Ma, W., Nie, J., Baeza-Yates, R., Chua, T., Croft, W.B., Eds.; ACM: New York, NY, USA, 2011; pp. 625–634. [Google Scholar]
  68. Kwak, H.; Lee, C.; Park, H.; Moon, S.B. What is Twitter, a social network or a news media? In Proceedings of the 19th International Conference on World Wide Web, WWW 2010, Raleigh, NC, USA, 26–30 April 2010; Rappa, M., Jones, P., Freire, J., Chakrabarti, S., Eds.; ACM: New York, NY, USA, 2010; pp. 591–600. [Google Scholar]
  69. Konstas, I.; Stathopoulos, V.; Jose, J.M. On social networks and collaborative recommendation. In Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, 19–23 July 2009; Allan, J., Aslam, J.A., Sanderson, M., Zhai, C., Zobel, J., Eds.; ACM: New York, NY, USA, 2009; pp. 195–202. [Google Scholar]
  70. Robu, V.; Halpin, H.; Shepherd, H. Emergence of consensus and shared vocabularies in collaborative tagging systems. TWEB 2009, 3, 14:1–14:34. [Google Scholar] [CrossRef]
  71. Tso-Sutter, K.H.L.; Marinho, L.B.; Schmidt-Thieme, L. Tag-aware recommender systems by fusion of collaborative filtering algorithms. In Proceedings of the 2008 ACM Symposium on Applied Computing (SAC), Fortaleza, Brazil, 16–20 March 2008; Wainwright, R.L., Haddad, H., Eds.; ACM: New York, NY, USA, 2008; pp. 1995–1999. [Google Scholar]
  72. Cheng, Z.; Caverlee, J.; Lee, K. You are where you tweet: A content-based approach to geo-locating twitter users. In Proceedings of the 19th ACM Conference on Information and Knowledge Management, CIKM 2010, Toronto, ON, Canada, 26–30 October 2010; Huang, J., Koudas, N., Jones, G.J.F., Wu, X., Collins-Thompson, K., An, A., Eds.; ACM: New York, NY, USA, 2010; pp. 759–768. [Google Scholar]
  73. Davidson, J.; Liebald, B.; Liu, J.; Nandy, P.; Vleet, T.V.; Gargi, U.; Gupta, S.; He, Y.; Lambert, M.; Livingston, B.; et al. The YouTube video recommendation system. In Proceedings of the 2010 ACM Conference on Recommender Systems, RecSys 2010, Barcelona, Spain, 26–30 September 2010; Amatriain, X., Torrens, M., Resnick, P., Zanker, M., Eds.; ACM: New York, NY, USA, 2010; pp. 293–296. [Google Scholar]
  74. Adomavicius, G.; Mobasher, B.; Ricci, F.; Tuzhilin, A. Context-Aware Recommender Systems. AI Mag. 2011, 32, 67–80. [Google Scholar] [CrossRef]
  75. Böhmer, M.; Hecht, B.; Schöning, J.; Krüger, A.; Bauer, G. Falling asleep with Angry Birds, Facebook and Kindle: A large scale study on mobile application usage. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, Stockholm, Sweden, 30 August–2 September 2011; ACM: New York, NY, USA, 2011; pp. 47–56. [Google Scholar] [CrossRef]
  76. Hussain, A. Cognitive Computation: An Introduction. Cogn. Comput. 2009, 1, 1–3. [Google Scholar] [CrossRef]
  77. Gutierrez-Garcia, J.O.; lopez neri, E. Cognitive Computing: A Brief Survey and Open Research Challenges. In Proceedings of the 2015 3rd International Conference on Applied Computing and Information Technology/2nd International Conference on Computational Science and Intelligence, Okayama, Japan, 12–16 July 2015. [Google Scholar] [CrossRef]
  78. Brasil, L.M.; de Azevedo, F.M.; Barreto, J.M. Hybrid expert system for decision supporting in the medical area: Complexity and cognitive computing. Int. J. Med. Inform. 2001, 63, 19–30. [Google Scholar] [CrossRef]
  79. Fortino, G.; Guerrieri, A.; Russo, W.; Savaglio, C. Integration of agent-based and Cloud Computing for the smart objects-oriented IoT. In Proceedings of the IEEE 18th International Conference on Computer Supported Cooperative Work in Design, CSCWD 2014, Taiwan, China, 21–23 May 2014; Hou, J., Trappey, A.J.C., Wu, C., Chang, K., Liao, C., Shen, W., Barthès, J.A., Luo, J., Eds.; IEEE: Piscataway, NJ, USA, 2014; pp. 493–498. [Google Scholar]
  80. Bhati, R.; Prasad, S. Open domain question answering system using cognitive computing. In Proceedings of the 2016 6th International Conference-Cloud System and Big Data Engineering (Confluence), Noida, India, 14–15 January 2016; pp. 34–39. [Google Scholar] [CrossRef]
  81. Hossain, M.S. Patient State Recognition System for Healthcare Using Speech and Facial Expressions. J. Med. Syst. 2016, 40, 272:1–272:8. [Google Scholar] [CrossRef]
  82. Zhang, Y. GroRec: A Group-Centric Intelligent Recommender System Integrating Social, Mobile and Big Data Technologies. IEEE Trans. Serv. Comput. 2016, 9, 786–795. [Google Scholar] [CrossRef]
  83. Ziani, A.; Azizi, N.; Schwab, D.; Aldwairi, M.; Chekkai, N.; Zenakhra, D.; Cheriguene, S. Recommender System Through Sentiment Analysis. In Proceedings of the International Conference on Automatic Control, Telecommunications and Signals, Annaba, Algeria, 11–12 December 2017. [Google Scholar]
  84. García-Crespo, Á.; Chamizo, J.; Rivera, I.; Mencke, M.; Palacios, R.C.; Gómez-Berbís, J.M. SPETA: Social pervasive e-Tourism advisor. Telemat. Inform. 2009, 26, 306–315. [Google Scholar] [CrossRef]
  85. Schiaffino, S.N.; Amandi, A. Building an expert travel agent as a software agent. Expert Syst. Appl. 2009, 36, 1291–1299. [Google Scholar] [CrossRef]
  86. Burke, R.D.; Hammond, K.J.; Young, B.C. Knowledge-Based Navigation of Complex Information Spaces. In Proceedings of the Thirteenth National Conference on Artificial Intelligence and Eighth Innovative Applications of Artificial Intelligence Conference, AAAI 96, IAAI 96, Portland, OR, USA, 4–8 August 1996; Clancey, W.J., Weld, D.S., Eds.; AAAI Press/The MIT Press: Cambridge, MA, USA, 1996; Volume 1, pp. 462–468. [Google Scholar]
  87. Chen, Z.; Meng, X.; Zhu, B.; Fowler, R.H. WebSail: From On-line Learning to Web Search. Knowl. Inf. Syst. 2002, 4, 219–227. [Google Scholar] [CrossRef]
  88. Billsus, D.; Pazzani, M.J. User Modeling for Adaptive News Access. User Model. User-Adapt. Interact. 2000, 10, 147–180. [Google Scholar] [CrossRef]
  89. Adomavicius, G.; Tuzhilin, A. Expert-Driven Validation of Rule-Based User Models in Personalization Applications. Data Min. Knowl. Discov. 2001, 5, 33–58. [Google Scholar] [CrossRef]
  90. Cortes, C.; Fisher, K.; Pregibon, D.; Rogers, A. Hancock: A language for extracting signatures from data streams. In Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Boston, MA, USA, 20–23 August 2000; Ramakrishnan, R., Stolfo, S.J., Bayardo, R.J., Parsa, I., Eds.; ACM: New York, NY, USA, 2000; pp. 9–17. [Google Scholar]
  91. Yakhchi, S.; Beheshti, A.; Ghafari, S.M.; Orgun, M.A. Enabling the Analysis of Personality Aspects in Recommender Systems. arXiv 2020, arXiv:2001.04825. [Google Scholar]
  92. Ghafari, S.M.; Yakhchi, S.; Beheshti, A.; Orgun, M.A. SETTRUST: Social Exchange Theory Based Context-Aware Trust Prediction in Online Social Networks. In Data Quality and Trust in Big Data—5th International Workshop, QUAT 2018, Held in Conjunction with WISE 2018, Dubai, UAE, 12–15 November 2018; Hacid, H., Sheng, Q.Z., Yoshida, T., Sarkheyli, A., Zhou, R., Eds.; Revised Selected Papers; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2018; Volume 11235, pp. 46–61. [Google Scholar]
  93. Morita, M.; Shinoda, Y. Information Filtering Based on User Behavior Analysis and Best Match Text Retrieval; Springer: London, UK, 1994. [Google Scholar]
  94. Aldhahri, E.; Shandilya, V.; Shiva, S.G. Towards an Effective Crowdsourcing Recommendation System: A Survey of the State-of-the-Art. In Proceedings of the 2015 IEEE Symposium on Service-Oriented System Engineering, SOSE 2015, San Francisco, CA, USA, 30 March–3 April 2015; pp. 372–377. [Google Scholar]
  95. Meehan, K.; Lunney, T.; Curran, K.; McCaughey, A. Context-aware intelligent recommendation system for tourism. In Proceedings of the 2013 IEEE International Conference on Pervasive Computing and Communications Workshops, PERCOM 2013 Workshops, San Diego, CA, USA, 18–22 March 2013; pp. 328–331. [Google Scholar]
  96. Lin, C.; Xie, R.; Li, L.; Huang, Z.; Li, T. PRemiSE: Personalized news recommendation via implicit social experts. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management, CIKM’12, Maui, HI, USA, 29 October–2 November 2012; Chen, X., Lebanon, G., Wang, H., Zaki, M.J., Eds.; ACM, 2012; pp. 1607–1611. [Google Scholar]
  97. Yuen, M.; King, I.; Leung, K. Task Matching in Crowdsourcing. In Proceedings of the 2011 IEEE International Conference on Internet of Things (iThings) & 4th IEEE International Conference on Cyber, Physical and Social Computing (CPSCom), Dalian, China, 19–22 October 2011; pp. 409–412. [Google Scholar]
  98. Beheshti, A.; Benatallah, B.; Nouri, R.; Tabebordbar, A. CoreKG: A Knowledge Lake Service. Proc. VLDB Endow. 2018, 11, 1942–1945. [Google Scholar] [CrossRef]
  99. González-Carrasco, I.; Palacios, R.C.; Cuadrado, J.L.L.; García-Crespo, Á.; Ruíz-Mezcua, B. PB-ADVISOR: A private banking multi-investment portfolio advisor. Inf. Sci. 2012, 206, 63–82. [Google Scholar] [CrossRef]
  100. Beheshti, A.; Benatallah, B.; Nouri, R.; Chhieng, V.M.; Xiong, H.; Zhao, X. CoreDB: A Data Lake Service. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, CIKM 2017, Singapore, 6–10 November 2017; pp. 2451–2454. [Google Scholar]
  101. Tabebordbar, A.; Beheshti, A.; Benatallah, B.; Barukh, M.C. Adaptive Rule Adaptation in Unstructured and Dynamic Environments. In Web Information Systems Engineering—WISE 2019—20th International Conference, Hong Kong, China, 26–30 November 2019, Proceedings; Cheng, R., Mamoulis, N., Sun, Y., Huang, X., Eds.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2019; Volume 11881, pp. 326–340. [Google Scholar] [CrossRef]
  102. Tabebordbar, A.; Beheshti, A. Adaptive rule monitoring system. In Proceedings of the 1st International Workshop on Software Engineering for Cognitive Services, SE4COG@ICSE 2018, Gothenburg, Sweden, 27–28 May 2018; pp. 45–51. [Google Scholar]
  103. Beheshti, S.; Benatallah, B.; Motahari-Nezhad, H.R. Scalable graph-based OLAP analytics over process execution data. Distrib. Parallel Databases 2016, 34, 379–423. [Google Scholar] [CrossRef]
  104. Beheshti, S.; Benatallah, B.; Motahari Nezhad, H.R.; Allahbakhsh, M. A Framework and a Language for On-Line Analytical Processing on Graphs. In Web Information Systems Engineering—WISE 2012—13th International Conference, Paphos, Cyprus, 28–30 November 2012. Proceedings; Wang, X.S., Cruz, I.F., Delis, A., Huang, G., Eds.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2012; Volume 7651, pp. 213–227. [Google Scholar] [CrossRef]
  105. Narayanan, A.; Chandramohan, M.; Venkatesan, R.; Chen, L.; Liu, Y.; Jaiswal, S. graph2vec: Learning distributed representations of graphs. arXiv 2017, arXiv:1707.05005. [Google Scholar]
  106. Goldberg, Y.; Levy, O. word2vec Explained: Deriving Mikolov et al.’s negative-sampling word-embedding method. arXiv 2014, arXiv:1402.3722. [Google Scholar]
  107. Beheshti, S.; Tabebordbar, A.; Benatallah, B.; Nouri, R. On Automating Basic Data Curation Tasks. In Proceedings of the 26th International Conference on World Wide Web Companion, Perth, Australia, 3–7 April 2017; pp. 165–169. [Google Scholar]
  108. He, R.; McAuley, J.J. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. In Proceedings of the 25th International Conference on World Wide Web, WWW 2016, Montreal, QC, Canada, 11–15 April 2016; pp. 507–517. [Google Scholar]
  109. McAuley, J.J.; Targett, C.; Shi, Q.; van den Hengel, A. Image-based Recommendations on Styles and Substitutes. arXiv 2015, arXiv:1506.04757. [Google Scholar]
  110. Burger, J. Introduction to Personality; Scott Foresman and Company: Glenview, IL, USA, 2011. [Google Scholar]
  111. Funder, D. Personality; W. W. Norton & Company: New York, NY, USA, 2001; pp. 197–221. [Google Scholar]
  112. Costa, P.; McCrae, R. Domains and Facets: Hierarchical Personality Assessment Using the Revised NEO Personality Inventory. J. Personal. Assess. 1995, 64, 21–50. [Google Scholar] [CrossRef] [PubMed]
  113. Cantador, I.; Fernández-Tobías, I.; Bellogín, A. Relating Personality Types with User Preferences in Multiple Entertainment Domains. In Late-Breaking Results, Project Papers and Workshop Proceedings of the 21st Conference on User Modeling, Adaptation, and Personalization, Rome, Italy, 10–14 June 2013; Volume 997. [Google Scholar]
  114. Wang, C.; Blei, D.M. Collaborative topic modeling for recommending scientific articles. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, CA, USA, 21–24 August 2011; pp. 448–456. [Google Scholar]
  115. Roshchina, A.; Cardiff, J.; Rosso, P. Evaluating the Similarity Estimator component of the TWIN Personality-based Recommender System. In Proceedings of the Eighth International Conference on Language Resources and Evaluation, LREC 2012, Istanbul, Turkey, 23–25 May 2012; pp. 4098–4102. [Google Scholar]

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.