Next Article in Journal
Efficient Load Balancing for Blockchain-Based Healthcare System in Smart Cities
Next Article in Special Issue
STEAM Education and the Innovative Pedagogies in the Intelligence Era
Previous Article in Journal
Method for Compensating Aberrations of a Virtual Image Formed by an Augmented Reality Display Based on a Cylindrical Diffractive Waveguide
Previous Article in Special Issue
A Novel Method for Cross-Modal Collaborative Analysis and Evaluation in the Intelligence Era
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Course Recommendation Based on Enhancement of Meta-Path Embedding in Heterogeneous Graph

1
School of Computer Science, South China Normal University, Guangzhou 510631, China
2
School of Information Technology in Education, South China Normal University, Guangzhou 510631, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Appl. Sci. 2023, 13(4), 2404; https://doi.org/10.3390/app13042404
Submission received: 31 October 2022 / Revised: 9 February 2023 / Accepted: 10 February 2023 / Published: 13 February 2023
(This article belongs to the Special Issue STEAM Education and the Innovative Pedagogies in the Intelligence Era)

Abstract

:
The main reason students drop out of online courses is often that they lose interest during learning. Moreover, it is not easy for students to choose an appropriate course before actually learning it. Course recommendation is necessary to address this problem. Most existing course recommendation methods depend on the interaction result (e.g., completion rate, grades, etc.). However, the long period required to complete a course, especially large-scale online courses in higher education, can lead to serious sparsity of interaction results. In view of this, we propose a novel course recommendation method named HGE-CRec, which utilizes context formation for heterogeneous graphs to model students and courses. HGE-CRec develops meta-path embedding simulation and meta-path weight fusion to enhance the meta-path embedding set, which can expand the learning space of the prediction model and improve the representation ability of meta-path embedding, thereby avoiding tedious manual setting of the meta-path and improving the effectiveness of the resulting recommendations. Extensive experiments show that the proposed approach has advantages over a number of existing baseline methods.

1. Introduction

In recent ten years the growth rate of distance education has been impressive, enabling students from all over the world to study courses at low cost. Many distance learning platforms, such as Coursera and edX, provide a large number of online courses and attract millions of registered users. The goal of users (students) is to master knowledge through course learning. The ongoing surge in the number of courses requires effective recommendation methods to help learners find suitable courses [1]. The recommendation accuracy is very important in regard to improving the service quality of online course platforms [2,3].
The purpose of course learning is to master new knowledge or improve the level of mastery of previously learned knowledge. Course learning is different from reading or browsing news, newsletters, and documents. The learning process is continuous (usually a semester), and the interactive objects (e.g., teacher, course video, subject) are diverse. For example, a higher education course on the XuetangX platform (xuetangx.com), e.g., Introduction to Machine Learning, lasts for 12 weeks and has 6–7 sections per week, while Introduction to Psychology is a 12-week course with 5–7 sections per week. Another example can be found in higher education courses on the edX (edx.org) platform, such as Big Data and Education, each of which are 8 weeks long and require 6–12 h per week. The Architectural Imagination course takes 10 weeks and 3–5 h per week. However, massive online course resources place students in danger of becoming lost in the large amount of information present at any time during the learning process [1]. In addition, the diversity of interactive objects enables relationships between students and students, students and courses, and courses and courses, even if these relationships are indirect or potential. The network in the real world is complex, with maany different elements affecting each other.
The traditional methods of modeling the real world with homogeneous networks neglect the impact of multi-source heterogeneous elements, while heterogeneous graphs (abbr. HG) have proved to be an effective method for modeling graph structures composed of multiple entities and relationships [4,5]. The advantage of HG is that it fully and intuitively uses the heterogeneous network structure in the dataset [6]. However, the main disadvantage is that it needs to manually design the meta-path, which is difficult to achieve optimally in real practice. Unfortunately, most existing methods do not solve these problems.
Faced with the aforementioned problems and issues, in this paper we propose a course recommendation method based on an enhancement of HG meta-path embedding (abbr. HGE-CRec). First, we use the skip-gram algorithm to generate the original meta-path embedding. Then, Graph Convolutional Networks (abbr. GCN) are utilized to generate simulated meta-path embedding based on the construction of the original meta-paths, enriching the dataset used for HG meta-path embedding. Third, we adopt a Graph Attention Network (abbr.GAT) to aggregate the neighboring node information of each node on the meta-path in order to enrich the semantics of node embedding. Fourth, a nonlinear method is adopted to fuse all information in order to enhance the node embedding of the meta-paths. Finally, the enhanced embedding is combined with a Matrix Factorization-based model to predict ratings for students and courses. We compare and analyze HGE-CRec with other existing Matrix Factorization-based recommendation models using two real-world online course datasets and two general open datasets dealing with HIN embedding-based recommendation research.
In brief, the contributions of this paper can be summarized based on the following three perspectives:
  • We propose a novel course recommendation method based on heterogeneous graph embedding, and our experiments prove that the performance of this method is better than existing methods.
  • We propose a novel solution for enhancing the embedding of the meta-path in HG.
  • Extensive experiments on four real-world datasets demonstrate the effectiveness of the proposed approach. In addition, we show that the proposed approach can maintain good performance even in the absence of meta-path data.
The rest of this paper is organized as follows. We briefly review related works in Section 2. In Section 3, we introduce preliminaries and important notation. In Section 4, we describe the framework and implementation of HGE-CRec. The extensive experimental studies we conducted are described in Section 5. Finally, we provide our conclusions in Section 6.

2. Related Work

In this section, we first review related research about course recommendation. Then, we define and explain the meaning of exercise difficulty and revisit existing methods for predicting exercise difficulty.

2.1. Course Recommendation System

In the educational domain, personalized learning recommender system have been a research hotspot. Traditional recommendation methods have applications in personalized course recommendation, such as content-based filtering [7,8], collaborative filtering [9,10], and Hybrid-based course recommendation systems [11]. Due to the hierarchical structure of knowledge concepts in curricula, research into ontology-based course recommendations [1,12,13] have received extensive attention. Generally, an administrator is required to operate an operational course recommender system. The administrator can adjust the algorithm parameters to generate more accurate learning log-based recommendations, monitor user feedback on the courses recommended by the system, and adjust the algorithm parameters according to actual situation to ensure the normal operation of the system. Traditional recommendation methods mostly come from the field of e-commerce. They regard courses as commodities, students as customers, and course learning behaviors as commodity purchase behaviors. However, course selection behavior is essentially different from commodity purchase behavior. When comparing learning content to movies or books, the cognitive state of the student and the learning content may change over time and context [14,15,16]. Learning a course generally takes a relatively long period of time, and constantly consumes students’ attention and energy. In addition, students intend to achieve good grades through a course, which strongly affects students’ level of satisfaction towards the course. Furthermore, due to changes in their level of knowledge mastery, students’ preference for courses is not persistent; that is, after completing a course and mastering relevant knowledge, their preference for courses with similar knowledge concepts decreases. Student satisfaction with a course should not be equated with preference, as course recommendation methods based on student preference have certain limitations. In [17], the authors pointed out that student satisfaction with course learning is significantly affected by teachers, course content, curriculum, and grades. Recently, the satisfaction of students has become an important factor in research on course recommendation. In [18], course recommendation based on learning performance prediction was proposed. A number of course recommendation methods focus on the characteristics and behavior data of students in the learning system. For example, [19] proposed a recommendation method for learning objects based on the integration of social signals, interests, and learner user preferences in an e-learning system. The authors of [20] proposed a course recommender system that uses extracted rules to find suitable courses according to student behaviors and preferences. In [21], a path that satisfies students’ limited time while maximizing their grades is used to make lesson-by-lesson recommendations. Similar to other recommendation systems, course recommendation systems must face the cold start problem, meaning that it is difficult to recommend courses for new students. The literature [22] points out that when there are insufficient data in one domain and relatively rich data in another, transfer learning can be used to overcome the cold-start problem when the two domains are explicitly or implicitly related. In addition, with sufficient data from the source domain, transfer learning and collaborative filtering can be used in combination to extract knowledge in order to improve the accuracy of recommendations in the target domain [23].

2.2. Heterogeneous Information Network Embedding-Based Recommendation

In natural and social systems, interacting components form interconnected networks, which can be referred to as complex information networks. These networks are homogeneous, containing the same type of objects and links; however, most real systems contain multiple types of interacting components, and as such can be modeled as heterogeneous information networks (abbr. HIN). HIN consist of multiple types of nodes and links, and have been proposed as a powerful information modeling method [24] able to naturally model complex objects and their rich relations. Figure 1 shows the HIN of two course datasets. HIN embedding, which aims to embed multiple types of nodes into a low-dimensional space, has received growing attention as well. Heterogeneous information networks can naturally model complex objects and their rich relations in recommender systems, as in such systems objects are of different types and links among objects represent different relations. In [25], the authors propose an approach to evaluate the similarity of items or users in HIN. In [26], the authors proposed an MF-based recommendation method that uses the entity similarity calculated on a heterogeneous information network based on a meta-path algorithm. In [27], a collaborative filtering method on a weighted heterogeneous information network was proposed. This method is constructed by connecting users and items with the same rating. It can flexibly integrate heterogeneous information to make recommendations through weighted meta-paths and weighted integration methods. In order to take full advantage of the relationship heterogeneity in information networks, the authors of [28] introduced metapath-based latent features to represent the connectivity between users and items along different types of paths. The network embedding approach is more resistant to sparse and noisy data. Considerable research has been done on representation learning for HIN. Broadly speaking, the existing works on HIN embedding can be categorized into four types: random walk-based methods, decomposition-based methods, deep neural network-based methods, and task-specific methods. In [6], an HIN embedding-based approach for recommendation was proposed. In [29], the authors exploited the attention-guided walk model in a heterogeneous information network to selectively sample discriminative attributes and representative explanation meta-paths to explain the recommendations.

3. Preliminary

The term Heterogeneous Graph is used uniformly in the descriptions in this paper. Because the graph structure means that it contains more comprehensive information and rich semantics, it has been widely used in many data mining tasks. In this section, we first introduce several definitions used in this article, including the HG and the meta-path of the HG. Then, we illustrate the working process of performance prediction using meta-path embedding. Several important notations are listed in Table 1, and we present a more detailed explanation of their role in this context.
Definition 1
(Heterogeneous Graph). (1) Given a graph G = { V , E } , where V and E are the node set and relation set, respectively, if there is a mapping function ϕ ( · ) of node type and a mapping function θ ( · ) of edge type which map the nodes v V and edges e E to the specific types A and C, respectively, then this type graph is a heterogeneous graph. (2) If | A | + | C | > 1 , then G is a heterogeneous graph and G = { A , C } is called heterogeneous graph (abbr. HG) schema. The schematic of a heterogeneous graph of a course is shown in Figure 1.
Definition 2
(Meta-path of HG). A meta-path is defined as a sub-path that links two different nodes in a heterogeneous graph. In this study, a meta-path is denoted as a path in the form of B 1 C 1 B 2 C 2 C l B l which describes a composite relation C = C 1 C 2 C l between entity B 1 and B i + 1 , where ∘ denotes the composition operator on relations.
Definition 3
(Reciprocal Relationship of HG Embedding). Given the HG embedding of a course, denoted by c , and a student, denoted by s , the reciprocal relationship between them is an interactive module Θ, e.g., R = Θ ( c , s ) , where R is the representation of the interactive result.

4. Proposed Approach for Course Recommendation

In this section, we propose a novel method for course recommendation based on HG meta-path embedding. For simplicity, in the following presentation we use the short name “HGE-CRec” for our proposed method. The framework of HGE-CRec is shown in Figure 2. As shown in the figure, HGE-CRec is a triple-layer architecture model that takes students’ ratings of each course as the output. The first layer is named the Meta-path Embedding Layer (MEL), the second layer is named the Embedding Weight Aggregation Layer (EWAL), and the third layer is named the Matrix Factorization based Prediction Layer (MFPL). The MEL generates meta-path embeddings for heterogeneous graphs and employs a GCN to simulate more meta-path embeddings. The EWAL employs GAT to aggregate neighbor node embeddings and concatenate them with the original embeddings. The MFPL uses a matrix factorization framework to predict students’ ratings on courses. The details of MEL, EWAL, and MFPL are illustrated in Section 4.1, Section 4.2 and Section 4.3.

4.1. Meta-Path Embedding Layer

4.1.1. Original Meta-Path Embedding

This module is used to generate the embedding of nodes on meta-paths of the heterogeneous graph. For this task, the meta-paths of the heterogeneous graph are generally sampled first, then the nodes on the sampled meta-paths are embedded. This module uses a meta-path based Deep Walk (abbr. MDK) to generate node embedding on each meta-path. MDK combines the random walk and word2vec algorithms. First, the heterogeneous graph is sampled and filtered for node sequences of various meta-paths, then the skip-gram algorithm in word2vec is used to map the node sequences into low-dimensional space:
R ( n t + 1 = y | n t = x , P ) = 1 | N A t + 1 ( x ) | , ( x , y ) E , Φ ( y ) = A t + 1 0 , ( x , y ) E , Φ ( y ) A t + 1 0 , ( x , y ) E
where n t represents the t-th node of the walk, x is a set of the node type which includes A t , | N A t + 1 ( x ) | represents the number of nodes with node type A t + 1 among the neighbors of node x, and R ( n t + 1 = y | n t = x , P ) represents the probability for a given node x of selecting a node y which represents the constraints of meta-path P. This regular sampling can ensure uniform sampling of various heterogeneous types of nodes under the constraint of the meta-path P to obtain the node sequence X = [ x 1 , x 2 , x 3 , , x n ] of various meta-paths. Next, in order to improve the training efficiency of meta-path nodes, we filter X, that is, we keep nodes of the same type as the starting node, map nodes of the same type to the same space, form a new homogeneous node sequence X ^ , and then pass embedding methods to generate embedded representations of the filtered nodes.
Next, the skip-gram algorithm is used to generate node embeddings of x ^ . The skip-gram algorithm adopts the principle of similarity of adjacent nodes, uses the central node to predict the context node, and obtains the embedding of the target node after continuous iterative optimization. Skip-gram is a three-layer network structure consisting of an input layer, hidden layer, and output layer. It first generates a node sequence according to the size of the window, then takes the central node of the sequence as input and continuously maximizes the occurrence probability of its neighbor nodes, and finally obtains the embeddings of all nodes. The optimization objective of this algorithm is as follows:
L = m a x f u V l o g P r ( N u | f ( u ) ) ,
where f is a function that maps each node u to a d-dimensional space vector, e.g., f = V R d , u is the current node, N u is the neighbor node of the u node obtained through the meta-path, and Stochastic Gradient Descent is used to optimize L.

4.1.2. Simulated Meta-Path Embedding

Using the method in the previous section, the embeddings generated under each meta-path in the heterogeneous graph can be obtained. In order to gather more neighbor information to improve the learning effect of node feature representation, this module uses GCN to aggregate the information of neighbor nodes to generate more meta-path node embeddings. As Figure 2 shows, a GCN model inside M E L is used to achieve this task; that is, more meta-path node embeddings are simulated by using GCN to aggregate neighbor embeddings for the node embeddings of the initial meta-path, thereby generating new node embeddings. The schematic of this process is shown in Figure 3.
For a heterogeneous graph G = ( V , E ) , M a denotes an adjacency matrix of G generated from the set of filtered meta-path sampling sequences X ^ ; M a is added as an identity matrix I for extension, e.g., M a = M a + I . Then, we have a matrix D
D i i = j M i j a ,
where D denotes a diagonal matrix of the node degree. Then, the GCN is used to generate the embeddings of the simulated meta-path following the process in Equation (3):
e ^ P = s o f t m a x ( D 1 2 M a D 1 2 L e a k y R e L U ( D 1 2 M a D 1 2 e P W 0 P ) W 1 P ) ,
where e ^ P denotes the simulated meta-path embeddings, e P denotes the original ones, and W 0 P and W 1 P represent the trainable weight matrix.

4.2. Embedding Weight Aggregation Layer

4.2.1. Aggregation of Meta-Path Embedding Based on Attention Mechanism

In order to aggregate the neighbor information of each node, EWAL adopts a GAT mechanism to update the embedding representation of each node to form a new node embedding vector. For each meta-path embedding, including the original meta-path embedding and the simulated meta-path embedding, Equation (4) can be used to generate a new node embedding for each node under each meta-path:
t v , j ( l ) = L e a k y R e L U ( η ( l ) T · [ W ( l ) e v ( l ) | | W ( l ) e j ( l ) ] ) ,
where e v ( l ) represents the embedding of node v under the l-th meta-path, t v , j ( l ) represents the contribution of features of neighbor j to node v under the l-th meta-path, η ( l ) T represents the attention parameter vector under the lth meta-path, W ( l ) represents the trainable weight matrix, and | | represents the splicing operation between vectors. Then, we can use Equation (5) for normalization:
a i , j ( l ) = e x p ( t v j ( l ) ) k = 1 k N v e x p ( t v k ( l ) )
After the weighted average of the neighborhood features of node v is obtained according to contribution a i , j ( l ) , a nonlinear conversion function σ is added to obtain the new features of node v, i.e., e ˜ v ( l ) . Equation (6) shows this process:
e ˜ v ( l ) = σ ( j N v a v j ( l ) W ( l ) e j ( l ) )
In order to better learn the correlation between nodes and neighbors, the module uses the multi-header attention mechanism to perform K times attention operations, then splices the K times of the results, as shown in Equation (7):
e ˜ v ( l ) ( K ) = | | k = 1 K σ ( j N v [ a v j ( l ) ] k [ W ( l ) ] k e j ( l ) ) ,
where [ a v j ( l ) ] k represents the normalized neighbor contribution weight to node v on the k attention header under the l meta-path, and [ W ( l ) ] k represents the trainable weight matrix on the k attention header under the l meta-path.
In order to retain the embedded information before and after updating the node, the embedded information before and after the update is spliced, meaning that the final embedded dimension after splicing is twice the previously embedded dimension. Both the user node and the project node need to undergo graph attention network aggregation embedding.
The framework of GAT Embedding is shown in Figure 4.

4.2.2. Fusion of Meta-Path Embedding

Next, we use nonlinear depth fusion method to fuse all of the different kinds of embedded information of the meta-path into the embedded information targeted at a single node. This embedding fusion transformation can transform the embedding into a more appropriate form, improving the recommendation performance.
With a node v V , we can find the embedded representation set of v nodes { e v ( l ) } l = 1 | Γ | , where Γ is a set of meta-paths that include the original meta-paths and the simulated meta-paths, and e v ( l ) represents the embedded information of node v under meta-path l. Taking the user node as an example, the nonlinear depth fusion function M ( · ) provided below can be used to fuse the embedded information of each user node u, as shown in Equation (8):
M ( { e u ( l ) } ) = σ ( l = 1 | Γ | W u ( l ) σ ( M ( l ) e u ( l ) + b ( l ) ) ) ,
where M ( l ) R D × d is the conversion matrix under path l, b ( l ) R D is the offset vector under path l, and W u ( l ) is the preference weight of user v under meta-path l. The function σ ( · ) is a nonlinear function. Here, the sigmoid function is used. For the fusion of embedded information of project nodes, a fusion method consistent with the embedded information of the user nodes is adopted. The algorithm for enhancing meta-path embedding is shown in Algorithm 1.
Algorithm 1: Algorithm for enhancing meta-path embedding
    Input: the heterogeneous graph G; the adjacency matrix M a ; the meta-path sets P ( U ) for users and P ( I ) for items.
    Output: the enhanced meta-path embedding set of users and items: { e u ( l ) } l | Γ ( U ) | , { e i ( l ) } l | Γ ( I ) | .
1:
Get original meta-path embedding sets { e i ( l ) } l | P ( I ) | and { e u ( l ) } l | P ( U ) | of G by using skip-gram
2:
for e i ( l ) in { e i ( l ) } l | P ( I ) |  do
3:
    e ˜ i ( l ) G C N ( e i ( l ) , M a ) . {Equation (3)}
4:
    Γ ( I ) { e i ( l ) , e ˜ i ( l ) } . {Get a set including two types meta-path embedding.}
5:
end for
6:
for e ¯ i ( l ) in Γ ( I )  do
7:
    t i , j ( l ) G A T ( e ¯ i ( l ) , e ¯ j ( l ) ) . { e ¯ j ( l ) is the embedding of the neighbor node j. Equation (4)}
8:
    a i , j ( l ) n o r m a l i z e ( t i , j ( l ) ) . {Equation (5)}
9:
    e ^ i ( l ) F ( a i , j ( l ) , e j ( l ) ) . {Equation (6), Equation (7)}
10:
    e i ( l ) C o n ( e i ( l ) , e ^ i ( l ) ) . Update e i ( l ) by connecting e ^ i ( l ) .
11:
end for
12:
for e u ( l ) in { e u ( l ) } l | P ( U ) |  do
13:
    e ˜ u ( l ) G C N ( e u ( l ) , M a ) . {Equation (3)}
14:
    Γ ( I ) { e u ( l ) , e ˜ u ( l ) } . {Get a set including two types meta-path embedding.}
15:
end for
16:
for e ¯ u ( l ) in Γ ( U )  do
17:
    t u , j ( l ) G A T ( e ¯ u ( l ) , e ¯ j ( l ) ) . { e ¯ j ( l ) is the embedding of the neighbor node j. Equation (4)}
18:
    a u , j ( l ) n o r m a l i z e ( t u , j ( l ) ) . {Equation (5)}
19:
    e ^ u ( l ) F ( a u , j ( l ) , e j ( l ) ) . {Equation (6), Equation (7)}
20:
    e u ( l ) C o n ( e u ( l ) , e ^ u ( l ) ) . Update e u ( l ) by connecting e ^ u ( l ) .
21:
end for
22:
return { e u ( l ) } l | Γ ( U ) | , { e i ( l ) } l | Γ ( I ) | .

4.3. Matrix Factorization-Based Prediction Layer

The MFPL module uses Matrix Factorization to predict the grade of students on courses. The HGE-CRec model proposed in this paper combines HG meta-path embedding with Matrix Factorization, and further combines the embedded vectors of users u and items i obtained from MEL and EWAL into the Matrix Factorization model. The prediction process of the rating is shown in Eqution (9):
r ^ u , i = u u T · v i + α · e u T · γ i + β · γ u T · e i ,
where r ^ u , i , u, and i belong to the rating matrix R , e u is the embedding of the user after merging the embedding vectors of different meta-paths, and e i is the embedding of the item after merging the embedding vectors of different meta-paths, that is, the result of merging function M ( · ) in Equation (8). In order to keep the form consistent, the hidden factors γ i and γ u are introduced to multiply the embedding vectors e u and e i , respectively, while α and β are adjustable parameters.
In order to provide the model with better generalization ability and prevent overfitting, regular constraints can be added to the loss function. For modeling scenarios of heterogeneous information networks, heterogeneous regular terms need to be added. The final optimization goal is shown in Eqution (10):
= < u , i , r u , i > R ( r u , i r ^ u , i ) 2 + λ u ( U u 2 + V i 2 + γ u 2 + γ i 2 + E u 2 + E i 2 ) ,
where r ^ u , i is the prediction score calculated using Equation (9), λ is the regularization parameter, E u is the parameter set of the function M ( · ) for users, and E i is the parameter set of the function M ( · ) for items. The model training uses Gradient Descent to obtain the partial derivative, then updates the variables according to the direction of the negative gradient. After multiple iterations, the low-dimensional matrix is updated continuously until the algorithm finally converges; the parameters of Equation (10) are updated according to the following formula:
U u U u η ( ( r u , i r ^ u , i ) V i + λ U U u )
E u , l E u , l η ( α ( r u , i r ^ u , i ) γ u ( U ) + λ E E u , l ) ,
V i V i η ( ( r u , i r ^ u , i ) U u + λ V V i )
E i , l E i , l η ( α ( r u , i r ^ u , i ) γ i ( I ) + λ E E i , l ) ,
e i ( l ) E i , l = W i ( l ) σ ( X a ) σ ( X f ) ( 1 σ ( X a ) ) ( 1 σ ( X f ) ) e i ( l ) , E = M ; W i ( l ) σ ( X a ) σ ( X f ) ( 1 σ ( X a ) ) ( 1 σ ( X f ) ) , E = b ; σ ( X a ) σ ( X f ) ( 1 σ ( X a ) ) , E = W ,
The algorithm for training HGE-CRec is shown in Algorithm 2.
Algorithm 2: HGE-CRec training algorithm
    Input: the heterogeneous graph G; the adjacency matrix M a ; the rating matrix R ; the adjustable parameters α , β ; the regularization parameter λ ; the learning rate coefficients for integrating embedding features; the enhanced meta-path embedding sets { e u ( l ) } l | Γ ( U ) | for users and { e i ( l ) } l | Γ ( I ) | for items.
    Output:  r ^ u , i , the users and items feature matrices U and V; the weights of users and items HG embedding; the weights of feature interaction matrix and; the parameters in the fusion function of embedding
1:
Get enhanced meta-path embedding sets { e u ( l ) } l | Γ ( U ) | and { e i ( l ) } l | Γ ( I ) | by using Algorithm 1
2:
Initialize U , V , γ ( U ) , γ ( I ) , E u , E i by standard normal distribution;
3:
while termination criterion is not satisfied do
4:
    r u , i Randomly select a tuple < u , i > R
5:
   Update U u and V i by a typical MF model;
6:
   for  e u ( l ) in Γ ( U )  do
7:
      ( U ) e u ( l ) E u , l {Equation (15)};
8:
     Update E u , l by Equation (12);
9:
   end for
10:
   Update γ u ( U ) by Equation (11);
11:
   for  e i ( l ) in Γ ( I )  do
12:
      ( I ) e i ( l ) E i , l {Equation (15)};
13:
     Update E i , l by Equation (14);
14:
   end for
15:
   Update γ i ( I ) by Equation (13);
16:
end while
17:
return U , V , γ ( U ) , γ ( I ) , E u , E i

5. Experiments

In this section, we conduct extensive experimental studies to verify the effectiveness and advantages of our approach. To this end, we compare the recommendation performance produced by HGE-CRec with several baselines on four datasets.

5.1. Datasets

In order to verify the effective of our proposed approach, the experiments are carried on four real datasets: two large-scale online courses datasets, Scholat and CNPC, and two other datasets, Yelp and Movielens, which are commonly used in research on HIN embedding-based recommendation. CNPC, Yelp, and Movielens are public datasets. Table 2 presents statistical information about the nodes and relationships in these datasets.
  • Scholat
    This dataset is from a real academic social course platform (scholat.com) which provides courses offered by Chinese universities, including undergraduate and graduate courses. The courses involve computer science, economics, pedagogy, and other disciplines. The student profiles include the school, grade, major, courses learned, etc. The dataset used in our experiment contains 3168 courses, 150,563 users, and 1,237,485 course visit records for the 2020–2021 academic year. The frequency of students’ attendance of courses represents information about student interest in the course. In this experiment, we scaled the attendance frequency to an interval.
  • This dataset consists of the Canvas Network Open Course (canvas.net), which hosts open online courses, including Massive Open Online Courses (MOOCs) that are freely available to participants around the world. The dataset used in our experiments is from January 2014 to September 2015, including 224,914 users and 238 courses as well as various attribute information on users’ social relations, forums, users, and courses. The courses include ten disciplines, e.g., mathematics, statistics, and education.
  • Yelp (https://www.yelp.com/dataset/documentation/main, accessed on 30 September 2022)
    This dataset comes from the largest merchant rating website in the United States, yelp.com. The dataset records user ratings of merchants, the users’ social relationship, and attribute information on users and merchants, including 16,239 users, 14,282 merchants, and 198,397 ratings.
  • Movielens (http://files.grouplens.org/datasets/movielens/ml-100k-README.txt, accessed on 30 September 2022)
    The Movielens dataset is a classic movie recommendation dataset from movielens.org. Movielens-100k was selected for this experiment. This dataset has 943 users, 1682 movies, and 100,000 scores, and contains social relationship and attribute information between users and movies.
For the proposed model, the interactive data between students and courses is the most important. In addition, we are concerned about the characteristics that are conducive to the formation of the rich meta-paths from datasets, such as course type and teacher or student school and type. Based on the statistical analysis in Table 2, we defined the meta-paths in all four datasets, as shown in Table 3.

5.2. Experimental Setup

In this subsection, we first clarify the implementation details of the experimental setup used for HGE-CRec. Then, we introduce the comparison baselines and evaluation metrics used in the experiments.

5.2.1. Baselines

This experiment selects three baseline methods to carry out comparative experiments with the proposed approach: PMF, SoMF, and HERec.
  • PMF [30]: This is a recommended algorithm for classical probability matrix factorization models which decomposes the scoring matrix into two low-dimensional matrices.
  • SoMF [31]: In this algorithm, social relations have the characteristics of social regularization items, helping to integrate social relations into basic recommendations in the matrix factorization model.
  • HERec [6]: This classical recommendation algorithm based on heterogeneous information network embedding adopts the random walk strategy based on the meta-path to generate the embedding, then integrates the embedded fusion into the matrix factorization model for recommendation.

5.2.2. Evaluation Metrics

This experiment selects two indicators commonly used in research on recommendation systems, namely, the Mean Absolute Error (MAE) and Root Mean Square Error (RMSE), as the evaluation indicators of the model. MAE and RMSE calculate the prediction accuracy by calculating the deviation between the predicted user score and the actual user score. The smaller the MAE and RMSE, the higher the recommendation quality.
The MAE can be expressed by Equation (16):
M A E = 1 | D t e s t | ( i , j ) D t e s t | r i , j r ^ i , j | .
The RMSE can be expressed by Equation (17):
R M S E = 1 | D t e s t | ( i , j ) D t e s t ( r i , j r ^ i , j ) 2 .
where r i , j is the real rating of item j by user i, r ^ i , j is the predicted score of user i on item j, and D t e s t is the test set of the scoring records.

5.3. Results of the Comparative Experiment

This subsection illustrates the comparative experimental results using the proposed approach and baseline methods on four datasets.
For each dataset, the preference (or score) record data are divided into a training set and a test set. For the Scholat, CNPC, and Movielens datasets, four training segmentation ratios are set, namely, 80%, 60%, 40%, and 20%; For the Yelp dataset, because it is more sparse than the other three datasets, four larger training ratios are set, namely, 90%, 80%, 70%, and 60%. For each ratio, teen evaluation sets are randomly generated, then the results are averaged to the final results, which as shown in Table 4, Table 5, Table 6 and Table 7.
Table 4, Table 5, Table 6 and Table 7 show a comparison of the two indicators, MAE and RMSE, with respect to the recommended results using the proposed approach and baseline methods on the four datasets.
Figure 5 shows the results on the four datasets in terms of MAE. Compared with the baselines, the line when using HGE-CRec is gentler in terms of MAE as the training ratio changes from 80% to 20%. In other words, the MAE growth of HGE-CRec is lower than the other three baselines. The same can be observed for all of the datasets.
Figure 6 shows the results on the four datasets in terms of RMSE. Compared with the baselines, the line when using HGE-CRec is gentler in terms of RMSE as the training ratio changes from 80% to 20%. In other words, as for MAE, the growth in RMS for EHGE-CRec is lower than for the other three baselines. Again, this can be observed for all of the datasets.
Moreover, from Figure 5 and Figure 6 it can be seen that the experimental results curves of the proposed approach is flat compared to the baselines, indicating that the effectiveness of the proposed approach is more stable than the baselines.

5.4. Ablation Study

In this section, we conduct an ablation study of the proposed approach through two experiments.

5.4.1. Component Adjustment

The first experiment observes the changes in the performance of the various approaches by adjusting the model’s components. The HGE-CRec proposed in this paper uses GCN and GAT to improve the meta-path embedding after generating the original meta-path embedding. The first source of improvement is realized by using GCN to generate the simulated meta-path embedding, which enhances the meta-path embedding and expands the range of sample feature distribution. The second improvement is to use GAT to aggregate the various kinds of meta-path embedding based on neighbor weights. In order to explore the effect of these two improvements on the model, an ablation study of the component was set up using the following models for comparison:
  • HGE-CRec G C N
    Only the first part of the HGE-CRec model’s meta-path embedding is improved, that is, while GCN is used to generate analog meta-path embedding, GAT is not used to aggregate various kinds of meta-path embedding based on neighbor weight.
  • HGE-CRec G A T
    Only the second part of the HGE-CRec model’s meta-path embedding is improved, that is, while GAT is used to aggregate the original meta-path embedding based on the neighbor weights, GCN is not used to generate simulated meta-path embeddings.
The training ratio was uniformly 80%. The experimental results of the above models on the four datasets are shown in Table 8.
It can be seen from the experimental results that HGE-CRec G C N has the weakest effect, which means that only the first part of the improvement has no significant impact on the model; slight jitter is observed during the training process, with a slight increase or decrease. This further indicates that, based on the premise of there being sufficient of original meta-path embeddings, more analog meta-path embeddings are generated by aggregating neighborhood information, and there is little improvement on the model. That is, when meta-path embedding reaches a sufficient amount, saturation occurs and it is of little significance to add meta-path embedding. The effect of HGE-CRec G A T is significantly improved, showing that the improvement in the second part has a good impact on the model. Furthermore, this shows that using GAT to aggregate the neighbor embedding information of each node based on weight can effectively improve the performance of the model. That is, by learning the influence weight of different neighbors on nodes in the meta-path, the node representation can be enriched and the accuracy of prediction can be improved.

5.4.2. Meta-Path Embedding Adjustment

From the above component adjustment experiment, it can be observed that the effect of the first source of model improvement does not result in a significant effect. Our analysis indicates that the reason for this is that the embedding of the selected meta-path from the dataset becomes saturated. In order to verify this hypothesis, the simulation experiment described in this section was designed to simulate whether the GCN can simulate the embedding of meta-paths in the case of insufficient meta-paths in the dataset (i.e., the embedding of meta-paths is not saturated), expand the range of feature distribution for the meta-paths embedded in the sample, and improve the recommendation effect. The design of the analog element path ablation experiment is described below.
Assuming that each dataset only provides one meta-path, a comparative experiment was conducted to investigate whether GCN can be used to simulate the embedding of meta-paths without considering the weight aggregation of GAT embedding. This experiment adopted a unified meta-path; the type of meta-path was User-Item-User and the training rate was 80%. The model that does not use GCN to simulate the embedding of meta-paths is named HGE-CRec N o n e O n e M P , the model embedded by GCN analog meta-path is named HGE-CRec G C N O n e M P , and the results of the analog element path ablation experiment for the four datasets are shown in Table 9.
The results of this experiment verify that in the case of insufficient meta-paths the use of a graph convolution network to aggregate neighbor information to generate more analog meta-path embedding can improve the experimental results. The method of adding small sample data to GCN can generate more embedded data for recommendation, improving the accuracy of small-sample training data in the final recommendation process. This further shows that the HGE-CRec proposed in this paper can be applied to datasets with insufficient meta-paths. In addition, the traditional predefined meta-path depends on the manual definition provided by researchers. In order to find a better predefined meta-path, a large number of experiments need to be carried out. HGE-CRec effectively expands the range of the feature distribution of the meta-path embedding sample by using GCN to generate more simulated meta-path embedding. For cases with only a small number of meta-paths, the best effect that can be achieved by manually predefined meta-paths can be obtained. From this point of view, the proposed model is conducive to relieving the complexity and uncertainty of manually predefined meta-paths.

6. Conclusions

This paper proposes a course recommendation model, HGE-CRec, based on heterogeneous graph and Graph Neural Network and adopts a heterogeneous graph approach to model multi-source heterogeneous information in the scenario of course recommendation for distance education. The proposed HGE-CRec model uses GCN and GAT to improve the meta-path embedding process in HG. Specifically, after using the skip-gram algorithm to generate the original meta-path embeddings, GCN is used to generate new embeddings to simulate more meta-path embeddings, effectively expanding the range of feature distribution of the meta-path embedded samples. Next, GAT is used to learn the neighborhood contribution degree, aggregate the neighbor embedding information of nodes, and obtain the node embedding vector with importance semantics. The node embedding vectors of different meta-paths are weighted nonlinearly and aggregated to form the low dimensional embedding vectors of each node, and the recommendation is implemented under the framework of matrix decomposition.
Data sparsity is a difficult problem in large-scale online course recommendation. The model proposed in this paper uses a heterogeneous graph structure to represent online course learning and expands the relationship domain of entities (e.g., students, courses) through the meta-paths, thereby alleviating the problem of data sparsity. This work can expand recommendation methods for large-scale online courses from a local perspective to a global perspective, providing a reference for further optimization of online course platforms. On the whole, our proposed model fully considers the different contributions of different neighbors and distinguishes the weight of different neighbor embeddings in order to better model the heterogeneous graph and improve the recommendation effect. Moreover, traditional meta-path generation methods rely on researchers manually predefining the meta-path. In order to find a better meta-path, repeated experiments need to be carried out. Using graph convolution network to generate new embeddings for simulation of more meta-paths might be a good way to solve this problem, as defining only a few meta-paths can already achieve a better effect than that achieved by manually predefining the meta-path. In this way, the problem of tedious and uncertain manual adjustment of predefined meta-paths can be solved. In our future work, we intend to make our model more flexible and extensible. For example, by considering the prevalence of streaming education as a global trend [32], this model can be adjusted to recommend interdisciplinary and cross-domain courses by adding attribute variables to generate meta-paths in the model. In addition, the extension of our framework into an advanced version with further consideration of the multi-modal information of courses and the social network behavior of learners [33] could potentially enrich the knowledge concept representation.

Author Contributions

Conceptualization, Z.W. and Z.Z.; Software, Q.L.; Data curation, Q.L.; Writing—original draft, Z.W. and Q.L.; Writing—review and editing, Z.Z.; Funding acquisition, Z.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This work is supported by the National Natural Science Foundation of China (62277018; 62237001), the China Ministry of Education Project in the Humanities and Social Sciences (22YJC880106), and the Major Project in the Social Sciences of South China Normal University (ZDPY2208).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Li, Y.; Chen, D.; Zhan, Z. Research on personalized recommendation of MOOC resources based on ontology. Interact. Technol. Smart Educ. 2022, 19, 422–440. [Google Scholar] [CrossRef]
  2. Lin, Y.; Feng, S.; Lin, F.; Zeng, W.; Liu, Y.; Wu, P. Adaptive course recommendation in MOOCs. Knowl. Based Syst. 2021, 224, 107085. [Google Scholar] [CrossRef]
  3. Tian, X.; Liu, F. Capacity Tracing-Enhanced Course Recommendation in MOOCs. IEEE Trans. Learn. Technol. 2021, 14, 313–321. [Google Scholar] [CrossRef]
  4. Zhu, Y.; Lu, H.; Qiu, P.; Shi, K.; Chambua, J.; Niu, Z. Heterogeneous teaching evaluation network based offline course recommendation with graph learning and tensor factorization. Neurocomputing 2020, 415, 84–95. [Google Scholar] [CrossRef]
  5. Wang, C.; Peng, C.; Wang, M.; Yang, R.; Wu, W.; Rui, Q.; Xiong, N.N. CTHGAT: Category-aware and Time-aware Next Point-of-Interest via Heterogeneous Graph Attention Network. In Proceedings of the 2021 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2021, Melbourne, Australia, 17–20 October 2021; pp. 2420–2426. [Google Scholar]
  6. Shi, C.; Hu, B.; Zhao, W.X.; Yu, P.S. Heterogeneous Information Network Embedding for Recommendation. IEEE Trans. Knowl. Data Eng. 2019, 31, 357–370. [Google Scholar] [CrossRef]
  7. Morsomme, R.; Alferez, S.V. Content-based Course Recommender System for Liberal Arts Education. In Proceedings of the 12th International Conference on Educational Data Mining, EDM 2019, Montréal, QC, Canada, 2–5 July 2019. [Google Scholar]
  8. Chau, H.; Barria-Pineda, J.; Brusilovsky, P. Content Wizard: Concept-Based Recommender System for Instructors of Programming Courses. In Proceedings of the Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization, UMAP 2017, Bratislava, Slovakia, 9–12 July 2017; pp. 135–140. [Google Scholar]
  9. Li, X.; Li, X.; Tang, J.; Wang, T.; Zhang, Y.; Chen, H. Improving Deep Item-Based Collaborative Filtering with Bayesian Personalized Ranking for MOOC Course Recommendation. In Proceedings of the Knowledge Science, Engineering and Management-13th International Conference, KSEM 2020, Hangzhou, China, 28–30 August 2020; Proceedings, Part I. Li, G., Shen, H.T., Yuan, Y., Wang, X., Liu, H., Zhao, X., Eds.; Springer: Berlin/Heidelberg, Germany, 2020; Volume 12274, pp. 247–258. [Google Scholar]
  10. Madani, Y.; Erritali, M.; Bengourram, J.; Sailhan, F. Social Collaborative Filtering Approach for Recommending Courses in an E-learning Platform. In Proceedings of the 10th International Conference on Ambient Systems, Networks and Technologies (ANT 2019)/The 2nd International Conference on Emerging Data and Industry 4.0 (EDI40 2019)/Affiliated Workshops, Leuven, Belgium, 29 April–2 May 2019; Shakshuki, E.M., Yasar, A., Eds.; Elsevier: Amsterdam, The Netherlands, 2019; Volume 151, pp. 1164–1169. [Google Scholar]
  11. Chang, P.; Lin, C.; Chen, M. A Hybrid Course Recommendation System by Integrating Collaborative Filtering and Artificial Immune Systems. Algorithms 2016, 9, 47. [Google Scholar] [CrossRef]
  12. Ibrahim, M.E.; Yang, Y.; Ndzi, D.L.; Yang, G.; Al-Maliki, M. Ontology-Based Personalized Course Recommendation Framework. IEEE Access 2019, 7, 5180–5199. [Google Scholar] [CrossRef]
  13. Huang, C.; Chen, R.; Chen, L. Course-recommendation system based on ontology. In Proceedings of the International Conference on Machine Learning and Cybernetics, ICMLC 2013, Tianjin, China, 14–17 July 2013; pp. 1168–1173. [Google Scholar]
  14. George, G.; Lal, A.M. Review of ontology-based recommender systems in e-learning. Comput. Educ. 2019, 142, 103642. [Google Scholar] [CrossRef]
  15. Núñez-Valdéz, E.R.; Lovelle, J.M.C.; Martínez, O.S.; García-Díaz, V.; de Pablos, P.O.; Marín, C.E.M. Implicit feedback techniques on recommender systems applied to electronic books. Comput. Hum. Behav. 2012, 28, 1186–1193. [Google Scholar] [CrossRef]
  16. Tong, Y.; Zhan, Z. An evaluation model based on procedural behaviors for predicting MOOC learning performance: Students’ online learning behavior analytics and algorithms construction. Interact. Technol. Smart Educ. 2023, 1, 1–22. [Google Scholar] [CrossRef]
  17. Hew, K.F.; Hu, X.; Qiao, C.; Tang, Y. What predicts student satisfaction with MOOCs: A gradient boosting trees supervised machine learning and sentiment analysis approach. Comput. Educ. 2020, 145, 103724. [Google Scholar] [CrossRef]
  18. Huang, L.; Wang, C.; Chao, H.; Lai, J.; Yu, P.S. A Score Prediction Approach for Optional Course Recommendation via Cross-User-Domain Collaborative Filtering. IEEE Access 2019, 7, 19550–19563. [Google Scholar] [CrossRef]
  19. da Silveira Dias, A.; Wives, L.K. Recommender system for learning objects based in the fusion of social signals, interests, and preferences of learner users in ubiquitous e-learning systems. Pers. Ubiquitous Comput. 2019, 23, 249–268. [Google Scholar] [CrossRef]
  20. Dahdouh, K.; Oughdir, L.; Dakkak, A.; Ibriz, A. Smart Courses Recommender System for Online Learning Platform. In Proceedings of the 5th IEEE International Congress on Information Science and Technology, CiSt 2018, Marrakech, Morocco, 21–27 October 2018; pp. 328–333. [Google Scholar]
  21. Nabizadeh, A.H.; Gonçalves, D.; Gama, S.; Jorge, J.A.; Rafsanjani, H.N. Adaptive learning path recommender approach using auxiliary learning objects. Comput. Educ. 2020, 147, 103777. [Google Scholar] [CrossRef]
  22. Lu, J.; Behbood, V.; Hao, P.; Zuo, H.; Xue, S.; Zhang, G. Transfer learning using computational intelligence: A survey. Knowl. Based Syst. 2015, 80, 14–23. [Google Scholar] [CrossRef]
  23. Zhang, Q.; Wu, D.; Lu, J.; Liu, F.; Zhang, G. A cross-domain recommender system with consistent information transfer. Decis. Support Syst. 2017, 104, 49–63. [Google Scholar] [CrossRef]
  24. Shi, C.; Li, Y.; Zhang, J.; Sun, Y.; Yu, P.S. A Survey of Heterogeneous Information Network Analysis. IEEE Trans. Knowl. Data Eng. 2017, 29, 17–37. [Google Scholar] [CrossRef]
  25. Shi, C.; Kong, X.; Huang, Y.; Yu, P.S.; Wu, B. HeteSim: A General Framework for Relevance Measure in Heterogeneous Networks. IEEE Trans. Knowl. Data Eng. 2014, 26, 2479–2492. [Google Scholar] [CrossRef]
  26. Yu, X.; Ren, X.; Sun, Y.; Sturt, B.; Khandelwal, U.; Gu, Q.; Norick, B.; Han, J. Recommendation in heterogeneous information networks with implicit user feedback. In Proceedings of the 7th ACM International Conference on Recommender Systems, Hong Kong, China, 12–16 October 2013; pp. 347–350. [Google Scholar]
  27. Shi, C.; Zhang, Z.; Luo, P.; Yu, P.S.; Yue, Y.; Wu, B. Semantic Path based Personalized Recommendation on Weighted Heterogeneous Information Networks. In Proceedings of the 24th ACM International Conference on Information and Knowledge Management, CIKM 2015, Melbourne, Australia, 19–23 October 2015; pp. 453–462. [Google Scholar]
  28. Yu, X.; Ren, X.; Sun, Y.; Gu, Q.; Sturt, B.; Khandelwal, U.; Norick, B.; Han, J. Personalized entity recommendation: A heterogeneous information network approach. In Proceedings of the 7th ACM International Conference on Web Search and Data Mining, New York, NY, USA, 24–28 February 2014; pp. 283–292. [Google Scholar]
  29. Wang, X.; Wang, Y.; Ling, Y. Attention-Guide Walk Model in Heterogeneous Information Network for Multi-Style Recommendation Explanation. In Proceedings of the 34th AAAI Conference on Artificial Intelligence, New York, NY, USA, 7–12 February 2020; pp. 6275–6282. [Google Scholar]
  30. Salakhutdinov, R.; Mnih, A. Probabilistic Matrix Factorization. In Proceedings of the 21st Advances in Neural Information Processing Systems, Vancouver, BC, Canada, 3–6 December 2007; pp. 1257–1264. [Google Scholar]
  31. Ma, H.; Zhou, D.; Liu, C.; Lyu, M.R. Recommender systems with social regularization. In Proceedings of the 4th International Conference on Web Search and Web Data Mining, Hong Kong, China, 9–12 February 2011; pp. 287–296. [Google Scholar]
  32. Zhan, Z.; Shen, W.; Xu, Z.; Niu, S.; You, G. A bibliometric analysis of the global landscape on STEM education (2004–2021): Towards global distribution, subject integration, and research trends. Asia Pac. J. Innov. Entrep. 2022, 16, 171–203. [Google Scholar] [CrossRef]
  33. Zhan, Z.; Mei, H.; Liang, T.; Huo, L.; Bonk, C.; Hu, Q. A longitudinal study into the effects of material incentives on knowledge-sharing networks and information lifecycles in an online forum. Interact. Learn. Environ. 2021, 3, 1–14. [Google Scholar] [CrossRef]
Figure 1. Network schemas of heterogeneous information networks for the two course datasets.
Figure 1. Network schemas of heterogeneous information networks for the two course datasets.
Applsci 13 02404 g001
Figure 2. Framework of HGE-CRec.
Figure 2. Framework of HGE-CRec.
Applsci 13 02404 g002
Figure 3. Schematic of GCN simulated embedding.
Figure 3. Schematic of GCN simulated embedding.
Applsci 13 02404 g003
Figure 4. Framework of GAT Embedding.
Figure 4. Framework of GAT Embedding.
Applsci 13 02404 g004
Figure 5. Comparison of MAE with the change in the training rate on four datasets.
Figure 5. Comparison of MAE with the change in the training rate on four datasets.
Applsci 13 02404 g005
Figure 6. Comparison of RMSE with the change in the training rate on four datasets.
Figure 6. Comparison of RMSE with the change in the training rate on four datasets.
Applsci 13 02404 g006
Table 1. Important notations used in this paper.
Table 1. Important notations used in this paper.
NotationDescription
G = ( V , E ) The heterogeneous graph
AThe set of the types of node
PA meta-path
Γ The set of the meta-path
A t The type of node t
| N A t ( v ) | The number of nodes of type A t in the neighbor of node v.
M a An adjacency matrix of HG.
e ( l ) A node embedding on the l meta-path.
e u ( U ) , e i ( I ) The finally embedding of user u and item i.
r ^ u , i The rating predicted by user u on item i.
u u , v i The potential factors for user u and item i
Table 2. Statistics for nodes and relationships in the datasets.
Table 2. Statistics for nodes and relationships in the datasets.
DatasetsRelations (A-B)Number (A)Number (B)Number (A-B)
Student-Course25,293167053,988
Student-Unit_of_study150,5635753150,563
ScholatStudent-Research_field150,5636458150,563
Course-School31683443168
Course-Type3168133168
Course-Teacher316810607846
User-Course224,914238325,199
User-Learner_type32,719732,719
CNPCUser-Age224,9144224,914
Course-Discipline23810238
Course-Course_length23879238
User-Business16,23914,284198,397
User-User10,58010,580158,590
YelpUser-Compliment14,4111176,875
Business-City14,2674714,267
Business-Category14,18051140,009
User-Movie9431682100,000
User-User94394347,150
MovielensUser-Occupation94321943
User-Age9438943
Movie-Movie1682168282,798
Movie-Genre1682182891
Table 3. Meta-paths of the four datasets.
Table 3. Meta-paths of the four datasets.
ScholatCNPCYelpMovielens
S-C-S, C-S-C,
S-C-Te-C-S,
C-Te-C, C-Ty-C,
S-C-Ty-C-S,
S-C-Sc-C-S,
C-Sc-C
U-C-U, C-U-C,
U-C-D-C-U,
C-D-C,
U-C-Co-C-U,
C-Co-C
U-B-U, B-U-B,
U-B-Ci-B-U,
B-Ci-B,
U-B-Ca-B-U,
B-Ca-B
U-M-U, M-U-M,
U-M-G-M-U,
M-G-M,
M-M,
U-M-M-U
Table 4. Results on Scholat.
Table 4. Results on Scholat.
Training RateMetricsPMFSoMFHERecHGE-CRec
80%MAE0.47320.46850.4529 0.4435
RMSE0.71990.70870.6596 0.6294
60%MAE0.50230.48320.4627 0.4486
RMSE0.76930.73030.6908 0.6516
40%MAE0.57580.50900.4801 0.4608
RMSE0.89880.77480.7185 0.6683
20%MAE0.83020.58560.5677 0.5516
RMSE1.41990.80480.7866 0.6976
Table 5. Results on CNPC.
Table 5. Results on CNPC.
Training RateMetricsPMFSoMFHERecHGE-CRec
80%MAE0.89980.90740.8775 0.8658
RMSE1.22541.22931.1666 1.1361
60%MAE0.91240.92480.8843 0.8695
RMSE1.25041.25631.1761 1.1374
40%MAE0.93350.95850.8955 0.8754
RMSE1.29341.30921.1928 1.1403
20%MAE1.05041.02360.9156 0.8805
RMSE1.40531.44651.2273 1.1428
Table 6. Results on Yelp.
Table 6. Results on Yelp.
Training RateMetricsPMFSoMFHERecHGE-CRec
90%MAE1.04121.00950.8395 0.7723
RMSE1.42681.33921.0907 0.9787
80%MAE1.07911.03730.8475 0.7804
RMSE1.48161.37821.1117 0.9884
70%MAE1.11701.06940.8580 0.7817
RMSE1.53871.42011.1256 0.9899
60%MAE1.17781.11350.8759 0.7853
RMSE1.61671.47481.1488 0.9928
Table 7. Results on Movielens.
Table 7. Results on Movielens.
Training RateMetricsPMFSoMFHERecHGE-CRec
80%MAE0.73240.72890.7103 0.6992
RMSE0.98620.98510.9274 0.8980
60%MAE0.74630.74500.7181 0.7041
RMSE1.01211.01120.9369 0.8998
40%MAE0.76610.77840.7293 0.7104
RMSE1.05421.06500.9536 0.9033
20%MAE0.85270.84510.7495 0.7179
RMSE1.16411.14230.9881 0.9086
Table 8. Results of ablation study on component adjustment.
Table 8. Results of ablation study on component adjustment.
DatasetMetricsHGE-CRec GCN HGE-CRec GAT HGE-CRec
ScholatMAE0.45280.44350.4435
RMSE0.65980.62950.6294
CNPCMAE0.87750.86580.8658
RMSE1.16671.13621.1361
YelpMAE0.84790.78070.7804
RMSE1.11110.98800.9884
MovielensMAE0.71030.69920.6992
RMSE0.92720.89810.8980
Table 9. Results of meta-path embedding enhancement.
Table 9. Results of meta-path embedding enhancement.
DatasetsMetricsHGE-CRec None OneMP HGE-CRec GCN OneMP
ScholatMAE0.45590.4533
RMSE0.67190.6604
CNPCMAE0.88080.8795
RMSE1.17841.1682
YelpMAE0.88040.8529
RMSE1.16071.1283
MovielensMAE0.71360.7112
RMSE0.93600.9298
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wu, Z.; Liang, Q.; Zhan, Z. Course Recommendation Based on Enhancement of Meta-Path Embedding in Heterogeneous Graph. Appl. Sci. 2023, 13, 2404. https://doi.org/10.3390/app13042404

AMA Style

Wu Z, Liang Q, Zhan Z. Course Recommendation Based on Enhancement of Meta-Path Embedding in Heterogeneous Graph. Applied Sciences. 2023; 13(4):2404. https://doi.org/10.3390/app13042404

Chicago/Turabian Style

Wu, Zhengyang, Qingyu Liang, and Zehui Zhan. 2023. "Course Recommendation Based on Enhancement of Meta-Path Embedding in Heterogeneous Graph" Applied Sciences 13, no. 4: 2404. https://doi.org/10.3390/app13042404

APA Style

Wu, Z., Liang, Q., & Zhan, Z. (2023). Course Recommendation Based on Enhancement of Meta-Path Embedding in Heterogeneous Graph. Applied Sciences, 13(4), 2404. https://doi.org/10.3390/app13042404

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop