A Hyper-Personalized Product Recommendation System Focused on Customer Segmentation: An Application in the Fashion Retail Industry

Abstract

Providing the right products, at the right place and time, according to their customer’s preferences, is a problem-seeking solution, especially for companies operating in the retail industry. This study presents an integrated product RS that combines various data mining techniques with this motivation. The proposed approach consists of the following steps: (1) customer segmentation; (2) adding the location dimension and determining the association rules; (3) the creation of product recommendations. We used the RFM technique for customer segmentation and the k-means clustering algorithm to create customer segments with customer-based RFM values. Then, the Apriori algorithm, one of the association rule mining algorithms, is used to create accurate rules. In this way, cluster-based association rules are created. Finally, product recommendations are presented with a rule-based heuristic algorithm. This is the first system that considers customers’ demographic data in the fashion retail industry in the literature. Furthermore, the customer location information is used as a parameter for the first time for the clustering phase of a fashion retail product RS. The proposed systematic approach is aimed at producing hyper-personalized product recommendations for customers. The proposed system is implemented on real-world e-commerce data and compared with the current RSs used according to well-known metrics and the average sales information. The results show that the proposed system provides better values.

1. Introduction

The rapid development of technology and its cheaper and widespread use cause the increase of data in electronic media daily. How these stored data will be interpreted, how and where they will be used, and how to access information are fundamental problems. Such problems lead to the emergence and development of new fields of study. Recommendation Systems (RS) is a new field of study that was put forward in parallel with these developments [1,2,3,4,5].

RSs are information filtering technology that predicts users’ interest and appreciation for an object they have never encountered before, using past interest and appreciation data on products (music, books, movies, etc.) [6,7,8]. RSs are currently being used actively in many sectors, especially in the retail industry. They enable customers to have personalized experiences by offering the right product to the right customer at the right time [1,9,10]. However, the most critical question always arises before the practitioners which product will be recommended to which customer. In this context, no RS application in the literature considers customer demographic data in the fashion retail industry. This situation, that is, the fact that the customer location information was not used as a segmentation parameter in the studies, constitutes the motivation of this study.

The use of demographic information on customers in RSs, especially in the clothing field, may be beneficial in terms of the accuracy of the recommendations. Hyper-personalized systems can be provided by adding information such as the region where the purchase is made or data presenting the customer demographics to the RS [11]. Hyper-personalized systems have uses in the retail field [12]. However, its use in the fashion retail industry is limited [13,14]. Existing studies focus on points different from RS and do not use customer location information.

To fill this gap in the literature, this study aims to create a hyper-personalized RS that includes the stages of a basket analysis with the Association Rule Mining (ARM) technique after customers are divided into clusters with RFM segmentation and geolocation data. For this purpose, an RS is established and tested on the actual data of a company operating in the fashion retail industry.

The remainder of this paper is organized as follows. In Section 2, RSs and some techniques used for them are explained, and the studies conducted in the literature are summarized and evaluated. In Section 3, the established RS model is described, and the techniques and methods used within the scope of this model are also explained in the same section. In Section 4, the implementation steps made within the scope of the defined model are presented, and the results of the implementation made within this scope are evaluated. Section 5 includes the general evaluation of the study and recommendations for future studies with the results.

2. Related Work

This section gives general information about the RS and Collaborative Filtering (CF) approach, and studies on the subject are examined.

2.1. Recommendation Systems

RSs are a phenomenon that has been frequently encountered by individuals recently. In their daily lives, people are faced with the decisions of how to spend their time and money at many stages of their lives and which choice will be better for their future. Traditionally, individuals either consult experts in such a decision stage, receive support from third-party software, use the internet, or simply follow the crowd [15]. Since these recommendations are not specific to the person, they often do not work. Here, RSs are a new tool developed to minimize these negativities. RSs are software tools and techniques that enable the recommendation of “objects” that may be of most interest to targeted/designated users [16].

Recommendations and predictions are presented as a result of the RS studies. Evaluation criteria measure the quality of the methods, approaches, and algorithms used to generate these recommendations and predictions. Evaluation criteria enable the comparison of the recommendation lists made by different methods for the same data set and facilitate the selection. Various evaluation measures are frequently used in the literature. These include metrics that measure the accuracy of predictions, such as Mean Absolute Error (MAE), Root of Mean Square Error (RMSE), Normalized Mean Average Error (NMAE), or coverage, such as Precision, Recall, and F1 [17].

RSs assist the customer in product selection, especially in systems or processes where the product range is wide [18]. With increasingly widespread e-commerce sites, the number of users and the amount of data to be managed is increasing. Here, it is difficult to predict the customer’s interest in the big data generated. RSs save the producer from excessive time and labor loss in such cases. In addition to this benefit, RSs provide more diverse product sales and increase customer trust and loyalty.

The RS’s basic flowchart is shown in Figure 1. Here, the User represents many users whose characters, interests, and requests are different. User Profile means the user’s likes, requests, and demographic information, requested during the first registration or obtained using various methods based on the user’s attitudes over time. The User–Item Matrix is the matrix that reflects the users’ opinions about the content in the system. The user fills the item matrix, and the information in this matrix can be requested from the user in different forms (numerical evaluation, verbal evaluation, binary, etc.) [19]. Item information represents the products’ contents, years of manufacture, types, etc.

The development of RS in modern terms has taken place in the last 25 years. RS’s origins go back to a global discussion/exchange system called Usenet [20]. From this system in the late 1970s until 1992, a limited number of studies were conducted, mostly on content filtering.

The primary growth in the literature started at the end of the 1990s. Establishing and publishing the first collaborative RS in Xerox’s research center in Palo Alto in 1992 is the modern beginning of the RS’s literature.

With the widespread use of internet technologies and the development of hardware technologies, there has been an increase in recent studies conducted, thanks to the technological relaxation in data processing. In a search in academic databases with the keyword “recommender system”, there are 1531 records between 1969 and 2005, while there are 30,945 records since 2005. This alone is enough to show the growth momentum in the literature. RSs are generally classified according to their estimation approach [21]. As seen in Figure 2, dividing the RS studies into four main categories is possible.

RSs with a content-based approach are considered one of the topics that are the beginning of information processing [22]. Unlike today’s systems that ignore content information [23], the use of content information has proven to be very helpful in processing and accessing information [24]. User profile and product feature databases are used in content-based approaches. If there is not enough information about the user’s profile, the user’s profile is created using the products that this user has rated in the past. Later, products suitable for this profile are recommended to the user [25,26]. In content-based systems, a result is obtained by comparing the user profile vector and the product properties vector.

The basic flowchart of the content-based approach is given in Figure 3. As can be seen here, if the user does not have a profile created before, the profile of the user is created using the product profile and user-item matrix information.

A new trend began when Goldberg et al. [27] introduced the collaborative approach (CF) as an alternative to the content-based approach [23]. Applications of this technique, new at that time, became popular in product recommendations and achieved commercial success [28].

CF algorithms work according to the logic that similar users have similar interests [29]. Recommendations are made to the user with the data obtained from the active user’s past information and other users’ past information. The more a user’s past evaluations of the products overlap with the previous evaluations of the active user, the more similar that user is to the active user. Users with high similarity with the active user play an active role in determining the interest of the active user in the product in question.

Collaborative RSs can be divided into two general groups [30]: Model-based and Memory-based algorithms. Model-based algorithms create a model using the user-item evaluation matrix when the user is not in the system (offline). When the user logs into the system, they offer recommendations to the user using this previously installed model. Memory-based algorithms generate recommendations for the user by using the entire user-item evaluation matrix while the user is in the system (online).

Like all intelligent systems, RSs use different forms of information [31]. Collaborative approaches only use user reviews for products, while content-based approaches use user profiles and product attribute information. However, there are points where both are advantageous and disadvantageous. Therefore, choosing these approaches may not be the best option in many cases. In knowledge-based approaches developed to fill this gap, users are asked to enter information about the object they want to access. The entered data is converted into product recommendations through Knowledge Bases. This information includes rules for simulating objects and similarity functions.

Hybrid approaches occur when combining two or more recommendation techniques to achieve better performance or overcome problems and constraints one cannot overcome [32]. While RSs with a content-based approach generally operate on product features and textual content, systems with a collaborative approach benefit from user similarities through the user–item evaluation matrix. In RSs with a knowledge-based approach, calculations are made based on the information about the objects; however, each approach encounters problems such as cold start, data sparseness, not working reasonably, etc., in practice. For this reason, many researchers are offered hybrid approaches by combining two or more methods to overcome such problems. Sometimes, hybrid approaches are chosen not to overcome a problem but to increase the algorithm’s accuracy.

2.2. Structure of Collaborative Filtering Algorithms

RSs with a collaborative approach consisting of three different calculation stages. There are various methods at each stage. From combinations of these methods, a whole RS mechanism is obtained. These stages are Similarity Calculation, Neighborhood Choice, and Prediction Calculation. A small change in any of these stages directly affects the quality of the RS. For this reason, many new approaches are presented by both academic and industrial circles for each calculation stage, and some success has been achieved in some performance criteria (accuracy, speed, customization level, etc.).

The first step of the estimation algorithms is to find the weights that express the similarity of the users with the active user [33]. The values found at this stage are the similarities between the active user and other users, but these values are used as the weight of the relevant user in the estimation calculation phase; that is, it determines how much that user will affect the calculation.

Many similarity-finding algorithms are used in RSs using a collaborative approach. Still, the experimental results showed that the Pearson correlation method is better than other similarity-finding methods in user-based RSs [33].

In the neighborhood selection, previously calculated similarities are used to find the closest neighbors to the active user. User-based collaborative approach algorithms work according to the logic that similar users have similar interests and likes. According to this definition, all users calculated to be similar to active users are not included in the calculation.

Two methods are used to reduce the number of neighborhoods and choose the ones most similar to the active user [34]. The first of these methods is to determine a threshold value, and the second is the k-nearest neighbor method. Both of these techniques used in neighborhood selection have some potential problems. These problems have been discussed in sources such as [21,33].

At the prediction calculation step, the similarities of the users with the active user express the weight of that user in the calculation. In other words, the similarity value of a user with the active user determines how much that user will affect the analysis. Simple Average, Weighted Average and Adjusted Weighted Average (AWA) are the most commonly used estimation methods.

The Simple Average is the most straightforward method in which similarity calculations are not considered in the estimation stage. Although this method provides results in a relatively shorter time, the accuracy of the result is compromised. The weighted average is the most common method used in the estimation calculation phase [21]. This method obtains more accurate results since the users’ proximity to the active user is also considered. In the adjusted weighted average, the evaluation habits of the users and how they perceive the evaluation scale are also taken into account [21,35]. The differences from the user average are used in the calculation instead of the actual rating values. For this reason, it is possible to obtain better results than previous methods.

The system proposed in this study also includes application steps similar to CF. However, it has been tried to avoid the disadvantages of CF. Although the Pearson correlation method provides better results, it may not be the best method for finding neighbors and for weighting the neighbors found. Because it might be products that everyone in many areas loves. Similarity metrics such as Pearson do not see it as more valuable to have a match between two users on a controversial product than on a product liked by everyone [15]. Additionally, if the similarity threshold is set too high in neighborhood selection, there may be few or no neighbors for many users, and no predictions can be made for some products.

On the contrary, if the similarity threshold is too low, the estimation quality decreases since active users and users with low similarity will be included in the calculation [21,33]. Similar problems apply to the selection of the k value in the k-nearest neighbor algorithm [15]. These disadvantages are overcome by segmenting the customers with the RFM method and clustering them with k-means and the location data. The Within Clusters Sum of Square (WSS) method is used to determine the k value for k-means. In many approaches, the estimate is calculated by adding and subtracting a value from the user’s average. However, if the user’s standard deviation is high, the added or subtracted value may be small to find the value the user gives to the product or contrary, it may be large. Instead, cluster-based association rules are presented with Association Rule Mining methods using the obtained customer cluster matches. A product recommendation list is created with a rule-based heuristic algorithm.

2.3. Literature Review on the Development of Recommendation Systems

The studies in the RS’s literature have increased since the end of the 1990s and have grown significantly in quantity, especially in the last decade. In this study, various publications made between 1997 and 2022 are examined. Especially in recent years, thanks to the developments in data mining techniques and infrastructure developments that facilitate the analysis of big data, it is seen that the work conducted in this field has increased. The studies examined and their characteristics are presented in Appendix A.

Among these studies, Pazzani & Billsus [36] is essential as it is one of the first studies in this literature. In this study, the authors analyze the content of web pages using user input. In this context, the Naive Bayes Classification method is compared with other methods. In the following years, different approaches were introduced, and various techniques were used to make product recommendations.

The CF approach is one of the most widely used approaches in the literature. In different studies, recommendation lists are created by combining the CF approach with various techniques. Kim et al. [37] proposed an RS using a Collaborative tagging-based CF approach. After the tags are created in this system, it is decided which item to recommend by the Naïve Bayes Classifier method. In the study by Jomaa et al. [38], users are clustered with a user-based collaborative approach. Then, the objects that the users like and that the active user does not consume in the cluster that the user is included in are recommended. Sun et al. [39] use an object-oriented collaborative approach in their study. In the study, products that are probably sold to relevant users later and similar to those that the user has purchased before are recommended. Hwangbo et al. [40] developed an RS that they named K-RecSys. The purpose of the developed system is to expand the object-based CF algorithm used and to combine online and offline sales data. Iwanaga et al. [41] proposed an approach that improves CF algorithms. The study aims to create a high-quality rating matrix using the shape-restricted optimization model. The authors noted that the approach yielded good results even with limited data. Noulapeu Ngaffo et al. [42] developed a CF-based method that uses a combination of various similarity measures. Their experiments show that the newly developed approach outperforms state-of-the-art CF-based methods based on rating and ranking prediction accuracy.

One of the approaches frequently used in the literature is the content-based approach. Zhao et al. [43] used a content-based approach and developed a weight-based item recommendation approach that uses a novel similarity distance to equalize accuracy and computational complexity. Son & Kim [44] proposed a content-based filtering approach using multi-attribute networks for movie recommendation. The authors emphasized that the method they developed was not affected by sparsity, cold start, and over-specialization problems.

New approaches obtained by combining different approaches are called hybrid approaches. Choi et al. [45] developed a hybrid online product RS, integrating CF and sequential model analysis approaches. Li et al. [46] presented a hybrid product RS that considers customer preferences, products’ quality performances, and retailers’ service performances. Cao et al. [47] proposed an RS product based on product attributes and emphasized that this system outperforms the basic methods of sparse data. Cai et al. [48] proposed a hybrid RS mix of the three base RS. The first clustering is done with the k-means algorithm in the system, and three CF approaches are applied. Then, the coefficients are optimized with the hybrid model, and recommendations are presented. Walek & Fojtik [49] introduced an RS that combines CF, content-based, and fuzzy expert systems and provides movie recommendations. M. Li et al. [50] proposed a hybrid RS that combines CF and content-based methods to recommend Q&A documents. Vahidy Rodpysh et al. [51] drew attention to the cold start problem and presented a hybrid model-driven approach that combines similar measurement methods to overcome it. Zhou et al. [52] stated some of the shortcomings of web service RS and developed a hybrid CF model to eliminate these shortcomings. The developed model calculated the similarity with two different Pearson’s correlation coefficient approaches.

In RSs, segmentation or clustering of customers is used to differentiate customer groups exhibiting similar behaviors. Separating these groups makes it possible to present recommendation lists by creating association rules. Ha [53] developed an RS model in which products are clustered, and users’ RFM segments are created. After these processes, ARM was applied to the developed system, and a product recommendation was made. Liu & Shih [54] established two RS models that adopted different approaches to describing clusters. According to the final set, the authors made recommendations to customers using the ARM method. Lee [55] proposed a model that identifies the most valuable 20% of users according to their RFM scores and makes recommendations to these users. Rodrigues & Ferreira [56] calculated the customers’ RFM values and segmented the customers using the k-means method. Afterward, they applied the ARM method and offered N products to users they had not purchased. Rezaeinia & Rahmani [57] developed a model based on customer clustering over RFM segments. However, unlike other studies, they used weighted RFM values in this study. Then, they used the Expectation-Maximization algorithm to create clusters and determine the nearest neighbors by the k-NN algorithm. A song RS is designed in Najafabadi et al. [58] ‘s study. Here, the songs are grouped according to certain features, and the preference level is determined for the users. There are relationship rules according to this information. Z. Chen et al. [59] proposed a differentially private user-based CF recommendation system based on 𝑘-means clustering to avoid performance degradation caused by differential privacy. Bellini et al. [60] proposed a multi-level clustering approach for the fashion retail industry. It was emphasized that the approach tested in both online and physical stores increased customer interest.

Some researchers used personalized recommendation systems to present the most relevant and compelling information, using customers’ history and behavior to predict customer preferences. Jing et al. [61] proposed a developed CF approach that makes personalized recommendations. They tested their newly developed approach on the data from a popular electronic commerce website in China and showed that the new approach is better. Liji et al. [62] developed a personalized RS that considers user attributes. The authors also considered score matrix filling and presented a new evolutionary clustering method in the study.

In recent years, learning algorithms have also started to be used in RS. Wang et al. [63] emphasize that RSs enable users to select products for individuals with personalized fashion recommendations. The authors recommend a complementary clothing-matching method and use a graph neural network for visual compatibility. Wang and Qiu [64] proposed a fashion collocation recommendation model that uses a deep neural network. The authors used their model for side information in e-commerce. Balim and Özkan [65] generated a dataset with clothing images, compatibility comments, and a common compatibility comment for each image. The authors diagnose outfit compatibility on generated data using deep learning techniques.

How the recommended products are presented to the user or customer is as important as determining the RSs and the recommended product lists. This issue has also attracted the attention of the literature, and various studies have been carried out. Sulikowski [66] drew attention to the importance of the way product recommendations are presented on sites with lots of advertisements. In the study, research including gaze tracking is carried out to monitor human–website interaction indirectly. As a result, the study emphasizes that a vertical layout instead of a horizontal one can be used in interface design and balanced visual density solutions should be used, so buyers do not show habituation behavior. Sulikowski and Zdziebko [67] examine the interfaces of different e-commerce sites, using the events-based behavior analysis tool for vertical, horizontal, and mixed layouts and human–computer interactions, emphasizing the importance of the recommendation zone layout. Sulikowski and Zdziebko [68] used a trained deep neural network to evaluate the recommendation list interface’s performance at which the recommendations’ position and density were presented. Sulikowski et al. [69] emphasize that e-commerce sites offering recommended products with high-density animations to attract users’ attention may have a negative effect. Sulikowski et al. [70] conducted a task-based user eye-tracking study to examine variants of a fashion e-commerce site. They discussed various aspects of the recommended products’ relation to user attention.

Since it is out of the scope of this study, all RS studies in the literature were not included. However, detailed literature studies were conducted before, and comprehensive analyses were presented in these studies [2,3,4,17,71,72]. Systematic literature studies can be examined if it is desired to obtain more comprehensive information on the subject.

In addition to these studies, a review article includes only RS studies on the fashion industry [11]. In this study, the authors who focused specifically on fashion RSs emphasized that despite the recent increasing interest in the subject, academic publications are limited, and these publications do not provide a comprehensive review. Within the scope of the study, articles published between 2010–2022 were examined. Then, the metrics and methods used in the studies between the years mentioned were discussed after giving general information about the subject. Finally, recommendations for future work are presented. Here, the importance of demographic data and cultural information about products and users is emphasized for RSs, and researchers can develop more specific methods based on these data.

As a result of the literature research, customer segmentation has been used with increasing intensity since the beginning of the 2000s in the studies examined. The recent trend in the literature is the widespread use of collaborative approaches. It can be said that using these approaches produces efficient results and is relatively easy to implement.

Additionally, the scarcity of studies on fashion retail is one of the important sources of motivation for this study. Another critical problem in the literature is that real applications are also limited. Only experimental applications are made in a significant number of selected studies.

In the literature, the location dimension is not considered at the point of customer segmentation. The fact that this dimension is not used is a significant shortcoming in the literature, as it may affect cultural characteristics and, thus, customer preference. The lack of using demographic data was also emphasized in the study by Chakraborty et al. [11] and suggested future studies. As defined within the scope of Chakraborty et al.’s [11] study, our study can also be defined as hyper-personalized RS.

3. Proposed Recommendation System

In this study, the developed system is a product RS focusing on customer segmentation. Although there are many RS studies where customer segmentation is performed in the literature, none use customer/user location as an input. The proposed system aims to provide product recommendations to users with maximum success by obtaining as few inputs as possible from key users. For this reason, the models in the literature were evaluated, various opinions were taken from the experts in the industry, and a model was developed to be completed with an actual industry application.

The proposed system uses similar patterns of behavior based on their overlapping interactions on items to make recommendations between users, as in traditional CF. However, it determines user clusters with location data and RFM segmentation to eliminate the disadvantages of basic CF. In addition, it uses one of the techniques accepted in the literature to determine the number of clusters. It also uses the ARM technique to expand the customers’ profiles and remove the rules on the users’ shopping behaviors. The conceptual design of the proposed system is shown schematically in Figure 4.

The proposed system consists of four phases. In Phase-1, customer data are analyzed, and RFM segmentation is applied. The customers’ shopping data from that period are used as the input in this phase. In Phase-2, the k-means algorithm is applied by adding location information to the customers’ RFM values and customers clusters. In Phase-3, customers’ shopping data are prepared using customer cluster information as the input. Accordingly, the ARM approach is implemented using the apriori algorithm. In Phase-4, product recommendation lists are prepared and presented to the user by using rule-based heuristic algorithms. The phases of the proposed system are explained in detail in the next section.

Phases of the Proposed Recommendation System

Phase-1: Analysis of customer data and RFM segmentation:

The basis of the proposed system design is customer segmentation. There are two values based on customer segmentation in the system. The first is the customer’s RFM values, and the second is the customer’s location information.

RFM technique is one of the most known and applied segmentation methods in marketing, especially in direct marketing [73,74]. RFM consists of the initials Recency, Frequency, and Monetary. Recency refers to the currentness of the customer’s last transaction, frequency refers to the frequency of commerce, and monetary refers to the total money the customer spends [75]. RFM is the answer to the questions of when, how often, and how much money the customer spends for the company, and its components are behavioral.

In this study, RFM values are used to determine customer clusters. First, the number of days since the each customer last shopped is calculated. This value corresponds to the customer’s recency value.

The expectation of shopping frequency should be determined for the firm where the implementation will be made to calculate the frequency value. For a food retailer, it is a meaningful frequency for the customer to make several purchases in the same month. In contrast, this value may decrease to several times a year for a fashion retailer. For this reason, it is crucial to determine the expected frequency for the relevant company by taking expert opinions. The frequency value is calculated as seen in Equation (1).

$$Frequency=\frac{\sum Number of Purchases}{\sum Number of Periods}$$

(1)

In this equation, “Number of Purchases” represents the total number of purchases made by the customer during the period included in the analysis, and “Number of Periods” represents the number of periods during which the customer is expected to purchase at least once between the start date and the end date of the dataset.

Monetary represents the average expenditure size of the customer in the analyzed period. Accordingly, the Monetary value is calculated by dividing the total amount of expenditure of the customer in the relevant period by the total number of purchases.

$$Monetary=\frac{\sum Total Amount of Expenditure}{\sum Number of Purchases}$$

(2)

After calculating the RFM values, whether these values fit a distribution is examined. If values contain numerous outliers, they must be normalized. Sigmoid functions are used for the normalization process. Sigmoid functions distribute data between zero and one or minus one and one. Although there are several different sigmoid functions, the tangent sigmoid function is used here, which is stated to provide better outputs in the literature [76]:

$$x^{\prime }=\frac{e^{x_i}-e^{-x_i}}{e^{x_i}+e^{-x_i}}$$

(3)

In this equation, x’ represents the normalized data, and x_i represents the input value. After the normalization process, the final RFM values of the customers are obtained.

Phase-2: Clustering customer data:

The proposed system’s second step is to identify potentially similar customers by dividing customers into clusters. At this point, in addition to the RFM values of the customers, location information is also taken into account. The extent to which location information should be considered should be decided by examining the data and expert opinions. The k-means algorithm is used in the clustering of customer data. K-means is a basic clustering algorithm that starts with k cluster centers and is chosen arbitrarily [77]. The situation at the beginning of the cluster analysis is expressed in Equation (4).

$$W_i=i_l,j\in \left\{1,\dots ,k\right\}, l\in \left\{1,\dots ,n\right\}$$

(4)

The inputs of the algorithm are the given number of clusters (k) and the data used (C), and the outputs are k clusters [78]. The application steps of the algorithm are as follows:

⮚

Determination of arbitrarily taken k elements as cluster center ($m_1,m_2$,…,$m_k$),

⮚

Assigning each element to the set of $m_i$ to which it is closest,

⮚

Recalculating the values $m_1,m_2$,…,$m_k$ of the clusters,

⮚

Continue from the first step until there is no change in the cluster. If there is no change, stop.

One of the k-means algorithm’s biggest problems is the k value’s determination. The WSS method can be used to determine the k value. The WSS value is the sum of the squares of the distance of each point from the cluster center. If this value is small, the clustering work is good.

At this point, the graphical interpretation of the WSS value for each k value is significant in determining the ideal cluster number. The WSS value decreases rapidly with the increase in clusters from the beginning; however, this decline takes a more horizontal course after a while. The number of clusters at the point of this break is used to determine the ideal number of clusters [79].

Phase-3: Preparation of shopping data and association analysis:

While preparing the data, the customers’ shopping data previously included in the RFM study are used. Since no association analysis can be made from this data, baskets consisting of a single product should be excluded. After this process, the resulting dataset is decomposed according to the clusters created in the previous step, and association analysis is performed for each customer cluster. In this way, the shopping tendency of each customer cluster is determined, and it is possible to make recommendations by referring to the cluster they belong to when recommending products to customers. As a result of shopping data subjected to association analysis for each cluster, category pairs with a confidence value determined by taking expert opinions are determined.

The association analysis aims to reveal the customers’ purchasing habits by obtaining data from the records in the database of the products purchased by the customers at the time of shopping by finding the association between the products they bought, or in other words, the relationships between the products. While finding association rules in large databases, the following steps are followed:

(1) First, frequently repeated sets of items are found. Each of these elements repeats at least as many as the predetermined minimum number of supports.

(2) The elements of frequently repeated clusters form stricter association rules; these rules can meet minimum support and minimum confidence values [20].

In market basket analysis, items refer to the items purchased by customers, and the transaction relates to the set of all items bought together.

The proposed system uses the Apriori algorithm while performing the association analysis. This is the basic algorithm used in the first stage of association rules and is frequently used in the literature [78]. The Apriori algorithm is a classical method used to learn relational rules in computer science and data mining [80]. The algorithm has a repetitive working style. It is used to discover the most common item sets in databases. Based on the Apriori algorithm, if an item set with z elements satisfies the minimum support, then the subsets of that item set will also meet the minimum support.

This algorithm involves a series of passes over the database; during k passes, the algorithm finds the set of L_k frequent itemset of length k that satisfies the minimum support requirement. When L_k is empty, the algorithm is terminated. A pruning step eliminates any candidate with a smaller subset [81].

The Apriori algorithm combines standard object sets formed in the previous pass and creates candidate object sets without dealing with movements in the database. It also deletes smaller subsets of the last pass. Considering the common object sets formed in the previous pass, the number of candidate object sets that pass the most frequently will make our work easier, and there will be a significant decrease [78].

In the first step of the algorithm, threshold values are determined to compare support and confidence values. The results obtained from the analysis are expected to be greater than or equal to the threshold values. In the second step, the support values for the products included in the analysis are calculated and compared with the threshold support value. If the obtained support value of the product is less than the threshold support value, the relevant rows are excluded from the analysis.

In the third step, the support values are obtained by grouping the products selected in the second step in pairs. These values are compared with the support values. Lines smaller than the threshold value are excluded from the analysis. In the fourth step, the grouping numbers are increased by one, and the threshold values are compared. The process continues as long as the repetitions exceed or are equal to the threshold value. In the last step, after the product group is determined, association rules are produced by looking at the rule support criterion. Confidence measures are calculated for each of the rules [78].

Phase-4: Representing product recommendations:

The proposed model’s final phase is presenting product recommendations to customers. This phase determines which products can be recommended to customers according to their shopping history. Suppose a recommendation will be given to a customer who has never been segmented before. In that case, these recommendations will not be customer specific, but products determined as a result of general rules determined by expert opinion.

The implementation steps of this phase are summarized in Figure 5, where the flowchart of the proposed RS is given. As a result of following these steps, a customer-specific product recommendation list is prepared and presented.

4. Experimental Design

The proposed RS is applied to the data obtained from the e-commerce operation of the Turkish fashion retail company. The fashion retail industry is an essential retail branch that has developed rapidly in recent years and has increased competition. However, the products are unique in the fashion retail industry and are produced and seasonally offered for sale.

The company offers its customers many different clothing and accessories products, especially products in the Jean category. In the company, sales can be made from stores and through e-commerce sites. The company has a product variety in over 50 categories under the main product groups for men and women. In this context, the right product must be presented to the customer with the right stocks. Therefore, this situation requires the need to guide the customers about the products. Especially in electronic commerce (e-commerce) channels, no assistants offer this type of service to the customer. Therefore, RSs are critical at this point.

As in all branches of the retail industry, one of the most fundamental problems in the fashion retail industry is presenting the right product to the right customer at the right time. Recommending products that may interest the customer in each shopping channel significantly contributes to the product mentioned above in the offering cycle.

Additionally, raising the conversion rate variable is one of the most basic needs in the fashion retail industry. The contribution of RSs to the conversion rate is indisputable. The company uses RSs to increase conversion rates and offer the right product to customers, especially in e-commerce operations. However, the RS used in the company belongs to a third-party software vendor, and the company managers do not know the system’s algorithm. This “black box” system uses a data integration tool to transfer the company’s customer data from the company’s systems and to send the product recommendation list from this system. Moreover, company managers have some concerns about the performance of the current product RS.

Furthermore, the lack of application in the literature in which the demographic data of customers is considered in the fashion retail industry has increased the motivation to present an application within the scope of the study. Turkey is a large country where different cultures live together in different regions. Cultures in various areas also affect the understanding of shopping. This can be observed particularly in the fashion sense. For this reason, it is essential to use demographic information in RS and to include location information in the proposed system. The design of the experiment is schematized in Figure 6.

Implementation of the Proposed Recommendation System

The data of the company’s e-commerce operation in Turkey between 2015-2017 are used for implementation. The main motivation for using data from these years is to normalize the first relative stagnation and then the wave of growth that the pandemic we have been facing since 2020 has brought to e-commerce operations. Another reason for using the data set from this timeframe is that the company’s marketplace operations were still limited. The company’s marketplace operations increased after 2018. Since marketplace channels do not share customer data details with the product owner company, the company’s customer data analysis becomes more complex and less valid. This dataset contains data from 43,127 transactions. This shopping data are subjected to RFM analysis; the number of customers included in this analysis is 33,176. The first day of the year is accepted as a milestone to calculate the Recency value of these customers. The time elapsed between the last shopping made by the customers back from this date and the first day of the year is considered recency. The frequency value of customers expresses the number of purchases made in the same period. On the other hand, the monetary value shows the average expenditure values made during this period.

RFM scores form the first basic input for customer clustering. The location information of the customers, which is the second basic input, is added to the dataset for each customer as a geographical region. The shipping address was used as customer location information.

There are two main reasons for including customer location information in the customer segmentation process. These are due to the nature of e-commerce data, especially in some geographical regions. Such sales are intense, and socio-culturally meaningful distinctions can be reached here. Additionally, the expert opinion received from company managers supports this regional distinction.

If a customer purchases from more than one region, the region where the customer makes the most purchases is the customer’s region. If the same shopping is carried out from the two regions, the region where the greater amount of shopping is made is considered the customer’s region. Turkey is geographically divided into seven regions. The names of these regions and the numerical codes used in the study are presented in

Table 1. Region names and corresponding numeric codes.

Numeric Code	Region
1	Marmara Region
2	Aegean Region
3	Mediterranean Region
4	Central Anatolia Region
5	Eastern Anatolia Region
6	Southeastern Anatolia Region
7	Black Sea Region

.

After the region information and RFM scores come together, the process of clustering customer data begins. The k-means algorithm is used for this process. The algorithm was coded in the Microsoft Visual Studio environment with the R programming language and ran on a PC with an Intel Core i5-7200U 2.50 GHz processor and 8.00 GB RAM.

In the k-means algorithm, the number of clusters must be entered as a parameter by the user. Here, the variation of the WSS value is considered, as discussed in Section 4, to determine the ideal number of clusters. The graph showing the change in WSS value is given in Figure 7. The chart shows that after the number of clusters is three, the WSS value follows a more horizontal course and decreases. It is deduced from here that it is appropriate to determine the number of clusters as three. The customer profile resulting from this clustering process is presented in

Table 2. Characteristics of the customer clusters.

Cluster	Frequency	Monetary	Recency	Two Busiest Regions	Customer Quantity
1	1.355	155.773	203.985	1 and 2	18,244
2	6.343	1075.469	223.297	1 and 4	674
3	0.634	132.360	798.468	1 and 3	14,258

.

As shown in Table 2, the customer clusters created have specific characteristics. Accordingly, the customers in the first cluster represent customers with a basket size close to the average for the company, who shop little more than once a year on average, and who have six months since their last purchase. This cluster can be considered as the average customer base expected to shop. The customers in this cluster are mainly located in the Marmara and Aegean regions. The highest number of customers is in this cluster.

The customers in the second cluster represent the company’s most valuable customers. The basket averages and frequency values of the customers in this cluster are pretty high. Therefore, the customers should not be lost for the company. The number of customers in this cluster is relatively small, as might be expected. The customers in this cluster are primarily located in the Marmara and Central Anatolia regions.

The third cluster is customers who are not loyal to the firm and can be considered lost. Although the basket size of the customers in this cluster is at average levels, their frequencies are relatively low. Simultaneously, their Recency values are pretty high, which shows that these customers have not shopped from the company for a long time. There is a relatively high number of customers in this cluster. From this, it can be deduced that the company should take action to regain these lost customers and enable them to visit the site. The customers in this cluster are mostly located in the Marmara and Mediterranean regions. It is noteworthy that the Marmara region is densely seen in all clusters. This situation arises from a natural extension of Turkey’s socio-economic status and Turkey’s e-commerce sector.

In the shopping data phase preparation, the shopping information of previously clustered customers is first brought. Since this shopping data cannot be used in basket analysis, baskets containing a single item are removed from the dataset. The cleaned dataset is grouped in a different format to be an input to the category-based association analysis study. In this context, it is determined that 76 different categories of products are sold in all clusters in the available dataset. The abbreviations of these categories used in the system and their explanations are presented in Appendix B.

The sales data of each category within each order in the data is analyzed. Categories with sales transactions are marked in these orders, so a dataset consisting of order, cluster, and category information is obtained. If sales belong to a category in order, this category is marked as 1; otherwise, the categories are marked as 0. This dataset is extracted for each customer cluster and made ready to generate input for association analysis.

Prepared files are given as input to the SPSS Modeler, and the types of information are marked. Then, the Apriori algorithm is applied. The desired parameters are entered at this stage for the algorithm to work. These steps are done for orders belonging to all three customer clusters, and association rules for these clusters are determined. During the study, the experts’ opinions of the company are evaluated. The minimum support value is determined as 1%, and the minimum confidence value is specified as 15% to achieve a sufficient association. The ten association rules with the highest confidence values detected for each cluster are shared in

Table 3. Top ten association rules identified for customer clusters.

Cluster	Antecedent	Description	Consequent	Description	Support (%)	Confidence (%)
1	M_BLT	Men Belt	M_PNT	Men Trousers	2.442	46.847
1	W_SHS	Women Shirt Short Sleeve	W_TSS	Women T-Shirt Short Sleeve	1.579	43.454
1	W_ATH	Women Athletes	W_TSS	Women T-Shirt Short Sleeve	4.795	38.440
1	M_ATH	Male Athlete	M_TSS	Men T-Shirt Short Sleeve	1.157	38.403
1	M_SCK	Men Socks	M_PNT	Men Trousers	3.621	35.358
1	M_SRT	Men Shorts	M_TSS	Men T-Shirt Short Sleeve	3.779	35.274
1	W_BLT	Women Belt	W_PNT	Women Pants	2.838	35.194
1	M_SHG	Men Shirt Long Sleeve	M_PNT	Men Trousers	7.193	33.700
1	W_TSL	Women T-Shirt Long Sleeve	W_TSS	Women T-Shirt Short Sleeve	2.820	33.541
1	W_SCK	Women Socks	W_PNT	Women Pants	3.951	32.183
2	M_BLT	Men Belt	M_PNT	Men Trousers	3.804	55.970
2	M_TSS and W_PNT	Men T-Shirt Short Sleeve and Women Pants	W_TSS	Women T-Shirt Short Sleeve	1.022	55.556
2	W_BLT	Women Belt	W_PNT	Women Pants	1.646	51.724
2	M_SCK	Men Socks	M_PNT	Men Trousers	2.299	50.617
2	W_SHG and W_TSS	Women Shirt Long Sleeve and Women T-Shirt Short Sleeve	W_PNT	Women Pants	2.157	50.000
2	M_SHG	Men Shirt Long Sleeve	M_PNT	Men Trousers	10.304	49.587
2	M_PLV and M_SHG	Men Sweater and Men Shirt Long Sleeve	M_PNT	Men Trousers	1.107	48.718
2	W_SCK	Women Socks	W_PNT	Women Pants	2.157	48.684
2	M_SHS	Men Shirt Short Sleeve	M_PNT	Men Trousers	6.812	46.667
2	W_TNC	Women Tunic	W_TSS	Women T-Shirt Short Sleeve	1.646	46.552
3	M_BLT	Men Belt	M_PNT	Men Trousers	3.556	48.667
3	W_TNC	Women Tunic	W_TSS	Women T-Shirt Short Sleeve	1.387	45.299
3	W_SHS	Women Shirt Short Sleeve	W_TSS	Women T-Shirt Short Sleeve	1.576	41.353
3	M_SRT	Men Shorts	M_TSS	Men T-Shirt Short Sleeve	5.109	38.051
3	M_PTK	Men Polo Short-Sleeve	M_TSS	Men T-Shirt Short Sleeve	4.498	37.286
3	W_ATH	Women Athletes	W_TSS	Women T-Shirt Short Sleeve	4.350	37.193
3	M_SRB	Men Sea Shorts	M_TSS	Men T-Shirt Short Sleeve	2.465	37.019
3	M_SHG	Men Shirt Long Sleeve	M_PNT	Men Trousers	8.416	35.775
3	M_SLR	Men Slipper	M_TSS	Men T-Shirt Short Sleeve	2.027	35.380
3	W_TSL	Women T-Shirt Long Sleeve	W_TSS	Women T-Shirt Short Sleeve	3.360	35.097

.

Table 3 shows that in the association rules in all three clusters, the rule that customers who buy men’s belt products buy from men’s trousers takes the first place. This is because the company’s product and sales focus are concentrated on the Jean groups.

Another striking point in Table 3 is that the association rules of the customers in the first and third clusters are pretty similar. Six of the first ten association rules are common to both clusters. From this, it can be deduced that the customers in these two clusters have similar shopping behaviors. Additionally, while products belong to more than two categories in the baskets of the customers in the second cluster, it is seen that the purchase of products belonging to a third category is quite intense. This can be explained by the fact that the basket averages of the customers in this cluster are pretty high. Another unique situation in the association rules in this cluster is that the confidence values are higher than in the other two clusters. It can be deduced that this situation is since the number of customers in this cluster and, accordingly, the number of baskets is less.

A sample from the previous year’s shopping data is used for testing during the implementation phase. The RS is explained at this phase through a randomly selected customer. After a random customer is determined, the cluster information that the customer is included in is retrieved from the customer–cluster relations table. The cluster of the selected customer is set to “2”. For this reason, the category pairs recommended to the customer should belong to the second set. In this way, it is determined from which categories the customer has made purchases in his previous purchases.

Table 4. Purchased product-category distribution for the selected customer.

Category	Description	Purchase Quantity
W_PNT	Women Pants	6
W_CRD	Women Cardigan	4
W_TSS	Sleeve	3
W_PLV	Women Sweater	2
W_SRT	Women Shorts	2
W_ATH	Women Athletes	1
W_COA	Women Coat	1
W_SCK	Women Socks	1
W_SHG	Women Shirt Long Sleeve	1
W_SKR	Women Skirt	1
W_SRB	Women Sea Shorts	1
W_SWS	Women Sweatshirt	1

shows the distribution of categories purchased by the selected customer.

According to Table 4, the customer mostly shops in the “W_PNT” (Women Pants), “W_CRD” (Women Cardigan), and “W_TSS” (Women T-shirt Short Sleeve) categories. Here, association rules with these categories should be determined in the recommendations to be presented to the customer.

Table 5. Potential category pairs that can be recommended for the selected customer.

Antecedent	Description	Consequent	Description	Support (%)	Confidence (%)
W_TSS	Women T-Shirt Short Sleeve	W_PNT	Women Pants	13.738	39.876
W_CRD	Women Cardigan	W_PNT	Women Pants	3.094	35.780
W_CRD	Women Cardigan	W_PLV	Women Sweater	3.094	30.275
W_CRD	Women Cardigan	W_TSS	Women T-Shirt Short Sleeve	3.094	23.853
W_CRD	Women Cardigan	W_SWS	Women Sweatshirt	3.094	22.018
W_PNT	Women Pants	W_TSS	Women T-Shirt Short Sleeve	27.022	20.273
W_CRD	Women Cardigan	W_TSL	Women T-Shirt Long Sleeve	3.094	18.349
W_CRD	Women Cardigan	W_SHG	Women Shirt Long Sleeve	3.094	17.431
W_TSS	Women T-Shirt Short Sleeve	W_SHG	Women Shirt Long Sleeve	13.738	15.702
W_TSS	Women T-Shirt Short Sleeve	W_ATH	Women Athletes	13.738	15.289
W_TSS	Women T-Shirt Short Sleeve	M_TSS	Men T-Shirt Short Sleeve	13.738	15.289

shows the association rules for these categories.

The categories recommended with high confidence are determined by considering the categories for which the customer does not shop to avoid repetition. In this context, when the five potential rules with the highest confidence value are examined, it is seen that four different categories can be recommended. These are categories with codes “W_PNT”, “W_PLV”, “W_TSS”, and “W_SWS”.

After these steps are completed, the action to be taken is to identify the products to be recommended. At this point, the most purchased products by the customer’s cluster in the last three months are determined. The critical point is the date on which the recommendation will be made to the customer. With the three-month criterion, it is desired to catch the seasonality, especially in the fast fashion sector.

The five best-selling products in each category that the customer has not purchased before are listed in

Table 6. A recommendation list was created for the selected customer.

Model	Category	Description	Order
CL1004735	W_PLV	Women Sweater	1
CL1003827	W_PLV	Women Sweater	2
CL1006477	W_PLV	Women Sweater	3
CL1005006	W_PLV	Women Sweater	4
CL1005054	W_PLV	Women Sweater	5
CL1013242	W_PNT	Women Pants	1
CL1013265	W_PNT	Women Pants	2
CL1017746	W_PNT	Women Pants	3
CL1013322	W_PNT	Women Pants	4
CL1013333	W_PNT	Women Pants	5
CL1014261	W_SWS	Women Sweatshirt	1
CL1022345	W_SWS	Women Sweatshirt	2
CL1022346	W_SWS	Women Sweatshirt	3
CL1023071	W_SWS	Women Sweatshirt	4
CL1024806	W_SWS	Women Sweatshirt	5
CL1018843	W_TSS	Women T-Shirt Short Sleeve	1
CL1018592	W_TSS	Women T-Shirt Short Sleeve	2
CL1017197	W_TSS	Women T-Shirt Short Sleeve	3
CL1018603	W_TSS	Women T-Shirt Short Sleeve	4
CL1017935	W_TSS	Women T-Shirt Short Sleeve	5

. According to the proposed RS, the customer-specific product recommendation list is prepared this way.

5. Discussion

Three metrics found in the RSs literature are used to measure the validity of the recommendation list created with the developed RS [56]. These metrics and their intended use are given below.

$$Recall=\frac{n\left(BI\cap RI\right)}{n\left(BI\right)}$$

(5)

$$Precision=\frac{n\left(BI\cap RI\right)}{n\left(RI\right)}$$

(6)

$$F1=\frac{2\ast Recall\ast Precision}{Recall+Precision}$$

(7)

The BI value used in the equations represents all the purchases made by the customer during the evaluation period, and the RI value represents the products offered to the customer in the same period. The Recall metric can evaluate the products that are correctly recommended to the customer. This metric is the ratio of the products purchased by the customer to all the customer’s purchases during the evaluation period. The Precision metric is the ratio of what the customer purchases among the products recommended to the customer to all the products recommended in the relevant period. These metric measures how high the prediction sensitivity of the RS is. The recall value can be increased by recommending too many products, but in this case, too many products are recommended to the customer, reducing the precision value. The F1 metric is used to eliminate this dilemma and provide balance. The F1 metric assigns equal weights to the recall and precision metrics.

These metrics are calculated for the customer given as an application example from the previous section to analyze the validity of the proposed RS. The purchase made by the customer during the comparison period is presented in

Table 7. The shopping details of the selected customer during the recommendation period.

E-mail ID	Item Code	Category	Description	Order Number
40881	CL1021011	W_SHG	Women Shirt Long Sleeve	0000115725_WO
40881	CL1017746	W_PNT	Women Pants	0000115725_WO
40881	CLBDEWSRT0329070	W_SRT	Women Shorts	0000115725_WO
40881	CL1019961	W_SRB	Women Sea Shorts	0000115725_WO

. As shown in Table 7, the product with the code CL1017746, which is in second place in the shopping list made by the customer, is among the products recommended to the customer in the trousers category. The recall, precision, and F1 values are calculated as 0.250, 0.050, and 0.083, respectively.

According to Table 7, one of the 20 products recommended to the customer has turned into a sale, which corresponds to a precision of 5%. One of the four products purchased by the customer is recommended to the customer in the recommendation list; in this case, the recall value is 25%. The F1 value is calculated as approximately 8.3%. In addition to these metrics, another metric is calculated as 64.95, showing the average sales amount of the recommended product purchased by the customer. The aim is to show the average number of sales made through the RS and measure its contribution.

The analyses for the selected customer are repeated on 1478 randomly selected customers who purchased the product in 2017. The year is divided into four quarterly segments to catch seasonality, and recommendations are produced for these periods. The cluster information of customers included is retrieved from the customer–cluster relations table, and the clusters of customers are set. This provides information on which categories the customers have made purchases in their previous purchases. Afterward, association rules and the most purchased products by the customers’ cluster in the last three months are determined—the products the customer has purchased before being removed from the determined products. Candidate products from each category are determined, and a customer-specific recommendation list is created by ordering them according to their sales volumes. At the same time, the study’s results are compared with the data from the current RS. 1478 customers are selected for the sample, and there are 1147 customers in Cluster 1 and 331 in Cluster 2.

Table 8. Implementation outputs of the current recommendation system.

Cluster	Period of the Analyzed Timeframe’s 3rd Year	Recall	Precision	F1	Average of Sales
1	January–March	0.167	0.140	0.152	76.38
1	April–June	0.248	0.161	0.195	71.18
1	July–September	0.081	0.069	0.075	77.76
1	October–December	0.266	0.138	0.182	75.92
2	January–March	0.117	0.096	0.106	65.53
2	April–June	0.212	0.153	0.178	73.28
2	July–September	0.235	0.099	0.139	74.36
2	October–December	0.192	0.130	0.155	76.99
Average				0.148	73.92

and

Table 9. Implementation outputs of the proposed recommendation system.

Cluster	Period of the Analyzed Timeframe’s 3rd Year	Recall	Precision	F1	Average of Sales
1	January–March	0.184	0.137	0.157	80.89
1	April–June	0.242	0.171	0.200	67.65
1	July–September	0.085	0.082	0.084	84.32
1	October–December	0.212	0.149	0.175	73.87
2	January–March	0.122	0.105	0.113	71.05
2	April–June	0.231	0.161	0.190	79.92
2	July–September	0.221	0.102	0.139	75.37
2	October–December	0.209	0.124	0.155	72.51
Average				0.152	75.70

show the summary of the results produced by the current RS and the proposed RS, respectively.

Table 10. The percentage difference between the proposed RS and the current RS.

Cluster	Period of the Analyzed Timeframe’s 3rd Year	Recall	Precision	F1	Average of Sales
1	January–March	9.239	−2.190	3.185	5.575
1	April–June	−2.479	5.848	2.500	−5.218
1	July–September	4.706	15.854	10.714	7.780
1	October–December	−25.472	7.383	−4.000	−2.775
2	January–March	4.098	8.571	6.195	7.769
2	April–June	8.225	4.969	6.316	8.308
2	July–September	−6.335	2.941	0.000	1.340
2	October–December	8.134	−4.839	0.000	−6.178
Average				3.114	2.075

shows the percentage difference between the proposed and current RS.

When the results are evaluated, it is seen that the proposed system has higher F1 and average sales values than the current system. In only one period (October–December of Cluster 1), the current system appears to have a higher F1 value than the proposed system. Similarly, the sales value of the current RS seems higher in some periods, but the proposed system is more successful in terms of the total sales average. In the April–June period of customers belonging to the first cluster, where the current system has the most successful F1 value, the proposed system achieved a more successful F1 score. In the same period, the sales average seems slightly lower than the current system, which can be explained by the recall value being slightly lower in the same period and the lower-priced product recommendations being successful.

The current RS’s data from the previous year is needed to compare the customers in the third cluster. However, since these data cannot be obtained from the company, the RS is run separately for the customers in the relevant cluster, and the previous year’s sales are taken as a reference. For this study, 864 customers in the third cluster who shopped in the previous year were randomly selected; the results are given in

Table 11. Application outputs for the third cluster customers of the proposed system.

Cluster	Period of the Analyzed Timeframe’s 2nd Year	Recall	Precision	F1	Average of Sales
3	January–March	0.183	0.150	0.165	74.42
3	April–June	0.143	0.125	0.134	61.56
3	July–September	0.166	0.114	0.135	78.42
3	October–December	0.196	0.139	0.162	68.70
Average				0.149	70.78

.

When the results in Table 11 are examined, it is noteworthy that the average sales amounts are somewhat low. However, it should not be overlooked that the change in product prices yearly may be effective in the background of this change. Here, the F1 value again appears to be at a satisfactory level. In this context, approximately 17% of the products purchased by the customer in Table 11 consist of the products recommended by the RS. Similarly, about 13% of the products targeted to be offered to customers are purchased by customers.

In general, the proposed system is tested on the shopping data of 2342 customers, and the outputs obtained are compared with the outcomes of the current RS in the company. As a result of this comparison, it is seen that the proposed product RS achieves more successful average sales and higher recommendation success than the current RS. In addition to providing better results than the current system, it is also crucial that the proposed RS is open for internal use and can be maintained by the company according to recent developments. The proposed system, which will replace the system outsourcing from a third-party provider, provides better results than the current system, allowing the study to go beyond its goals. An RS that will be operated openly for internal use allows the transfer of demographic information, such as location, which cannot be shared with third parties due to the protection of personal data, into the system. In this way, customers are offered hyper-personalized products. The importance of personalized recommendations can also explain the superiority of the proposed system over the existing system.

6. Conclusions and Future Studies

Presenting the right product at the right time is one of the problems that must be solved for all sectors, especially the retail sector. Giving recommendations that suit customers’ preferences and enjoyment is essential in overcoming this problem. RSs enable all kinds of objects to be presented to users/customers.

This study focuses on the fashion retail industry, an essential retail branch that has developed rapidly in recent years and has increased competition. The literature review has shown that no RS in the fashion retail industry considers customers’ demographic data. At the same time, it is observed that customer location information is not used as a parameter in clustering or recommendation preparation models in any of the studies examined. The proposed system to fill this gap in the literature was applied to the real customer data obtained from the e-commerce operation of the Turkish fashion retail company, and the application results were evaluated.

RFM segmentation was first applied to the customer data obtained during the proposed system’s implementation. In the following phase, the geographical regions of the places where the customers make purchases and the regions where the customers were located were determined. Customers were divided into clusters using the k-means algorithm by combining the region information of each customer with their RFM scores. In the next phase, the ARM technique was applied at the category level for each cluster obtained to determine which categories the customers in each cluster purchased together. Then, a product recommendation was prepared for a sample customer. Afterward, the proposed system was implemented on a total of 2342 customers, and the results of the implementation were compared with the current RSs used in the company. To measure the performance of the RS, “recall”, “precision”, and F1 metrics were used. As a fourth metric, the average prices of products recommended to customers and purchased by customers were added to these evaluation criteria. The proposed system achieved better values than the RS available in the company in both F1 and average sales values. At this point, the validity and applicability of the proposed system were verified on real sector data. By applying our proposed system, the managers found the opportunity to compare the performances of the current product RS and our proposed product RS. All the managers of the related departments appeared to be satisfied with the results and flexibility of our proposed system. Company executives welcomed having a non-black-box system and improving it in line with the company’s changing business requirements. These managers’ feedback has encouraged the company to replace their current RS system with our proposed system.

Although the system’s primary goals are achieved by applying it to a Turkish fashion retail company, we are aware of this study’s limitations, especially its relatively small sample size. In future studies, the proposed system can be applied to larger datasets and combined with data from different sales channels; it can be tested and used more reliably. In addition, the suitability of the proposed recommendation system may be evaluated by applying it to e-commerce operations of different retail sectors such as footwear, consumer durables, jewelry, books-music-gift articles, etc.

Additionally, in this study, we used the performance indicators found in the literature to validate the proposed system. It would be worth differentiating the key performance indicators in the future, especially by taking expert opinions. Furthermore, we plan to extend the clustering phase of the proposed study by using different customer parameters such as the customer’s socio-economic status, marital status, navigation data on the e-commerce site, etc. At this point, it should be noted that the number of customer clusters created should be manageable and meaningful.