Next Article in Journal
Taylor’s Formula for Generalized Weighted Fractional Derivatives with Nonsingular Kernels
Next Article in Special Issue
Measuring Profitable Efficiency, Technical Efficiency, Technological Innovation of Waste Management Companies Using Negative Super-SBM–Malmquist Model
Previous Article in Journal
The Possibility of Combining and Implementing Deep Neural Network Compression Methods
Previous Article in Special Issue
On the Generalized Bilal Distribution: Some Properties and Estimation under Ranked Set Sampling
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluation of Digital Marketing Technologies with Fuzzy Linguistic MCDM Methods

Faculty of Commerce, Van Lang University, Ho Chi Minh City 70000, Vietnam
*
Author to whom correspondence should be addressed.
Axioms 2022, 11(5), 230; https://doi.org/10.3390/axioms11050230
Submission received: 21 April 2022 / Revised: 11 May 2022 / Accepted: 11 May 2022 / Published: 13 May 2022
(This article belongs to the Special Issue Communications in Industrial Statistics—Theory and Methods)

Abstract

:
Technology is becoming the tool that changes how people live every day, and the marketing strategies of businesses are also gradually shifting to the industry 4.0 mindset of constant growth and development. Digital marketing has changed human habits of information accessibility, determined their interactions, and witnessed the birth of a variety of new marketing technologies. Marketers are creating digital marketing products and services that enhance the experience for consumers, products, and services that are also delivered through high digital marketing networks. As a result, data sources become more abundant and allow consumers to have more choices. All products, services, technologies, and data are increasingly meeting the needs of consumers, thereby confirming the effectiveness of digital marketing in today’s market. However, the evaluation and selection of digital marketing technology is very complex since it has many conflicting criteria and goals. The multi-criteria decision-making model (MCDM) is a powerful technique widely used for solving this type of problem. Thus, the author proposed a fuzzy linguistic MCDM method for evaluation of digital marketing technologies. After determining the evaluation criteria and alternatives, two MCDM methods, including Spherical Fuzzy Analytic Hierarchy Process (SF-AHP) and Technique for Order Preference by Similarity to Ideal Solution (TOPSIS), are used in the evaluation and selection of digital marketing technologies procedure. Finally, an application is present to demonstrate the potential use of the proposed methodology. The main contribution of this study is to propose a Spherical fuzzy MCDM model to support planners and decision makers in the digital marketing technology evaluation and selection processes. A case study is also performed to showcase the feasibility of the proposed approach.

1. Introduction

In late 2019, a new coronavirus was identified as the cause of human illness in Wuhan, China, and given the name “novel coronavirus” (2019-nCoV). Individuals of all ages are at risk of SARS-CoV-2 infection and severe disease. However, the probability of serious COVID-19 disease is higher in people aged ≥60 years, such as those living in a nursing home or long-term care facility and those with chronic medical conditions. In the context of the complicated development of the COVID-19 pandemic, the trend of users accessing the Internet and social networking sites is still developing strongly. As a result, Digital Marketing in Vietnam is becoming more and more popular, gradually occupying an important position in an overall marketing strategy [1].
Looking back at the general development trend of the whole world, with the help of technology, communication activities are also gradually shifting and adapting to the needs of interacting and understanding customers, thereby significantly contributing to promotion and accelerating the sales process of businesses, opening a new development step for the media field in Vietnam today [2]. Many years ago, the marketing industry transitioned from a traditional paradigm to a digital one, resulting in a more sophisticated marketing approach. The previous Marketing model’s core was behavioral-based customer targeting, which led to the development of automation. As a result, digital commerce and customer service in cyberspace are possible. Additionally, this can serve as a springboard to fresh demand.
To be more effective, digital marketing must now be supported by digital technology. The following technologies are utilized in digital marketing:
Artificial Intelligence (AI): AI is a branch of computer science; an intelligence created by humans with the goal of helping computers to automate intelligent behaviors like humans. Artificial intelligence has been used in a variety of industries, including labor, health care, security, transportation, and marketing, as technology has advanced. The application of AI in marketing is connected to researching consumer behavior, collecting customer information, and answering customers about the company’s offerings [3]. The future of digital marketing will be shaped by artificial intelligence. The power of AI creates new opportunities for digital marketing in the near future. Lots of other productivity techniques, strategies, and levers will be made possible by artificial intelligence [4].
Big data: Big Data is a discipline that deals with methods for analyzing, methodically extracting information, and generally dealing with data volumes that are too big or complicated for typical data-processing application software to handle [5]. Currently, customers are becoming increasingly “fastidious” when making decisions to buy products or use services in any field. With the application of Big Data, businesses can easily approach customers and answer their questions, enabling them to understand the “Insight” of customers in a better way [6].
Machine learning (ML): ML is the study of computer algorithms that may improve automatically via experience and the usage of data. Machine learning will likely have a huge influence on the application of digital marketing in the future. To lead in the technology race, the use of machine learning will improve the effectiveness of Digital Marketing strategy. Machine learning supports collect information about target customers to best serve marketing campaigns. Machine learning can help collect user data, including their behavior, and marketing automation supports the arrangement and grouping of data in the most logical way. The information collected is used to develop strategies to attract and improve customer satisfaction. At the same time, it also helps companies create personalized content suitable for each audience [7].
Augmented/Virtual Reality (AR): With the potential to create a breakthrough in customer experience, from product discovery to purchase decision, Augmented Reality has quickly captured the attention of marketers [8]. AR application brings a new dimension to the online retailer catalog, allowing interaction on online features. Using an AR application allows you to view the product from any angle and can project the product in the three-dimensional space that the customer wants. In other words, AR brings a wide range of shopping options to catalogs and online retailers, providing an effective visual view of the product, leading to a seamless customer shopping experience [9].
Internet of Things (IoT): The IoT accelerates marketing processes and provides businesses with real-time marketing. The time spent on marketing and sales has been decreased as a result of altering marketing methods using the Internet of Things, and the sales process has been faster and easier.
Because there are so many competing criteria and aims, evaluating and selecting digital marketing technologies is quite difficult. The multi criterion decision-making model (MCDM) is a sophisticated approach that is extensively used to solve issues of this nature. Thus, the author proposed a fuzzy linguistic MCDM method, including SF-AHP and TOPSIS models, for evaluation of digital marketing technologies in this research.
Science, technology, and innovation represent a bigger category of activities that are highly interrelated but separate [10]. The primary goal of this study is to propose a fuzzy MCDM model for digital marketing technologies. The evaluation of digital marketing technology alternatives requires several linguistic criteria to be included in the decision process. The numerical definitions of these criteria are realized by spherical fuzzy sets, incorporating a new point of view to decision making under fuzziness. The independent assignment of membership parameters with larger domains brings novelty to the evaluation process of digital marketing technology alternatives. After determining the evaluation criteria and alternatives, SF-AHP is used for determining the weights of criteria, where the spherical fuzzy sets theory is applied in order to deal with uncertainty in this decision-making environment, and the TOPSIS model is applied for ranking digital marketing technologies.

2. Literature Review

The MCDM model is a study area that involves the examination of numerous accessible options in a circumstance or research topics that include everyday life, social sciences, engineering, medicine, and many other fields. The term MCDM refers to the process of selecting the best opinion from among all viable possibilities. Figure 1 depicts a MCDM process model.
Mukul et al. [11] proposed a MCDM model for evaluation and selection of a suitable digital marketing technology. In this research, they applied the AHP model and Complex Proportional Assessment (COPRAS) for ranking digital marketing technologies. Erdoğan et al. [12] presented a fuzzy MCDM model to determine the best cyber security technology. Via fuzzy MCDM process, the author also discussed risk factors in the selection processes.
Chang et al. [13] used a hybrid MCDM framework for evaluating industry 4.0 technology application in SMEs. In this study, the author applied MCDM models, such as the DEMATEL—INRD—VIKOR technique. The results of their research show that the technology aspect is the most influential factor. Samanlioglu et al. [14] proposed MCDM models, including fuzzy FBWM and Fuzzy TOPSIS, for evaluation of a hotel website and digital solutions provider firms.
Imanova and Gunel [15] proposed a framework under Z-environment for the evaluation and selection of optimal digital marketing technologies. The author also presented a numerical example in order to check the validity of the considered framework. Mahdiraji et al. [16] showed marketing strategies’ evaluation based on big data analysis. The author applied Best/Worst Method Complex Proportional Assessment methods in this study. Hsieh [17] applied MCDM methodology to verify the co-relationship between social media and service quality in the dynamic m-commerce era. In this study, the fuzzy-set qualitative comparative analysis (FSQCA) approach was hierarchically cross-employed in the compared assessable statistics and measurements of QFD-HOQ model.
Tang et al. [18] proposed the Fuzzy MCDM method for evaluating the propagating Electronic Commerce market strategies. Ajripour [19] used the MCDM Technique in analyzing the effect of promotion items based on online shopping factors. The author applied PROMETHEE II in analyzing the effect of promotion items based on online shopping criteria. Khatwani and Das [20] used the hybrid fuzzy MCDM technique for evaluating the combination of individual pre-purchase internet information channels. The author applied Fuzzy AHP and was employed to identify the weight criteria, and then Fuzzy TOPSIS was used to rank different combinations of pre-purchase channels according to the same demographic parameters.
Joshi et al. [21] did research into enhanced selling on digital space via matching buyer and seller preferences using the fuzzy MCDM method. Büyüközkan et al. [22] introduced a decision framework based on the HFLTS, Hesitant Fuzzy Linguistic (HFL), AHP, and ARAS methods for analysis of companies’ digital maturity. Kwak et al. [23] applied the integer goal programming model and the analytic hierarchy process for media selection in the dual consumer/industrial market. The satisfying solution is identified and analyzed, and sensitivity analyses are performed for model flexibility. Kaltenrieder et al. [24] introduced the fuzzy analytical network process (FANP) as a potential multi-criteria-decision-making (MCDM) method to improve digital marketing management endeavors. Lu et al. [25] demonstrated the effectiveness of the hybrid MCDM model for Improving RFID adoption in Taiwan’s healthcare industry. In this research, the author applied the DEMATEL model for solving the problems of interdependence and feedback and applied the DEMATEL-based ANP (DANP) and VIKOR models for identify influential weights and gaps based on the TOEC framework. Boopathy et al. [26] presented decision analysis framework in financial marketing using multi-criteria decision-making methods.

3. Methodology

In the past few years, marketing has become a rapidly growing industry. The current trend of Digital Marketing is gradually replacing traditional marketing. Marketing activities are deployed mainly on the Internet and social networks. The MCDM is one of the most popular treaties in the literature among scholars. The term MCDM refers to the process of determining the best opinion from among all possible alternatives. This study’s recommended approach consists of three key steps, and the research graph is shown in Figure 2.
Step 1. Determining the criteria to evaluate and select digital marketing technology processes.
Step 2. Identifying the weight of criteria via the Spherical Fuzzy Analytic Hierarchy Process (SF-AHP) model.
Step 3. The Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) is based on the idea that the preferred alternative should be the one with the shortest geometric distance from the positive ideal solution (PIS) and the one with the greatest geometric distance from the negative ideal solution (NIS). In the last stage, the TOPSIS approach is used to evaluate digital marketing technologies based on the criteria.

3.1. Theory of Spherical Fuzzy Sets

The Spherical Fuzzy Sets Theory was initially mentioned by Gundogdu and Kahraman [27] as a subset of Neutrosophic Sets Theories [28]. Since its recent inception, the spherical fuzzy sets theory has been used in various researches to construct MCDM models to handle a wide range of decision-making concerns and problems [29]. A spherical fuzzy set’s B ˜ S . membership matrix is determined by its membership ( m B ˜ S ( x ) . ), non-membership ( n B ˜ S ( x ) ), and hesitation (( h B ˜ S ( x ) ). Each of these parameters can separately have a value between 0 and 1, and the aggregate of their squared values can only be 1.
Within a universe U 1 , a spherical fuzzy set B ˜ S is defined as:
B ˜ S = { x ,   ( m B ˜ S ( x ) ,   n B ˜ S ( x )   ,   h B ˜ S ( x ) ) | x ϵ U 1 }
with:
m B ˜ S ( x )   :   U 1 [ 0 , 1 ] ,   n B ˜ S ( x )   : U 1 [ 0 , 1 ] ,   and   h B ˜ S ( x )   : U 1 [ 0 , 1 ]  
and
0   m B ˜ S 2 ( x ) + n B ˜ S 2 ( x ) + h B ˜ S 2 ( x ) 1  
with x U 1 .

3.2. Model of the Spherical Fuzzy Analytic Hierarchy Process (SF-AHP)

The SF-AHP approach extends the AHP with spherical fuzzy sets. The SF-AHP approach consists of five stages:
Stage 1: Create the model’s hierarchical structure.
The model’s hierarchical structure is divided into three tiers. Level 1 is the model’s goal, which is derived using a performance index. The score index is determined with n criteria, which is represented in Level 2 of the structure. A set of m alternative B (m ≥ 2) is defined in Level 3 of the structure.
Stage 2: As stated in Table 1, create a pairwise comparison matrix of the criteria using spherical fuzzy judgement based on qualitative words and the linguistics measure of importance established by Gundogdu and Kahraman.
The performance index (PI) of each equation is then calculated using Equations (3) and (4):
PI = | 100 [ ( μ B ˜ s π B ˜ s ) 2 ( v B ˜ s π B ˜ s ) 2 ] |  
for absolute high significance, very high significance, high significance, slightly high significance, and equally significance and
1 PI = 1 | 100 [ ( μ B ˜ s π B ˜ s ) 2 ( v B ˜ s π B ˜ s ) 2 ] |
for slightly low significance, low significance, very low significance, and absolutely low significance.
Stage 3: Conduct a proper consistency check for each pairwise comparison matrix.
The Consistency Ratio (CR) has a 10% threshold:
C R =   C I R I
The Random Index (RI) is computed using the number of criteria, and the Consistency Index (CI) is calculated as follows:
C I =   λ m a x   N N 1
with λ m a x . as the matrix’s maximum value.
Stage 4: Determine the fuzzy weights of the criteria and choices.
The fuzzy weightings of each choice with regard to each criterion are determined as follows:
S W M w ( B ˜ S 1 ,   ,   B ˜ S N ) = w 1 B ˜ S 1 + + w N B ˜ S N =   [ 1 i = 1 n ( 1 μ B ˜ S i 2 ) w i ] 1 2 ,   i = 1 n v B ˜ S i w i ,   [ i = 1 N ( 1 μ B ˜ S i 2 ) w i i = 1 n ( 1 μ A ˜ S i 2 π A ˜ S i 2 ) w i ] 1 / 2  
with w = 1 / N .
Stage 5: To determine the total weights, use layer sequencing from highest to lowest.
The choices performance index is computed by adding the fuzzy weights at each level of the model’s hierarchical structure. There are two approaches to this:
The first option is to use Equation (8) to de-fuzzify the criterion weights:
S ( w ˜ j S ) = | 100 [ ( 3 μ B ˜ s π B ˜ s 2 ) 2 ( v B ˜ s 2 μ B ˜ s ) 2 ] |  
Then, using Equation (9), normalize the criterion weights as follows:
w ¯ j s = S ( w ˜ j s ) j = 1 n S ( w ˜ j s )
In Equation (10), use spherical fuzzy multiplication:
B ˜ S i j = w ¯ j s B ˜ S i = ( 1 ( 1 m B ˜ S 2 ) w ¯ j s ) 1 2 ,   n B ˜ S w ¯ j s ,   ( ( 1 m B ˜ S 2 ) w ¯ j s ( 1 m B ˜ S 2 h B ˜ S 2 ) w ¯ j s ) 1 2                            
For each choice B i , the final performance index ( P ˜ ) is calculated:
P ˜ = j = 1 N B ˜ S i j = B ˜ S i 1 + B ˜ S i 2 + + B ˜ S i N                 .  
The second method is to execute the computation without de-fuzzifying the weights of the criterion. The spherical fuzzy global weights are computed as follows:
j = 1 N B ˜ S i j = B ˜ S i 1 B ˜ S i 2 B ˜ S i N                    
The final performance index ( P ˜ ) for each option B i is determined using Equation (11).

3.3. Technique for Order Preference by Similarity to Ideal Solution (TOPSIS)

TOPSIS was initially suggested by Hwang et al. in 1981. A typical TOPSIS procedure consists of the five phases shown below [30]:
Stage 1: Create the normalized choice matrix:
g i j = X ij i = 1 m X ij 2
where X ij . is the decision matrix’s original score and g i j is the decision matrix’s normalized score.
Stage 2: Calculate the normalized weight matrix:
o i j = h j g i j
where the weight of the j t h criteria is represented by h j .
Stage 3: Positive ideal solution (PIS) and Negative ideal solution (NIS) matrices are defined as follows:
O + = o 1 + ,   o 2 + , , o n + O = o 1 ,   o 2 , , o n
Stage 4: Using the PIS and NIS matrices, compute the performance difference between the values of each option.
Each option’s distance to PIS is computed as follows:
                                D i + = j = 1 m ( o i + o ij ) 2   ; i = 1 ,   2 ,   ,   m
Each option’s distance to NIS is computed as follows:
D i = j = 1 m ( o ij o i ) 2   ;   i = 1 ,   2 ,   ,   m
using the i t h option, with D i + as the distance to the PIS and D i as the distance to the NIS
Additionally, with D i +   as the distance to the PIS and D i   as the distance to the NIS for the i t h option.
Stage 5: Each option’s preference value (Vi) is determined as follows:
          V i = D i D i + D i +                                   i = 1 ,   2 ,   ,   m
Finally, the V i values are utilized to rank and analyze the various options.

4. Case Study

In this research, a fuzzy linguistic MCDM method for evaluation of digital marketing technologies included Artificial Intelligence (A1), Big Data (A2), Machine Learning (A3), Augmented/Virtual Reality (A4), and the Internet of Things (A5). Based on experts opinions and literature reviews, there are three sub-criteria of this, and each main criterion is shown in Figure 3.
The Spherical Fuzzy Analytic Hierarchy Process (SF-AHP) method was introduced by Gundogdu and Kahraman and is an extension of AHP with spherical fuzzy sets. In this paper, SF-AHP was employed to determine the DC selection criteria weights. All inputs data were defined by 15 experts (Marketing manager, IT manager, …). Based on linguistic measures of significance (Table 1), some information about the experts is shown in Table 2. Input data and results from the SF-AHP model is shown in Table 3 and Table 4.
TOPSIS is based on the concept that the chosen alternative should have the shortest geometric distance from the PIS and the longest geometric distance from the NIS. In this stage, the TOPSIS model is applied for evaluation and ranking of digital marketing technologies. Normalized matrix and normalized weighted matrix are shown in Table 5 and Table 6.
The 4.0 technology revolution opens a new era for the marketing industry: moving from traditional to digital technology. It means that consumers have become more powerful and have more choices, so businesses need to change their sales and marketing thinking accordingly. Marketing technology 4.0 is a form of marketing with interaction between online and offline businesses and customers. In today’s digital age, businesses must completely change the way they approach customers, specifically analyzing needs, sales, marketing, customer care, and so on, to match the modern day. Digital Marketing offers fair competition opportunities for all types of businesses, allowing them o advertise their brands in an online environment. No longer the same as before, when there were only large companies; new multinationals are able to grasp and apply Digital Marketing in business. Currently, the role of Digital Marketing for small and medium businesses is very important because it helps businesses achieve efficiency and improve business results.
In this study, the author proposed a fuzzy linguistic MCDM method for evaluation of digital marketing technologies, including Artificial Intelligence, Big data, Machine learning, Augmented/Virtual Reality, and Internet of Things. As shown in Table 7 and Figure 4, Artificial Intelligence (A1) has become the most appropriate digital marketing technology among five alternatives, with a final score value of 0.8342. To compare results obtained using traditional TOPSIS with equal weights and the proposed MCDM model, we have shown the result in Table 8.
As shown in Table 8, the ranking of alternatives is the same between traditional TOPSIS with equal weights and the proposed MCDM model. However, the traditional TOPSIS model has some disadvantages, such as correlations between criteria, uncertainty in obtaining the weights only by objective methods or subjective methods, and the possibility of alternative closed to ideal point and nadir point concurrently. This is one of the reasons why the author integrated the SF-AHP and TOPSIS models in this paper: to assist corporates in decision making due to its flexibility in analytical ranking, especially for the digital marketing industry.

5. Conclusions

Today, there are many technologies applied in the field of digital marketing, and businesses must choose a technology that is suitable for their organization. However, the evaluation and selection of digital marketing technologies is very complex since it has many conflicting criteria and goals. Therefore, the author proposed a fuzzy linguistic MCDM method for evaluation of digital marketing technologies. After determining the evaluation criteria and alternatives, two MCDM methods, including SF-AHP and TOPSIS models, were used in the evaluation and selection of digital marketing technologies. Finally, an application is presented to demonstrate the potential use of the proposed methodology. The most significant contributions in this study can be described as follows:
The proposed fuzzy MCDM model is the first digital marketing technology selection model in Vietnam. We discovered this by interviewing experts and reviewing the literature.
Second, this is the first study to provide a case study on evaluating marketing technology utilizing the approach proposed by the combination of SF-AHP and TOPSIS models.
The results of this study can be valuable guidance in the alternatives assessment and selection sector, not only for the marketing sector but also for decision-makers and investors in other industries.
For future research, the digital marketing technology evaluation model can be improved by increasing the number of criteria and alternatives or by using different decision-making methods, such as MAIRCA, COPRAS, and LINMAP models, for comparing the results.

Author Contributions

Conceptualization, N.V.T. and N.Q.T.; Data curation, N.V.T. and N.Q.T.; Formal analysis, N.V.T. and N.Q.T.; Funding acquisition, N.V.T. and N.Q.T.; Investigation, N.Q.T.; Methodology, N.V.T.; Project administration, N.V.T.; Resources, N.Q.T.; Supervision, N.V.T.; Validation, N.Q.T.; Writing—original draft, N.V.T.; Writing—review and editing, N.Q.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Van Lang University and The APC was funded by Van Lang University.

Acknowledgments

The authors wish to express their gratitude to Van Lang University, Vietnam, for financial support for this research.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Xu hướng ngành Digital Marketing Việt Nam 2021 (Digital Marketing Industry Trends 2021 in Vietnam). Available online: https://vietnamdigital.vn/blog/xu-huong-nganh-digital-marketing-viet-nam-2021/ (accessed on 18 August 2021).
  2. Công nghệ số thay đổi diện mạo của ngành truyền thông tại Việt Nam (Digital Transformation is Impacting the Media Industry in Vietnam). Available online: https://advertisingvietnam.com/cong-nghe-so-thay-doi-dien-mao-cua-nganh-truyen-thong-tai-viet-nam (accessed on 18 August 2021).
  3. Trí tuệ nhân tạo và ứng dụng trong hoạt động marketing (Artificial Intelligence and Its Application in Marketing Activities). Available online: https://senplus.vn/tri-tue-nhan-tao-ai-va-ung-dung-trong-hoat-dong-marketing.html (accessed on 18 August 2021).
  4. AI sẽ thay đổi Digital Marketing thế nào trong năm 2021 (How AI Will Change Digital Marketing in 2021). Available online: https://advertisingvietnam.com/ai-se-thay-doi-digital-marketing-the-nao-trong-nam-2021-p15989 (accessed on 18 August 2021).
  5. Hilbert, M.; López, P. The world’s technological capacity to store, communicate, and compute information. Science 2011, 332, 60–65. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Ho Phuong Thao. Big Data và những ứng dụng tuyệt vời vào ngành Marketing thời đại 4.0 (Big Data and Great Applications in the Industry 4.0 Era of Marketing). Available online: https://123job.vn/bai-viet/big-data-va-nhung-ung-dung-tuyet-voi-vao-nganh-marketing-thoi-dai-40-937.html (accessed on 18 August 2021).
  7. 7 xu hướng ứng dụng marketing automation cho doanh nghiệp (7 Marketing Automation Application Trends for Businesses). Available online: https://www.navee.asia/kb/7-xu-huong-ung-dung-marketing-automation-cho-doanh-nghiep/ (accessed on 18 August 2021).
  8. Ứng dụng xu hướng tương tác thực tế—Augmented Reality vào Marketing. Available online: https://www.brandsvietnam.com/congdong/topic/3529-Ung-dung-xu-huong-tuong-tac-thuc-te-Augmented-Reality-vao-marketing (accessed on 18 August 2021).
  9. Augmented Reality là gì? (What is Augmented Reality?). Available online: https://webdoctor.vn/augmented-reality-la-gi-xu-huong-tuong-tac-thuc-te-thoi-dai-so/ (accessed on 18 August 2021).
  10. Brooks, H. The relationship between science and technology. Res. Policy 1994, 23, 477–486. [Google Scholar] [CrossRef]
  11. Mukul, E.; Büyüközkan, G.; Güler, M. Evaluation of digital marketing technologies with MCDM methods. In Proceedings of the 6th International Conference on New Ideas in Management, Economics and Accounting, Paris, France, 19–21 April 2019. [Google Scholar]
  12. Erdoğan, M.; Karaşan, A.; Kaya, İ.; Budak, A.; Çolak, M. A fuzzy based MCDM methodology for risk evaluation of cyber security technologies. In Proceedings of the INFUS 2019 Conference, Istanbul, Turkey, 23–25 Junly 2019; Springer: Cham, Switzerland, 2019. [Google Scholar]
  13. Chang, S.C.; Chang, H.H.; Lu, M.T. Evaluating industry 4.0 technology application in SMES: Using a Hybrid MCDM Approach. Mathematics 2021, 9, 414. [Google Scholar] [CrossRef]
  14. Samanlioglu, F.; Burnaz, A.N.; Diş, B.; Tabaş, M.D.; Adıgüzel, M. An Integrated fuzzy best-worst-TOPSIS method for evaluation of hotel website and digital solutions provider firms. Adv. Fuzzy Syst. 2020, 2020, 8852223. [Google Scholar] [CrossRef]
  15. Imanova, G.E.; Imanova, G. Digital marketing technologies selection under Z-environment. In Proceedings of the 14th International Conference on Theory and Application of Fuzzy Systems and Soft Computing—ICAFS-2020 , Istanbul, Turkey, 28–30 October 2020; Springer: Cham, Switzerland, 2020. [Google Scholar]
  16. Mahdiraji, H.A.; Kazimieras Zavadskas, E.; Kazeminia, A.; Abbasi Kamardi, A. Marketing strategies evaluation based on big data analysis: A Clustering-MCDM Approach. Econ. Res. Ekon. Istraživanja 2019, 32, 2882–2892. [Google Scholar] [CrossRef] [Green Version]
  17. Hsieh, M.Y. Employing MCDM methodology to verify correlationship between social media and service quality in the dynamic m-commerce era. J. Internet Technol. 2018, 19, 539–553. [Google Scholar]
  18. Tang, M.T.; Tzeng, G.H.; Wang, S.W. A hierarchy fuzzy MCDM method for studying electronic marketing strategies in the information service industry. J. Int. Inf. Manag. 1999, 8, 1. [Google Scholar]
  19. Ajripour, I. Applying MCDM Technique in analyzing the effect of promotion items based on online shopping factors: A Case Study. In European Union’s Contention in the Reshaping Global Economy; University of Szeged: Szeged, Hungary, 20–21 March 2020. [Google Scholar]
  20. Khatwani, G.; Das, G. Evaluating combination of individual pre-purchase internet information channels using hybrid fuzzy MCDM technique: Demographics as Moderators. Int. J. Indian Cult. Bus. Manag. 2016, 12, 28–49. [Google Scholar] [CrossRef]
  21. Joshi, K.P.; Alur, S. Enhanced selling on digital space via matching buyer and seller preferences using fuzzy MCDM method. In Fuzzy Optimization and Multi-Criteria Decision Making in Digital Marketing; IGI Global: Hershey, PA, USA, 2016. [Google Scholar]
  22. Büyüközkan, G.; Güler, M. Analysis of companies’ digital maturity by hesitant fuzzy linguistic MCDM methods. J. Intell. Fuzzy Syst. 2020, 38, 1119–1132. [Google Scholar] [CrossRef]
  23. Kwak, N.K.; Lee, C.W.; Kim, J.H. An MCDM model for media selection in the dual consumer/industrial market. Eur. J. Oper. Res. 2005, 166, 255–265. [Google Scholar] [CrossRef]
  24. Kaltenrieder, P.; D’Onofrio, S.; Portmann, E. Applying the fuzzy analytical network process in digital marketing. In Fuzzy Optimization and Multi-Criteria Decision Making in Digital Marketing; IGI Global: Hershey, PA, USA, 2016. [Google Scholar]
  25. Lu, M.T.; Lin, S.W.; Tzeng, G.H. Improving RFID adoption in Taiwan’s healthcare industry based on a DEMATEL technique with a hybrid MCDM model. Decis. Support Syst. 2013, 56, 259–269. [Google Scholar] [CrossRef]
  26. Boopathy, P.; Deepa, N. Decision analysis in financial marketing using multi-criteria decision-making methods. In Sustainability Reporting, Ethics, and Strategic Management Strategies for Modern Organizations; IGI Global: Hershey, PA, USA, 2021. [Google Scholar]
  27. Gündoğdu, F.K.; Kahraman, C. Spherical fuzzy sets and spherical fuzzy TOPSIS method. J. Intell. Fuzzy Syst. 2019, 36, 337–352. [Google Scholar] [CrossRef]
  28. Yager, R. Pythagorean fuzzy subsets. In Proceedings of the 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS), Edmonton, AB, Canada, 24–28 June 2013; pp. 57–61. [Google Scholar]
  29. Gündoğdu, F.K.; Kahraman, C. A novel spherical fuzzy analytic hierarchy process and its renewable energy application. Soft Comput. 2019, 24, 4607–4621. [Google Scholar] [CrossRef]
  30. Hwang, C.L.; Yoon, K. Multiple Attribute Decision Making: Methods and Applications; Springer: New York, NY, USA, 1981. [Google Scholar]
Figure 1. The MCDM model’s processes.
Figure 1. The MCDM model’s processes.
Axioms 11 00230 g001
Figure 2. Research Graph.
Figure 2. Research Graph.
Axioms 11 00230 g002
Figure 3. The devised AHP model for the evaluation process.
Figure 3. The devised AHP model for the evaluation process.
Axioms 11 00230 g003
Figure 4. Digital marketing technologies ranking list.
Figure 4. Digital marketing technologies ranking list.
Axioms 11 00230 g004
Table 1. Linguistic measures of significance.
Table 1. Linguistic measures of significance.
( μ ,   v ,   π )   Score Index (PI)
Absolute high significance (AH)(0.9, 0.1, 0.0)9
Very high significance (VH)(0.8, 0.2, 0.1)7
High significance (HS)(0.7, 0.3, 0.2)5
Slightly high significance (SM)(0.6, 0.4, 0.3)3
Equally significance (ES)(0.5, 0.4, 0.4)1
Slightly low significance (SL)(0.4, 0.6, 0.3)1/3
Low significance (LS)(0.3, 0.7, 0.2)1/5
Very low significance (VL)(0.2, 0.8, 0.1)1/7
Absolutely low significance (AL)(0.1, 0.9, 0.0)1/9
Table 2. The professionals interviewed.
Table 2. The professionals interviewed.
CategoryProfileNo. of Experts
Education levelBSc in Marketing/BSc in Information technology/Business administration 9
MSc in Marketing/BSc in Information technology/Business administration4
PhD in Marketing/BSc in Information technology/Business administration2
Work ExperienceBetween five to ten years3
More than ten years12
AgeBetween 20- to 30-year-old1
More than 30-year-old14
Table 3. Initial comparison matrices.
Table 3. Initial comparison matrices.
Left Criteria Is Greater Right Criteria Is Greater
DimensionAHVHHSSMESSLLSVLALDimension
C11 4321311 C12
C11 43215 C13
C11 32145 C21
C11 3411321 C22
C11 344211 C23
C11 333411 C31
C11 234123 C32
C11 341133 C33
C12 34332 C13
C12 134511 C21
C12 23451 C22
C12 23451 C23
C12 34521 C31
C12 34521 C32
C12 34251 C33
C13 34521 C21
C13 242151 C22
C13 343221 C23
C13 13443 C31
C13 14334 C32
C13 322422 C33
C21 45411 C22
C21 3342111 C23
C21 423114 C31
C21 334221 C32
C21 45132 C33
C22 433113 C23
C22 222423 C31
C22 34332 C32
C22 223431 C33
C23 43422 C31
C23 451122 C32
C23 34413 C33
C31 34323 C32
C31 23451 C33
C32 34521 C33
Table 4. Results from the SF-AHP model.
Table 4. Results from the SF-AHP model.
CriteriaSpherical Fuzzy WeightsCrisp Weights
C110.4390.5330.3240.092
C120.4250.5450.3190.089
C130.3950.5970.2810.084
C210.4620.5320.2880.099
C220.4870.4990.2960.105
C230.5380.4550.2930.117
C310.5740.4140.2820.126
C320.6160.3790.2670.137
C330.6670.3300.2530.150
Table 5. Normalized matrix.
Table 5. Normalized matrix.
A1A2A3A4A5
C110.549760.427590.305420.488680.42759
C120.616670.342590.479630.205560.47963
C130.446300.255030.573820.510060.38255
C210.536920.201350.536920.134230.60404
C220.524890.408250.466570.349930.46657
C230.445400.509030.445400.381770.44540
C310.538820.478950.419080.419080.35921
C320.482420.422120.482420.422120.42212
C330.538820.419080.419080.478950.35921
Table 6. Normalized weighted matrix.
Table 6. Normalized weighted matrix.
A1A2A3A4A5
C110.050730.039460.028180.045090.03946
C120.055040.030580.042810.018350.04281
C130.037280.021300.047930.042600.03195
C210.053300.019990.053300.013320.05996
C220.055140.042880.049010.036760.04901
C230.052280.059750.052280.044810.05228
C310.068140.060570.053000.053000.04543
C320.066100.057840.066100.057840.05784
C330.080690.062760.062760.071720.05379
Table 7. Ranking score.
Table 7. Ranking score.
AlternativesSi+Si-Ci
A10.01460.07350.8342
A20.06020.02990.3314
A30.03670.05760.6108
A40.06720.03340.3322
A50.04400.05670.5635
Table 8. Comparing results with TOPSIS with equal weights Ci value.
Table 8. Comparing results with TOPSIS with equal weights Ci value.
AlternativesTOPSIS with Equal Weights
Ci Value
RankProposed MCDM Model
Ci Value
Rank
A10.822210.83421
A20.306150.33145
A30.637220.61082
A40.333440.33224
A50.605830.56353
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Trung, N.Q.; Thanh, N.V. Evaluation of Digital Marketing Technologies with Fuzzy Linguistic MCDM Methods. Axioms 2022, 11, 230. https://doi.org/10.3390/axioms11050230

AMA Style

Trung NQ, Thanh NV. Evaluation of Digital Marketing Technologies with Fuzzy Linguistic MCDM Methods. Axioms. 2022; 11(5):230. https://doi.org/10.3390/axioms11050230

Chicago/Turabian Style

Trung, Ngo Quang, and Nguyen Van Thanh. 2022. "Evaluation of Digital Marketing Technologies with Fuzzy Linguistic MCDM Methods" Axioms 11, no. 5: 230. https://doi.org/10.3390/axioms11050230

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop