Next Article in Journal
A More Flexible Asymmetric Exponential Modification of the Laplace Distribution with Applications for Chemical Concentration and Environment Data
Previous Article in Journal
Network Thermodynamics-Based Scalable Compartmental Model for Multi-Strain Epidemics
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Extension of Interval-Valued Fermatean Fuzzy TOPSIS for Evaluating and Benchmarking COVID-19 Vaccines

Department of Management and Quantitative Methods in Economics, University of Plovdiv Paisii Hilendarski, 4000 Plovdiv, Bulgaria
*
Author to whom correspondence should be addressed.
Mathematics 2022, 10(19), 3514; https://doi.org/10.3390/math10193514
Submission received: 13 July 2022 / Revised: 12 August 2022 / Accepted: 22 September 2022 / Published: 26 September 2022
(This article belongs to the Section Fuzzy Sets, Systems and Decision Making)

Abstract

:
In order to help curb the spread of the COVID-19 pandemic, this paper develops a multi-attribute decision-making framework for COVID-19 vaccine evaluation based on their major clinical characteristics and efficacy. Firstly, a new multi-criteria Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) modification has been constructed in an interval-valued Fermatean fuzzy (IVFF) environment, improving the shortcomings of traditional TOPSIS. Secondly, a new conceptual framework for static and dynamic evaluation of COVID-19 vaccines has been built. The proposed methodology incorporates a variety of crisp and fuzzy MCDM methods. The analysis of the results of two practical examples shows that the new framework for vaccine comparison is feasible and effective, and finally, some recommendations for enhancement of government anti-COVID-19 strategies are suggested.

1. Introduction

The coronavirus epidemic is one of the most serious challenges facing countries in the world since World War II [1]. More than 550 million people have been infected and at least 6.3 million have died so far from severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) [2]. Due to unprecedented investments in research and development and global collaboration, scientists have rapidly developed a variety of vaccines against coronavirus disease 2019 (COVID-19) in record time [3]. According to World Health Organization (WHO) [4], vaccination prevents a disease from spreading through a population and decreases severe COVID-19 illness and deaths.
However, there is false and misleading content on the Internet that vaccines modify DNA, harm or cause poisoning of the human body, etc. [5]. All these misconceptions about the safety and effects of COVID-19 vaccines can lead to hesitation and denial of vaccination among the population. The lack of a common perspective on the worldwide health crisis can cause significant damage to public health, through paranoia and fear, and leave people unprotected or more vulnerable to the virus [6].
In September 2021, WHO [7] set an ambitious global action plan—to reach 70% global vaccination coverage, including 100% of those aged over 60, 100% of health workers, and 100% of those with underlying conditions by 30 June 2022. In the European Union, by 1 September 2021, just eight months after the start of COVID-19 vaccination, 70% of the adult population has already been fully vaccinated [8]. Unfortunately, the picture is different in other parts of the globe. In low-income countries, the share of vaccinated is still very small—less than 15% of the population has been inoculated within the specified period. In 90 out of 220 countries, only between 20% and 70% of the population has been vaccinated within the same period [9]. This delay in the immunization process could prolong the fight against the pandemic and has serious economic consequences, such as a slowdown in economic recovery, lack of supply in global labor markets, an increase in government debt, and a decline in investments.
Insufficient production of vaccines, their supply chain challenges, and uneven global distribution have a particularly negative impact on the low-income population of the world:
  • Citizens live at elevated risk of health problems and higher mortality from COVID-19 and related comorbidities.
  • There is a growing probability of the emergence of a black market for vaccines against COVID-19.
  • Elderly and vulnerable people can easily fall victim to vaccine fraud.
The main challenges of insufficient vaccination and low immunization rates to the governments are as follows:
  • Vaccines shortages—require a solving budget, transportation, and logistics problems such as supply chain disruptions and delays caused by suppliers.
  • Providing an informed choice of vaccine—raises the question of comparing available vaccines based on different indicators and objective decision-making.
  • Vaccine hesitancy—specific concerns of some communities can be overcome through coordinated public information campaigns at the local and global levels.
  • Delayed vaccination and lack of immunity—require more restrictions if the pandemic returns.
Many of the above-mentioned challenges could be overcome by improving public health strategies by adding administrative activities. To resolve the second challenge, multi-criteria decision-making (MCDM) methods can be applied. These techniques can handle the problem of vaccine selection involving a multitude of criteria in sorting a finite set of decision alternatives and emphasizing the best feasible option. MCDM methods have a wide variety of applications, including product selection [10,11] and customer prioritization [12].
Unlike classic MCDM methods, their fuzzy variants may select the best alternative in case of imprecise and vague estimates. Many MCDM methods have been modified using fuzzy sets and their advances variations [13,14,15,16]. The application of fuzzy assessments describes real-life situations more objectively and improves ranking in case of subjectivity and inaccuracy in assessment. The main advantage of fuzzy multi-criteria algorithms for decision analysis is that they construct more realistic rankings in decision-making process [17].
In this paper, our tasks are the following: (1) develop and verify new MCDM framework for COVID-19 vaccine selection, and (2) study and evaluate new modification of multi-criteria Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) method as a tool for comparison and prioritizing of COVID-19 vaccines. We compare vaccines’ features under two scenarios—in static and dynamic situations and compare different vaccines to understand which ones are more effective and safer.
The contributions of this paper can be summarized as follows:
(1)
We analyze and summarize the existing multi-criteria approaches for COVID-19 vaccines selection. We classify them according to the included techniques and types of estimates (numeric, interval and linguistic values; crisp and fuzzy numbers) and divide them into three main categories by their complexity (number of multi-criteria techniques), flexibility (fuzziness character) and iteration (single or repeated data processing), respectively.
(2)
We design a theoretical framework for ranking COVID-19 vaccines based on single and hybrid methods with both crisp and fuzzy estimates. The former employ only one weight determination or ranking method, while the latter uses a combination of weight determination and ranking methods. We also apply several auxiliary techniques such as fuzzy interval arithmetic operations, robustness, and sensitivity analysis to improve the efficacy of decision analysis and approach benchmark rankings. To enhance the efficiency of the developed fuzzy Fermatean group TOPSIS method, we implement a recently proposed 3D distance metric to achieve a better multi-criteria comparison of vaccines’ features.
(3)
Finally, we construct static and dynamic rankings with real-world COVID-19 datasets based on single or repeated multi-criteria decision analysis. In the former case, we employ experts’ opinions as input for decision matrices. In the latter case, the ranking depends on measuring public attitudes towards vaccines. The dynamics detection may also be based on the user’s behavior and feelings, expressed in social media data. The comparative analysis of obtained results with other multi-criteria baselines shows the effectiveness as well as the necessity of proposed ideas.
This paper is organized as follows: Section 2 presents the literature review outlining the motivation of our study. Section 3 describes the proposed theoretical decision-making framework for vaccine selection, main characteristics, and operations with interval-valued Fermatean fuzzy numbers (IVFFNs) and new TOPSIS modification in the IVFF environment. Section 4 provides details about two practical examples and ends with a discussion on the obtained results. The last section summarizes the work completed, concludes with final remarks, and set up directions for future works.

2. Related Work

2.1. Literature Review on MCDM and Its Applications in COVID-19 Vaccine Evaluation

Although vaccines against COVID-19 have recently been developed, they have already been explored in many studies. Some of scholars reflect only the medical point of view and their research is essentially descriptive or generic. They usually make purely medical comparisons and often do not rely on advanced statistical methods for data analysis. Another part of studies involves modern computational approaches such as machine learning, optimization, and MCDM methods. The advantage of the latter approach is that MCDM does not require large datasets and computationally intensive procedures.
Öztaş et al. have discovered the most important criteria that count in decision-making considering uncertainties associated with parameters such as risks, and costs for individuals in order to select the right COVID-19 vaccine. A survey study for assessment according to the given most important criteria based on expert opinion is conducted through the Best Worst Method (BWM) for weight determination. The obtained results show that the efficacy criterion has the highest score, and it is followed by storage requirements, incorporated vaccine technology, and international acceptance criterion. Participants prioritize the origin and price of the vaccine behind all other criteria [18].
Abdelwahab et al. have proposed and developed a novel vaccine selection decision-making model (VSDMM), based on the analytic hierarchy process (AHP) technique to assess many alternatives (vaccines). In this study, six COVID-19 vaccines have been compared with respect to six criteria: (1) vaccine availability; (2) vaccine formula; (3) vaccine efficacy; (4) vaccine-related side effects; (5) cost savings, and (6) host-related factors [19].
Ozsahin et al. have evaluated fifteen important vaccines based on criteria such as dose number, dose schedule, storage advantages, efficacy, and side effects. In this evaluation, the researchers have used the fuzzy PROMETHEE approach, and the importance level of the criteria has been determined based on expert opinion [20].
Çetin et al. have compared, rated, and ranked SARS-CoV-2 vaccines as well as vaccine platforms in multi-attributes using grey systems theory. The authors have selected twelve leading vaccines and fourteen attributes such as efficacy rate, safety (reactogenicity) and protection against variants to children use, approvals to prices, logistics, and market share [21].
Öztürk et al. have employed the interval-valued intuitionistic fuzzy VIseKriterijumska Optimize Kompromisno Resenje (VIKOR) method for COVID-19 vaccine selection using criteria such as side effects of vaccines, supply chain processes, storage conditions, costs and perception on people in decision-making [22].
Forestal and Pi have created a hybrid methodology based on ELimination Et Choice Translating REality III (ELECTRE III)–Genetic Algorithm (GA) and TOPSIS to select the optimal SARS-CoV-2 vaccine [23].
Ecer has developed a new intuitionistic fuzzy (IF) extension of the multi-attributive ideal–real comparative analysis (MAIRCA) framework to assess coronavirus vaccines. Based on the group decision-making, the IF-MAIRCA both extracts the criteria weights and discovers the prioritization of the alternatives under uncertainty. In this work, five coronavirus vaccines are evaluated according to various criteria. The findings demonstrate that the most significant criteria considered in coronavirus vaccine selection are the duration of protection, the effectiveness of the vaccine, success against the mutations, and logistics, whereas the best coronavirus vaccine is Vaxzevria (AZD1222) [24].
According to their complexity (number of decision methods used), the existing models may be divided into two groups—single [18,21] or hybrid [19,23] multi-criteria techniques, respectively. According to input data specifics, models can also be divided into two groups—crisp [18,19,21,23] or fuzzy [20,22,24] estimates. The first group is developed for arithmetic calculations and distance metrics for crisp input values, while the second one unites multi-criteria methods working in fuzzy environments. The last third category also includes two groups of methods: non-iterative and iterative. The former involves the ranking of particular alternatives that are already known to the decision-maker. The latter prioritizes a dynamic set of alternatives on an ongoing basis (e.g., periodically), including in real time. All the above-mentioned studies refer to non-iterative methods.
The literature review shows that there is no universal approach or unified procedure for solving the COVID-19 vaccine selection problem. The previous studies provide some insights on the comparison of vaccines, but they also demonstrate some shortcomings:
(1)
The majority of proposed multi-criteria solutions do not offer a holistic (multi-stage) solution but focus only on specific parts of the problem such as: (1) determining the relative importance of a few medical attributes in the criteria system [18] or (2) generating of vaccines ranking based on only one multi-criteria method [19,21].
(2)
There are only a few studies [20,22,24] that can handle inaccurate attribute estimates. As the evaluation of COVID-19 vaccines often depends on qualitative factors, their assessments should be made by a group of experts using classic fuzzy numbers or their advanced variants.
(3)
Most of existing fuzzy solutions implement only one or two MCDM methods in a non-iterative procedure [20,22].
However, evaluation should be a holistic process depending on many factors; for example, technological, economic and organizational parameters, which can often be expressed only by inaccurate, unclear and uncertain estimates. To overcome the above-mentioned drawbacks, in this paper we propose a new fuzzy methodology for COVID-19 vaccine selection. The choice of a specific vaccine according to the public health strategy or individual preferences is a complex procedure, influenced by many features. While at national level preferred vaccine depends on factors such as national vaccination program, availability and affordability (storage and transport requirements) of vaccines, at individual level, choice may be influenced by health status, age, lifestyle, occupation of the person as well as GP or immunization provider recommendations.
To solve COVID-19 vaccine selection problem, we propose to follow a unified way applying a new integrated multi-criteria framework for vaccines’ data processing. The group multi-criteria approach has the potential to solve this multi-factor problem. Alternatives include a variety of COVID-19 vaccines currently available in a particular country. The solution to the problem is the vaccine that best meets the national requirements or recipient’s preferences.

2.2. Literature Review on Proposed Vaccines’ Evaluation Criteria

The COVID-19 vaccines usually contain an agent that resembles the disease-causing microorganism and are often made from an attenuated, inactivated, or killed form of the virus or one of its surface proteins. The immune response protects from infection if the real virus enters the human body. According to the literature review, the most important characteristics for COVID-19 vaccine evaluation are the following: type of vaccine, number of doses, dose schedule, storage conditions, efficacy, and side effects [18,19,20,21,22,24,25]. In this subsection, we present these vaccines’ peculiarities in order to build an attribute-based evaluation system.
(1)
Vaccine Type
There are three main approaches to designing COVID-19 vaccines using: viral vector; parts (subunits) or whole virus; genetic material, providing instructions for making specific proteins that can trigger the immune system.
  • Viral vector vaccines—these vaccines use a harmless virus version called “vector” to deliver to the body a gene of SARS-CoV-2. Cells employ it to produce a harmless fragment of the coronavirus, or so-called “spike” protein, found on the surface of SARS-CoV-2. Once the immune system recognizes this foreign protein, it creates antibodies and defensive white blood cells. If the body later becomes infected with the COVID-19 virus, the antibodies will fight it. The Jcovden COVID-19 vaccine (Janssen) is a vector vaccine. AstraZeneca and the University of Oxford have also developed a vector COVID-19 vaccine (Vaxzevria).
  • Antigen vaccines—they use specific antigens to stimulate the immune system. Subunit antigen vaccines include only the parts of a virus that stimulate the immune system. This type of COVID-19 vaccine also contains harmless proteins. The immune system recognizes it as a foreign protein and thus activates the body’s natural defenses. Nuvaxovid (Novavax) is a protein subunit COVID-19 vaccine. The second group of antigen vaccines is those with the inactivated whole virus. They are produced using traditional vaccine technology and has established methods and a high level of safety. A theoretical advantage of inactivated vaccines is that they contain additional viral proteins, which could broaden protection beyond anti-spike protein responses and reduce the escape of variants from vaccine immunity. Valneva COVID-19 vaccine (VLA2001) is currently the only whole virus, inactivated vaccine candidate in clinical trials against COVID-19 in Europe.
  • Nucleic acid vaccines—messenger RiboNucleic Acid (mRNA) teaches cells how to produce a protein (or part of a protein) that elicits an immune response. The technology for creating an mRNA vaccine has been developed for several decades. These vaccines do not contain live viruses and do not affect human DNA. mRNAs are the vaccines of Pfizer/Biontech and Moderna, Comirnaty, and Spikevax, respectively.
(2)
Number of doses and dose schedule
The number of doses and time interval between doses are important indicators that affect the vaccination rate. Each next dose further complicates the vaccination procedure and prolongs the time required for its primary series. It is crucial to maintain users’ motivation to finish a multi-dose vaccination. The vaccine schedule is also an essential factor influencing the completion of the vaccination process.
(3)
Storage Advantages
Conditions of use and storage, shelf life, and stringent requirements in vaccine transport are very important in state-level procurement planning. The solution to various supply chain problems does not affect in any way the choice of vaccine at the individual level. However, they may influence government decision-making regarding vaccine policy and deployment. Currently, Comirnaty is the only COVID-19 vaccine that should be stored and transported at ultra-low temperature conditions (−60 °C to −86 °C). Recommended temperatures for the majority of vaccines are between 2 °C and 8 °C for the refrigerator and between −50 °C and −15 °C for the freezer.
(4)
Efficacy
The efficacy of vaccines refers to the degree to which a vaccine prevents symptomatic or asymptomatic infection in clinical trials. Effectiveness is associated with preventing person-to-person virus transmission; protecting against serious illness and hospitalization, and significantly reducing the risk of death. It has been found that after its administration, the efficacy of the COVID-19 vaccines gradually decreases over time. The level of protection of COVID-19 vaccines ranges among different age groups and virus strains.
(5)
Side Effects
COVID-19 vaccines can cause side effects, but not everybody will experience them. In addition, most side effects of vaccination are mild and short-term. Scientists continue to accumulate and analyze data on the frequency of adverse reactions after vaccine administration and their severity. Based on datasets collected so far, some numerical indicators can be formed for the side effects caused by COVID-19 vaccines.
The above list of attributes for vaccines’ comparison can be expanded using additional indicators such as medical (number of doses administered, the number of hospitalizations, number of severe cases among the vaccine group), technological (production technology, composition, dose quantity) or economic (cost per dose) parameters.

2.3. Literature Review on COVID-19 Vaccines

In this subsection, we present the most widely used COVID-19 vaccines, approved by the world’s leading authorities.
Comirnaty is a vaccine for preventing COVID-19 in people aged 5 years and older. Comirnaty contains mRNA molecules with instructions for producing a protein from SARS-CoV-2. Comirnaty does not contain the virus itself and cannot cause COVID-19. According to the WHO Strategic Advisory Group of Experts on Immunization (SAGE), the Pfizer-BioNTech COVID-19 mRNA vaccine is safe and effective. The vaccine is approved for use as a two-dose series. Individuals may receive the second dose 4-8 weeks after the first dose in the primary series. The efficacy of Comirnaty is 95% [20].
2.
Spikevax (previously COVID-19 Vaccine Moderna) (mRNA-1273), Moderna, Cambridge, MA, USA (https://www.modernatx.com, accessed on 7 July 2022)
Spikevax is a vaccine for preventing COVID-19 in people aged 6 years and older. Spikevax contains mRNA molecules, which have instructions for making the spike protein. Spikevax does not contain the virus itself and cannot cause COVID-19. The vaccine is approved for use as two doses in the primary series, given 4–8 weeks apart. The efficacy of Spikevax is 94.1% [26].
3.
Convidecia (Ad5-nCoV), CanSino Biologics, Tianjin, China, (https://www.cansinotech.com, accessed on 7 July 2022)
Convidecia is a recombinant viral vector vaccine for COVID-19 produced in China. The single-dose vaccine was developed on CanSino Biologics’ adenovirus-based viral vector vaccine technology platform. The WHO’s SAGE recommends the use of the vaccine as a single dose, in all age groups 18 and above. The efficacy of Convidecia is 63.7% [20].
4.
Sputnik V (Gam-COVID-Vac), Gamaleya Research Institute of Epidemiology and Microbiology, Moscow, Russia, (https://gamaleya.org/en, accessed on 7 July 2022)
The COVID-19 vaccine Sputnik V is an adenoviral-based, two-part vaccine against the SARS-CoV-2 coronavirus. Initially produced in Russia in 2020, Sputnik V uses a weakened virus to deliver small parts of a pathogen and stimulate an immune response. The Sputnik V vaccine reduces the time taken for the actual development of immunity to SARS-CoV-2. The Sputnik V is a two-dose schedule vaccine that has been administered to people who are 18 years of age and above. The second dose should be taken after a 3-week gap from the first dose. The efficacy of Sputnik V is 95% [20].
5.
EpiVacCorona (Aurora-CoV), Vektor State Research Center of Virology and Biotechnology, Koltsovo, Novosibirsk Oblast, Russia (http://www.vector.nsc.ru/, accessed on 7 July 2022)
EpiVacCorona is a COVID-19 preventive vaccine developed by the Vektor State Research Center of Virology and Biotechnology in Russia. EpiVacCorona is an antigens-based vaccine that provokes an immune reaction against COVID-19 and promotes immunity development. The EpiVacCorona vaccine requires two intramuscular administrations spaced 21–28 days apart. The efficacy of EpiVacCorona is 100% [20].
6.
BBIBP COVID-19 vaccine (BBIBP-CorV), Beijing Institute of Biological Products Co., Ltd., China National Pharmaceutical Group Corporation (CNPGC, Sinopharm), Beijing, China, (http://www.sinopharm.com, accessed on 7 July 2022)
The Sinopharm BBIBP (BBIBP-CoV, Covilo) COVID-19 vaccine is an inactivated virus vaccine made of virus particles grown in culture and lacks disease-producing capability. The vaccine is two-dose, administered on a 21–28-day schedule. The efficacy of BBIBP COVID-19 vaccine is 79.6% [27].
7.
WIBP COVID-19 vaccine (WIBP-CorV), China National Pharmaceutical Group Corporation (CNPGC, Sinopharm), Wuhan, China (http://www.sinopharm.com, accessed on 7 July 2022)
The Sinopharm WIBP COVID-19 vaccine is the second of two inactivated virus COVID-19 vaccines developed by Sinopharm. The vaccine is two-dose, administered on a 21–28-day schedule. The efficacy of WIBP COVID-19 vaccine is 72.8% [28].
8.
CoronaVac (PiCoVacc), Sinovac Biotech, Beijing, China, (www.sinovac.com, accessed on 7 July 2022)
Sinovac COVID-19 vaccine is based on an inactivated pathogen made by growing the whole virus in a laboratory and then destroying it. CoronaVac is a 2-dose inactivated vaccine administered on a 14–28-day schedule. The efficacy of CoronaVac is 83.5% [20].
9.
Vaxzevria (previously COVID-19 Vaccine AstraZeneca) (AZD1222), University of Oxford, Oxford, UK; AstraZeneca Cambridge, UK (https://www.astrazeneca.com, accessed on 7 July 2022)
The Vaxzevria vaccine is developed from a virus, which is a weakened version of a common cold virus (adenovirus). In addition, genetic material has been added to make proteins from the coronavirus. After vaccination, the surface spike protein is produced, priming the immune system to attack SARS-CoV-2 if it later infects the body. The Vaxzevria primary vaccination course consists of two separate doses. The second dose should be administered between 4 and 12 weeks after the first dose. The efficacy of Vaxzevria is 79% [20].
10.
Nuvaxovid (NVX-CoV2373), Novavax, Gaithersburg, MD, USA (https://www.novavax.com/, accessed on 7 July 2022)
Nuvaxovid is a subunit vaccine and contains a version of the spike protein, which has been produced in a laboratory. It also contains an “adjuvant”, a substance to help strengthen the immune responses to the vaccine. The dose schedule is to give 2 doses 21 days apart. The efficacy of Nuvaxovid is 92.6% [29].
11.
Jcovden (previously COVID-19 Vaccine Janssen), Janssen Pharmaceutical, Beerse, Belgium (https://www.janssen.com, accessed on 7 July 2022)
Jcovden is produced by another virus (of the adenovirus family) that has been modified to contain the gene for making a protein found on SARS-CoV-2. Jcovden does not contain SARS-CoV-2 itself and cannot cause COVID-19. The vaccine is authorized for emergency use as a one-dose series. The efficacy of Jcovden is 74.8% [30].
12.
INO-4800, Inovio Pharmaceuticals, Plymouth Meeting, PA, USA, https://www.inovio.com, International Vaccine Institute, Seoul, South Korea (https://www.ivi.int/, accessed on 7 July 2022)
INO-4800 is a nucleic-acid-based vaccine that encodes for the entire length of the spike protein of SARS-CoV-2. The stability of the product does not require freezing in storage and transport. The vaccine has a two-dose regimen, administered one month apart. The efficacy of INO-4800 is 95% [31].
13.
Covaxin (BBV152), Bharat Biotech, Turkapally, Hyderabad, India (https://www.bharatbiotech.com, accessed on 7 July 2022)
Covaxin is an inactivated COVID-19 vaccine based on the Asp614Gly variant that uses adjuvant to boost immune response and longer-lasting immunity. SAGE recommends the use of the BBV152 vaccine in two doses. The vaccine can be administered at an interval of 4 weeks. The efficacy of Covaxin is 78% [20].
14.
Covifenz (CoVLP+AS03), Medicago, Quebec, QC, Canada, https://medicago.com/en; GSK, London, UK (https://www.gsk.com, accessed on 7 July 2022)
Covifenz COVID-19 vaccine uses living plants as bioreactors to produce non-infectious versions of viruses (virus-like particles, or VLP). VLPs mimic the architecture of a virus but are non-infectious. The natural cell process of Nicotiana benthamiana plants is exploited to produce VLPs. The dosing schedule is two doses 21 days apart. The efficacy of Covifenz is 95% [20].
15.
Covishield (AZD1222), Serum Institute of India, Pune, Maharashtra, India (https://www.seruminstitute.com, accessed on 7 July 2022)
Covishield COVID-19 vaccine, formerly known as ChAdOx1 nCoV-19, is made from a weakened version of an adenovirus. In addition, genetic material has been added to the ChAdOx1 construct, which is used to make proteins from the SARS-CoV-2 spike protein. CoviShield is the Serum Institute of India version of the AstraZeneca COVID-19 vaccine. The gap between the first and second doses of the Covishield vaccine was extended to 12−16 weeks. The efficacy of Covishield is 62% [20].
Table 1 contains data about manufacturer, type of vaccine, applicability, conditions for storage, dosing schedule and efficacy of above-mentioned COVID-19 vaccines.
According to the collected data (Table 1), all the above-mentioned vaccines are safe and effective tools to prevent COVID-19 transmission, hospitalization, and death, but their characteristics vary depending on the particular vaccine considered. The analysis of the main characteristics of selected COVID-19 vaccines shows that the most commonly used vaccines belong to the three main vaccine types:
  • Viral vector vaccines—Convidecia, Sputnik V, Vaxzevria, Jcovden, Covishield (5);
  • Antigen vaccines: inactivated virus vaccines—BBIBP, Wuhan Sinopharm inactivated vaccine, CoronaVac, Covaxin (4); protein-based vaccines—EpiVacCorona, Nuvaxovid, Covifenz (3);
  • mRNA/DNA vaccines—Comirnaty, Spikevax (2); Spike DNA-based—INO-4800 (1).
Most COVID-19 vaccines require two doses because the second dose helps to better reinforce the immune response. Only two out of fifteen vaccines (CanSino Biologics and Janssen COVID-19 vaccines), both viral vector vaccines, require only one shot. In the rest of the cases, the interval between doses for two-dose vaccines should be three- or four-week. Moreover, three out of fifteen vaccines require ultra-low or fridge temperature conditions (Comirnaty, Spikevax, and Sputnik V). Overall, all COVID-19 vaccines have high efficacy against the original strain and the variants of concern and are well tolerated. Comirnaty, Spikevax, Sputnik V, EpiVacCorona, INO-4800, and Covifenz have the highest efficacy (more than 90%) after two doses in preventing symptomatic cases. The described vaccines rarely expose serious adverse effects. Some side effects of the vaccination are similar to the symptoms of COVID-19 (pain, redness, or swelling at the site where the shot was administered, tiredness, headache, muscle pain, chills, fever, or nausea throughout the rest of the body) [25].

3. Methodological Framework for Vaccine Selection

This section provides an overview of the theoretical foundations of contemporary MCDM methods and interval-valued Fermatean fuzzy numbers (IVFFNs). Then, we introduce a new TOPSIS modification via IVFFNs. Finally, we propose a new conceptual framework for the analysis of COVID-19 vaccine data.

3.1. Methodological Foundations of MCDM Methods

The multi-criteria decision methods are used to select the most suitable candidates among a given set of alternatives ranked by multiple criteria. MCDM methods with crisp and fuzzy numbers refer to the group of soft computing methods. The first MCDM method has been created in the 1970s. Some of the advantages of these methods are as follows:
  • They can be used in both modes—individual and group by decision-making experts.
  • They can easily be combined in pairs consisting of the relative weight determination method and method for alternative ranking.
  • They do not require large datasets and high-performance computing.
  • The input data (the characteristics of alternatives and criteria weights) could be heterogeneous, evaluated with both crisp values and uncertain estimates—discrete or interval values, linguistic variables, fuzzy (symmetric or asymmetric; type-1 or type-2 fuzzy numbers; spherical, Fermatean, etc.), estimates.
The relative weights of vaccines’ attributes can be calculated via statistical measures, such as variation, mean squared error and entropy; traditional (DEcision MAking Trial and Evaluation Laboratory—DEMATEL (1973), Analytic Hierarchy Process—AHP (1983), Measuring Attractiveness by a Categorical-Based Evaluation Technique—MACBETH (1999)) and modern (Best Worst Method—BWM (2015), Method based on the Removal Effects of Criteria—MEREC (2021) [32]) methods for weight determination.
For solving the problem for COVID-19 vaccines selection, we propose to employ the classic Technique for Order of Preference by Similarity to Ideal Solution—TOPSIS (1981) [33] method and some recently developed MCMD models. The most widely used MCDA techniques, created after the first decade of the 21st century are as follows: Additive Ratio Assessment—ARAS (2010) [34], Weighted Aggregated Sum Product Assessment—WASPAS (2014) [35], Evaluation based on Distance from Average Solution—EDAS (2015) [36], Multi-Attribute Border approximation Area Comparison—MABAC (2015) [37], MAIRCA (2016) [38], Combinative Distance-based Assessment—CODAS (2016) [39] and Measurement of Alternatives and Ranking according to Compromise Solution—MARCOS (2020) [40].
TOPSIS (1981) is a distance-based multi-criteria method and calculates the distances between every alternative and the ideal and anti-ideal solutions, the best and the worst result on each criterion, respectively. The winner is the alternative with the highest coefficient of relative closeness to the ideal solution. In ARAS, the utility value of each alternative is divided by the value of the optimal alternative and the results are used as ranking values to select the best alternative. The utility function of the WASPAS method summarizes the values obtained by the Single Additive Weighting (SAW) and Weighted Product Method (WPM). EDAS is a distance-based multi-criteria method, and its evaluation of each alternative depends on the positive and negative distance to the average solution (average value of each criterion estimates). In MABAC, the evaluations of alternatives are functions of their distance to the border approximation area. MAIRCA calculates the gaps between ideal and empirical ratings. The best alternative in the ranking is the one with the lowest gap value. In CODAS, the ranking depends on the Euclidean and Manhattan distance to the negative ideal solution. For MARCOS, the value of each alternative depends on its relation to the ideal and anti-ideal solution.
The above-mentioned techniques belong to two main categories of multi-criteria methods—scoring and compromising methods. In the first category, the decision maker’s preferences are expressed via the utility function. To this category belong ARAS and WASPAS methods. The second category includes methods that find a feasible solution for alternatives’ ranking, which is the closest/farthest to the ideal/anti-ideal (the best/the worst compromise), and helps decision-makers to reach a final ranking. TOPSIS, EDAS, MABAC, MAIRCA, CODAS, and MARCOS are members of the second MCDM category.

3.2. Interval Value Fermatean Fuzzy Numbers—Some Basic Definitions and Operations

The implementation of interval-valued Fermatean fuzzy sets (IVFFSs) [41] for TOPSIS modification requires knowledge about their peculiarities and arithmetic operations. In this subsection, we present some fundamental ideas related to IVFFNs.
The theory of IVFFSs is an extension of FFS (2020). IVFFSs are three-dimensional and their belongingness grade (BG), non-belongingness grade (NG), and hesitation grade are represented by numbers from an interval within 0 , 1 . The only constraint is that the cube sum of respective upper bounds of the interval-valued BG and interval-valued NG is less or equal to 1. Moreover, the BG and NG within an IVFFS are described by flexible interval values. Thus, compared with the FFSs, IVFFSs can present the uncertainty more precisely. Often the available data make it difficult for decision-makers and researchers to obtain crisp BG and NG for assessments of given alternatives. In such a situation, IVFFNs with flexible interval-valued BG and NG are suitable to address such concerns.
Definition 1.
Let U be the universe of discourse and I n t 0 ,   1  be the set of all closed subintervals of 0 ,   1  Then an IVFFS T is defined by a mapping from U in Int[0, 1] as follows:
T = u i ,   μ T l b u i , μ T u b u i , ν T l b u i , ν T u b u i :   u i U ,
where
0 μ T l b u i μ T u b u i 1 ,   0 ν T l b u i ν T u b u i 1   a n d   μ T u b u i 3 + ν T u b u i 3 1 .
Here  μ T u i = μ T l b u i , μ T u b u i and ν T u i = ν T l b u i , ν T u b u i represent the BG and NG of u i U , correspondingly, in terms of interval values.
The function π T u i = π T l b u i , π T u b u i denotes the hesitancy (indeterminacy) degree of u i to T, where
π T l b u i = 1 μ T u b u i 3 ν T u b u i 3 3   a n d   π T u b u i = 1 μ T l b u i 3 ν T l b u i 3 3
For simplicity, an Interval-Valued Fermatean Fuzzy Number (IVFFN) could be signified by λ = μ λ l b , μ λ u b , ν λ l b , ν λ u b , which fulfils μ λ u b 3 + ν λ u b 3 1 .
Definition 2.
For any IVFFN λ = μ λ l b , μ λ u b , ν λ l b , ν λ u b , the score function S  of λ is given by
S λ = 1 2 μ λ l b 3 + μ λ u b 3 ν λ l b 3 ν λ u b 3 , S λ 1 ,   1 .
Definition 3.
For any IVFFN λ = μ λ l b , μ λ u b , ν λ l b , ν λ u b , the accuracy function E  of λ is given by
E λ = 1 2 μ λ l b 3 + μ λ u b 3 + ν λ l b 3 + ϑ ν λ u b 3 , E λ 0 ,   1 .
Corresponding to the score and accuracy functions, a comparative scheme to compare any two IVFFNs   λ 1   and   λ 2   is given as:
If S λ 1 > S λ 2 , then λ 1 λ 2 ;
If S λ 1 = S λ 2 , then
If E λ 1 > E λ 2 , then λ 1 λ 2 ;
If E λ 1 < E λ 2 , then λ 1 λ 2 ;
If E λ 1 = E λ 2 , then λ 1 = λ 2 .
Definition 4.
Let λ = μ λ l b , μ λ u b , ν λ l b , ν λ u b , λ 1 = μ λ 1 l b , μ λ 1 u b , ν λ 1 l b , ν λ 1 u b and λ 2 = μ λ 2 l b , μ λ 2 u b , ν λ 2 l b , ν λ 2 u b be three IVFFNs and γ + . The operations on IVFFNs are given in the next formulas:
λ 1 λ 2 = max μ λ 1 l b , μ λ 2 l b , max μ λ 1 u b , μ λ 2 u b , min ν λ 1 l b , ν λ 2 l b , min ν λ 1 u b , ν λ 2 u b
λ 1 λ 2 = min μ λ 1 l b , μ λ 2 l b , min μ λ 1 u b , μ λ 2 u b , max ν λ 1 l b , ν λ 2 l b , max ν λ 1 u b , ν λ 2 u b
λ 1 λ 2 = μ λ 1 l b 3 + μ λ 2 l b 3 μ λ 1 l b 3 μ λ 2 l b 3 3 , μ λ 1 u b 3 + μ λ 2 u b 3 μ λ 1 u b 3 μ λ 2 u b 3 3 , ν λ 1 l b ν λ 2 l b , ν λ 1 u b ν λ 2 u b
α 1 α 2 = μ λ 1 l b μ λ 2 l b , μ λ 1 u b μ λ 2 u b , ν λ 1 l b 3 + ν λ 2 l b 3 ν λ 1 l b 3 ν λ 2 l b 3 3 , ν λ 1 u b 3 + ν λ 2 u b 3 ν λ 1 u b 3 ν λ 2 u b 3 3
γ λ = 1 1 μ l b 3 γ 3 ,   1 1 μ u b 3 γ 3 , ν l b γ , ν u b γ
λ γ = μ l b γ , μ u b γ , 1 1 ν l b 3 γ ,   1 1 ν u b 3 γ 3 3
In order to average IVFFNs, we employ a weighted averaging aggregation operator—interval-valued Fermatean fuzzy weighted averaging (IVFFWA) operator.
Definition 5.
Consider λ j = μ j l b , μ j u b , ν j l b , ν j u b ,   j = 1 , n ¯ be a collection IVFFNs and I V F F N : Ω n Ω , then IVFFWA can be given by the formula:
I V F F W A λ 1 , λ 2 ,   ,   λ n = j = 1 n ω j λ j ,
where Ω is a set of all IVFFNs and ω j is weight value with ω j 0 ,   1 and j = 1 n ω j = 1 .
The IVFFWA formula [41] is as follows:
I V F F W A λ 1 , λ 2 ,   ,   λ n = 1 j = 1 n 1 μ j l b 3 w j 1 3 , 1 j = 1 n 1 μ j u b 3 w j 1 3 , j = 1 n ν j l b w j , j = 1 n ν j u b w j
Definition 6.
Let λ 1 = μ λ 1 l b , μ λ 1 u b , ν λ 1 l b , ν λ 1 u b and λ 2 = μ λ 2 l b , μ λ 2 u b , ν λ 2 l b , ν λ 2 u b be IVFFNs. The Euclidean distance between IVFFNs λ 1 and λ 2 [42] is defined as follows:
D G E λ 1 ,   λ 2 = D μ + D ν + D π l + D π u 6 ,   w h e r e   D μ = μ λ 1 l b 3 μ λ 2 l b 3 2 + μ λ 1 u b 3 μ λ 2 u b 3 2 , D ν = ν λ 1 l b 3 ν λ 2 l b 3 2 + ν λ 1 u b 3 ν λ 2 u b 3 2 , D π l = 1 μ λ 1 l b 3 ν λ 1 l b 3 1 μ λ 2 l b 3 ν λ 2 l b 3 2   a n d   D π u = 1 μ λ 1 u b 3 ν λ 1 u b 3 1 μ λ 2 u b 3 ν λ 2 u b 3 2 .
To summarize, the space of IVFFNs is greater compared with the space of interval-valued intuitionistic fuzzy numbers (IVIFNs) and interval-valued Pythagorean fuzzy numbers (IVPFNs). Due to the relaxed constraint, IVFFSs are more accurate for handling complex uncertain MCDM problems than IVIFSs and IVPFSs.

3.3. TOPSIS in IVFFNs Environment

TOPSIS is one of the most widely used distance-based MCDM methods. It ranks the alternatives by measuring their closeness to the ideal solution and remoteness to the negative-ideal solution. To transform the method to work with IVFFNs, we propose measuring the distances between alternatives using Equation (11). The pseudocode of the new modified version of TOPSIS in IVFFNs environment is presented in Algorithm 1.
Algorithm 1. Pseudocode of IVFFNs TOPSIS.
Step 1:Formulation of DM problem:
   identify A i //  A is the set of given alternatives
   identify C j and ω j //  C is the set of identified criteria for A evaluation
//  ω is the set of relative weights of criteria
    X i , j i n t e r s e c A ,   C // Empty decision matrix X
Step 2:Input of X s
Step 2.1:Data transformation
  N l e n g t h A ; M l e n g t h C ; K number   of   experts
   for k in {1..K}
          for i in {1..N}
                for j in {1..M}
                          X k i , j A i , C j   // Input of assessments of kth expert in X k matrix
                        X ˜ k i , j X k i , j // Transform X matrices in IVFFNs values
                endfor
          endfor
   endfor
Step 2.2:Data processing
               for i in {1..N}
                         for j in {1..M}
                            X ˜ i , j I V F F W A X ˜ 1 i , j , X ˜ 2 i , j ,   ,   X ˜ k i , j //Averaging X ˜ for the group of experts according to Equation (10), where the experts have equal weight (1/K)
                         endfor
               endfor
Step 2.3:Data normalization
              for i in {1..N}
                for j in {1..M}
                     r ˜ i , j x ˜ i , j x ˜ i , j 2 //Normalizing each x ˜ using its score function according to Equation (2)
                endfor
              endfor
Step 3:Calculation of weighted value of assessments for each criterion
       for i in {1..N}
          for j in {1..M}
                v ˜ i , j w j r ˜ i , j //Weighting r ˜ according to Equation (8)
          endfor
       endfor
Step 4:Calculation of ideal and negative ideal solution for each criterion
       for i in {1..N}
           for j in {1..M}
A ˜ = v ˜ 1 , v ˜ 2 ,   , v ˜ M = max j v ˜ i , j | j B min j v ˜ i , j | j
A ˜ = v ˜ 1 , v ˜ 2 ,   , v ˜ M = min j v ˜ i , j | j B max j v ˜ i , j | j
// Computation of the ideal A ˜ and the negative ideal A ˜ solution for beneficial B and cost criteria ( ).
           endfor
       endfor
Step 5:Calculation of Euclidean distances to the ideal and negative ideal solutions for each alternative
       for i in {1..N}
D i = j = 1 M D G E v ˜ i , j ,   v ˜ j
D i = j = 1 M D G E v ˜ i , j ,   v ˜ j
// Computation of Euclidean distances from each alternative to the ideal and negative ideal solutions.
Step 6:for i in {1..N} R C i = D D + D + // Computation of the relative closeness of each alternative to the ideal solution
Step 7:Output of alternatives’ ranks in descending order of their assessment
Unlike classic fuzzy TOPSIS, the proposed IVFFNs modification requires a larger number of computations. However, here the evaluations of alternatives are presented more precisely and in detail, and the resulting ranking is based on a more exhaustive comparison.

3.4. Theoretical Framework for COVID-19 Vaccine Selection

The new framework for unified analysis of COVID-19 vaccines data consists of eight stages (Figure 1).
Stage 1. Analysis of the problem for COVID-19 vaccine selection
In the first stage, decision-makers should answer the question about the needs and expectations of COVID-19 vaccine selection. Using a systematic literature review, they collect data about authorized or approved vaccines and the current state of the vaccination process. Data can be extracted directly from journal articles and other types of reports of studies (official COVID-19 datasets, regulatory reviews, trial registers, clinical studies reports, etc.). The goal is to clarify what vaccines are available, what share of the population is unvaccinated, and where the locations for vaccination are. If the result obtained for a particular situation confirms the need for COVID-19 vaccines, the selection process can continue to Stage 2. Otherwise, it should go to the end of the process.
Stage 2. Development of user requirements specification for a COVID-19 vaccine
In this stage, the survey method can be used. The survey comprises a questionnaire that contains several question groups, corresponding to the different characteristics of vaccines and their use. At the end of this stage, the main parameters of the preferable COVID-19 vaccine are defined.
Stage 3. Construction of multi-criteria system for COVID-19 vaccines assessment
In this stage, a multi-criteria index for vaccine comparison is established. The new index is built according to the user requirements and the importance of vaccine specifications for a given situation. Other evaluation measures may also be included in the construction of the assessment systems such as organizational characteristics of the vaccination strategy or individual preferences. The set of criteria can also be expanded with additional technical specifications and economic data from COVID-19 vaccine manufacturers, vaccination trackers, or users’ reviews.
Stage 4. Selection of data types and MCDM methods for relative weights and ranking of alternatives
The choice depends on the resources available to the decision maker and the data accumulated in Stage 3. In case of limited resources, the decision maker will probably prefer classic data types (real, interval real, fuzzy, interval fuzzy, etc.), and algorithms with low computational complexity. The implementation of advanced data types and advanced multi-criteria methods will produce results that are more precise. This stage includes various methods for vaccine data collecting—medical experiments, medical information systems, open health data repositories, expert and user surveys, social media networks (reviews, likes, and follows/shares), etc.
Stage 5. Data preprocessing and storage
For each data type and algorithm from Stage 4, the specific coding rules are defined. All assessments except those expressed by real numbers (interval data, categorical data, linguistic terms) are transformed into numeric form (real numbers, classic fuzzy membership functions, or their contemporary extensions). The collected and converted data are imported into a relational database or in a single dataset. The coded data should be checked for duplicates, errors, or missing values. According to the data type, a decision should be made to remove duplicate observations or store them with appropriate substitutes in case of inconsistent values (errors or missing values). The most frequently used methods to handle missing values are as follows: replacing with mode, median, previous or next value, etc.
Stage 6. Determination of relative weights of evaluation criteria
Using data about vaccines and immunization progress, a multi-attribute evaluation system, and available datasets for vaccine comparison, the input values are filled in the decision matrix. The weight coefficients could be given in advance, or they could be calculated via weight determination methods (Section 3.1).
Stage 7. Multi-criteria data analysis
The next stage calculates the COVID-19 vaccine ranking via crisp or fuzzy multi-criteria decision-making algorithms (Section 3.1). Our proposal is employing several MCDM or different hybrid combinations from weight determination and MCDM methods.
Stage 8. Results analysis and interpretation
Here, the decision-maker analyses revealed dependencies in vaccine ranking. If the highest ranked alternative is not accepted or more processing is needed, the researcher gathers additional data and goes to the next iteration of data processing (Stage 4). In the other case, this is the end of calculations, and the results should be interpreted. In this analysis, only COVID-19 vaccines that have been top-ranked with the various MCDM techniques are left. In this stage, decision makers select the most suitable vaccine.

4. Practical Examples

4.1. A Case Study of Quality-Based Evaluation of COVID-19 Vaccines

Let S be an administrative authority faced with a COVID-19 vaccine selection problem. The benefits of vaccination for S are numerous. The problem is how to find the best COVID-19 vaccine for the particular subject.
The execution of Stage 1 of the proposed framework shows that there are several available vaccines, and the process of vaccine selection can start. In this illustrative example, we utilize a COVID-19 vaccine dataset, collected from Ozsahin et al. [20]. The dataset consists of five assessment criteria C 1 ,   C 2 ,   , C 5 (Section 2.2), and fifteen COVID-19 vaccines A 1 ,   A 2 ,   , A 15 (Section 2.3). The criteria are related to the following aspects of COVID-19 vaccines’ features: C 1 —dose number, C 2 —dosing schedule, C 3 —storage advantage, C 4 —efficacy and C 5 —side effects. The COVID-19 vaccines are as follows: A 1 —Comirnaty, A 2 —Spikevax, A 3 —Convidecia, A 4 —Sputnik V, A 5 —EpiVacCorona, A 6 —BBIBP-CorV, A 7 —WIBP-CorV, A 8 —CoronaVac, A 9 —Vaxzevria, A 10 —Nuvaxovid, A 11 —Jcovden, A 12 —INO-4800, A 13 —Covaxin, A 14 —Covifenz and A 15 —Covishield.
In Stage 2, experts from institution S fill in the questionnaire about their COVID-19 requirements. Respondents evaluate the vaccine’s features via a five-point Likert scale ranging from “Extremely important” (corresponding to 5) to “Unimportant” (corresponding to 1).
In Stage 3, a multi-attribute criteria index is constructed. The evaluation index consists of variables C i ,   i = 1 , 5 ¯ .
In the next stage, we decide that the data type is IVFFNs and employ the proposed new IVFF TOPSIS modification. The values of the decision matrix are converted into a five-point Likert scale (Table 2). For transforming every linguistic variable into its corresponding IVFFNs, the correspondence table (Table 3) is applied.
The importance of weight coefficients is as follows: w 1 = w 2 = w 3 = w 4 = w 5 = 0.2 .
The obtained overall scores and rankings of given COVID-19 vaccines by using IVFF and crisp TOPSIS method are displayed in Table 4.
The problem has also been solved using several other MCDM methods (Table 5). In order to show that the IVFF TOPSIS solution is feasible, we compare the obtained ranking with those obtained with crisp estimates.
The final rankings are as follows:
  • SAW: A5     A10     A3     A4     A6     A7     A11     A8     A14     A9     A1     A2     A12     A15     A13,
  • TOPSIS: A5     A10     A3     A4     A6     A7     A11     A8     A14     A9     A1     A2     A12     A15     A13; ρ = 100 % ,
  • WASPAS: A5     A4     A10     A4     A6     A7     A11     A14     A1     A8     A9     A2     A12     A15     A13, ρ = 94 % ,
  • EDAS: A5     A10     A4     A6     A7     A3     A14     A8     A11     A9     A1     A2     A15     A12     A13, ρ = 96 %
  • IVFFNs TOPSIS: A5     A11     A3     A12     A10     A4     A6     A7     A8     A9     A14     A2     A1     A13     A15, ρ = 75 % .
Spearman’s rank correlation coefficient is applied as a measure between benchmark ranking (SAW) and rankings obtained using the other MCDM methods. The results have proven that the new method is reliable (Spearman’s ρ IVFFNs   TOPSIS = 0.754).
Analysis of obtained rankings also shows that three groups of COVID-19 vaccines can be distinguished:
Group 1. Vaccines with the highest assessments—Convidecia, Sputnik V, Epivac, and Nuvaxovid (4);
Group 2: Vaccines with middle to high estimates—BBIBP-CorV, WIBP-CorV, Coronavac, Jcovden, and Covifenz (5);
Group 3: Vaccines with relatively low assessments—Comirnaty, Spikevax, Vaxzevria, INO-4800, Covaxin, and Covishield (6).
The high efficacy (C4) assessments and relatively mild side effects (C5) of Sputnik V, Epivac and Nuvaxovid allow them to occupy leading positions in the rankings and vice versa, Covishield is lagging behind in efficacy and ranking, respectively. The special cold chain (C3) of Pfizer/BioNTech and Moderna cause their vaccines to fall into the last part of the rankings.
It can be concluded, that the proposed framework is reliable and properly reflects the requirements of administrative authority S.

4.2. A Case Study of Dynamic Attitude-Based Evaluation of COVID-19 Vaccines

Let the administrative authority S faced with a COVID-19 vaccine selection problem. The execution of Stage 1—Stage 4 of the proposed framework shows that the public attitudes to COVID-19 vaccines in social networks can be used for vaccine selection. In this illustrative example, we utilize a COVID-19 vaccine dataset, collected from Twitter using a text analysis add-on of Orange software (University of Ljubljana, Slovenia, https://orangedatamining.com, accessed on 30 June 2022). The dataset consists of only one attitude assessment criteria C and six COVID-19 vaccines A 1 ,   A 2 ,   , A 6 . The assessments of alternatives with the respect to the criterion are expressed in IVFFNs, in which BGs and NGs correspond to the lower and upper limits of positive and negative attitudes towards vaccines for a specific period (first day = 4 May 2021, last day = 19 May 2021). The COVID-19 vaccines are as follows: A 1 —Comirnaty, A 2 —Spikevax, A 3 —Sputnik V, A 4 —BBIBP-CorV, A 5 —Vaxzevria and A 6 —Jcovden.
In the next stage, we collect Twitter data (tweets) about the six vaccines, apply sentiment analysis, and find the user’s emotions towards given vaccines (in percent of corresponding tweets’ number). To convert data about users’ emotions into IVFFNs, we apply the following rule: The BG is equal to the “Joy” value, while the NG is obtained as a sum of negative emotions’ shares (“Anger”, “Disgust”, “Fear” and “Sadness”) (Table 6).
Finally, to evaluate every alternative, we employ the score function (Equation (2)). The decision matrix, overall scores, and final vaccine ranks can be found in Table 7.
The final ranking is as follows: A4     A6     A3     A5     A2     A1. The comparative analysis shows that all vaccines, except A4 (BBIBP-CorV) retain their relative rankings from the first example. A possible reason for this high positive attitude towards BBIBP-CorV can be found in the fact that China was the first country affected by the coronavirus and the country’s control strategies have successfully slowed the spread of the pandemic. Chinese Zero-COVID approach, as a mix of NPIs and vaccination programs, has quickly balanced economic growth and public health imperatives. The task for ranking COVID-19 vaccines based on users’ attitudes can be solved periodically or in real time using online streaming data.
Vaccination is a powerful tool to prevent the spread of SARS-CoV-2, but there are still people who are reluctant to get vaccinated. To facilitate the selection process and clear the vaccination backlog, multi-faceted institutional activities promoting the benefits of vaccines are needed. The proposed approach provides an opportunity for experts to consider many technological, storage, and handling characteristics, establish requirement specifications, employ fuzzy estimates and objectively select the most suitable vaccine for a particular country. The decision-makers can further expand the evaluation system by adding factors such as the epidemiological situation (patterns and frequency), health system capacity, the cost per vaccine administration, etc.

5. Conclusions, Limitations, and Future Work

Recently, the tools for assessments of antiviral vaccines have become a research hotspot due to the expansion of the COVID-19 pandemic and the increasing role of vaccination. Many biotechnology and pharmaceutical companies have focused their efforts on the fast development of a variety of vaccines against SARS-CoV-2. Unfortunately, the availability and effectiveness of existing algorithms for the selection of COVID-19 vaccines are not high.
In this study, a new integrated framework for COVID-19 vaccine selection has been suggested. The proposed framework includes different multi-criteria decision-making methods and objectively evaluates COVID-19 vaccines. In addition, a new IVFFNs-based MCDM method has been developed and implemented for vaccine selection. Due to its fuzzy nature, the new method can cope with uncertainty and vagueness in experts’ estimates.
The proposed fuzzy modification is based on TOPSIS, which is one of the most widely used distance-based multi-criteria methods. The advantage of the proposed IVFFNs TOPSIS is that the distances between compared alternatives are calculated by an improved formula for the IVFF environment:
  • In addition to interval-valued membership and non-membership grades, the interval-valued hesitancy degree is also included.
  • The length of belongingness, non-belongingness, and hesitancy intervals also participates in distance calculation.
The effectiveness of new framework has been demonstrated using two practical examples for choosing among COVID-19 vaccines. The first one is concerned to finding the best ranking alternative among fifteen COVID-19 vaccines (Comirnaty (previously Pfizer-BioNTech), Spikevax (previously Moderna), Convidecia, Sputnik V, EpiVacCorona, BBIBP-CorV, WIBP-CorV, CoronaVac, Vaxzevria (previously AstraZeneca), Nuvaxovid, Jcovden (previously Janssen), INO-4800, Covaxin, Covifenz and Covishield) according to five evaluation criteria. The second example is concerned with ranking vaccines according to public attitudes toward them, expressed via tweets. The analysis of obtained results shows that the proposed methodology is reliable and correctly reflects vaccines’ features in final rankings.
In the future, the conceptual framework will be enhanced by adding several recently developed multi-criteria methods. Additionally, the proposed mechanisms for ranking COVID-19 vaccines will be expanded to address the uncertainty of estimates with different types of classic and interval fuzzy sets (for example, type-2 fuzzy numbers and q-rung orthopair fuzzy numbers). We also plan on developing a new hybrid method for COVID-19 vaccines’ evaluation combining new modifications of weights determination algorithms with modified multi-criteria decision-making methods.

Author Contributions

Conceptualization, G.I. and T.Y.; framework, T.Y. and G.I.; TOPSIS modification, G.I.; validation, G.I. and T.Y.; formal analysis, T.Y.; resources, G.I.; writing—original draft preparation, G.I.; writing—review and editing, G.I. and T.Y.; visualization, T.Y.; supervision, G.I.; project administration, T.Y.; funding acquisition, G.I. and T.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research was partially funded by the Ministry of Education and Science and by the National Science Fund, co-founded by the European Regional Development Fund, Grant No. BG05M2OP001-1.002-0002 “Digitization of the Economy in Big Data Environment”.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors thank the academic editor and anonymous reviewers for their insightful comments and suggestions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Đukić, A.; Štaka, M.; Drašković, D. The Impact of the COVID-19 Pandemic on the Macroeconomic Aggregates of the European Union. Economics 2021, 9, 91–108. [Google Scholar] [CrossRef]
  2. Johns Hopkins Coronavirus Resource Center. Available online: https://coronavirus.jhu.edu/map.html (accessed on 30 June 2022).
  3. Collins, F.S.; Stoffels, P. Accelerating COVID-19 Therapeutic Interventions and Vaccines (ACTIV): An unprecedented partnership for unprecedented times. JAMA 2020, 323, 2455–2457. [Google Scholar] [CrossRef]
  4. World Health Organization. Coronavirus Disease (COVID-19): Herd Immunity, Lockdowns and COVID-19. 31 December 2020. Available online: https://www.who.int/news-room/questions-and-answers/item/herd-immunity-lockdowns-and-covid-19 (accessed on 11 June 2022).
  5. Marco-Franco, J.E.; Pita-Barros, P.; Vivas-Orts, D.; González-de-Julián, S.; Vivas-Consuelo, D. COVID-19, fake news, and vaccines: Should regulation be implemented? Int. J. Environ. Res. 2021, 18, 744. [Google Scholar] [CrossRef]
  6. Scrima, F.; Miceli, S.; Caci, B.; Cardaci, M. The relationship between fear of COVID-19 and intention to get vaccinated. The serial mediation roles of existential anxiety and conspiracy beliefs. Person. Individ. Differ. 2022, 184, 111188. [Google Scholar] [CrossRef]
  7. World Health Organization. Strategy to Achieve Global COVID-19 Vaccination by Mid-2022. Available online: https://cdn.who.int/media/docs/default-source/immunization/covid-19/strategy-to-achieve-global-covid-19-vaccination-by-mid-2022.pdf (accessed on 30 June 2022).
  8. Council of the European Union. Available online: https://www.consilium.europa.eu/bg/policies/coronavirus/covid-19-research-and-vaccines (accessed on 30 June 2022).
  9. Our World in Data. Available online: https://ourworldindata.org/covid-vaccinations?country=OWID_WRL (accessed on 3 July 2022).
  10. Aruldoss, M.; Lakshmi, T.M.; Venkatesan, V.P. A survey on multi criteria decision making methods and its applications. Am. J. Inf. Syst. 2013, 1, 31–43. [Google Scholar]
  11. Ilieva, G.; Yankova, T. IoT System Selection as a Fuzzy Multi-Criteria Problem. Sensors 2022, 22, 4110. [Google Scholar] [CrossRef]
  12. Gavade, R.K. Multi-Criteria Decision Making: An overview of different selection problems and methods. Int. J. Comput. Sci. Inf. Technol. 2014, 5, 5643–5646. [Google Scholar]
  13. Senapati, T.; Yager, R.R. Fermatean fuzzy sets. J. Ambient Intell. Humaniz. Comput. 2020, 11, 663–674. [Google Scholar] [CrossRef]
  14. Gül, S. Fermatean fuzzy set extensions of SAW, ARAS, and VIKOR with applications in COVID-19 testing laboratory selection problem. Expert Syst. 2021, 38, e12769. [Google Scholar] [CrossRef] [PubMed]
  15. Kutlu Gündoğdu, F.; Kahraman, C. Spherical fuzzy sets and spherical fuzzy TOPSIS method. J. Intell. Fuzzy Syst. 2019, 36, 337–352. [Google Scholar] [CrossRef]
  16. Garg, H.; Sharaf, I.M. A new spherical aggregation function with the concept of spherical fuzzy difference for spherical fuzzy EDAS and its application to industrial robot selection. Comput. Appl. Math. 2022, 41, 212. [Google Scholar] [CrossRef]
  17. Lopez, D.; Gunasekaran, M. Assessment of vaccination strategies using fuzzy multi-criteria decision making. In Proceedings of the Fifth International Conference on Fuzzy and Neuro Computing (FANCCO-2015), Hyderabad, India, 17–19 December 2015. [Google Scholar]
  18. Öztaş, G.Z.; Bars, A.; Genç, V.; Erdem, S. Criteria Assessment for COVID-19 Vaccine Selection via BWM. In Proceedings of the International Workshop on Best-Worst Method, Delft, The Netherlands, 10–11 June 2021. [Google Scholar]
  19. Abdelwahab, S.F.; Issa, U.H.; Ashour, H.M. A Novel Vaccine Selection Decision-Making Model (VSDMM) for COVID-19. Vaccines 2021, 9, 718. [Google Scholar] [CrossRef]
  20. Ozsahin, D.U.; Gelisen, M.I.; Taiwo, M.; Agachan, Y.; Rahi, D.; Uzun, B. Decision analysis of the COVID-19 vaccines. Eurobiotech J. 2021, 5, 20–25. [Google Scholar] [CrossRef]
  21. Çetin, E.; Özen, H.; Özen, Ö. Primus inter pares: A Comparison and Ranking of COVID-19 Vaccines. Int. J. Anal. 2021, 1, 1–19. [Google Scholar]
  22. Öztürk, C.; Yildizbasi, A.; Yilmaz, I.; Ariöz, Y. Vaccine Selection Using Interval-Valued Intuitionistic Fuzzy VIKOR: A Case Study of COVID-19 Pandemic. In Proceedings of the International Conference on Intelligent and Fuzzy Systems (INFUS 2021), Istanbul, Turkey, 24–26 August 2021. [Google Scholar]
  23. Forestal, R.L.; Pi, S.M. A hybrid approach based on ELECTRE III-genetic algorithm and TOPSIS method for selection of optimal COVID-19 vaccines. J. Multi-Criteria Decis. Anal. 2022, 29, 80–91. [Google Scholar] [CrossRef]
  24. Ecer, F. An extended MAIRCA method using intuitionistic fuzzy sets for coronavirus vaccine selection in the age of COVID-19. Neural Comput. Appl. 2022, 34, 5603–5623. [Google Scholar] [CrossRef]
  25. Fiolet, T.; Kherabi, Y.; MacDonald, C.J.; Ghosn, J.; Peiffer-Smadja, N. Comparing COVID-19 vaccines for their characteristics, efficacy and effectiveness against SARS-CoV-2 and variants of concern: A narrative review. Clin. Microbiol. Infect. 2021, 28, 202–221. [Google Scholar] [CrossRef] [PubMed]
  26. Baden, L.R.; El Sahly, H.M.; Essink, B.; Kotloff, K.; Frey, S.; Novak, R.; Diemert, D.; Spector, S.A.; Rouphael, N.; Creech, C.B.; et al. Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N. Engl. J. Med. 2021, 384, 403–416. [Google Scholar] [CrossRef]
  27. Al Kaabi, N.; Oulhaj, A.; Ganesan, S.; Al Hosani, F.I.; Najim, O.; Ibrahim, H.; Acuna, J.; Alsuwaidi, A.R.; Kamour, A.M.; Alzaabi, A.; et al. Effectiveness of BBIBP-CorV vaccine against severe outcomes of COVID-19 in Abu Dhabi, United Arab Emirates. Nat. Commun. 2022, 13, 3215. [Google Scholar] [CrossRef] [PubMed]
  28. Al Kaabi, N.; Zhang, Y.; Xia, S.; Yang, Y.; Al Qahtani, M.M.; Abdulrazzaq, N.; Al Nusair, M.; Hassany, M.; Jawad, J.S.; Abdalla, J.; et al. Effect of 2 inactivated SARS-CoV-2 vaccines on symptomatic COVID-19 infection in adults: A randomized clinical trial. JAMA 2021, 326, 35–45. [Google Scholar] [CrossRef]
  29. Dunkle, L.M.; Kotloff, K.L.; Gay, C.L.; Áñez, G.; Adelglass, J.M.; Barrat Hernández, A.Q.; Harper, W.L.; Duncanson, D.M.; McArthur, M.A.; Florescu, D.F.; et al. Efficacy and safety of NVX-CoV2373 in adults in the United States and Mexico. N. Engl. J. Med. 2022, 386, 531–543. [Google Scholar] [CrossRef]
  30. Lin, D.Y.; Gu, Y.; Wheeler, B.; Young, H.; Holloway, S.; Sunny, S.K.; Moore, Z.; Zeng, D. Effectiveness of COVID-19 vaccines over a 9-month period in North Carolina. N. Engl. J. Med. 2022, 386, 933–941. [Google Scholar] [CrossRef]
  31. Tebas, P.; Agnes, J.; Giffear, M.; Kraynyak, K.A.; Blackwood, E.; Amante, D.; Reuschel, E.; Liu, N.; Purwar, M.; Christensen-Quick, A.; et al. Safety and Immunogenicity of INO-4800, a COVID-19 DNA Vaccine as a Primary Series and Booster. Open Forum Infect. Dis. 2021, 8, S387–S388. [Google Scholar] [CrossRef]
  32. Keshavarz-Ghorabaee, M.; Amiri, M.; Zavadskas, E.K.; Turskis, Z.; Antucheviciene, J. Determination of objective weights using a new method based on the removal effects of criteria (MEREC). Symmetry 2021, 13, 525. [Google Scholar] [CrossRef]
  33. Hwang, C.L.; Yoon, K. Methods for multiple attribute decision making. In Multiple Attribute Decision Making; Springer: Berlin/Heidelberg, Germany, 1981; pp. 58–191. [Google Scholar]
  34. Zavadskas, E.K.; Turskis, Z. A new additive ratio assessment (ARAS) method in multicriteria decision-making. Technol. Econ. Dev. Econ. 2010, 16, 159–172. [Google Scholar] [CrossRef]
  35. Chakraborty, S.; Zavadskas, E.K. Applications of WASPAS Method in Manufacturing Decision Making. Informatica 2014, 25, 1–20. [Google Scholar] [CrossRef]
  36. Keshavarz Ghorabaee, M.K.; Zavadskas, E.K.; Olftat, L.; Turslis, Z. Multi-criteria inventory classification using a new method of evaluation based on distance from average solution (EDAS). Informatica 2015, 26, 435–451. [Google Scholar] [CrossRef]
  37. Pamučar, D.; Ćirović, G. The selection of transport and handling resources in logistics centers using Multi-Attribute Border Approximation area Comparison (MABAC). Expert Syst. Appl. 2015, 42, 3016–3028. [Google Scholar] [CrossRef]
  38. Gigović, L.; Pamučar, D.; Bajić, Z.; Milićević, M. The Combination of Expert Judgment and GIS-MAIRCA Analysis for the Selection of Sites for Ammunition Depots. Sustainability 2016, 8, 372. [Google Scholar] [CrossRef]
  39. Keshavarz Ghorabaee, M.; Zavadskas, E.K.; Turskis, Z.; Antucheviciene, J. A New Combinative Distance-based Assessment (CODAS) Method for Multi-Criteria Decision-Making. Econ. Comput. Econ. Cybern. Stud. Res. 2016, 50, 25–44. [Google Scholar]
  40. Stević, Ž.; Pamučar, D.; Puška, A.; Chatterjee, P. Sustainable supplier selection in healthcare industries using a new MCDM method: Measurement of alternatives and ranking according to compromise solution (MARCOS). Comput. Ind. Eng. 2020, 140, 106231. [Google Scholar] [CrossRef]
  41. Rani, P.; Mishra, A.R. Interval-valued Fermatean fuzzy sets with multi-criteria weighted aggregated sum product assessment-based decision analysis framework. Neural Comput. Appl. 2022, 34, 8051–8067. [Google Scholar] [CrossRef]
  42. Jeevaraj, S. Ordering of interval-valued Fermatean fuzzy sets and its applications. Expert Syst. Appl. 2021, 185, 115613. [Google Scholar]
Figure 1. The flowchart of proposed framework for decision analysis of COVID-19 vaccines.
Figure 1. The flowchart of proposed framework for decision analysis of COVID-19 vaccines.
Mathematics 10 03514 g001
Table 1. Comparison of the most widely used COVID-19 vaccines.
Table 1. Comparison of the most widely used COVID-19 vaccines.
NBrand
Name
CompanyVaccine
Type
Vaccine
Storage
Dosing
Schedule
Efficacy
1Comirnaty (also known as Pfizer-BioNTech)Pfizer-BioNTechMessenger RNA (mRNA)Frozen between −90 °C to −60 °C for up to 9 months.Two doses, 21 days apart95%
2Spikevax (previously Moderna)ModernamRNAFrozen between −25 °C to −15 °C for up to 9 months.Two doses, 28 days apart94.1%
3ConvideciaCanSino BiologicsViral vectorRefrigerated between 2 °C to 8 °C for up to 12 months.Single dose63.7%
4Sputnik VGamaleya Research Institute of Epidemiology and MicrobiologyAdenoviral basedFrozen at −18 °C or less. The shelf life is 3 months from the date of production.Two doses, 21 days apart85.7%
5EpiVacCoronaVektor State Research Center of Virology and BiotechnologyAntigens-basedRefrigerated between 2 °C to 8 °C.Two doses, 14 days apart100%
6BBIBP-CorVSinopharmWhole inactivated virusRefrigerated between 2 °C to 8 °C for up to 24 months.Two doses, 21 days apart79.6%
7WIBP-CorVSinopharmInactivated virusRefrigerated between 2 °C to 8 °C for up to 6 months.Two doses, 21 days apart72.8%
8CoronaVacSinovacWhole inactivated virusRefrigerated between 2 °C to 8 °C for up to 12 months.2 doses, 14 days apart83.5%
9Vaxzevria (previously AstraZeneca)Oxford-AstraZenecaCarrier vaccineRefrigerated between 2 °C to 8 °C for up to 6 months.Two doses, four to 12 weeks apart79%
10NuvaxovidNovavaxProtein adjuvantRefrigerated between 2 °C to 8 °C for up to 9 months.Two doses, 21 days apart92.6%
11Jcovden (previously Janssen)Janssen, Johnson & JohnsonCarrier vaccine Frozen between −25 ° to −15 °C for up to 24 months.Single dose74.8%
12INO-4800Inovio PharmaceuticalsDNA-basedFive-year projected shelf life and does not need to be frozen during transport or storage.Two doses, 28 days apart95%
13CovaxinBharat BiotechWhole inactivated virus-basedRefrigerated between 2 °C to 8 °C for up to 9 months.Two doses, 28 days apart78%
14CovifenzMedicagoVirus-like particles of SARS-CoV-2 spike proteinRefrigerated between 2 °C to 8 °C.Two doses, 21 days apart95%
15CovishieldSerum Institute of IndiaAdenovirus-basedRefrigerated between 2 °C to 8 °C for up to 6 months.Two doses, 4 to 12 weeks apart62%
Remark: The table includes only data for primary vaccination course. It does not contain booster doses data.
Table 2. Input decision matrix for COVIF-19 vaccine selection.
Table 2. Input decision matrix for COVIF-19 vaccine selection.
Criteria AlternativeC1C2C3C4C5
A1VHVLVLVHVH
A2VHMVLVHM
A3VLMVHVLM
A4VHVLVLVHVL
A5VHMVHVHVL
A6VHVLVHMH
A7VHVLVHMH
A8VHMVHMM
A9VHMVHMH
A10VHVLVHHM
A11VLVHVHLM
A12VHMVLVHH
A13VHMVLLH
A14VHVLVLVHM
A15VHVLVLVLM
Criterion type B B
Source: The decision matrix is based on the dataset from Ozsahin et al. [20].
Table 3. Linguistic variables and their corresponding interval-valued Fermatean fuzzy numbers.
Table 3. Linguistic variables and their corresponding interval-valued Fermatean fuzzy numbers.
Linguistic TermIVFFN
Very Low (VL)([0, 0.2], [0.8, 0.95])
Low (L)([0.3, 0.4], [0.6, 0.7])
Medium (M)([0.45, 0.55], [0.4, 0.55])
High (H)([0.6, 0.7], [0.2, 0.3])
Very High (VH)([0.8, 0.95], [0, 0.15])
Table 4. Scores and their corresponding rankings—TOPSIS method, IVFFNs, and crisp values.
Table 4. Scores and their corresponding rankings—TOPSIS method, IVFFNs, and crisp values.
A1A2A3A4A5A6A7A8A9A10A11A12A13A14A15
IVFFNSsScore0.330.390.610.540.730.510.510.500.470.570.640.580.220.430.21
Rank131236178910524141115
CrispNsScore0.450.440.560.550.620.530.530.500.470.590.530.410.250.500.38
Rank111234156810271315914
Table 5. Overall scores and their corresponding ranking—SAW, WASPAS, and EDAS methods, crisp values.
Table 5. Overall scores and their corresponding ranking—SAW, WASPAS, and EDAS methods, crisp values.
SAWWASPASEDAS
AlternativeScoreRankScoreRankScoreRank
A11.87111.3090.4211
A21.86121.04120.3312
A33.1131.4470.626
A42.8741.7220.773
A53.5011.8010.871
A62.7061.5440.694
A72.7071.5450.695
A82.5781.24100.528
A92.28101.20110.4410
A103.2221.6930.862
A112.7651.4860.459
A121.62130.99130.2414
A131.25150.69150.0015
A142.3791.3780.597
A151.50140.97140.2613
Spearman’s ρ 0.94 0.96
Table 6. Twitter data for COVID-19 vaccines by day and emotion (%).
Table 6. Twitter data for COVID-19 vaccines by day and emotion (%).
DateFirst DayLast Day
Alternative EmotionA1A2A3A4A5A6A1A2A3A4A5A6
Joy0.6520.6780.7790.7950.6790.8590.7960.7940.7460.9000.8000.758
Anger0.0020.0080.0000.0000.0040.0000.0000.0040.0000.0020.0000.000
Disgust0.0140.0020.0020.0050.0020.0040.0000.0000.0000.0000.0040.002
Fear0.0720.0980.1600.0730.1250.0250.0560.0640.2340.0420.0820.052
Sadness0.0420.0320.0020.0250.0060.0070.0060.0240.0000.0080.0180.024
Surprise0.2180.1820.0560.1010.1830.1060.1420.1140.0200.0480.0960.164
BG0.6520.6780.7790.7950.6790.8590.7960.7940.7460.9000.8000.758
NG0.1300.1400.1650.1040.1370.0350.0620.0920.2340.0520.1040.078
Source: Twitter data and own calculations.
Table 7. Evaluation scores and ranks for COVID-19 vaccines.
Table 7. Evaluation scores and ranks for COVID-19 vaccines.
Alternative μ l b μ u b ν l b ν u b ScoreRank
A10.6520.7960.0620.1300.3906
A20.6780.7940.0920.1400.4045
A30.7790.7460.1650.2340.4363
A40.7950.9000.1040.0520.6161
A50.6790.8000.1040.1370.4114
A60.8590.7580.0350.0780.5342
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ilieva, G.; Yankova, T. Extension of Interval-Valued Fermatean Fuzzy TOPSIS for Evaluating and Benchmarking COVID-19 Vaccines. Mathematics 2022, 10, 3514. https://doi.org/10.3390/math10193514

AMA Style

Ilieva G, Yankova T. Extension of Interval-Valued Fermatean Fuzzy TOPSIS for Evaluating and Benchmarking COVID-19 Vaccines. Mathematics. 2022; 10(19):3514. https://doi.org/10.3390/math10193514

Chicago/Turabian Style

Ilieva, Galina, and Tania Yankova. 2022. "Extension of Interval-Valued Fermatean Fuzzy TOPSIS for Evaluating and Benchmarking COVID-19 Vaccines" Mathematics 10, no. 19: 3514. https://doi.org/10.3390/math10193514

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop