A Systematic Review of the Applications of Multi-Criteria Decision Aid Methods (1977–2022)

: Multicriteria methods have gained traction in academia and industry practices for effective decision-making. This systematic review investigates and presents an overview of multi-criteria approaches research conducted over forty-four years. The Web of Science (WoS) and Scopus databases were searched for papers on multi-criteria methods with titles, abstracts, keywords, and articles from January 1977 to 29 April 2022. Using the R Bibliometrix tool, the bibliographic data was evaluated. According to this bibliometric analysis, in 131 countries over the past forty-four years, 33,201 authors have written 23,494 documents on multi-criteria methods. This area’s scientiﬁc output increases by 14.18 percent every year. China has the highest percentage of publications at 18.50 percent, followed by India at 10.62 percent and Iran at 7.75 percent. Islamic Azad University has the most publications with 504, followed by Vilnius Gediminas Technical University with 456 and the National Institute of Technology with 336. Expert Systems with Applications , Sustainability , and the Journal of Cleaner Production are the top journals, accounting for over 4.67 percent of all indexed works. In addition, E. Zavadskas and J. Wang have the most papers in the multi-criteria approaches sector. AHP, followed by TOPSIS, VIKOR, PROMETHEE, and ANP, is the most popular multi-criteria decision-making method among the ten nations with the most publications in this ﬁeld. The bibliometric literature review method enables researchers to investigate the multi-criteria research area in greater depth than the conventional literature review method. It allows a vast dataset of bibliographic records to be statistically and systematically evaluated, producing insightful insights. This bibliometric study is helpful because it provides an overview of the issue of multi-criteria techniques from the past forty-four years, allowing other academics to use this research as a starting point for their studies.


Introduction
As the transmission of scientific knowledge in its most diverse fields of study expands, literature evaluation becomes a demanding work for the researcher [1].The challenge is reflected in the volume of research published each month by thousands of academic publication outlets.According to [2]'s theory of limited rationality, a researcher's rationality is constrained by the knowledge available, the cognitive limitations of the individual mind, and the decision-making time availability.
Human activities require decision-making.All such decisions are based on an evaluation of individual decision options, typically based on the decision maker's preferences, experience, and other data [3].Some decisions are simple, while others are complex [4].
According to Kahraman et al. [5] and Govindan and Jepsen [6], some decisions are relatively simple, especially if the consequences of making the wrong decision are minor, whereas others are highly complex and have significant effects.In most cases, real-life problem-solving involves several competing points of view that must be considered to reach a reasonable decision [7].A decision can be defined formally as a choice made based on available information or a method of action aimed at solving a specific decision problem [8].In practice, multiple-criteria decision analysis (MCDA) evaluates possible courses of action or options by selecting a preferred option or sorting the options from best to worst [9][10][11][12].In everyday practice, the use of MCDA is critical in signaling the best rational alternative to the decision-maker so that he can allocate finite resources between competing and alternative interests.Whether in an organizational or domestic setting, the decision-maker is constantly confronted with multiple paths and limited resources.Researchers refer to multiple criteria methods in various ways.Some authors prefer the term multiple-criteria decision aid or aiding (MCDA), while others prefer to use the term multicriteria decision-making or multiple-criteria decision-making (MCDM), multi-objective decision-making (MODM), or multi-attribute decision-making (MADM).Some authors prefer the term multiple-criteria decision aid or aiding (MCDA), while others prefer to use the term multiple-criteria decision analysis [13].
The most often used MCDA approaches, as opined by [3,14], are divided into two "schools": American and European.The American School of decision-support methods is based on a functional approach, namely the utilization of value or usability.These strategies typically do not account for data inconsistency, ambiguity, or decision-maker preferences.This collection of techniques is closely related to the operational approach based on a single synthesized criterion.MAUT, AHP, ANP, SMART, UTA, MACBETH, and TOPSIS are the critical methods used in the American School.The European School's techniques are based on a relational concept.As a result, they employ a synthesis of criteria based on outranking relations.Transgression between pairs of decision alternatives characterizes this relationship.Among the European School of decision support methods, the ELECTRE and PROMETHEE groups are the most prominent.NAIADE, ORESTE, REGIME, ARGUS, TACTIC, MELCHIOR, and PAMSSEM are other methodologies from the European MCDA sector.Many multi-criteria decision-making strategies integrate ideas from the American and European decision-making schools.EVAMIX, QUALIFLEX, PCCA, MAPPAC, PRAGMA, PACMAN, IDRA, COMET, and DRSA are a few examples.
Furthermore, as stated by [6,[14][15][16], MCDA methods are used to solve decision-making problems in several areas, including the information and communication technology; business intelligence; environmental risk analysis; environmental impact assessment and environmental sciences; water-resource management; solid-waste management; remote sensing; flood-risk management; health-technology assessment; healthcare; transport; nanotechnology research; climate change; energy; international law and policy; human resources; financial management; performance and benchmarking; supplier selection; e-commerce and m-commerce; agriculture and horticulture; chemical and biochemical engineering; software evaluation; network selection; education and social policy; heating, ventilation, and air conditioning and small-scale energy management systems; and public security.
According to Sałabun et al. [3], despite the numerous MCDA approaches available, it is essential to note that no method is ideal and can be deemed acceptable for use in every decision-making context or for solving every choice problem [17].As a result, different multi-criteria techniques may yield various choice suggestions [18].However, if multiple multi-criteria methods produce inconsistent findings, the accuracy of each option is called into doubt [19].In such a case, selecting a decision-support technique relevant to the given problem [20] becomes essential because only an appropriately chosen approach allows one to acquire the correct answer that reflects the decision maker's preferences [21].
Humans make decisions regularly, and decision-making is an inherent element of people's character.Some decisions are simple and have little impact on people's lives; others, on the other hand, directly impact people's lives, cities, and nations.In this regard, and given the importance of multi-criteria decision-making methods in assisting decisionmakers in a variety of fields, the current study aims to answer the following research questions (RQ) and develop a reference framework on academic productivity regarding multi-criteria decision-making methods: RQ1: Who are the most influential authors and researchers in their scientific productivity in multi-criteria decision-making methods?RQ2:What is the annual scientific publication growth in multi-criteria decision-making methods?RQ3: Which countries have the most significant production of articles on the multi-criteria methods of decision support?RQ4: Which journals have the highest number of publications?RQ5: What are the most used methods, and in which research areas?RQ6: What are the conceptual structures of the multi-criteria decision-support methods?Three hundred forty-two systematic literature studies on multi-criteria methods were discovered during the literature survey.The ten largest categories classified by Web of Science using multi-criteria methods were green sustainable science technology [22], energy fuels [23], environmental sciences [24], operations research and management science [25,26], computer science and artificial intelligence [27], management [28], economics [29], engineering environmental [30], computer science and interdisciplinary applications [31], and civil engineering [32].
This article is structured as follows: Section 2 briefly describes the methods and materials.Section 3 presents the preliminary bibliometric results and visualizes the collaborative relationships between countries and authors using R and the VOSviewer software.Keyword co-occurrences are analyzed, and strategic diagrams are constructed in the same section to reveal thematic trends on the multi-criteria decision support theme.The main discussions are summarized in Section 4.

Materials and Methods
This section presents the fundamental concepts that guided this study.The intention is not to cover all the subjects but rather to provide essential supporting information for understanding the research, the context, and the results.
The volume of academic publications is increasing at an accelerating rate.In this way, keeping up-to-date and knowing a given topic's state of the art is becoming increasingly difficult.As stated by Aria and Cuccurullo [33], the emphasis on empirical contributions has resulted in voluminous and fragmented research flows, which contributes to the heavy work of the researcher to keep up to date.Researchers affirm that literature reviews are prevalent in the state-of-the-art synthesis of various themes [33,34].
The structured literature review is a traditional way to analyze and review scientific literature.This type of review provides an in-depth analysis according to the content of the literature [35][36][37][38][39].However, this method suffers from several limitations.For instance, it is very time-consuming, and the number of analyzed papers is limited.It is almost impossible to analyze hundreds of documents through the structured literature-review process.Although the authors carefully select the documents according to several criteria, it is challenging to eliminate subjective factors, and some essential studies may be omitted.With the digitization of scientific journals, the volume of published papers has increased dramatically.A bibliometric analysis effectively handles hundreds, even thousands, of documents and reviews the related literature from a macro perspective [37].
The term bibliometric refers to the quantitative study of bibliographic materials [40,41].It can characterize the development in a research field or capture the changes in a specific journal.Various techniques have been developed to conduct bibliometric analysis, and the most-used methods are social network analysis and co-word analysis [37].
Social network analysis is based on the premise that the relationships between units can be interpreted as a graph [42].It is an effective method to evaluate the importance of nodes and reveal the network structure.In the bibliometric networks, different types of networks, such as coauthorship networks [43,44], bibliographic coupling networks [45], and co-citation networks [46], are constructed by bibliometrics [47].
Co-word analysis is a content-analysis technique proposed by [48,49].It is applied to map the strength of associations between information items in textual data [50].It involves a co-occurrence analysis of keywords in a selected body of literature.Co-occurrence analysis, a central task of association analysis in data mining, is used to group keywords with high relevance in clusters [51].Typically, each set corresponds to a search theme.Researchers use co-occurrence analysis to identify established and emerging research themes or tracking patterns [52][53][54].
In this study, a topical query on 29 April 2022, was conducted in the Web of Science (WoS) and Scopus database, using the following search query: (("multi-attribute decision making" or "madm" or "mcda" or "modm" or "mcdm" or "multi-criteria" or "multi-criteria" or "multiplecriteria") and ("ahp" or "todim" or "topsis" or "promethee" or "electre" or "vikor" or "maut" or "fitradeoff" or "dematel" or "copras" or "multimoora" or "swara" or "analytical network process" or "anp" or "simple multi-attribute rating technique" or "smart" or "goal programming" or "thor" or "cbr" or "saw" or "condorcet" or "drsa" or "macbeth" or "paprika" or "wpm" or "wsm" or "utadis" or "waspas")).The search was only restricted to titles, abstracts, keywords, and articles published between 1977 and 2022.Additionally, the search in the WoS database was limited to the Core Collection.The search query yielded 35,643 entries from the WoS and Scopus databases.Following the download of the records, the RStudio bibliometrix package version 1.2.1335 was installed on a Win64 operating system.Bibliometric analysis was performed using the Bibliometrix R package.The Bibliometrix tool was used to build the descriptive and co-citation networks.The function convert2df embedded in the Bibliometrix package was used to extract and create a data frame corresponding to the unit of analysis within the exported files from WoS and Scopus databases.After making the data frames from the WoS and Scopus files, the mergeDbSources function merged the WoS and Scopus data frames and excluded duplicate records from both files.Twelve thousand one hundred forty-nine duplicate records were removed, resulting in a data frame with 23,494 records for the bibliometric analysis.The process of obtaining the bibliographic records file can be seen in Figure 1.

Results
The results from the bibliometric analysis show that 33,201 authors produced 23,494 documents in the period from 1 January 1977, to 29 April 2022.The types of documents identified in the sample, despite the limitations, are described in the methods and data section and further illustrated in Figure 2.
Regarding academic production, studies on multi-criteria decision-support methods had their genesis in 1977.Figure 3 depicts the publishing trajectory until April 2022.The graph shows that the upward trend began in 1986 with a modest inclination.During this time, the average number of publications each year was 7.3.From 1987 to 1996, the average number of papers per year climbed to 28.3 documents.This average increased to 123.2 records per year during the next ten years and finally reached 1265.73 from 2007 to 2021, indicating a strong level of interest in the topic among researchers.Taking the entire period into account, publications on multi-criteria decision-support methods grew at an annual percentage rate of 14.18.Figures 4 and 5 show the average total citations per year (16.06) and the average years from publication (6.36), respectively.

Results
The results from the bibliometric analysis show that 33,201 authors produced 23,494 documents in the period from 1 January 1977, to 29 April 2022.The types of documents identified in the sample, despite the limitations, are described in the methods and data section and further illustrated in Figure 2.
Regarding academic production, studies on multi-criteria decision-support methods had their genesis in 1977.Figure 3  Five peaks are depicted in the graph shown in Figure 4.In 1983, the earliest and most important studies were conducted.In that year, six documents were published.The article by Van Laarhoven and Pedrycz [62], with a total citation count of 2158, had the most impact on citations in 1983.The authors presented a fuzzy variant of Saaty's pairwise comparison method for deciding between many options when there are competing choice criteria.Eleven publications were included in the sample in 1986.The article by Brans et al. [63] had a significant impact that year, increasing the yearly average of 1609 citations.Brans et al. [63] introduced the PROMETHEE approach in this study.Chen et al. [64] had the most-cited paper in 1994, with 967 citations.Chinese researchers provided novel methods for dealing with fuzzy multi-criteria decision-making based on the theory of fuzzy sets.There were 2454 citations to Chen's paper [64] in 2000, which affected the average of the 63 articles published that year.Chen [64] extended the TOPSIS model to the fuzzy environment.Furthermore, in 2004, two publications significantly impacted the average number of citations among the 128 papers published: Opricovic and Tzeng [65] had 2590 citations, while Pohekar and Ramachandran [66] had 1270 citations.The VIKOR and TOPSIS approaches were compared by Opricovic and Tzeng [65].Pohekar and Ramachandran [66] conducted a systematic review of multi-criteria techniques for sustainable energy management.Table 1 provides a summary of the sample's most cited articles.Five peaks are depicted in the graph shown in Figure 4.In 1983, the earliest and most important studies were conducted.In that year, six documents were published.The article by Van Laarhoven and Pedrycz [62], with a total citation count of 2158, had the most impact on citations in 1983.The authors presented a fuzzy variant of Saaty's pairwise comparison method for deciding between many options when there are competing choice criteria.Eleven publications were included in the sample in 1986.The article by Brans et al. [63] had a significant impact that year, increasing the yearly average of 1609 citations.Brans et al. [63] introduced the PROMETHEE approach in this study.Chen et al. [64] had the most-cited paper in 1994, with 967 citations.Chinese researchers provided novel methods for dealing with fuzzy multi-criteria decision-making based on the theory of fuzzy sets.There were 2454 citations to Chen's paper [64] in 2000, which affected the average of the 63 articles published that year.Chen [64] extended the TOPSIS model to the fuzzy environment.Furthermore, in 2004, two publications significantly impacted the average number of citations among the 128 papers published: Opricovic and Tzeng [65] had 2590   Five peaks are depicted in the graph shown in Figure 4.In 1983, the earliest and most important studies were conducted.In that year, six documents were published.The article by Van Laarhoven and Pedrycz [62], with a total citation count of 2158, had the most impact on citations in 1983.The authors presented a fuzzy variant of Saaty's pairwise comparison method for deciding between many options when there are competing choice criteria.Eleven publications were included in the sample in 1986.The article by Brans et al. [63] had a significant impact that year, increasing the yearly average of 1609 citations.Brans et al. [63] introduced the PROMETHEE approach in this study.Chen et al. [64] had the most-cited paper in 1994, with 967 citations.Chinese researchers provided novel methods for dealing with fuzzy multi-criteria decision-making based on the theory of fuzzy sets.There were 2454 citations to Chen's paper [64] in 2000, which affected the average of the 63 articles published that year.Chen [64] extended the TOPSIS model to the fuzzy environment.Furthermore, in 2004, two publications significantly impacted the average number of citations among the 128 papers published: Opricovic and Tzeng [65] had 2590  The year 2022 is shown as an outlier in Figure 5.The average number of papers cited every year was calculated using only the year of publication, which skews the results by overestimating this value.However, there are no distinguishing traits in this year's sample compared to earlier times.The volume of publications resulted in a total of 472,345 references.

Monitoring of Scientific Production around the World
Figure 6 shows that at least 120 countries or regions contributed to the research on multicriteria methods.China (n = 4327) is the largest contributor to multicriteria methods research, followed by India (n = 2485), Iran (n = 1812), Turkey (n = 1788), Taiwan (n = 1192), United States (n = 794), Brazil (n = 752), Spain (n = 608), Italy (n = 555), and Malaysia (n = 493).Regarding citations, Table 2 offers a slightly different order, but China continues to lead scientific production in terms of both knowledge generation and references to the scientific community: China (n = 82,615), Taiwan (n = 32,535), Turkey (n = 28,739), India (n = 23,643), Iran (n = 23,613), United States (n = 20,217), Lithuania (n = 12,292), United Kingdom (n = 10,917), Spain (n = 10,071), and Italy (n = 8601).As shown in Table 1, the top 10 research universities are Islamic Azad University (n = 504), Vilnius Gediminas Technical University (n = 456), National Institute of Technology (n = 336), University of Tehran (n = 334), Indian Institute of Technology (n = 265), and Istanbul Technical University (n = 243), as seen in Table 1.This section provides a quick summary of the bibliometric findings.However, we chose to go beyond a typical bibliometric analysis by stratifying the investigation and providing the reader with specific information about the countries ranked in Figure 2. Table 3 lists the major research topics, universities, research funding organizations, notable authors, and the most relevant papers.This section provides a quick summary of the bibliometric findings.However, we chose to go beyond a typical bibliometric analysis by stratifying the investigation and providing the reader with specific information about the countries ranked in Figure 2. Table 3 lists the major research topics, universities, research funding organizations, notable authors, and the most relevant papers.Figure 8 depicts the inter-relationship between the Journals, which was developed based on the researchers' preferences and referencing publications from sources with a high impact factor.The diameter of the circles is directly related to the number of citations, while the colors represent the identified clusters.In the eleventh column of Table 4, we can observe the five countries that published the most in each source.The maximum number of articles is from China, occupying the first position in eight out of the ten journals.The analysis of the highly cited papers shows that Renewable and Sustainable Energy Reviews, Expert Systems with Applications, and the International Journal of Production Economics have an incredible scientific impact on all scholars and have articles with more than 800 citations (Table 1).

Analysis of the Most Influential Authors Who Discuss the Topic of the Multi-Criteria Methods
Zavadskas E, Wang J, Tzeng G, Wang Y, and Kahraman C are among the top ten authors out of 29,050 who have published the most articles on this topic (Table 5).Edmundas Kazimieras Zavadskas is the first vice-rector of Vilnius Gediminas Technical University (VGTU).In addition, he is a member of the VGTU Senate, a professor, and the head of the Department of Construction Technology and Management.He has co-written over fifty novels in Lithuanian, Russian, German, and English.Corporations and academic institutions commissioned over forty research papers.The professor's primary research interests include building life cycles, decision-support systems, and multi-criteria optimization methods in construction technology and management.

Main Research Areas for the Application of Multi-Criteria Methods
The distribution of scientific production by research areas is depicted in Table 6.It is observed that there has been a shift in the preferences of academics in research fields over the past four decades.Table 7 displays the top five study areas by period.There was no change in the first five areas observed in the first two periods.From 1982 to 2002, research

Main Research Areas for the Application of Multi-Criteria Methods
The distribution of scientific production by research areas is depicted in Table 6.It is observed that there has been a shift in the preferences of academics in research fields over the past four decades.Table 7 displays the top five study areas by period.There was no change in the first five areas observed in the first two periods.From 1982 to 2002, research and applications of multi-criteria methods focused mainly on the following areas: operations research (1st), business economics (2nd), computer Science (3rd), engineering (4th), and mathematics (5th).With the increase in the volume of works published in the third decade under study, as shown in Figure 2, there was also a change in the research areas.From 2003 to 2012, the mathematics field was surpassed by environmental sciences ecology, which ranked fifth with 288 papers.Operations research, which held the numberone spot for two decades, was ranked third.The field of business economics lost its second place to computer science and fell to fourth place, followed by the ascent of engineering from fourth to first place.The most recent period analyzed was marked by a substantial increase in the number of published works.However, regarding the areas of interest of researchers, there has been a clear preference for engineering (1st) and computer science (2nd), followed by a change in preference as the traditional area of operations research has given way to environmental sciences ecology (3rd).In the fourth position, we find science technology, which has emerged with a greater level of interest from researchers due to the advancement of recent changes.The fifth place was occupied by business economics, a field in which scholars' interest has diminished over the past four decades.In Section 3.1, a global overview of the scientific output on multi-criteria methods is provided, highlighting the significant countries and classifying each production.However, as seen in the case of research domains, the hegemony of the scientific output has also evolved differently between nations.The shift in emphasis in specific scientific fields and the consolidation of others directly impact the hegemony of nations.If we analyze Table 2, we can see the consolidation of engineering and computer science as prominent areas in the production of the ten countries explored and the emergence of interest in science and technology.

Most-Used Methods
Table 8 lists the 26 methods examined throughout the sample period.The publishing period in WoS/Scopus concerning the investigated method is recorded in column 3. The chronology was produced based on the evolution of multi-criteria approaches, as shown in Figure 10, using information from the starting period of each method's scientific output.The chronology depicts techniques that have been embedded in the literature and that continue to evolve, such as AHP, TOPSIS, PROMETHEE, ELECTRE, and others, such as SWARA, WASPAS, and FITRADEOFF, that have been published for up to ten years but are not yet well-known in academia.The publications of each studied technique are then noted in column 4. The AHP, TOPSIS, and VIKOR approaches have the most publications in the four decades studied.They are also the most commonly employed methods by professionals in solving multi-criteria related issues.Column 5 indicates the research areas wherein the specialists used the method the most.Computer science stands out among others because 47% of the researched methods address issues related to these areas, with the TOPSIS method being used the most.Engineering follows, with 35% of the methods, with the AHP method being the second most-used method.Business economics takes 11%, and operations research 8% respectively.In column 7, we build on the study to show a trend toward developing solutions that include one or more methodologies and the creation of hybrid models based on the data acquired.This section concludes by emphasizing that, despite the small number of applications, the scenario depicts the integration of multicriteria methods with some machine learning techniques, which could be the beginning of a new trend in the coming years (see column 8).

Mapping the Evolution of Themes
Cobo et al. [170] assert the set of identified themes of the subperiod t, with U ∈ T^t representing each detected theme in the subperiod t.Let V ∈ T^(t + 1) represent each theme

Mapping the Evolution of Themes
Cobo et al. [170] assert the set of identified themes of the subperiod t, with U ∈ Tˆt representing each detected theme in the subperiod t.Let V ∈ Tˆ(t + 1) represent each theme found in the subsequent subperiod t + 1.It is argued that there is a thematic progression from topic U to theme V if both related thematic networks contain the same keywords.Thus, V can be considered a development of U. Additionally, the keyword cluster k ∈ U ∩ V is regarded as a "thematic nexus" or "conceptual nexus".
Figure 11 was created using the "thematicEvolution" function of the Bibliometrix R package.The evolution of themes associated with multi-criteria methods is depicted in Figure 11 across the five time periods.In the first period, i.e., between 1977 to 1986, three themes are recorded.As the rectangles represented the same region during this period, it may be deduced that there was a balance in disseminating topics.In the second phase (1987)(1988)(1989)(1990)(1991)(1992)(1993)(1994)(1995), there are twelve topics, of which eight had no foundation in the first period, such as "AHP", "TOPSIS", and "fuzzy set theory".These methods have their earliest publication record in 1990/1991 (Table 8).Still, researchers favor them, as in the case of TOPSIS, which has the same rectangular area as "GOAL PROGRAMMING", one of the three primary subjects of the program.During the third era (1996-2004), we recorded fourteen themes that originated in or branched from the preceding period.In this third period, the focus is on the AHP method, which is the most influential subject, as indicated by a distinct set of four keywords ("ahp", "analytic hierarchy process", and "analytical hierarchy process (ahp)").It is important to note that the "GOAL PROGRAMMING" theme has become less popular and that the PROMETHEE and ELECTRE methods have become more popular.Despite being published for the first time in 1989/1991, they did not emerge as a topic until the third period.The themes decreased from fourteen to nine for the fourth phase (2005)(2006)(2007)(2008)(2009)(2010)(2011)(2012)(2013).Two AHP-related concepts continue to hold the apex of importance.In addition to the PROMETHEE method, the TOPSIS methods, which did not emerge in the third era, reappeared distinctly.The final period evaluated between 2014-2022 continues with a reduction from nine to six themes presented in a balanced way, reflecting the preference for topics associated with the AHP and TOPSIS methods.The use of the theme-evolution map allowed us to graphically confirm the choice of specialists in solving multi-criteria problems using original tools in the AHP and TOPSIS methods during the study period.

Discussion
This research article presents a bibliometric analysis of the multi-criteria methods from 1977 to 29 April 2022.The bibliographic data was obtained from the Scopus and Web of Science (WoS) databases.The bibliometric analysis was conducted using the Bibliometrix R tool and the VOSviewer software to investigate the essential characteristics

Discussion
This research article presents a bibliometric analysis of the multi-criteria methods from 1977 to 29 April 2022.The bibliographic data was obtained from the Scopus and Web of Science (WoS) databases.The bibliometric analysis was conducted using the Bibliometrix R tool and the VOSviewer software to investigate the essential characteristics of the studies done so far, including publications; citations, citation structure; influential authors; cocitation contributors and burst detection analysis; author-keywords; co-occurrence analyses; and timeline-view analysis.The ability to make judgments is a distinguishing characteristic of a person.Man makes spontaneous and intuitive decisions based on his brain's information-processing skills.We judge the color of our ties for a business meeting as to whether or not to invest millions of dollars in a specific project.We realize that we face two distinct types of decisions: simple and complex.We can make straightforward decisions with few variables and little trouble.However, when the problem involves a matrix (n × m) variable, we require methodologies and computer capabilities to systematize, arrange, and rank the best options to aid decision-making.Accordingly, the objective of this study was to comprehend the global evolution of research on the creation and use of multi-criteria decision methods.
With a scientific production growth rate of 14.18% each year, it is clear that the academic community is interested in researching and publishing publications on multi-criteria decision-making approaches.Moreover, 60.93% of all publications were concentrated in only ten nations, with China leading the way with 18.50%, India coming in second with 10.62%, and Iran coming in third with 7.75%.In addition, the remaining 39% of publications have an average production rate of less than 1%, suggesting that the dissemination of multi-criteria approach research in such nations could enhance academic output.The top 10 countries in terms of citations follow a consistent pattern, accounting for 62.48% of all citations made during the research period.Among the top 10 countries in terms of multi-country collaboration (MCP) in publications, Turkey has the lowest MCP ratio with 0.0487, indicating a limited partnership with researchers from other nations, followed by India (0.0592) and Brazil (0.0861).Malaysia leads multi-country collaboration, with an MCP ratio of 0.2331, followed by the United States (0.2234) and Spain (0.2169).
Regarding sites that publish articles on multi-criteria techniques, the study reveals the top ten journals that have published approximately 10.4% of the subject's total publications.China, India, Iran, and Turkey, the four nations with the most publications on multi-criteria techniques, account for around 80% of the university-based publications on multi-criteria methods.These universities account for 11.79% of academic output, with the Islamic Azad University of Iran contributing 2.14% and Vilnius Gediminas Technical University of Lithuania accounting for 2.18%.Surprisingly, Lithuania is not among the top ten nations regarding scientific output.However, among the other authors in this survey, Prof. Edmundas Kazimieras Zavadskas of Lithuania ranks first with 240 articles on multicriteria approaches.
The journal Expert Systems with Applications has published 1.70% of all articles to date, followed by Sustainability with 1.68 percent and the Journal of Cleaner Production with 1.30%.The leading journals in terms of citations are Expert Systems with Applications, with an average of 7.88 citations per paper, followed by the European Journal of Operational Research, with 6.61 citations per article.Regarding the origin of publications, eight of the top ten countries publish most of their articles in the ten highest-ranked journals.In contrast, the European Journal of Operational Research ratio is 2 out of 10.
Regarding the most influential authors in this field, approximately 0.034% of 33,201 authors are responsible for 6.98% of publications over the past forty-four years, with ZAVAD-SKAS E having the most publications, with 240, followed by WANG J with 211 articles and TZENG G with 191 articles.This bibliometric analysis reveals that six of the top ten authors are Chinese, with the Central South University author affiliation standing out.
In addition to identifying writers with higher academic production, this study includes a comprehensive summary of the countries, funding sources, and the five multi-criteria approaches, i.e., AHP, TOPSIS, VIKOR PROMETHEE, and ANP, most frequently utilized by the authors in their respective studies.Engineering and computer science are the most prominent subjects in terms of research fields.One trend identified was the expansion of multi-criteria technique integration and the formation of hybrid models.This paper gives a complete overview of multi-criteria methods through a bibliometric study, enabling scholars to comprehend the current state and future development patterns of multi-criteria decision-making methods research.As an indication for prospective research, we can emphasize the need to understand the emergence and regionalization of specific techniques and their variations, expand research within the identified countries to gain a deeper understanding of their scientific production on the issue investigated, apply topic modeling to find latent themes in the researched database, and systematize method variants and their interfaces with other research areas, such as machine learning.

Figure 1 .
Figure 1.Search strategy and extraction of data.Source: Prepared by the authors based on Basilio et al. [60] and Ghosh and Prasad [61].

Figure 1 .
Figure 1.Search strategy and extraction of data.Source: Prepared by the authors based on Basilio et al. [60] and Ghosh and Prasad [61].
depicts the publishing trajectory until April 2022.The graph shows that the upward trend began in 1986 with a modest inclination.During this time, the average number of publications each year was 7.3.From 1987 to 1996, the average number of papers per year climbed to 28.3 documents.This average increased to 123.2 records per year during the next ten years and finally reached 1265.73 from 2007 to 2021, indicating a strong level of interest in the topic among researchers.Taking the entire period into account, publications on multi-criteria decision-support methods grew at an annual percentage rate of 14.18.Figures 4 and 5 show the average total citations per year (16.06) and the average years from publication (6.36), respectively.

Electronics 2022, 11 , 1720 6 of 30 Figure 2 .
Figure 2. Graphical representation of the documents contained in the sample.

Figure 3 .
Figure 3. Graphical representation of the annual scientific production.Note: The data for 2022 corresponds to partial values quantified up to 29 April 2022.

Figure 2 . 30 Figure 2 .
Figure 2. Graphical representation of the documents contained in the sample.

Figure 3 .
Figure 3. Graphical representation of the annual scientific production.Note: The data for 2022 corresponds to partial values quantified up to 29 April 2022.

Figure 3 .
Figure 3. Graphical representation of the annual scientific production.Note: The data for 2022 corresponds to partial values quantified up to 29 April 2022.

Figure 4 .
Figure 4. Graphical representation of the average total citations per year.

Figure 5 .
Figure 5. Graphical representation of the average article citations per year.

Figure 4 .
Figure 4. Graphical representation of the average total citations per year.

Figure 4 .
Figure 4. Graphical representation of the average total citations per year.

Figure 5 .
Figure 5. Graphical representation of the average article citations per year.

Figure 5 .
Figure 5. Graphical representation of the average article citations per year.

Figure 6 .
Figure 6.Graphical representation of the top 10 most productive countries.Figure 6. Graphical representation of the top 10 most productive countries.

Figure 6 .
Figure 6.Graphical representation of the top 10 most productive countries.Figure 6. Graphical representation of the top 10 most productive countries.

Figure 7 30 Figure 7
Figure 7 illustrates the relationships between organizations through the coauthorship analysis, using universities as the unit of analysis.The research was based on the following criteria: (1) the minimum number of documents per organization (n ≥ 50); (2) the minimum number of citations per organization (n ≥ 50).With the established criteria, 50 organizations out of the 7619 analyzed were separated.The nodes represent the universities.The diameter of the nodes represents the number of citations, and the thickness of the connecting lines between the nodes represents the level of cooperation between the institutions.As a result, Islamic Azad University and Vilnius Gediminas Technical University stand out in this analysis.

Figure 7 .
Figure 7.The network map of institutions involved in multi-criteria methods of decision-support research.Note: The colors of the circles are used to identify the clusters resulting from the analysis of the relations provided by the VOSviewer software.

Figure 7 .
Figure 7.The network map of institutions involved in multi-criteria methods of decision-support research.Note: The colors of the circles are used to identify the clusters resulting from the analysis of the relations provided by the VOSviewer software.

Figure 8 .
Figure 8.The network map of co-cited journals.Note: The colors of the circles are used to identify the clusters resulting from the analysis of the relations produced by the VOSviewer software.

Figure 8 .
Figure 8.The network map of co-cited journals.Note: The colors of the circles are used to identify the clusters resulting from the analysis of the relations produced by the VOSviewer software.

Figure 9
Figure 9 depicts a group of 160 authors grouped into six clusters based on two essential criteria about the authors' academic output: the minimum number of citations (n ≥ 500) and the minimum number of documents (n ≥ 10).Each cluster, identified by a distinct color, indicates the authors' and co-authors' iterations.The number of links and the total links strength (TLS) are employed to determine the strength of the relationships.Each cluster's featured author is the author with the most links and the highest TLS.In this way, each cluster's information is presented: Cluster 1 (red) contains 37.5% of the sample, with an emphasis on authors Wang Y (Links = 112, TLS = 540) and Cheng Y (Links = 103, TLS = 394); Cluster 2 (green) contains 26.9% of the sample, with an emphasis on authors Wang J (Links = 140, TLS = 315), Xu Z (Links = 141, TLS = 2048), Zhang H (Links = 144, TLS = 1935), and Wang X (Links = 121, TLS = 658); Cluster 3 (blue) contains 10.6% of the sample, with an emphasis on author Kahraman C (Links = 143, TLS = 2548); Cluster 4 (yellow) contains 10% of the sample, with an emphasis on authors Zavadskas E (Links = 153, TLS = 9165) and Turskis Z (Links = 138, TLS = 4074); Cluster 5 (purple) contains 7.5% of the sample, and author Liu H stands out (Links = 122, TLS = 1395); Cluster 6 (light blue) has 7.5% of the sample, highlighting the author Tzeng G (Links = 139, TLS = 2167).Electronics 2022, 11, 1720 16 of 30

Figure 9 .
Figure 9.The network map of productive authors.Note: The colors of the circles are used to identify the clusters resulting from the analysis of the relations produced by the VOSviewer software.

Figure 9 .
Figure 9.The network map of productive authors.Note: The colors of the circles are used to identify the clusters resulting from the analysis of the relations produced by the VOSviewer software.

Figure 10 .
Figure 10.Evolution of scientific production classified by method over the period analyzed.

Figure 10 .
Figure 10.Evolution of scientific production classified by method over the period analyzed.

Figure 11 .
Figure 11.The evolution of themes built with the authors' keywords.

Figure 11 .
Figure 11.The evolution of themes built with the authors' keywords.

Table 2 .
The top 10 countries/regions and institutions contributing to publications in multicriteria methods.

Table 3 .
Analytic picture of scientific production in the ten best-ranked countries.

Table 4 .
Top 10 most-active journals that published research articles on multicriteria methods (sorted by count).

Table 4 .
Top 10 most-active journals that published research articles on multicriteria methods (sorted by count).

Table 5 .
Ranking of authors with the highest scientific production on multicriteria methods.

Table 6 .
Distribution of scientific production by research areas.It is necessary to clarify the value indicated in the third column, "26,376" this is the total number of articles in the sample associated with the research areas.Each article can be related to more than one search area. Note:

Table 7 .
Evolution of scientific production according to research areas in the analyzed periods.
Note: Only data corresponding to the fifth position in each period were recorded.

Table 8 .
Characteristics of the methods most used by researchers.