Next Article in Journal
Implementation of Shared Laser–LED Sources in a Free Space Optics (FSO) Network under Environmental Impact
Previous Article in Journal
Condition-Based Maintenance of an Anaerobic Reactor Using Artificial Intelligence
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Towards Nuts and Bolts of Conducting Literature Review: A Typology of Literature Review

Department of Arts, Communications and Social Sciences, University Canada West, Vancouver, BC V6B 1V9, Canada
Electronics 2023, 12(4), 800; https://doi.org/10.3390/electronics12040800
Submission received: 21 November 2022 / Revised: 19 January 2023 / Accepted: 2 February 2023 / Published: 5 February 2023
(This article belongs to the Special Issue Innovative Research Methods in Computer Science and Engineering)

Abstract

:
Literature reviews demonstrate the progress of knowledge and a comprehensive understanding of related phenomena, contexts, and variables in any subject. Learning how to efficiently conduct a literature review is crucial to succeeding in an academic and even up-to-speed career. Summing up and synthesizing previous research in a particular field of interest indicates enjoying a thorough grasp of the available knowledge. It also lends a hand in learning and moving forward towards being professional in a particular milieu. However, an unorganized growth in literature may hinder amelioration by broaching the probability of complicated, competing, and implausible arguments in the scholarly inquiry. This study is a just-out attempt to develop a typology of review types and present an explanatory insight into the most typical and applicable literature reviews by relying on the aim, significance, applicability, and pros and cons. The goals of conducted typology are to study and analysis different types of literature review to assist researchers to commence their evaluations and place their contribution.

1. Introduction

The foundation of scientific research tasks/projects is to conduct research and establish a connection between the study’s objective and the existing body of knowledge, regardless of the field. To implement the methodological scheme, the literature review section should be regarded as a seniority among all academics [1]. In a similar route, the collection of information is seen as a crucial element for any area to be deemed “scientific” and “credible” [2]. To be more accurate, formulating impactful literature reviews is of great significance in producing and accelerating knowledge. [3]. A literature review is at the heart of the scientific projects and engrosses a significant corner of academic activities, in other words, it is considered the pillar of all social, business and engineering research. In the current global research, the frontiers of knowledge bases are extending month by month. Thus, it is becoming more important to enhance the published body of information. Fundamental to this concept is the notion that ground-breaking ideas build upon previously published research [4]. In essence, a literature evaluation demonstrates the need or need for doing fresh investigations [5,6]. As one of the most fundamental properties of research work, Creswell [5] expounded the definition in a special frame:
“The literature review in the context of a research study fulfills numerous objectives: (a) It shares the findings of other studies which are relevant to the study being reported with readers. (b) It links a study and ongoing stretches in the literature and extends prior studies. (c) It sets up a pertinent framework to justify the significance of the study (pp. 20–21).
Many researchers suppose that their art of research report is accepted with no resistance from evaluators. They are unsuccessful in perceiving the underlying significance of the literature review. The detailed view of reviewers attracts the literature review which is considered an “Achilles’ heel” of many researchers [7]. Looking at this issue through a scientific lens, researchers of some ilk are unaware of what fleshes out research, and likely they still presume that a literature review is not sheerly a formality [8].
Now, all the fundamentals necessary for a complete comprehension of the definition, aims, and relevance of a literature review have been emphasized. A literature review is one of the disciplines of research. This section will examine the topic at hand from the perspective of business research. Each study plan should adhere to a blueprint strategy to be carried out. Initially, a study contributes a fresh horizon of thought to an existing theory or empirical body of research by validating the theory in new contexts or elaborating it. To go ahead, elaboration or validation calls for a stretch of evidence that is employed to generate new hypotheses. They also play a part in explaining why and how the new lines of implications are relevant. One step beyond the basic concerns, the focus changes to practical issues. Researchers should centralize their integral aim in ascertaining how the new findings would untie the practical gaps [9].
It has been established that literature reviews aggregate data from much research, suggesting that when numerous results go in the same direction, more confidence in the reliability of conclusions may be accumulated [10]. In the second view, literature reviews open up new chambers for researchers to tap into broad questions. Put simply, they draw on research that exerted a variety of research methods and measurements [11]. In this sense, the literature review “foreshadows the researchers’ study” [12]. In summarizing the significance of literature review, [13] noted that literature reviews operate as a stimulant, motivating researchers to educate themselves on as large a body of relevant information as possible. Furthermore, they are apropos indicators to readers that the author(s) had a robust perception of the research topic. It has been maintained that through scrutinizing and reviewing the literature review on the previous literature, all shortcomings and foibles of prior studies will be lightened [14,15]. Therefore, they would enact as a lantern in creating and enriching the existing study context for conducting further research and even facilitating argument formulation.
One step beyond the nature and significance of literature reviews is the matter of centralization. Literature reviews could embrace several various focuses, which vary from one study to another. The leading focus deals with researchers’ conception of general research questions [16]. About the research questions, underlying concepts of research questions should cover all the domains of prior literature about the research topic, even if it does not straightly conform. In the second view, literature reviews enjoy high potential in educating readers about whether studies contribute to the accumulated knowledge or not. Hence, literature reviews help in fulfilling the integral aim through spotlighting on delineating themes and notions and stretches of relevant issues to the topic.
Cooper [15] categorized literature evaluations into a single category of emphasis by grouping all areas of attention under one umbrella. In this regard, literature reviews can be integrative (based on general conclusions, and previous studies are recapped). Methodological (dealing with multifarious methodological approaches that have been employed in prior research and their contributions to the overall research body), and theoretical reviews (highlighting sundry theories in clarifying a phenomenon). Over the years, various types of literature reviews have cropped up [3,17,18,19]. On the continuum of literature review, the four main types include traditional or narrative, meta-analysis, and systematic literature reviews [19]. Tapping on this matter on hand from another perspective, Paré, Trudel [3] extended the existing categorization. In this view, qualitative systematic reviews, and an umbrella, were added. In another classification, Paré and Kitsiou [18] enumerated other types namely, scoping and critical reviews. Regardless of categorization, the advancement of literature in any field might lead to the obverse, as it opposes the scholarly objective of promoting an in-depth perception of dynamics across numerous variables and contexts [20]. In this regard, the unplanned evolution of a discipline might result in the emergence of integrated, conflicting, and unsustainable ideas that would impede academic progress. This paper describes the different types of literature reviews and their strengths and limitations to assist Computer Science and Engineering researchers in adopting literature reviews as one of the research methods. In the following section, various classification of literature reviews including the pros and cons and the scope of applicability is discussed.

2. Types of Literature Review

Numerous sorts of literature reviews have developed over time. Briefly, the following are some step-by-step tips for conducting a literature review:
  • Narrowing the subject and picking papers accordingly
  • Literature search
  • Reading and reviewing the selected articles thoroughly
  • Organizing the chosen papers by identifying patterns and developing subthemes
  • Creating a thesis or mission statement
  • Developing the paper
  • Reviewing the work
The selection of a certain kind is determined by your study methodology and design. In the following subsections, several classifications of literature reviews, including their merits and drawbacks and scope of application, are examined.

2.1. Narrative Literature Review

As a social process including aggregate and iterative steps, this type of literature review has its basis in process theory. According to the purpose and application scope, narrative reviews focus on developing theories as their main goal [21,22], and typically they have appositeness in various fields namely humanities, management research, and social sciences [23,24].
A narrative review is defined as a thorough narrative synthesis of prior published information. Looking at the definition from a different perspective, narrative reviews are qualitative summaries of the relevant literature (whether statistics were used or not). They have a lot of potential for bringing together studies that looked at different research questions and approaches/methodologies [4]. The process of conducting this type is considered non-structured, multilayered, and calls for sundry cumulative written outcomes which occur in a social context [22]. Narrative reviews might become more robust through the inclusion of tables and making comparisons among quantitative results of different strings of studies. Interestingly, researchers found that the benefits of narrative reviews are extending to some other types of literature review such as systematic reviews and meta-analyses [25,26].
In addition to the extensive coverage of benefits and application in narrative reviews, some drawbacks have been found, hence researchers are recommended to be cautious in this regard. The greatest weakness has been attributed to the issue of “bias” in drawing the conclusions (Webster and Watson [27]). Bias may be rooted in the seedling stage of processing a review. There is less consensus about how experts have been selected. Furthermore, funders may choose experts whose opinions agree with their own and shun those whose opinions are different. About the essence of evidence, some complicated and evolving background knowledge and notions need the Top of Form.

Bottom of Form

In the second view, the completeness and wide coverage of narrative reviews in different fields have been corroborated. However, this type does not ineluctably follow regulations in searching for evidence [28]. Concerning evidence, Schlesselman and Collins [26] asserted that some complicated and evolving background knowledge and notions need a wide range of situational choices about the inclusion of evidence and thus call for more flexible narrative reviews. Thirdly, in typical narrative reviews, there are no traces of how conclusions and decisions were made about the pertinence of studies and the validity of the included studies. Casting much light, Schlesselman and Collins [26] maintained that the findings of one piece of research should meet the referees’ sense of legitimacy. However, readers might not make any judgments on the authors’ choices. Table 1 is the summary of narrative review characteristics.

2.2. Systematic Literature Review

Contrary to narrative reviews, systematic literature reviews adopt a more robust approach to reviewing the literature. The rigorousness of such reviews can be attributed to the fact that systematic reviews mostly have their centralization in answering structured and particular research questions [29]. Generally speaking, systematic reviews have their applicability scope in domains namely healthcare literature, traditional social science, and business management literature reviews [30,31]. At the heart of all fields, the string of systematic review utilization has been interwoven with healthcare movements in the late 1970s and early 1980s. They have emerged in unwinding the gaps in finding an “evidence-based medicine movement” by using and organizing the accessible knowledge on the efficaciousness of healthcare remedies into dependable formats [29]. Systematic reviews were defined as “a method of making conclusions from a bundle of information and is considered as a means of sharing the answers to research questions about what works and what does not” [29]. In line with the definition, Jesson, Matheson [30] have demonstrated that this type of review concentrates on accelerating the body of research knowledge and can be both qualitative and quantitative.
Compared to narrative reviews, systematic reviews encompass a more goal-based appraisal of evidence. Thus, since systematic reviews adopt a methodological approach, they are less prone to bias and error. As in narrative reviews, the type of exerted methods in singling out the pertinent data are not pellucid enough. Therefore, the selection of the study can be arbitrary (can be affected by reviewers’ bias) [32,33]. One line of strength in systematic reviews is associated with the level of precise and reliable appraisals, meaning that they are critically appraised, the strength of evidence is assessed, and quantitative synthesis of data is carried out [34]. In the third view, a reproducible process of systematic research synthesis lends a hand in untying any incertitude between the original study, traditional literature reviews, and experts’ credence [35]. Looking at the benefits from a research-based view, it has been highlighted that systematic reviews assist in abating the time interval between research discovery and implementation and enhance the generalizability of the results.
Encapsulating all benefits under one umbrella, systematic reviews are regarded as one of the most impactful tools in gaining thorough utilization of the global investment in research domains, and furthermore, they could help in recognizing areas that require more rigorous bunches of evidence. Therefore, up-and-coming novel research questions are produced [34].
Even though systematic reviews are regarded as the most powerful approach to finding a conclusive answer to a research question, some flaws should be pinpointed. The major drawback has been addressed and expounded in the light of the benefits, in systematic reviews (in quantitative studies), researchers can integrate data by using meta-analytic techniques. This would enhance the likelihood of distinguishing the original/real effects that smaller research could not detect. From this respect, since all the small biases and true effects are identified, such an increased effect might be considered a stumbling block [36]. The second problem is attributed to the scope of focus since systematic reviews have a concentration on narrow focus. Thus, they do not lend themselves to comprehensive coverage. The third limitation address the selection of studies, information loss on significant outcomes, improper subgroup analyses, and inconsistency with the novel experimental data [37]. Table 2 presents the summary of systematic review characteristics.

2.3. Meta-Analysis Literature Review

In retrospection to the aforementioned types of reviews, it has been stated that compared to narrative reviews, meta-analysis literature reviews are newer and apply a quantitative method of integrating the results of prior studies [38]. There is a disagreement between users of the two methods, some scholars who tend to inject this approach into their studies opine that narrative approaches and reviews have become obsolete. However, both have specialized a promising place in science [39]. Meta-analysis is a preferred type of literature review in combining the results of a multitude of studies that have adopted comparable methods in addressing a similar research question. Put the definition in another way, meta-analysis literature reviews include taking results from the selected literature and analyzing the results under the shade of standardized statistical techniques [38,40]. The arrays of applicability in meta-analytic reviews are extended into realms of economic studies such as cost-effective analyses, biomedical, and medical research (establishing the association between the amount of exposure and disease) [41]. Further, the obtained results from meta-analyses can be applied in verifying the acceptable sample size of a future trial [42].
Interestingly, what makes a borderline between systematic and narrative reviews with meta-analysis literature reviews is the potentiality of drawing conclusions and finding patterns and relationships between the findings [43]. It has been discussed that by pooling significant findings with non-significant findings from the related studies, meta-analysis reviews enjoy enhanced potential in appraising more accurate estimates of a phenomenon’s effects [44,45,46]. As one of the most powerful research methods, meta-analyses open up new chambers for researchers to draw apropos inferences through reliance on existing controversies [47]. Meta-analysis reviews hold a multitude of benefits namely an enhancement in power, detection patterns in studies with disorganized findings, and amelioration in precision [39]. The researchers have maintained that highly structured meta-analysis reviews could provide scholars with a comprehensive perception of state-of-art and accordingly enact a momentous role in disciplines’ advancement [10,48,49]. It is noteworthy to consider the dark sides of meta-analyses reviews in the context of empirical research, in this regard, the integral limitation is attributed to the incapability of this type in rectifying the imposed restrictions by previous insufficiently powered lines of studies. Put simply, meta-analytic reviews do not enjoy adequate potentiality in correcting shrimp sample bias and detecting the probable effect of pertinent moderators and mediators [42]. Tackling the second pitfall through the lens of statistics, meta-analyses mostly measure heterogeneity among studies. Some tests such as Cochran’s Q (it is a type of statistics that has its basis on the χ2 test) revealed what percentage of the overall variation is beyond the matter of chance [34]. Such variation estimates are the introduction of inconclusiveness that should be scrutinized in evidence interpretations. Table 3 provides the summary of the meta-analyses review characteristics.

2.4. Umbrella Literature Review

Making a bridge on what has been discussed earlier in this section, umbrella reviews are typically characterized as reviews of prior published meta-analyses and systematic reviews. They are one of the highest methods in representing evidence synthesis [50]. Taking the great prevalence and contribution of umbrella reviews in advancing the body of knowledge at this time interval, they are becoming highly injected with their vitality in the biomedical literature reviews, medical research, psychology, and genetics [51,52]. Addressing the applicability of umbrella reviews, it has been demonstrated that meta-analyses and systematic reviews generally have their major concentration on synthesizing the previous results and detecting the biases. However, as the number of reviews in these types increases, researchers find themselves in an overwhelming world. To find a remedy addressing this problem, umbrella reviews have emerged to fill out the existing knowledge gap [51]. Scholars who have conducted reviews in the channel of umbrella reviews opined that in most cases they are required to rely on the available information of systematic and meta-analyses, though, caution should be made in conceding the potential limitations [53]. Secondly, in selecting factors with a sufficient string of evidence and corroborating the data, umbrella reviews adopted systematic and meta-analyses literature reviews [54]. In line with thoroughly presenting the evidence in the scope of umbrella reviews, researchers should sufficiently take the limitations into account. From this respect, one of the most critical pitfalls is the limited scope of the report, meaning that umbrella reviews could just provide a report on what researchers have interrogated and published [55]. The second drawback is attributed to the necessity of knowledge novelty. In this regard, umbrella reviews can encompass all the studies even beyond what has been included in the range of published reviews. Such a comprehensive inclusion calls for fresher literature research, and accordingly, it requires more time and works devotion that becomes unfeasible [52]. Table 4 is the summary of umbrella review characteristics.

2.5. Descriptive Literature Review

A descriptive literature review is the summarization of individual research and mostly provides researchers with nuts and bolts of two important sections of methodology and results of the cited research [56]. The integral aim of this type of review is to present an explicable pattern of the existing literature reviews, these patterns generally provide quantified reports in the form of frequency analysis such as research methodology and research outcomes [56]. The process of conducting a descriptive review is systematic and includes searching, filtering, categorizing, codifying, and analyzing [57]. Magnifying the systematicity of the procedure, scholars delineated that at the seedling stage reviewers need to collect as many research papers as possible. In this line, they should carry out thorough research on the related literature [44,58,59]. Following the data collection, reviewers scrutinize each paper individually to reflect the frequencies of the topic, researchers, and the employed methods and to detect the patterns and trends among the surveyed research papers [60]. The overall resulting patterns are the manifestos of a research area. Extending the significance line to applicability scope, descriptive reviews have their utilization traces in educational settings, engineering research studies, and psychology. Highlighting the benefits of descriptive reviews, it has asserted that this type provides an in-depth picture of the intended fields of interest. Second, researchers can utilize the results of descriptive literature reviews to generate new research hypotheses and questions from cause-and-effect relationships [61]. One more advantage to be played out is attributed to the potential of descriptive reviews in expounding pros and cons in a particular field of study, researchers and policymakers can benefit from the suggested solutions to address the niches. Despite the beneficial horizons, the major pitfall in descriptive literature reviews deals with the nature of interpretations. The researchers feel free to use the results in formulating new research questions from the cause-and-effect patterns, though they should not establish any cause-and-effect relationships [61]. Table 5 illustrates a summary of descriptive review characteristics.

2.6. Scoping Literature Review

Scoping literature reviews are generally used to present a primary indication of the size and nature of the literature in specific fields of interest [62]. The integral objective of scoping reviews is to inspect the range and essence of research activities and particularly, verify the valuation of conducting systematic reviews and determining the research niches [63]. To better understand the nature of scoping reviews, it has been defined as exploratory research which systematically outlines the available literature on a topic, searches for key concepts, theories, and the origin of evidence, and more importantly addresses the existing gaps in research [64]. Scoping literature reviews have become increasingly trendy in healthcare research domains. Interestingly, from 2012 until the current time, the number of conducted scoping reviews has been accelerated, it has been argued that such an upsurging advancement in scoping review is attributed to its high potential in assisting research agendas and policymakers [62].
Additionally, the strength of scoping reviews is in their ability to illustrate ‘analysis of the evidence, breadth, and broad scope in a field’, and powerful tools in outlining sundry topics which can inform future studies [65]. Taking into account the extensive use and beneficial role of scoping reviews, there are no apparent criteria for assessing and guiding this type of literature review. Making a bridge, scholars found that in systematic reviews and clinical practices reporting guidelines have been provided. However, no quality criteria have been established about scoping reviews [66].
In scoping reviews, researchers need to define (redefine) the research questions, find strategies and criteria iteratively, and consequently, a great deal of time and resources should be sacrificed. One more pitfall that puts scoping reviews at risk and makes them become out of date is that researchers could not succinctly report the results and difficulty in publishing the scoping reviews in journal word counts [67]. Table 6 illustrates a summary of scoping review characteristics.

2.7. Critical Literature Review

Due to the extensive horizons of connection to other works and researchers across different fields of studies, critical literature reviews have allocated a great deal of research value in the larger academic milieu [68]. In the literature review domain, critical reviews have targeted the appraisal of information and synthesis particularly by magnifying observations and drawing wind-ups [69]. In a general view, critical reviews are objective and comprehensive rundowns and critical analyses of the related literature with all foibles, controversies, and inconsonances on the matter being examined [70]. The applicability scope of reviews of this type includes ecological studies [71], clinical and particularly nursing [71,72]. Delving into the deep layers, critical reviews collect information about sundry sources and encompass all pertinent to the topic being studied namely historical records, books, government reports, journal articles, theses, and dissertations.
Accordingly, they have a high potential in making a more robust basis for the improvement of knowledge and expediting theory development [73]. What makes critical reviews distinct from other types is that contrary to reviews that synthesize the existing studies, critical reviews do not certainly compare the included studies together [21]. It has been demonstrated that they examine each study against a criterion and evaluates it as more or less acceptable [21,74].
The strength of critical reviews is attributed to their high potential in playing up niches, inconsistencies, or even domains in which there is a paucity of attention to the existing knowledge [75]. From this respect, critical reviews could effectively assist researchers and step-up the advancement of knowledge by providing guidance and direction to studies for future development. The two pitfalls that address the critical reviews are, first, they rarely encompass a thorough search for all the related literature. Second, they could scarcely evaluate the quality of the selected studies specifically the qualitative research that lacks a hierarchy of designs [75]. Table 7 presented a summary of critical review characteristics.
Table 8 demonstrates the number of distinct types of literature reviews from 2012 to 2022 (28 December 2022). Due to the scope of this analysis, the terms “Management Information System”, “Computer Science”, “Computer Engineering”, and “Information Technology” are searched in the Scopus database. It might be assumed that systematic literature reviews are more prevalent in this scope.
For every sort of literature review paper, Table 9 provides two examples between 2020 and 2022. The title of a literature review paper determines its type.
For each form of the literature review article, Table 10 offers an overview of the merits and limitations of each style of literature review.
The disadvantages of literature review methods could be corrected fairly easily with a few key steps, some of which do not require too much skill, time, or money. Carefully establishing and publishing an a priori procedure that includes strategies for searching, screening, data extraction, evaluation, and synthesis.
The advantages of one method can overcome the disadvantages of another. It may be inferred that combining approaches may mitigate certain disadvantages. Despite all indicated potential answers, each approach has inherent limits, and the researcher should select the most appropriate method for the literature review based on the review scope.

3. Discussion

The goal of the current study was to provide a typology of review literature in nuts and bolts. The first category of literature reviews in the context of the current study was narrative reviews, which is the traditional method of a literature review. Narrative reviews can be distinguished from other types in several aspects, they are typically ‘selective’ in nature, meaning that they do not involve a systematic and all-inclusive search of the whole related literature [67]. Narrative reviews usually fulfill the aspect of surveying the literature and also groups of evidence that are accessible to the researcher, from this respect they are opportunistic [90]. In contrast to other types of literature reviews, narrative reviews are more likely to be subjective, so they do not explain how the whole process of reviewing literature was carried out. In contrast to systematic, meta-analysis, scoping, and umbrella reviews, they employ informal ways to combine prior data, including commentary or interpretation. [91,92].
One step higher, meta-analyses reviews are considered a robust technique for synthesizing the prior study findings. Compared to systematic reviews (they only synthesize the available evidence), meta-analyses reviews can probe and establish associations among sundry studies [45]. In some research situations, conducting meta-analyses is not reasonable nor apropos in pooling strings of studies together, the reason is attributed to the existence of broad heterogeneity among the reviewed studies, or variation among tools or concluded outcomes [93]. In such dilemmas, systematic reviews enact a remedial role in unwinding the tie through synthesis approaches namely content analysis, tabulations, and categorization schemes.
Systematic reviews open up new chambers for more goal-based evaluation than narrative reviews. Evidence from empirical studies investigating the underlying reasons why an intervention was effective or not and in what conditions enact a significant role, are all feasible through conducting systematic reviews [94]. Systematic reviews that yield contrariant findings would conduce to an overwhelming condition in interpreting and making decisions from the review-level evidence [95]. To effectively address this issue, there is a growing need for assessment and synthesis of past systematic studies to ensure that interpretation and decision-making are based on accumulated evidence. Umbrella reviews can resolve the difficulty of synthesizing discordant findings, they are overviews of systematic reviews aiming to compare and contrast the synthesized findings from a multitude of systematic and meta-analyses reviews [96,97]. It should be pinpointed that umbrella reviews use a similar set of guidelines and principles as systematic reviews. However, the basis of analysis in umbrella reviews is a systematic review, not a primary study [96,98]. Despite the similarities, umbrella reviews are different from systematic reviews in that the scope of inquiry in umbrella reviews is broader than systematic ones [99].
On the other hand, scoping reviews are a type of method whose main goal is to map the evidence from a variety of study designs in a certain area of study [62]. They have their concentrate on the breadth of the literature coverage rather than the depth. Contrary to narrative and descriptive reviews, the target of scoping reviews is much more comprehensive [59]. Researchers are approximately free to apply a variety of approaches to search, singling out, and selecting pertinent scientific research papers. In addition, they may freely describe arbitrary qualities, how one research relates to others, and eventually, make conclusions [3]. Some are exploratory, such as scoping reviews, while others, such as descriptive reviews, look for patterns [40,66]. Researchers are advised to choose the most appropriate form of literature review before starting a review project to effectively cover all the issues in one chapter.

4. Common Errors in Conducting Literature Review

Since minority individuals are provided with explicit instruction on how to carry out a literature review, many attempted to learn it mostly through the trial-and-error process. The first and utmost error is associated with the state/quality of purpose, it is of great significance to know the aim of the literature review. Many authors mistakenly suppose that the major objective of the literature review is to summarize the previous studies on a specific topic. However, a summarized capsule of past findings does not merely formulate a unified whole. Ideally, a clear goal enacts a beneficial role in advancing the field’s theoretical perception and could lead to introducing new theories that connect a sundry of findings. It has been demonstrated that a mature topic would broach a novel enhanced understanding of a theory by testing it against the previously published works [69].
The second mistake is associated with the mechanical components. An ambiguous introduction and weak organization would deviate readers to find the precise findings. Some authors do not follow a logical plan in formulating their literature review, that is they provide a brief introduction about the significance and niches of the study. Following that, the research findings are discussed, and once all of the content is covered, they initiate presenting their theoretical perspectives from the resulting themes and conclusions [100]. The researchers could not expect readers to hold a multitude of research findings in mind prior to finding out how they tie all together. In this meandering realm, the reader would lose the track of the main points and mislead them by mistakenly claiming that authors mentioned the theories in advance.
The next common mistake is the lack of providing adequate information about the intended literature review. Presenting superfluous or too few details about some works put constraints on the overall understanding. Generally, a literature review has centralized its integral aim in summing up particular research methods and findings from the studies it cited. Any pieces of empirical study contribute to the authentic data and have its reliance on how well they could justify the findings. Illustrating the essence of evidence is of great importance [101].

5. Thumb Rules in Writing Literature Review

Regardless of what type of literature review is going to be conducted, if researchers intend to formulate a thorough literature review, they need to strive to be as comprehensive as possible. At the seedling stages, the most integral and delicate rule to highlight is to ring in the need and goal of writing the literature review. The need for conducting a literature review can be grounded on an out-of-date notion of a topic, recent development and variegation of the literature, particularly on a novel and emerging topic [102]. In detail, debating can be carried out on a topic that has been already demystified by entrant theories or operationalized in various ways and it could be the extended version of the literature. It should be pinpointed that researchers can present the literature review as a composition of more than one theory. Researchers might demonstrate their success with the data and, by extension, the body of ideas, in this respect, by offering tenable explanations based on evidence.
As the literature on a new subject of interest initiates to accumulate and becomes the pillar of the literature body, researchers can assist in the literature review to tie each single study string together and analyze them to detect different viewpoints and insights. Moreover, shortcomings, imprecision, and any further problems. From this respect, selecting an apropos topic would make the study review distinct from the pertinent topics, support the concentration of the study, and set out boundaries to lay out the literature. Establishing boundaries for the topic would become the crux in developing the criteria to keep or discard the literature retrieved in the scope of the literature search later in the study [10].
One step above the topic of literature is the discussion of methods in the conducted literature. For all types of reviews and particularly for new topics in which the confirmed model/framework has not been thoroughly built up, the discussion is required to involve the means exerted to certify the validity or dependability of the resulting themes [102]. Similar to all research reports, the employed methods should be delineated in an adequate brass track so that readers could easily verify whether the literature on the topic has been injected into the study and so that researchers can replicate the study based on the research method. Once the methods of literature are elucidated, it is the repined time to critically analyze each study in the literature [103]. Through reviewing the multitude of articles, researchers have gained a broad perception of the literature quality, and therefore the basis for critical analysis is prepared. Critical analysis helps in determining the advantage, disadvantage, and inconsistencies in the literature and evaluates how well the literature manifests the topic [4]. Academically speaking, an impactful critique provides an equalized appraisal of strengths and ways to ameliorate the quality of the literature body. It equips the prerequisites for literature-review synthesis. As a rule of thumb in writing the literature review, authors’ viewpoints should be considered, and all the taken hidden perspectives have to be expounded for readers (e.g., neutral representations and biases) [4]. One neglected rule should be pinpointed and that is the authors’ assumptions should be demonstrated in the light of the viewpoints. Therefore, in line with justifying the perspectives in the light of the evidence, motley paragraphs on each previous study seem plausible to vindicate the findings.
Using the general arrangement and composition of literature as a guide, scholars are encouraged to create a harmonic flow of concepts and ideas so that readers can discern the entire (e.g., conceptual, methodological, and temporal structures). In some types of literature such as mapping and umbrella reviews, the organization of literature includes diagrams and visual representations. In this regard, the systematic structure and order of representations would highly enhance readers’ understanding of the addressed matter on hand. The literature evaluation should include traces of future subjects in the targeted discipline, as well as the aforementioned niceties. The traces include factors that have shaped the future of the topic, dissertate the pending advancements in the field of interest, and further assess the probable arrays for future trends [27,102].

6. Conclusions

Literature review is an essential method of any research project so there is a momentous need to conduct more robust literature reviews. The major objective of the current study was to study various literature reviews which are integral to the continuous advancement of knowledge. A handful of review types scrutinized the objective, significance, scope of applicability, strengths, and weaknesses in each review. The typology presented in the context of the current study acknowledged that there is a sense of void in some groups of the review classification. The addressed weaknesses and strengths need to be revived and become more robust. Accordingly, further empirical studies are required to deeply perceive and fill the existing gap.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Snyder, H. Literature review as a research methodology: An overview and guidelines. J. Bus. Res. 2019, 104, 333–339. [Google Scholar] [CrossRef]
  2. Kelley, C. Reviewing literature and formulating problems. In The SAGE Handbook for Research in Education: Pursuing Ideas as the Keystone of Exemplary Inquiry, 2nd ed.; SAGE Publications: Thousand Oaks, CA, USA, 2011; pp. 83–92. [Google Scholar]
  3. Paré, G.; Trudel, M.-C.; Jaana, M.; Kitsiou, S. Synthesizing information systems knowledge: A typology of literature reviews. Inf. Manag. 2015, 52, 183–199. [Google Scholar] [CrossRef]
  4. Baumeister, R.F. Writing a literature review. In The Portable Mentor; Springer: New York, NY, USA, 2013; pp. 119–132. [Google Scholar]
  5. Creswell, J.W.; Creswell, J.D. Research Design; SAGE: Thousand Oaks, CA, USA, 1994. [Google Scholar]
  6. Mohamed-Shaffril, H.A.; Samsuddin, S.F.; Abu Samah, A. The ABC of systematic literature review: The basic methodological guidance for beginners. Qual. Quant. 2021, 55, 1319–1346. [Google Scholar] [CrossRef]
  7. Green, B.N.; Johnson, C.D.; Adams, A. Writing narrative literature reviews for peer-reviewed journals: Secrets of the trade. J. Chiropr. Med. 2006, 5, 101–117. [Google Scholar] [CrossRef] [PubMed]
  8. Bastian, H.; Glasziou, P.; Chalmers, I. Seventy-five trials and eleven systematic reviews a day: How will we ever keep up? PLoS Med. 2010, 7, e1000326. [Google Scholar] [CrossRef]
  9. Rienties, B.; Hampel, R.; Scanlon, E.; Whitelock, D. Reflecting on the main findings and practical applications. In Open World Learning: Research, Innovation and the Challenges of High-Quality Education; Routledge: New York, NY, USA, 2022; pp. 264–272. [Google Scholar]
  10. Palmatier, R.W.; Houston, M.B.; Hulland, J. Review Articles: Purpose, Process, and Structure; Springer: Berlin/Heidelberg, Germany, 2018; pp. 1–5. [Google Scholar]
  11. Boyd, B.K.; Solarino, A.M. Ownership of corporations: A review, synthesis, and research agenda. J. Manag. 2016, 42, 1282–1314. [Google Scholar] [CrossRef]
  12. LaMarre, A.; Chamberlain, K. Innovating qualitative research methods: Proposals and possibilities. Methods Psychol. 2022, 6, 100083. [Google Scholar] [CrossRef]
  13. Bah, E.; Njoume, F.E.; Nague, L.; Mbozo’O, Y.O.; Dongmo, A.; Mback, E.L.; Berinyuy, M.; Ravana, P.; Kourfed, S.; Noah, R.; et al. Early introduction of African medical students into scientific research: A viewpoint and literature review of the importance, barriers, and proposed solutions. Front. Emerg. Med. 2021, 6, e24. [Google Scholar] [CrossRef]
  14. van Dinter, R.; Tekinerdogan, B.; Catal, C. Automation of systematic literature reviews: A systematic literature review. Inf. Softw. Technol. 2021, 136, 106589. [Google Scholar] [CrossRef]
  15. Cooper, H.M. Organizing knowledge syntheses: A taxonomy of literature reviews. Knowl. Technol. Policy 1988, 1, 104–126. [Google Scholar] [CrossRef]
  16. Denney, A.S.; Tewksbury, R. How to write a literature review. J. Crim. Justice Educ. 2013, 24, 218–234. [Google Scholar] [CrossRef]
  17. Cundiff, E.W.; Rudestam, K.E.; Newton, R.R. The method chapter: Describing your research plan. In Surviving Your Dissertation: A Comprehensive Guide to Content and Process; SAGE Publications: Thousand Oaks, CA, USA, 2007; pp. 87–117. [Google Scholar]
  18. Paré, G.; Kitsiou, S. Methods for literature reviews. In Handbook of eHealth Evaluation: An Evidence-Based Approach; University of Victoria: Victoria, BC, Canada, 2017. [Google Scholar]
  19. Danson, M.; Arshad, N. The literature review. In Research Methods for Business and Management: A Guide to Writing Your Dissertation; Goodfellow Publishers Ltd.: Oxford, UK, 2014; pp. 37–57. [Google Scholar]
  20. Pittaway, L.; Holt, R.; Broad, J. Synthesising knowledge in entrepreneurship research-the role of systematic literature reviews. In Handbook of Research on Small Business and Entrepreneurship; Edward Elgar Publishing: Cheltenham, UK, 2014. [Google Scholar]
  21. Baumeister, R.F.; Leary, M.R. Writing narrative literature reviews. Rev. Gen. Psychol. 1997, 1, 311–320. [Google Scholar] [CrossRef]
  22. Juntunen, M.; Lehenkari, M. A narrative literature review process for an academic business research thesis. Stud. High. Educ. 2019, 46, 330–342. [Google Scholar] [CrossRef]
  23. Tranfield, D.; Denyer, D.; Smart, P. Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review. Br. J. Manag. 2003, 14, 207–222. [Google Scholar] [CrossRef]
  24. Pickering, C.; Grignon, J.; Steven, R.; Guitart, D.; Byrne, J. Publishing not perishing: How research students transition from novice to knowledgeable using systematic quantitative literature reviews. Stud. High. Educ. 2014, 40, 1756–1769. [Google Scholar] [CrossRef]
  25. Dijkers, M.P. The value of “traditional” reviews in the era of systematic reviewing. Am. J. Phys. Med. Rehabil. 2009, 88, 423–430. [Google Scholar] [CrossRef] [PubMed]
  26. Schlesselman, J.J.; Collins, J.A. Evaluating systematic reviews and meta-analyses. In Seminars in Reproductive Medicine; Thieme Medical Publishers, Inc.: New York, NY, USA, 2013. [Google Scholar]
  27. Webster, J.; Watson, R.T. Analyzing the past to prepare for the future: Writing a literature review. MIS Q. 2002, 13–23. [Google Scholar]
  28. Collins, J.A.; Fauser, B.C. Balancing the Strengths of Systematic and Narrative Reviews; Oxford University Press: Oxford, UK, 2005; pp. 103–104. [Google Scholar]
  29. Bearman, M.; Smith, C.; Carbone, A.; Slade, S.C.; Baik, C.; Hughes-Warrington, M.; Neumann, D. Systematic review methodology in higher education. High. Educ. Res. Dev. 2012, 31, 625–640. [Google Scholar] [CrossRef]
  30. Jesson, J.; Matheson, L.; Lacey, F.M. Doing Your Literature Review: Traditional and Systematic Techniques; SAGE Publications: Thousand Oaks, CA, USA, 2011. [Google Scholar]
  31. Popay, J.; Roberts, H.; Sowden, A.; Petticrew, M.; Arai, L.; Rodgers, M.; Britten, N.; Roen, K.; Duffy, S. Guidance on the Conduct of Narrative Synthesis in Systematic Reviews: A Product from the ESRC Methods Programme; Institute for Health Research: London, UK, 2006; Volume 1, p. b92. [Google Scholar]
  32. Mulrow, C.D. The Medical Review Article: State of the Science. Ann. Intern. Med. 1987, 106, 485–488. [Google Scholar] [CrossRef]
  33. Hunter, C.; Januszyk, M.; Wan, D.C.; Momeni, A. Systematic Reviews in Craniofacial Trauma—Strengths and Weaknesses. Ann. Plast. Surg. 2016, 77, 363–368. [Google Scholar] [CrossRef]
  34. Finckh, A.; Tramèr, M.R. Primer: Strengths and weaknesses of meta-analysis. Nat. Clin. Pract. Rheumatol. 2008, 4, 146–152. [Google Scholar] [CrossRef] [PubMed]
  35. Higgins, J.P.; Thomas, J.; Chandler, J.; Cumpston, M.; Li, T.; Page, M.J.; Welch, V.A. Cochrane Handbook for Systematic Reviews of Interventions; John Wiley & Sons: Hoboken, NJ, USA, 2019. [Google Scholar]
  36. Kitchenham, B. Procedures for Performing Systematic Reviews; Keele University: Keele, UK, 2004; Volume 33, pp. 1–26. [Google Scholar]
  37. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G.; PRISMA Group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. Ann. Intern. Med. 2009, 151, 264–269. [Google Scholar] [CrossRef] [PubMed]
  38. Gurevitch, J.; Koricheva, J.; Nakagawa, S.; Stewart, G. Meta-analysis and the science of research synthesis. Nature 2018, 555, 175–182. [Google Scholar] [CrossRef] [PubMed]
  39. Ahn, E.; Kang, H. Introduction to systematic review and meta-analysis. Korean J. Anesthesiol. 2018, 71, 103–112. [Google Scholar] [CrossRef]
  40. Coughlan, M.; Cronin, P.; Ryan, F. Step-by-step guide to critiquing research. Part 1: Quantitative research. Br. J. Nurs. 2007, 16, 658–663. [Google Scholar] [CrossRef]
  41. Russo, M.W. How to review a meta-analysis. Gastroenterol. Hepatol. 2007, 3, 637. [Google Scholar]
  42. Hussain, N.; Bookwala, A.; Sancheti, P.; Bhandari, M. The 3-min appraisal of a meta-analysis. Indian J. Orthop. 2011, 45, 4. [Google Scholar] [CrossRef]
  43. Polit, D.F.; Beck, C.T. The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Res. Nurs. Health 2006, 29, 489–497. [Google Scholar] [CrossRef]
  44. King, W.R.; He, J. Understanding the role and methods of meta-analysis in IS research. Commun. Assoc. Inf. Syst. 2005, 16, 32. [Google Scholar] [CrossRef]
  45. Rosenthal, R.; DiMatteo, M.R. Meta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews. Annu. Rev. Psychol. 2001, 52, 59–82. [Google Scholar] [CrossRef]
  46. Higgins, J. Analysing data and undertaking meta-analyses. In Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.; The Cochrane Collaboration: London, UK, 2011; Volume 6. [Google Scholar]
  47. Deeks, J.J.; Higgins, J.P.T.; Altman, D.G. Analysing data and undertaking meta-analyses. In Cochrane Handbook for Systematic Reviews of Interventions; John Wiley & Sons: Hoboken, NJ, USA, 2019; pp. 241–284. [Google Scholar]
  48. Jones, O.; Gatrell, C. The Future of Writing and Reviewing for IJMR; Wiley Online Library: Hoboken, NJ, USA, 2014; pp. 249–264. [Google Scholar]
  49. Ma, L.; Liu, Y.; Zhang, X.; Ye, Y.; Yin, G.; Johnson, B.A. Deep learning in remote sensing applications: A meta-analysis and review. ISPRS J. Photogramm. Remote Sens. 2019, 152, 166–177. [Google Scholar] [CrossRef]
  50. Fusar-Poli, P.; Radua, J. Ten simple rules for conducting umbrella reviews. Evid. Based Ment. Health 2018, 21, 95–100. [Google Scholar] [CrossRef] [Green Version]
  51. Dipietro, L.; Evenson, K.R.; Bloodgood, B.; Sprow, K.; Troiano, R.; Piercy, K.L.; Vaux-Bjerke, A.; Powell, K.E.; 2018 Physical Activity Guidelines Advisory Committee. Benefits of Physical Activity during Pregnancy and Postpartum: An Umbrella Review. Med. Sci. Sports Exerc. 2019, 51, 1292–1302. [Google Scholar] [CrossRef] [PubMed]
  52. Aromataris, E.; Fernandea, R.; Godfray, C.M.; Holly, C.; Khalil, H.; Tungpunkom, P. Summarizing systematic reviews: Methodological development, conduct and reporting of an umbrella review approach. JBI Evid. Implement. 2015, 13, 132–140. [Google Scholar] [CrossRef] [PubMed]
  53. Siontis, K.C.; Hernandez-Boussard, T.; Ioannidis, J.P.A. Overlapping meta-analyses on the same topic: Survey of published studies. BMJ 2013, 347, f4501. [Google Scholar] [CrossRef]
  54. Bellou, V.; Belbasis, L.; Tzoulaki, I.; Evangelou, E.; Ioannidis, J.P.A. Environmental risk factors and Parkinson’s disease: An umbrella review of meta-analyses. Park. Relat. Disord. 2016, 23, 1–9. [Google Scholar] [CrossRef]
  55. Faulkner, G.; Fagan, M.J.; Lee, J. Umbrella reviews (systematic review of reviews). Int. Rev. Sport Exerc. Psychol. 2021, 15, 1–18. [Google Scholar] [CrossRef]
  56. Yang, H.; Tate, M. A descriptive literature review and classification of cloud computing research. Commun. Assoc. Inf. Syst. 2012, 31, 2. [Google Scholar] [CrossRef]
  57. Schlagenhaufer, C.; Amberg, M. A descriptive literature review and classification framework for gamification in information systems. In Proceedings of the 23rd European Conference on Information Systems (ECIS), Münster, Germany, 26–29 May 2015. [Google Scholar]
  58. Whetten, D.A. What constitutes a theoretical contribution? Acad. Manag. Rev. 1989, 14, 490–495. [Google Scholar] [CrossRef]
  59. Rumrill, P.D.; Fitzgerald, S.M.; Merchant, W.R. Using scoping literature reviews as a means of understanding and interpreting existing literature. Work 2010, 35, 399–404. [Google Scholar] [CrossRef]
  60. Hartling, L.; Chisholm, A.; Thomson, D.; Dryden, D.M. A Descriptive Analysis of Overviews of Reviews Published between 2000 and 2011. PLoS ONE 2012, 7, e49667. [Google Scholar] [CrossRef] [PubMed]
  61. Gupta, P.; Chauhan, S.; Jaiswal, M.P. Classification of Smart City Research—A Descriptive Literature Review and Future Research Agenda. Inf. Syst. Front. 2019, 21, 661–685. [Google Scholar] [CrossRef]
  62. O’Brien, K.K.; Colquhoun, H.; Levac, D.; Baxter, L.; Tricco, A.C.; Straus, S.; Wickerson, L.; Nayar, A.; Moher, D.; O’Malley, L. Advancing scoping study methodology: A web-based survey and consultation of perceptions on terminology, definition and methodological steps. BMC Health Serv. Res. 2016, 16, 305. [Google Scholar] [CrossRef] [PubMed]
  63. Tricco, A.C.; Lillie, E.; Zarin, W.; O’Brien, K.; Colquhoun, H.; Kastner, M.; Levac, D.; Ng, C.; Sharpe, J.P.; Wilson, K.; et al. A scoping review on the conduct and reporting of scoping reviews. BMC Med. Res. Methodol. 2016, 16, 1–10. [Google Scholar] [CrossRef] [PubMed]
  64. Levac, D.; Colquhoun, H.; O’Brien, K.K. Scoping studies: Advancing the methodology. Implement. Sci. 2010, 5, 19. [Google Scholar] [CrossRef] [PubMed]
  65. Colquhoun, H.L.; Levac, D.; O’Brien, K.K.; Straus, S.; Tricco, A.C.; Perrier, L.; Kastner, M.; Moher, D. Scoping reviews: Time for clarity in definition, methods, and reporting. J. Clin. Epidemiol. 2014, 67, 1291–1294. [Google Scholar] [CrossRef]
  66. Daudt, H.M.; van Mossel, C.; Scott, S.J. Enhancing the scoping study methodology: A large, inter-professional team’s experience with Arksey and O’Malley’s framework. BMC Med. Res. Methodol. 2013, 13, 19. [Google Scholar] [CrossRef]
  67. Peters, M.D.J.; Godfrey, C.M.; Khalil, H.; McInerney, P.; Parker, D.; Soares, C.B. Guidance for conducting systematic scoping reviews. JBI Evid. Implement. 2015, 13, 141–146. [Google Scholar] [CrossRef]
  68. Colling, J. Demystifying the clinical nursing research process: The literature review. Urol. Nurs. 2003, 23, 297–299. [Google Scholar]
  69. Torraco, R.J. Writing Integrative Literature Reviews: Guidelines and Examples. Hum. Resour. Dev. Rev. 2005, 4, 356–367. [Google Scholar] [CrossRef]
  70. Geneidy, O.; Ismaeel, W.S.; Abbas, A. A critical review for applying three-dimensional concrete wall printing technology in Egypt. Arch. Sci. Rev. 2019, 62, 438–452. [Google Scholar] [CrossRef]
  71. Graça, M.; Cruz, S.; Monteiro, A.; Neset, T.-S. Designing urban green spaces for climate adaptation: A critical review of research outputs. Urban Clim. 2022, 42, 101126. [Google Scholar] [CrossRef]
  72. Mukasyan, A.; Rogachev, A.; Moskovskikh, D.; Yermekova, Z. Reactive spark plasma sintering of exothermic systems: A critical review. Ceram. Int. 2022, 48, 2988–2998. [Google Scholar] [CrossRef]
  73. Kirkwood, A.; Price, L. Technology-enhanced learning and teaching in higher education: What is ‘enhanced’ and how do we know? A critical literature review. Learn. Media Technol. 2013, 39, 6–36. [Google Scholar] [CrossRef]
  74. Hedges, L.; Cooper, H. Research synthesis as a scientific process. Handb. Res. Synth. Meta-Anal. 2009, 1, 4–7. [Google Scholar]
  75. Dixon-Woods, M.; Bonas, S.; Booth, A.; Jones, D.R.; Miller, T.; Sutton, A.J.; Shaw, R.; Smith, J.; Young, B. How can systematic reviews incorporate qualitative research? A critical perspective. Qual. Res. 2006, 6, 27–44. [Google Scholar] [CrossRef]
  76. Gómez-Cantarino, S.; Mazoteras-Pardo, V.; Rodríguez-Montejano, J.; Gradellini, C.; Cunha-Oliveira, A.; Ugarte-Gurrutxaga, M.I. Theorising about child maltreatment: Health Education Models, Conceptual Frameworks and the importance of ICTs. Front. Psychol. 2022, 13, 4527. [Google Scholar] [CrossRef]
  77. Canário, A.C.; Byrne, S.; Creasey, N.; Kodyšová, E.; Akik, B.C.; Lewandowska-Walter, A.; Stanke, K.M.; Pećnik, N.; Leijten, P. The use of information and communication technologies in family support across Europe: A narrative review. Int. J. Environ. Res. Public Health 2022, 19, 1488. [Google Scholar] [CrossRef]
  78. Holloman, T.K.; Lee, W.C.; London, J.S.; Ash, C.D.H.; Watford, B.A. The assessment cycle: Insights from a systematic literature review on broadening participation in engineering and computer science. J. Eng. Educ. 2021, 110, 1027–1048. [Google Scholar] [CrossRef]
  79. Pirker, J.; Dengel, A.; Holly, M.; Safikhani, S. Virtual Reality in Computer Science Education: A Systematic Review. In Proceedings of the 26th ACM symposium on virtual reality software and technology, Virtual Event Canada, 1–4 November 2020. [Google Scholar]
  80. Sinwell, L.; Julian, B.; Matthias, B.; Andreas, A. A meta analysis of the status of AI in environmental computer science. Informatik 2021, 2021, 333–347. [Google Scholar]
  81. Santini, F.d.O.; de Metos, C.A.; Ladeira, W.J.; Jardim, W.C.; Perin, M.G. Information technology adoption by small and medium enterprises: A meta-analysis. J. Small Bus. Entrep. 2022, 1–24. [Google Scholar] [CrossRef]
  82. Fennelly, O.; Cunningham, C.; Grogan, L.; Cronin, H.; O’Shea, C.; Roche, M.; Lawlor, F.; O’Hare, N. Successfully implementing a national electronic health record: A rapid umbrella review. Int. J. Med Informatics 2020, 144, 104281. [Google Scholar] [CrossRef] [PubMed]
  83. Sinkovics, N.; Gunaratne, D.; Sinkovics, R.; Molina-Castillo, F.-J. Sustainable Business Model Innovation: An Umbrella Review. Sustainability 2021, 13, 7266. [Google Scholar] [CrossRef]
  84. Hutchinson, G.; Ophoff, J. A descriptive review and classification of organizational information security awareness research. In Proceedings of the International Information Security Conference 2020, Bali, Indonesia, 16–18 December 2020; Springer: Berlin/Heidelberg, Germany, 2020. [Google Scholar]
  85. Fuertes, G.; Alfaro, M.; Vargas, M.; Gutierrez, S.; Ternero, R.; Sabattin, J. Conceptual Framework for the Strategic Management: A Literature Review—Descriptive. J. Eng. 2020, 2020, 1–21. [Google Scholar] [CrossRef]
  86. Lei, Y.; Allen, M. English Language Learners in Computer Science Education: A Scoping Review. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education V. 1, Providence, RI, USA, 3–5 March 2022. [Google Scholar]
  87. Virkki, O.T. Computer Science Student Selection–A Scoping Review and a National Entrance Examination Reform. In Proceedings of the 52nd ACM Technical Symposium on Computer Science Education, Virtual Event, USA, 13–20 March 2021. [Google Scholar]
  88. Chege, S.M.; Wang, D. The Role of Information Technology Innovation in Combating Corruption in SMEs in Developing Countries: A Critical Literature Review. IEEE Eng. Manag. Rev. 2020, 48, 120–132. [Google Scholar] [CrossRef]
  89. Huang, W.; Looi, C.-K. A critical review of literature on “unplugged” pedagogies in K-12 computer science and computational thinking education. Comput. Sci. Educ. 2020, 31, 83–111. [Google Scholar] [CrossRef]
  90. Hodgkinson, G.P.; Ford, J.K. Narrative, meta-analytic, and systematic reviews: What are the differences and why do they matter? J. Organ. Behav. 2014, 35, S1–S5. [Google Scholar] [CrossRef]
  91. Dixon-Woods, M.; Agarwal, S.; Jones, D.; Young, B.; Sutton, A. Synthesising qualitative and quantitative evidence: A review of possible methods. J. Health Serv. Res. Policy 2005, 10, 45–53. [Google Scholar] [CrossRef]
  92. Jahan, N.; Naveed, S.; Zeshan, M.; A Tahir, M. How to Conduct a Systematic Review: A Narrative Literature Review. Cureus 2016, 8, e864. [Google Scholar] [CrossRef]
  93. Mickan, S.; Atherton, H.; Roberts, N.W.; Heneghan, C.; Tilson, J.K. Use of handheld computers in clinical practice: A systematic review. BMC Med. Informatics Decis. Mak. 2014, 14, 1–10. [Google Scholar] [CrossRef]
  94. Noyes, J.; Popay, J.; Pearson, A.; Hannes, K.; Booth, A. Qualitative Research and Cochrane Reviews; Cochrane: London, UK, 2015. [Google Scholar]
  95. Moher, D. The Problem of Duplicate Systematic Reviews; British Medical Journal Publishing Group: London, UK, 2013. [Google Scholar]
  96. Becker, L.A.; Oxman, A.D. 22 Overviews of Reviews. In Cochrane Handbook for Systematic Reviews of Interventions; John Wiley & Sons: Hoboken, NJ, USA, 2008; Volume 607, pp. 607–631. [Google Scholar]
  97. Bellou, V.; Belbasis, L.; Tzoulaki, I.; Middleton, L.T.; Ioannidis, J.P.; Evangelou, E. Systematic evaluation of the associations between environmental risk factors and dementia: An umbrella review of systematic reviews and meta-analyses. Alzheimer’s Dement. 2016, 13, 406–418. [Google Scholar] [CrossRef] [PubMed]
  98. Ioannidis, J.P. Integration of evidence from multiple meta-analyses: A primer on umbrella reviews, treatment networks and multiple treatments meta-analyses. Can. Med. Assoc. J. 2009, 181, 488–493. [Google Scholar] [CrossRef] [PubMed]
  99. Smith, V.; Devane, D.; Begley, C.M.; Clarke, M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions. BMC Med Res. Methodol. 2011, 11, 1–6. [Google Scholar] [CrossRef]
  100. Fisch, C.; Block, J. Six Tips for Your (Systematic) Literature Review in Business and Management Research; Springer: Berlin/Heidelberg, Germany, 2018; pp. 103–106. [Google Scholar]
  101. Paul, J.; Criado, A.R. The art of writing literature review: What do we know and what do we need to know? Int. Bus. Rev. 2020, 29, 101717. [Google Scholar] [CrossRef]
  102. Torraco, R.J. Writing integrative reviews of the literature: Methods and purposes. Int. J. Adult Vocat. Educ. Technol. IJAVET 2016, 7, 62–70. [Google Scholar] [CrossRef]
  103. Callahan, J.L. Writing Literature Reviews: A Reprise and Update; SAGE Publications: Los Angeles, CA, USA, 2014; pp. 271–275. [Google Scholar]
Table 1. Summary of Narrative Review Characteristics.
Table 1. Summary of Narrative Review Characteristics.
Review TypeQuestions ScopeApplicability ScopeWeaknessStrength
Narrative BroadHumanities Management research
Social sciences
Not following regulation in searching evidence
No traces on how conclusions and decisions were made about the pertinence of studies
No traces on validity of the included studies
Wide coverage
More prone to bias and error
High potential in integrating studies with various research questions and approaches/methodologies
Benefits of narrative reviews can be extended over some other types of literature review
Table 2. Summary of Systematic Review Characteristics.
Table 2. Summary of Systematic Review Characteristics.
Review TypeQuestions ScopeApplicability ScopeWeaknessStrength
Systematic Narrow Healthcare literature
Traditional Social science
Business management
Over-magnification of small biases and true effects
Not comprehensive coverage
Inconsistency with the novel experimental data
Loss of information on significant outcomes
Improper subgroup analyses
Provision of a more goal-based appraisal of evidence
Less prone to bias and error
High level of precision and reliable appraisals
Assessing strength of evidences
Conducting quantitative synthesis of data
Helping in recognizing areas require more rigorous evidences
Generation of novel research hypotheses/questions
Table 3. Summary of Meta-Analyses Review Characteristics.
Table 3. Summary of Meta-Analyses Review Characteristics.
Review TypeQuestions ScopeApplicability ScopeWeaknessStrength
Meta-analyses Narrow Economic studies
Medical and Biomedical research
Low potentiality in correcting sample bias
Low detection in the probable effect of pertinent moderators and mediators
Overmagnification on heterogeneity and variation
Providing much accurate estimates of a phenomenon effects
Drawing apropos inferences through reliance on existing controversies
Detecting patterns in studies with disorganized findings High potential in integrating studies with various research questions and approaches/methodologies
Providing comprehensive perception of state-of- art
Table 4. Summary of Umbrella Review Characteristics.
Table 4. Summary of Umbrella Review Characteristics.
Review TypeQuestions ScopeApplicability ScopeWeaknessStrength
UmbrellaNarrow Medical research
Psychology
Biomedical
Genetics
Limited scope of report
Requiring more time and work devotion
High potential in representing evidence synthesis
Detecting the biases
Table 5. Summary of Descriptive Review Characteristics.
Table 5. Summary of Descriptive Review Characteristics.
Review TypeQuestions ScopeApplicability ScopeWeaknessStrength
DescriptiveBroadEducational settings
Engineering
Psychology
No establishment of cause-and-effect relationships
Providing rich/detailed information about methodology and results section of the cited research
Helping to generate new research hypotheses and questions from cause-and-effect relationships
Representing an in-depth picture of the intended fields of interest
Table 6. Summary of Scoping Review Characteristics.
Table 6. Summary of Scoping Review Characteristics.
Review TypeQuestions ScopeApplicability ScopeWeaknessStrength
ScopingBroadHealthcare research
No apparent criteria in assessing and guiding this type of literature review
A great deal of time and resources devotion
Difficulty in publishing the scoping reviews in journal word counts
Risk of becoming out of date
Analysis of the evidence
Breadth, and broad scope in a field’
Powerful tools in outlining sundry topic which can inform future studies
Table 7. Summary of Critical Review Characteristics.
Table 7. Summary of Critical Review Characteristics.
Review TypeQuestions ScopeApplicability ScopeWeaknessStrength
CriticalBroadEcological and clinical studies particularly nursing
Rarely encompass a thorough search for all the related literature A great deal of time and resources devotion
Low potential in evaluating the quality of the selected studies specifically the qualitative research
High potential in playing up niches, inconsistencies, or even novel domains
Help researchers and step up advancement of knowledge through providing guidance and direction to studies for future development
Table 8. The Number of Different Kinds of Literature Reviews from 2012 to 2022.
Table 8. The Number of Different Kinds of Literature Reviews from 2012 to 2022.
Literature Review TypeManagement Information SystemComputer ScienceComputer EngineeringInformation Technology
Narrative2008
Systematic163011211
Meta-analysis03141
Umbrella0000
Descriptive0001
Scoping12039
Critical04118
Table 9. Examples of Each Type of Literature Review Paper—2020 to 2022.
Table 9. Examples of Each Type of Literature Review Paper—2020 to 2022.
Sample PaperPublished YearReference
NarrativeA narrative review of health education approaches, conceptual frameworks, and the significance of communication and information technologies in relation to child abuse.2022[76]
A narrative review of the use of communication and information technologies in family support across Europe2022[77]
SystematicInsights from a systematic literature analysis on increasing participation in engineering and computer science about the assessment cycle2021[78]
A Systematic Analysis of Virtual Reality in Computer Science Instruction2020[79]
Meta-analysisA meta-analysis of artificial intelligence in environmental computing at this time2021[80]
Adoption of information technology by small and medium-sized businesses: a meta-analysis2022[81]
UmbrellaImplementing a national electronic health record successfully: a rapid umbrella review2020[82]
An umbrella review of sustainable business model innovation2021[83]
DescriptiveA descriptive review and categorization of information security awareness research in organizations2020[84]
A literature study on the conceptual framework of strategic management—descriptive2020[85]
ScopingA scope review of English language learners in computer science instruction2022[86]
Selection of computer science students? A scoping review and a reform of the national entrance exam2021[87]
CriticalA critical literature review on the role of information technology innovation in fighting corruption in small and medium-sized enterprises in developing nations2020[88]
A critical literature review of “unplugged” pedagogies for computational thinking education and K-12 computer science2021[89]
Table 10. The Strengths and Weaknesses Summary of the Literature Review Different Types.
Table 10. The Strengths and Weaknesses Summary of the Literature Review Different Types.
Literature ReviewAdvantagesDisadvantages
Narrative
A complete viewpoint may be provided on certain subjects.
More susceptible to mistakes and prejudice
Potential for combining studies with diverse research topics, techniques, and procedures.
The advantages of narrative reviews surpass those of several other forms of literature review.
Not the following procedure while looking for proof
No indications of how choices and conclusions were reached about the relevance of investigations.
No indications of the validity of the included studies
Systematic
Provision of a more objective evidence evaluation
exhibiting less prejudice and inaccuracy
Highly precise and dependable evaluations
Evaluating the reliability of evidence
Data synthesis based on quantitative analysis
Aiding in the identification of areas requiring more rigorous evidence
Innovation of research concepts and/or questions
Overemphasis on tiny biases and genuine effects
Not exhaustive coverage
contradiction with the new experimental data
Loss of knowledge regarding major consequences
Inadequate subgroup analyses
Meta-analysis
Effects of providing more precise estimations of a phenomena
Drawing pertinent assumptions based on existing disputes
Pattern recognition in research with disordered results
Potential for combining studies with diverse research topics, techniques, and procedures.
Providing a complete view of the state-of-the-art
Low chance of reversing sample bias
Low sensitivity to the likely influence of relevant moderators and mediators
Exaggerated emphasis on heterogeneity and variety
Umbrella
Significant potential for resembling a synthesis of evidence
Identifying biases
Limited report scope
Requiring more time and effort
Descriptive
Providing rich/detailed information regarding the methods and results part of the research being referenced.
Contributing to the generation of novel ideas and research topics based on cause-and-effect correlations
Providing a comprehensive depiction of the targeted areas of focus
There is no evidence of cause-and-effect relationships.
Scoping
Examination of the evidence
Extensiveness and breadth in a field.
Effective techniques for describing diverse topics that might inform future research.
There are no evident assessment and guiding criteria for this form of a literature evaluation.
Significant time and resources investment
Difficulty in submitting scoping reviews in journals with sufficient word limits
Possibility of becoming obsolete
Critical
Strong potential for exploiting niches, inconsistencies, and even new areas.
Assist researchers and enhance knowledge by offering future development studies with advice and direction.
Rarely include a comprehensive search for all relevant literature.
Significant investment of time and resources
Low possibility for assessing the quality of the chosen studies, particularly qualitative research
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Taherdoost, H. Towards Nuts and Bolts of Conducting Literature Review: A Typology of Literature Review. Electronics 2023, 12, 800. https://doi.org/10.3390/electronics12040800

AMA Style

Taherdoost H. Towards Nuts and Bolts of Conducting Literature Review: A Typology of Literature Review. Electronics. 2023; 12(4):800. https://doi.org/10.3390/electronics12040800

Chicago/Turabian Style

Taherdoost, Hamed. 2023. "Towards Nuts and Bolts of Conducting Literature Review: A Typology of Literature Review" Electronics 12, no. 4: 800. https://doi.org/10.3390/electronics12040800

APA Style

Taherdoost, H. (2023). Towards Nuts and Bolts of Conducting Literature Review: A Typology of Literature Review. Electronics, 12(4), 800. https://doi.org/10.3390/electronics12040800

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop