Next Article in Journal
Effects of a Combined Community Exercise Program in Obstructive Sleep Apnea Syndrome: A Randomized Clinical Trial
Next Article in Special Issue
Effective Diagnosis and Treatment through Content-Based Medical Image Retrieval (CBMIR) by Using Artificial Intelligence
Previous Article in Journal
Application of the Sepsis-3 Consensus Criteria in a Geriatric Acute Care Unit: A Prospective Study
Previous Article in Special Issue
Exploration of Machine Learning for Hyperuricemia Prediction Models Based on Basic Health Checkup Tests
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Global Evolution of Research in Artificial Intelligence in Health and Medicine: A Bibliometric Study

1
Institute for Preventive Medicine and Public Health, Hanoi Medical University, Hanoi 100000, Vietnam
2
Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD 21205, USA
3
Center of Excellence in Artificial Intelligence in Medicine, Nguyen Tat Thanh University, Ho Chi Minh City 700000, Vietnam
4
Center of Excellence in Evidence-based Medicine, Nguyen Tat Thanh University, Ho Chi Minh City 700000, Vietnam
5
Institute for Global Health Innovations, Duy Tan University, Da Nang 550000, Vietnam
6
Center for Interdisciplinary Social Research, Phenikaa University, Yen Nghia, Ha Dong District, Hanoi 100803, Vietnam
7
Faculty of Economics and Finance, Phenikaa University, Yen Nghia, Ha Dong district, Hanoi 100803, Vietnam
8
Sciences Po Paris, Campus de Dijon, 21000 Dijon, France
9
Vietnam-Germany Hospital, 16 Phu Doan street, Hoan Kiem district, Hanoi 100000, Vietnam
10
Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore
11
Information Systems Technology and Design (ISTD) pillar, Singapore University of Technology and Design, Singapore 487372, Singapore
12
A.I. for Social Data Lab (AISDL), Vuong & Associates, 3/161 Thinh Quang, Dong Da District, Hanoi 100000, Vietnam
13
Department of Psychological Medicine, National University Hospital, Singapore 119228, Singapore
14
Center of Excellence in Behavioral Medicine, Nguyen Tat Thanh University, Ho Chi Minh City 700000, Vietnam
15
Department of Psychological Medicine, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore
16
Biomedical Global Institute of Healthcare Research & Technology (BIGHEART), National University of Singapore, Singapore 117599, Singapore
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2019, 8(3), 360; https://doi.org/10.3390/jcm8030360
Submission received: 19 February 2019 / Revised: 9 March 2019 / Accepted: 10 March 2019 / Published: 14 March 2019
(This article belongs to the Special Issue The Future of Artificial Intelligence in Clinical Medicine)

Abstract

:
The increasing application of Artificial Intelligence (AI) in health and medicine has attracted a great deal of research interest in recent decades. This study aims to provide a global and historical picture of research concerning AI in health and medicine. A total of 27,451 papers that were published between 1977 and 2018 (84.6% were dated 2008–2018) were retrieved from the Web of Science platform. The descriptive analysis examined the publication volume, and authors and countries collaboration. A global network of authors’ keywords and content analysis of related scientific literature highlighted major techniques, including Robotic, Machine learning, Artificial neural network, Artificial intelligence, Natural language process, and their most frequent applications in Clinical Prediction and Treatment. The number of cancer-related publications was the highest, followed by Heart Diseases and Stroke, Vision impairment, Alzheimer’s, and Depression. Moreover, the shortage in the research of AI application to some high burden diseases suggests future directions in AI research. This study offers a first and comprehensive picture of the global efforts directed towards this increasingly important and prolific field of research and suggests the development of global and national protocols and regulations on the justification and adaptation of medical AI products.

1. Introduction

While the growing importance and relevance of artificial intelligence (AI) is indisputable, the term itself has no universally agreed upon definition [1,2]. AI commonly refers to the computational technologies that mimic or simulate processes supported with human intelligence, for instance, reasoning, deep learning, adaptation, interaction, and sensory understanding [1]. In a broader definition, the Cambridge dictionary puts AI as an interdisciplinary approach that adopts principles and devices from a variety of fields, such as computation, mathematics, logics, and biology, to solve the problem of understanding, modeling, and replicating intelligence and cognitive processes [3]. As such, applications of AI can be found in various domains, from robotics [4,5], image and voice recognition [6], to natural language processing and expert systems [2]. Given its broad, dynamic and rapidly growing capabilities, it is no wonder that AI has been applied in the field of medicine since as early as the 1950s when physicians made the first attempts to improve their diagnoses using computer-aided programs [3]. A notable example of this is abdominal pain diagnosis that utilized computer analysis by Gunn in 1976 [7,8]. The interest and advances in medical AI applications have surged in recent years, thanks to the substantially enhanced computing power of modern computers [4,9] and the vast amount of digital data now available for collection and utilization [1].
Within the medical literature, scholars have written extensively on the benefits of AI applications, highlighting the technology’s potential to improve diagnostic and therapeutic accuracy and the overall clinical treatment process [10,11]. With its sophisticated algorithms and deep learning capacity, AI applications have assisted doctors and medical professionals in general in the domains of health information systems, geocoding health data, epidemic and syndromic surveillance, predictive modeling and decision support, and medical imaging [4,5,12,13]. In particular instances, an AI system can provide health professionals with constant, possibly real-time updates of medical information from various sources including journals, textbooks, clinical practices, and patients to inform proper patient care [14] and enable appropriate inferences for health risk alert and health outcome prediction [15].
As AI is rapidly transforming the medical landscape, scholarship on the topic has also mounted substantially in recent years, presenting the need for a comprehensive review of the research patterns as well as trends of AI in medicine (AIM). In their thorough review article on Nature Biomedical Engineering, Yu, Beam, and Kohane [4] survey the literature on AIM, explain the advanced techniques and their applications, and point out the breakthroughs and challenges for the field. The paper, though among the most recent attempts to draw out clinical integration of medical AI at various stages, has yet to dig into the entirety of the literature on AIM over a certain period of time. Thus, in order to identify research gaps and facilitate the clear, on-point translation of knowledge that would better inform policy development, this study presents the use of scientometric analysis in exploring research trends in the subject of AI in health and medicine. Scientometrics uses databases of published literature to objectively assess the impact of research knowledge on health issues and provide substantial empirical evidence. It shows the way of changing concerned research topics in national and international contexts with the increasing number of published articles over time, and reflects the visual collaborations of researcher networks within different topics [16,17,18]. Scientometric methods are particularly useful in the evaluation of global scientific production and development trends, such as in the cases of health systems research [19], administrative healthcare database [20], or diabetes research in Middle East countries from 1992 to 2012 [21], to name a few. Through an extensive review of the scholarship on AIM, this paper aims to present a better understanding of publications and research trends, and suggests potential directions toward solving this ongoing challenge. Specifically, we reviewed the global growth of research production in medical AI and analyzed patterns of research areas and trends in this field.

2. Materials and Methods

The search used the Web of Science (WOS) database from Clarivate [22] and Scopus from Elsevier [23]. WOS was chosen because it covers (i) more research fields compared with PubMed, and (ii) research dated from 1900 to the present. For the Scopus database, due to the restriction for not downloading completed data larger than 2000 papers, we could only download papers by year. This analysis focuses on articles published from 1971 to 31 December 2018 in peer-reviewed journals. The bibliometric study does not include grey literature, conference proceedings, or books/book chapters. Articles written in any languages other than English are excluded.

2.1. Search Strategy

There are two steps conducted in sequential order: inclusionary step, followed by an exclusionary step. Each step is explained in detail below. We applied two steps for both WOS and Scopus.

2.1.1. Inclusion Step

The literature from the WOS database was retrieved using a developed set of search terms, focusing on (1) AI types, and (2) health and medicine. The search terms were chosen based on our research on prevailing literature on the topic, discussions within our team, and suggestions provided by AI experts. The team defined clearly the synonyms for search terms and resolved any potential differences via discussion. The search query is outlined in Box 1.
Box 1. Search query text.
(1)
“Artificial intelligence” OR “Machine intelligence” OR “artificial neutral network*” OR “Machine learning” OR “Deep learn*” OR “Natural language process*” OR “Robotic*” OR “thinking computer system” OR “fuzzy expert system*” OR “evolutionary computation” OR “hybrid intelligent system*”
(2)
disease* OR illness OR health-related OR medic* OR “medical diagnosis” OR treatment OR health* OR wellness OR well-being
In our final step, we connected query 1 to 2 with the “AND” operator (see Tables S1 and S2 Supplementary).

2.1.2. Exclusion Step

The team excluded articles published from 1 January 2019 onwards as any capture from that period forward would include incomplete bibliometric data for that year. Other types of documents being excluded are book chapters and conference proceedings, plus items with anonymous authors and studies written in any languages other than English.

2.2. Data Extraction

As a restriction from Scopus, we applied this step and the following only for the dataset downloaded from WOS. Retrieved data were exported from the WOS database under text format and applied STATA version 15 (STATA Corp., College Station, TX, USA) to merge data files and extract others. Based on the Global burden of disease 2017 study, we identified 25 diseases with the highest Disability-Adjusted Life Years (DALYs) and used STATA to extract the number of papers related to AI types. The .dta file then was stored in Excel. The data exported include: (1) Title name, (2) Names of journals, (3) Authors’ name with the Web of Science affiliation, (4) Number of citations, (5) The types of documents, (6) The year of publication for each publication, (8) Author and Web of Science keywords, and (9) Abstracts.

2.3. Data Analysis

We applied STATA to perform a regression model for the growth of world publication in AI in healthcare and medicine.
In terms of coauthorship analysis, the study examined the most productive countries based on the number of papers, total citations, citations per paper, the number of downloaded papers, collaborative country, and international collaborative papers.
VOSviewer software was used to create visualization maps (http://www.vosviewer.com/). For the most prolific countries, we applied the cutoff point of 5 papers, and there were 93 countries in the mapping analysis.
A network graph illustrates the connection among the 568 most common authors’ keywords by applying the specific threshold of 15 appearances for each keyword. Based on this graph, the team identified the main topic of AIM.
After that, STATA was applied to the number of papers related to the AI tools and the clinical application of AI. This measure shows not only the trend applying a specific AI type for a disease, but also identifies whether the investment and testing of an AI tool for a particular disease are adequate with the burden of disease (in this study we used disability-adjusted life-years or DALYs).

3. Results

3.1. The Publication Trend

After the removal of unmatched data (15,197 research results), 27,451 research results (24,758 Article and 2849 reviews) were included from WOS published between 1971 and 2018. (Figure 1)
Table 1 shows the distinctive transformation of worldwide publications on AI in medicine and health. Below are some of the highlights:
  • Most of the papers (80.0%) were assorted into one (n = 14,756; 53.6%) or two (n = 7225; 26.4%) subject categories.
  • The number of publications dated between 2008 and 2017 (16,913 articles) accounts for 61.6% of the total number of publications being analyzed. This figure was double compared with the previous time range and seven times as much as that in the previous ten-year period.
  • The number of countries means the paper was written by one country only or in collaboration with others. Based on that information, we found that AI-related medical research was mainly performed by one to three countries (85.9%). The global collaboration among nation-states was not so high (14.0%).
Figure 2 is the visualization of this exponential growth of AI research in medicine. Although the number of papers in Web of Science is more than that in Scopus, both showed a similar trend over the study period. The number of publications has increased exponentially since 1998, and most of the papers (65.0% Scopus paper and 97.7% WoS paper) were published in 2008–2018. The first paper related to “AI in health and medicine” of WOS was found in 1977, whereas that of Scopus was in 1963.
We attempted to estimate the number of publications related to AI in healthcare and medicine on a global level by employing an exponential model in which the dependent variable was the annual number of articles and the independent variable was the year published. The coefficients of determination (r2) of such model was 0.935. Figure 3 visualizes how the exponential model fit with observed data compared to a linear model. The dotted lines corresponding to each solid line in terms of color (dotted blue with solid blue, dotted green with solid green) represent the 95% confidence interval.
There is an inflection point in the amount of AI research that happens around 2002–2003 when the quantity of AI research in health and in medicine surges upward dramatically. This observation can be explained by the exponential growth of computing power and data storage capacity, which also went through an inflection point during the same period [2,24,25]. The revolution in computing power and digitalization has not only changed the quantity of research but also enabled a robot called Adam to identify the function of a yeast gene on 12 June 2007, a noteworthy point in the history of AI, as it effectively ended the human monopoly of scientific discovery [26].
Five thousand and fifty-seven journals published 27,451 research articles. Two-thousand two hundred and fifty-seven (8.2%) journals published one paper, 848 (3.09%) journals published two, 490 (1.78%) journals published three, and 1462 (86.9%) journals published four or more. PLOS One (n = 478; 1.74%) and Expert Systems with Applications (n = 281; 1.02%) are two journals that published the most papers, followed by Journal of Biomedical Informatics (n = 269; 1.00%), Medical Physics (n = 258; 0.94%), and Journal of Robotic Surgery (n = 255; 0.93%). “Expert systems with applications” (281 papers) was the most prolific journal, publishing in the categories “Computer Science” and “Engineering”. Among all topics, AI in health and medicine was the one which attracted the greatest concern, mainly from the medical community, which could be clearly seen from the diversity of the subject categories, such as surgery, medical chemistry, and oncology. (see Table S3 Supplementary).

3.2. Contribution by Author

As Table 1 shows, 40% (n = 10,992) of the papers were the fruits of collaboration of four or six authors; the number of papers with two or three authors was 8085 (29.5%) and only 5.15% (n = 1413) of items were written by one author. Given that publications in this field were mostly the results of coauthorship, one implication stands out here: conducting research on medical AI often requires extensive teamwork. This observation also highlights the multidisciplinary links among the authors and the interdisciplinary nature of the field. However, it is also noteworthy that the number of papers with more than 10 authors accounts for only 6.25% (n = 1724). This suggests it might not be effective for too many authors to collaborate on international publications; the data imply four to six authors as the optimal number of team members.
Applying the cut-off of 15 papers for one author, we visualized the global cooperation of authors. Among 135 authors in Figure 4, most of the prolific authors had strong collaborations with others and appeared at the center of many constellations. Such authors are Mani Menon (red cluster), Kaouk Jihad H, Autorino Ricardo (yellow cluster), and Inderbir S. Gill (purple cluster). Meanwhile, stand-alone authors had fewer papers. The thickness of lines is an indication of the strength of the relationship between authors relative to others. The strength of these relationships was determined by the frequency with which they appeared together in published articles. Their inclusion into specific thematic groups was based on their clustering with a certain constellation of terms. The position of an author within this constellation represents how interrelated and frequent their co-occurrence was with other authors. This pattern has been confirmed by other scientometric studies as socially important and productive researchers tend to drive the productivity of their coauthors [18,27].

3.3. Global Collaboration

Table 2 illustrates the productivity ranking of the top 20 countries in this dataset. In this list, the top five countries were from North America (the United States and Canada), Europe (Italy, and Germany), and China. The United States ranked at the top of all indices: total papers (10,623 papers, 30.8%), total citations (232,669 citations), and number of downloads (25,384). Countries in Europe had the strong co-operation in AIM, confirmed by the high number of institutes (>7.7), countries in collaboration (>2.0), and collaborative papers (>50%). Meanwhile, in Asia, China was ranked second with 2671 papers (7.6%) and 15,995 downloads. It is remarkable that Israel and Singapore had the highest level of international collaboration (nearly 70%), while the figure in other Asian countries was only one-third of this.
The network of 93 countries with the minimum of five papers is visually mapped and presented in Figure 5. This visualization also demonstrates the strength of collaborative partnerships between countries. Regarding AI technology, the United States, China, England, and Canada are leading the way. The red cluster showed the close collaboration between The United States and China, Australia, and other Asian countries, such as Japan, Taiwan, and South Korea. Europe sought to narrow the gap in the AI world leader race [28]. The largest cluster in Europe was formed among Germany, Italy, the Netherlands, and Denmark (green cluster). Clusters of collaboration were also seen among France, Greece, and Morocco (Purple cluster) or, beyond the European border, Spain was the leader in the cooperation with South America countries (Brazil, Mexico, and Argentina).
Table S1 (Supplementary) presents the most active institutions in AI technology publications, which also shows the leading positions of those from the United States, China, England and Canada.

3.4. Keyword and Text Analysis

As can been seen from Figure 6, the author’s keywords can be divided into two groups: (1) types of AI, and (2) AI applications in health and medicine.
  • Types of AI: among all the keywords applied for searching, three kinds of AI being outstanding compared with others were “machine learning”, “robotics”, and “deep learning”
  • AI applications in health and medicine: For example, “machine learning”, “artificial intelligence”, “support vector machines” were used to support the diagnose and/or treatment of “Parkinson’s disease”, “Alzheimer’s disease” or used in “neuroimaging”. “Robotics” was utilized mainly for assisting laparoscopy of “oropharyngeal cancer” or “cervical cancer” or “surgery”. “Natural language processing” was applied for collecting “health records” information contributing to “big data” system.
It is quite remarkable that the keyword “ethics” is nowhere to be seen in the figure, suggesting that there is a lack of attention toward AI ethics in health and medicine. Additionally, in our dataset, when searching “ethics” on both keyword field and abstracts there are only 204 papers (0.7%) related to ethics. The first paper was published in 1994 “Ethical considerations in the management of individuals with severe neuromuscular disorders”. The application of AI has brought many benefits to the healthcare system and improve medicine. However, the use of AI technology unethically may be dangerous to patients and physicians. Thus, we need an ethical standard to apply to all the actors not only in healthcare services, but also in health-related fields [29].
Table 3 provides the number of publications of most common AI tools and types of clinical application using AI (diagnosis/prediction or treatment) for each of the top 25 diseases in terms of the burden of disease measured in DALYs [30]. Robotics is transforming health care with its diverse applications, such as early detection, training future doctors, or treatment. The highest number of papers were about robotic surgery. Machine learning was the second most popular AI type in which one would use for large and complex data analysis fields, such as genetics [31]. AI clinicians are higher than medical clinicians [32], however, in our dataset, the number of papers using AI for prediction of disease or its consequences was higher than that of treatment. The burdens of disease shift from infectious diseases to noncommunicational diseases (NCDs) [33], thus the research on AI application for heart disease, stroke, or respiratory disease were higher than for other diseases. The increasing burden due to cancer has attracted scientific concern, with the highest total number of papers in AI tools (Robotic, Machine leaning, or Artificial neural network) and in treatment and diagnosis. Robotics received the highest concern due to its broad application in medicine and health care, from serving as a nurse to supporting in surgery [34].

4. Discussion

To the best of our understanding, although bibliometrics has been used to explore the trends in other research areas [16,17,18,19,20,21], this study can be considered the first intensive global mapping and analysis of scientific research on AI in health and medicine.
The growth of scientific literature in the field of AI has increased rapidly, particularly in the past 10 years, thanks to the exponential growth of computing power and data storage capacity [2,25,26]. This growth is attributed to the prolific output of research at leading institutions located in the United States, Europe, and China. These three players are also the biggest contributors to overall AI research worldwide [2]. At the national level, this study points out that among the top 10 researchers, the number of citations per paper of Asian researchers is significantly lower than that of their North American peers. This can be explained by the late-coming of China to the field. In-depth research should look into factors driving the differences in research output and citation impacts between the two regions.
Our research was the first study showing the number of papers with AI applications in healthcare and medicine with the global burden of disease measured by DALYs. The number of papers related to disease with high rank in burden of disease shows there is shifting focus from infectious diseases to NCDs. The volume of publications mentioned about AI application in cancer was the highest, although the rank of cancer was 12th in the list (Table 3). The special concern that the scientific community spent for the second leading cause of death disease can be explained by (1) the uncertainty in early diagnosis and treatment outcomes; (2) the severity of late treatment, (3) the variety in types of cancers. Using AI in treatment will increase the level of accuracy, which may cause evolution of cancer treatment.
The absence of the word “ethics” in the research subjects, the keywords, and the text mining of the abstracts (Figure 5 and Figure S2 Supplementary) suggests the promotion of evidence-informed policy making, health system strengthening, and a renewed focus to ensure that AI should be developed and used in the transparent and accountable way, which is consistent with public interest. This suggests a need for research on AI-related policy. The effect of AI might be reduced where data are not available, difficult to collect, or transfer digitally.
Another implication is the factors contributing to research output in medical AI. Empirical data suggest influential authors, as measured by the total number of citations and the number of citations per paper, are often those who either lead a field and stay productive throughout his or her career, or invents a method applicable in a variety of research areas. This pattern has been observed in other studies, such that senior and productive authors will drive the productivity of their collaborators [28].
In terms of policy implications, this study puts forth three suggestions. First, recent approaches that are rising in popularity include the use of AI to collect health data and information, in support of treating cancer (Table 3). This means applications of AI in medicine will be increasingly useful in aiding diagnosis and clinical treatment. Second, developing countries should look to investment in research in medical AI. particularly China and India, which are emerging as top players in the field. Third, rapidly development of AI might create new challenges to established frameworks. Fourth, future AI techniques and development trends will focus on machine learning based on data obtained from the latest diagnostic modalities, including multi-omics (e.g., genomics, metabolomics) [35] and state-of-the-art imaging methods to predict treatment responses [36,37], especially in areas where there is a lack of objective diagnostic methods, e.g., psychiatric disorders [38]. Finally, to accelerate application and expansion of AI in health and medicine, it is critical to develop global and national protocols and regulations to frequently review and justify the validity of AIM products in clinical and practical environments.
An important challenge in applying AI for health and medicine is the lack of large clinical datasets for training AI models. This is especially true for datasets with labels, which require doctors/medical expert annotation and therefore are very costly and time-consuming to collect [39,40,41]. In general, AI techniques that are applicable to situations with limited amounts of labeled training data are of great interest for many applications [42], in addition to health and medicine. This is an important fundamental problem with active AI research and several promising AI directions: First, more sophisticated data augmentation techniques have recently been proposed to enrich the training datasets to better characterize data distribution. These techniques include feature space data augmentation [42,43] and data synthesis using complex deep neural networks models, notably generative adversarial networks (GAN) [44,45,46,47]. Second, there are substantial interests to improve semisupervised learning: learning methods that typically use a small amount of labeled data and unlabeled data [48]. Third, self-supervised learning [49,50] has attracted a lot of attention. Self-supervised learning methods automatically identify and extract supervisory signals without using any labeled data. Self-supervised learned models represent strong baselines that can be used in different applications with limited labeled data, including many medical and health applications.
Regarding the weaknesses and limitations of this study, the restriction on searchable peer-reviewed research publication and the exclusion of other documents may impact the thoroughness of the results and analysis. In addition, as only English articles and reviews were included in this study, the non-English papers were not counted. That made the number of Western countries’ publications, especially English-speaking ones, more than that of Asia or Africa. Nonetheless, a bibliometric analysis of a large volume of publications and a summary of keywords is a helpful proxy for the overall content of these papers. Further studies may benefit from investigating how different AI techniques are being used to resolve specific medical tasks or exploring the impacts of methodological versus more application-oriented AI studies.
Given the limitations and current scope of the study, both academics and practitioners are aware that the AI developments—despite the field’s vibrant growth—will further evolve in line with rising uncertainties and complexities in the coming years. It is hard to tell if one specific technique will prevail, but the surging trend is inexorable, to the extent that entrepreneurial attempts and policymaking changes will have to adapt. This study provides a contextual outline which may become useful for creating a more enabling environment, in which both AI developers and health researchers will work. It is anticipated that more in-depth reviews and theoretical surveys will be conducted, and early “maps” will more likely help at this early stage of development, let alone the fact that the recent debates on ethical issues of AI in the industries in general, and in the medical realm, in particular, will be less fruitful without a more updated understanding of macro views.
In conclusion, AI has been applied for a wide range of purposes, especially in in the field of healthcare. With the rapid development of technology, AI has the opportunity to help raise important health problems to light but might be restricted by the unavailability of health data, and/or by the inability of AI to have some human characteristics, such as compassion. The use of AI raises some ethical and social issues, which might be overcome via data policy. A key challenge for governments is that AI development should be conducted in a way that is easy to approach and aligned with the public interest.

Supplementary Materials

The following are available online at https://www.mdpi.com/2077-0383/8/3/360/s1, Table S1: Search results (WOS), Table S2: Search results (Scopus), Table S3: Journal subject category and the Journal included those subject categories, Figure S1: Institutions network, Figure S2: Text (titles and abstracts) mining.

Author Contributions

Conceptualization, B.X.T., Q.-H.V., T.-T.V., V.-P.L., W.W.S.T., H.-K.T.N., C.S.H.H. and R.C.M.H.; Data curation, G.T.V., M.-T.O. (Manh-Tung Ho), M.-T.O. (Manh-Toan Ho), K.-C.P.N. and N.-M.C.; Formal analysis, B.X.T., G.H.H., Q.-H.V., T.-T.V., H.L.T.N. and C.A.L.; Funding acquisition, Q.-H.V., V.-P.L., M.-T.O. (Manh-Toan Ho) and H.L.T.N.; Investigation, G.H.H., M.-T.O. (Manh-Tung Ho), C.A.L., W.W.S.T., N.-M.C., H.-K.T.N., C.S.H.H. and R.C.M.H.; Methodology, G.T.V. and K.-C.P.N.; Project administration, B.X.T., G.H.H., M.-T.O. (Manh-Toan Ho), H.L.T.N., H.-K.T.N. and R.C.M.H.; Resources, G.T.V., C.A.L., N.-M.C. and C.S.H.H.; Software, G.H.H., Q.-H.V., M.-T.O. (Manh-Tung Ho), T.-T.V., V.-P.L., Ki.-C.P.N., H.L.T.N. and W.W.S.T.; Supervision, B.X.T., T.-T.V., M.-T.O. (Manh-Toan Ho), K.-C.P.N., W.W.S.T. and R.C.M.H.; Validation, M.-T.O. (Manh-Tung Ho), C.A.L., H.-K.T.N., C.S.H.H. and R.C.M.H.; Visualization, M.-T.O. (Manh-Toan Ho); Writing—original draft, B.X.T., G.H.H., G.T.V., Q.-H.V., M.-T.O. (Manh-Tung Ho), T.-T.V., V.-P.L., M.-T.O. (Manh-Toan Ho), K.-C.P.N., H.L.T.N., C.A.L., W.W.S.T., N.-M.C., H.-K.T.N., C.S.H.H. and R.C.M.H.; Writing—review & editing, B.X.T., G.H.H., G.T.V., Q.-H.V., M.-T.O. (Manh-Tung Ho), T.-T.V., V.-P.L., M.-T.O. (Manh-Toan Ho), K.-C.P.N., H.L.T.N., C.A.L., W.W.S.T., N.-M.C., H.-K.T.N., C.S.H.H. and R.C.M.H.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Nuffield Council on Bioethics. Bioethics Briefing Notes: Artificial Intelligence (AI) in Healthcare and Research. Available online: http://nuffieldbioethics.org/wp-content/uploads/Artificial-Intelligence-AI-in-healthcare-and-research.pdf (accessed on 21 December 2018).
  2. Elsevier. Artificial Intelligence: How Knowledge Is Created, Transferred, and Used; Elsevier Artificial Intelligence Program: Amsterdam, The Netherlands, 2018. [Google Scholar]
  3. Frankish, K.; Ramsey, W.M. (Eds.) Introduction. In The Cambridge Handbook of Artificial Intelligence; Cambridge University Press: Cambridge, UK, 2014; pp. 1–14. [Google Scholar]
  4. Yu, K.-H.; Beam, A.L.; Kohane, I.S. Artificial intelligence in healthcare. Nat. Biomed. Eng. 2018, 2, 719–731. [Google Scholar] [CrossRef]
  5. Hamet, P.; Tremblay, J. Artificial intelligence in medicine. Metabolism 2017, 69, S36–S40. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Trivikram, C.; Samarpitha, S.; Madhavi, K.; Moses, D. Evaluation of hybrid face and voice recognition systems for biometric identification in areas requiring high security. I-Manag. J. Pattern Recognit. 2017, 4, 9–16. [Google Scholar]
  7. Gunn, A. The diagnosis of acute abdominal pain with computer analysis. J. R. Coll. Surg. Edinb. 1976, 21, 170–172. [Google Scholar] [PubMed]
  8. Ramesh, A.N.; Kambhampati, C.; Monson, J.R.T.; Drew, P.J. Artificial intelligence in medicine. Ann. R. Coll. Surg. Engl. 2004, 86, 334–338. [Google Scholar] [CrossRef] [Green Version]
  9. Niu, J.; Tang, W.; Xu, F.; Zhou, X.; Song, Y. Global research on artificial intelligence from 1990–2014: Spatially-explicit bibliometric analysis. ISPRS Int. J. Geo-Inf. 2016, 5, 66. [Google Scholar] [CrossRef]
  10. Begovic, M.; Oprunenco, A.; Sadiku, L. Let’s Talk about Artificial Intelligence; UNDP: New York, NY, USA, 2018; Volume 2019. [Google Scholar]
  11. Jiang, F.; Jiang, Y.; Zhi, H.; Dong, Y.; Li, H.; Ma, S.; Wang, Y.; Dong, Q.; Shen, H.; Wang, Y. Artificial intelligence in healthcare: Past, present and future. Stroke Vasc. Neurol. 2017, 2, 230–243. [Google Scholar] [CrossRef] [PubMed]
  12. Shaban-Nejad, A.; Michalowski, M.; Buckeridge, D.L. Health intelligence: How artificial intelligence transforms population and personalized health. NPJ Digit. Med. 2018, 1, 53. [Google Scholar] [CrossRef]
  13. Mudaly, T.; Moodley, D.; Pillay, A.; Seebregts, C.J. Architectural frameworks for developing national health information systems in low and middle income countries. In Proceedings of the First International Conference on Enterprise Systems: ES 2013, Cape Town, South Africa, 7–8 November 2013; pp. 1–9. [Google Scholar]
  14. Pearson, T. How to Replicate Watson Hardware and Systems Design for Your Own Use in Your Basement; IBM: Watson, MN, USA, 2011. [Google Scholar]
  15. Neill, D.B. Using artificial intelligence to improve hospital inpatient care. IEEE Intell. Syst. 2013, 28, 92–95. [Google Scholar] [CrossRef]
  16. Sharifi, V.; Rahimi Movaghar, A.; Mohammadi, M.; Goodarzi, R.; Izadian, E.; Farhoudian, A.; Mansouri, N.; Nejatisafa, A.A. Analysis of mental health research in the Islamic republic of Iran over 3 decades: A scientometric study. East. Mediterr. Health J. 2008, 14, 1060–1069. [Google Scholar]
  17. Eghbal, M.J.; Ardakani, N.D.; Asgary, S. A scientometric study of pubmed-indexed endodontic articles: A comparison between Iran and other regional countries. Iran. Endod. J. 2012, 7, 56–59. [Google Scholar]
  18. Vuong, Q.-H.; La, V.-P.; Vuong, T.-T.; Ho, M.-T.; Nguyen, H.-K.T.; Nguyen, V.-H.; Pham, H.-H.; Ho, M.-T. An open database of productivity in Vietnam’s social sciences and humanities for public use. Sci. Data 2018, 5, 180188. [Google Scholar] [CrossRef]
  19. Yao, Q.; Chen, K.; Yao, L.; Lyu, P.-H.; Yang, T.-A.; Luo, F.; Chen, S.-Q.; He, L.-Y.; Liu, Z.-Y. Scientometric trends and knowledge maps of global health systems research. Health Res. Policy Syst. 2014, 12, 26. [Google Scholar] [CrossRef]
  20. Chen, Y.-C.; Yeh, H.-Y.; Wu, J.-C.; Haschler, I.; Chen, T.-J.; Wetter, T. Taiwan’s national health insurance research database: Administrative health care database as study object in bibliometrics. Scientometrics 2011, 86, 365–380. [Google Scholar] [CrossRef]
  21. Peykari, N.; Djalalinia, S.; Kasaeian, A.; Naderimagham, S.; Hasannia, T.; Larijani, B.; Farzadfar, F. Diabetes research in Middle East countries: A scientometrics study from 1990 to 2012. J. Res. Med Sci. 2015, 20, 253–262. [Google Scholar]
  22. Clavirate Analytics. Web of Science; Clavirate Analytics: Philadelphia, PA, USA, 2018. [Google Scholar]
  23. Elsevier. Scopus; Elsevier: Amsterdam, The Netherlands, 2018. [Google Scholar]
  24. Brynjolfsson, E.; McAfee, A. The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies; WW Norton & Company: New York, NY, USA, 2014. [Google Scholar]
  25. Viktor, M.-S.; Kenneth, C. Big Data: A Revolution That Will Transform How We Live, Work, and Think; John Murray: London, UK, 2013. [Google Scholar]
  26. Flemming, N. How artificial intelligence is changing drug discovery. Nature 2018, 557, S55–S57. [Google Scholar] [CrossRef] [Green Version]
  27. Ho, T.; Nguyen, H.; Vuong, T.; Dam, Q.; Pham, H.; Vuong, Q. Exploring Vietnamese co-authorship patterns in social sciences with basic network measures of 2008–2017 Scopus data. F1000Research 2017, 6, 1559. [Google Scholar] [CrossRef]
  28. European Commission. USA-China-EU Plans for AI: Where do We Stand? European Commission: Brussels, Belgium, 2018. [Google Scholar]
  29. Pesapane, F.; Volonté, C.; Codari, M.; Sardanelli, F. Artificial intelligence as a medical device in radiology: Ethical and regulatory issues in Europe and the United States. Insights Imaging 2018, 9, 745–753. [Google Scholar] [CrossRef]
  30. Kyu, H.H.; Abate, D.; Abate, K.H.; Abay, S.M.; Abbafati, C.; Abbasi, N.; Abbastabar, H.; Abd-Allah, F.; Abdela, J.; Abdelalim, A.; et al. Global, regional, and national disability-adjusted life-years (DALYs) for 359 diseases and injuries and healthy life expectancy (HALE) for 195 countries and territories, 1990–2017: A systematic analysis for the global burden of disease study 2017. Lancet 2018, 392, 1859–1922. [Google Scholar] [CrossRef]
  31. Libbrecht, M.W.; Noble, W.S. Machine learning applications in genetics and genomics. Nat. Rev. Genet. 2015, 16, 321–332. [Google Scholar] [CrossRef]
  32. Komorowski, M.; Celi, L.A.; Badawi, O.; Gordon, A.C.; Faisal, A.A. The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nat. Med. 2018, 24, 1716–1720. [Google Scholar] [CrossRef]
  33. Cao, X. A call for global research on non-communicable diseases. Lancet 2015, 385, e5–e6. [Google Scholar] [CrossRef]
  34. Jeelani, S.; Dany, A.; Anand, B.; Vandana, S.; Maheswaran, T.; Rajkumar, E. Robotics and medicine: A scientific rainbow in hospital. J. Pharm. Bioallied Sci. 2015, 7, S381–S383. [Google Scholar] [CrossRef]
  35. Liu, D.; Ray, B.; Neavin, D.R.; Zhang, J.; Athreya, A.P.; Biernacka, J.M.; Bobo, W.V.; Hall-Flavin, D.K.; Skime, M.K.; Zhu, H.; et al. Beta-defensin 1, aryl hydrocarbon receptor and plasma kynurenine in major depressive disorder: Metabolomics-informed genomics. Transl. Psychiatry 2018, 8, 10. [Google Scholar] [CrossRef]
  36. Lai, C.Y.Y.; Ho, C.S.H.; Lim, C.R.; Ho, R.C.M. Functional near-infrared spectroscopy in psychiatry. BJPsych Adv. 2018, 23, 324–330. [Google Scholar] [CrossRef]
  37. Ho, C.S.; Zhang, M.W.; Ho, R.C. Optical topography in psychiatry: A chip off the old block or a new look beyond the mind-brain frontiers? Front. Psychiatry 2016, 7, 74. [Google Scholar] [CrossRef]
  38. Athreya, A.; Iyer, R.; Neavin, D.; Wang, L.; Weinshilboum, R.; Kaddurah-Daouk, R.; Rush, J.; Frye, M.; Bobo, W. Augmentation of physician assessments with multi-omics enhances predictability of drug response: A case study of major depressive disorder. IEEE Comput. Intell. Mag. 2018, 13, 20–31. [Google Scholar] [CrossRef]
  39. Esteva, A.; Kuprel, B.; Novoa, R.A.; Ko, J.; Swetter, S.M.; Blau, H.M.; Thrun, S. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017, 542, 115–118. [Google Scholar] [CrossRef]
  40. Do, T.; Hoang, T.; Pomponiu, V.; Zhou, Y.; Chen, Z.; Cheung, N.; Koh, D.; Tan, A.; Tan, S. Accessible melanoma detection using smartphones and mobile image analysis. IEEE Trans. Multimed. 2018, 20, 2849–2864. [Google Scholar] [CrossRef]
  41. Nejati, H.; Alizadeh Ghazijahani, H.; Abdollahzadeh, M.; Malekzadeh, T.; Cheung, N.-M.; Lee, K.H.; Low, L. Fine-grained wound tissue analysis using deep neural network. In Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada, 15–20 April 2018; pp. 1010–1014. [Google Scholar]
  42. Dixit, M.N.; Kwitt, R.N.; Niethammer, M.N.; Vasconcelos, N.N. Aga: Attribute guided augmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017. [Google Scholar]
  43. Liu, B.; Dixit, M.; Kwitt, R.; Vasconcelos, N. Feature space transfer for data augmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 18–22 June 2018. [Google Scholar]
  44. Goodfellow, I.J.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative adversarial nets. In Proceedings of the 27th International Conference on Neural Information Processing Systems—Volume 2; MIT Press: Montreal, QC, Canada, 2014; pp. 2672–2680. [Google Scholar]
  45. Tran, N.-T.; Bui, A.; Cheung, N.-M. Improving GAN with neighbors embedding and gradient matching. In Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence (AAAI-19), Honolulu, HI, USA, 27 January–1 February 2019. [Google Scholar]
  46. Lim, S.K.; Loo, Y.; Tran, N.-T.; Cheung, N.-M.; Roig, G.; Elovici, Y. DOPING: Generative data augmentation for unsupervised anomaly detection with GAN. In Proceedings of the IEEE International Conference on Data Mining 2018, Singapore, 17–20 November 2018. [Google Scholar]
  47. Frid-Adar, M.; Diamant, I.; Klang, E.; Amitai, M.; Goldberger, J.; Greenspan, H. GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification. Neurocomputing 2018, 321, 321–331. [Google Scholar] [CrossRef]
  48. Dai, Z.; Yang, Z.; Yang, F.; Cohen, W.; Salakhutdinov, R. Good semi-supervised learning that requires a bad GAN. In Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA, 4–9 December 2017. [Google Scholar]
  49. Pathak, D.; Krahenbuhl, P.; Donahue, J.; Darrell, T.A.; Efros, A. Context encoders: Feature learning by inpainting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 26 June–1 July 2016. [Google Scholar]
  50. Gidaris, S.; Singh, P.; Komodakis, N. Unsupervised representation learning by predicting image rotations. arXiv, 2018; arXiv:1803.07728. [Google Scholar]
Figure 1. Selection of papers in the Web of Science database.
Figure 1. Selection of papers in the Web of Science database.
Jcm 08 00360 g001
Figure 2. The number of papers by year in the database, 1977–2017.
Figure 2. The number of papers by year in the database, 1977–2017.
Jcm 08 00360 g002
Figure 3. The number of papers since the year 1977 (estimated and observed). The dotted lines (corresponding in term of color to the two solid lines) represent the 95% confidence interval.
Figure 3. The number of papers since the year 1977 (estimated and observed). The dotted lines (corresponding in term of color to the two solid lines) represent the 95% confidence interval.
Jcm 08 00360 g003
Figure 4. The global network of coauthors.
Figure 4. The global network of coauthors.
Jcm 08 00360 g004
Figure 5. The global network of the 93 countries (at least five papers). Note: Figure 5 visually represents the proportional contributions of each country, including their collaborations with one another. The size of each country node represents this proportional contribution of articles to the data set. Attribution of papers to a country was based on the institutional affiliation of the lead author. The length of the lines was automatically generated and was based on the strength of the collaboration between two countries.
Figure 5. The global network of the 93 countries (at least five papers). Note: Figure 5 visually represents the proportional contributions of each country, including their collaborations with one another. The size of each country node represents this proportional contribution of articles to the data set. Attribution of papers to a country was based on the institutional affiliation of the lead author. The length of the lines was automatically generated and was based on the strength of the collaboration between two countries.
Jcm 08 00360 g005
Figure 6. The co-occurrence of authors’ keywords. Figure 6 presents the prevalence of 568 keywords appearing in our search results using the Web of Science. The thickness of lines is an indication of the strength of the relationship between keywords relative to the others. The strength of these relationships was determined by the frequency with which they appeared together in published articles. Their inclusion into specific thematic groups was based on their clustering with a certain constellation of terms. The position of a keyword within this constellation represents how interrelated and frequent its co-occurrence was with other terms.
Figure 6. The co-occurrence of authors’ keywords. Figure 6 presents the prevalence of 568 keywords appearing in our search results using the Web of Science. The thickness of lines is an indication of the strength of the relationship between keywords relative to the others. The strength of these relationships was determined by the frequency with which they appeared together in published articles. Their inclusion into specific thematic groups was based on their clustering with a certain constellation of terms. The position of a keyword within this constellation represents how interrelated and frequent its co-occurrence was with other terms.
Jcm 08 00360 g006
Table 1. Characteristics of the selected articles.
Table 1. Characteristics of the selected articles.
CharacteristicCategoryNumberPercent
Total number of papers 27,451100
Year of publication2018–201416,91361.62
2013–2009630322.97
2008–200424719.00
2003–19999683.53
1998–19945992.18
1993–19891740.64
<1989230.06
Number of authors114135.15
2–3808529.45
4–610,99240.05
7–10523719.07
>1017246.28
Number of subject categories114,75653.75
2722526.32
3359713.10
412444.53
>56292.30
Number of countries in authorship118,53267.51
2495418.05
311264.1
42951.07
51090.4
6420.15
7320.12
8200.07
960.02
>10180.06
Table 2. The most prolific countries in AI in Health/Medicine research and their collaborations.
Table 2. The most prolific countries in AI in Health/Medicine research and their collaborations.
No.CountryTotal Papers% PapersTotal CitationsCite RateTotal DownloadsTotal Co-AuthorsTotal InstitutesTotal Country% Papers with International Collaboration
1United States10,62330.8232,6693.425,3845.86.81.533.6%
2China26177.627,9972.915,9955.97.31.744.8%
3Italy18345.329,4852.833437.48.42.155.2%
4Germany15534.531,2193.334157.48.92.153.1%
5Canada13123.822,6082.933436.28.01.848.5%
6France13083.822,6873.126237.49.02.263.7%
7India12643.712,8712.133504.54.91.631.6%
8Spain10293.014,6532.628526.57.72.049.3%
9Australia9102.617,4133.533375.87.52.050.5%
10Japan8412.411,0542.221076.77.51.735.7%
11Turkey7872.390581.811214.14.41.420.3%
12Iran7132.174382.215994.14.61.430.2%
13Netherlands6401.914,8114.419488.010.12.459.2%
14Switzerland5541.610,1973.618047.69.72.363.5%
15Taiwan5431.662131.810845.16.61.528.5%
16Brazil4891.460972.613806.68.11.944.6%
17Israel3841.163933.49507.89.82.469.8%
18Sweden3821.162203.07007.79.72.461.3%
19Belgium3651.172693.56968.810.72.866.6%
20Singapore3491.053783.219046.07.12.266.2%
Table 3. Number of papers related to AI techniques, clinical application of AI, and top burden of diseases.
Table 3. Number of papers related to AI techniques, clinical application of AI, and top burden of diseases.
TitleRoboticMachine LearningArtificial Neural NetworkArtificial IntelligenceNatural Language ProcessDeep LearningFuzzy Expert SystemEvolutionary ComputationClinical ApplicationTreatmentPredictionDiagnosisTotalRank Burden of Diseases (DALY)
Cancer177476736614410305628209100882449212
Heart Diseases26335716675335911311193313313611
Vision5432648110157145192718921131222
Stroke5439945169002133211958833
Alzheimer1731470188001522104869324
Depression71232293324010739178662020
Kidney2936438149020117125957219
Diabetes3815986342004316176215488
Respiratory1191046420162001913664774
Substance use75101571735700220120443816
HIV24114352821602610113436313
Injuries16232995010573012615
Asthma1260296121200062418825
Tuberculosis8421712220012421514314
Congenital64241451300361931429
Cirrhosis112324620002438211211
Malaria4389810101042210615
Suicide0431310000113419416
COPD53273301000291816
Neonatal72285431000221732
Hearing711960001011435221
Back pain185921000221105010
Headache disorders000005000000523
Diarrhea10000000000017
Headache disorders000001000000118
Total405929071173565376903323109413304827213,068

Share and Cite

MDPI and ACS Style

Tran, B.X.; Vu, G.T.; Ha, G.H.; Vuong, Q.-H.; Ho, M.-T.; Vuong, T.-T.; La, V.-P.; Ho, M.-T.; Nghiem, K.-C.P.; Nguyen, H.L.T.; et al. Global Evolution of Research in Artificial Intelligence in Health and Medicine: A Bibliometric Study. J. Clin. Med. 2019, 8, 360. https://doi.org/10.3390/jcm8030360

AMA Style

Tran BX, Vu GT, Ha GH, Vuong Q-H, Ho M-T, Vuong T-T, La V-P, Ho M-T, Nghiem K-CP, Nguyen HLT, et al. Global Evolution of Research in Artificial Intelligence in Health and Medicine: A Bibliometric Study. Journal of Clinical Medicine. 2019; 8(3):360. https://doi.org/10.3390/jcm8030360

Chicago/Turabian Style

Tran, Bach Xuan, Giang Thu Vu, Giang Hai Ha, Quan-Hoang Vuong, Manh-Tung Ho, Thu-Trang Vuong, Viet-Phuong La, Manh-Toan Ho, Kien-Cuong P. Nghiem, Huong Lan Thi Nguyen, and et al. 2019. "Global Evolution of Research in Artificial Intelligence in Health and Medicine: A Bibliometric Study" Journal of Clinical Medicine 8, no. 3: 360. https://doi.org/10.3390/jcm8030360

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop