Next Article in Journal
Low-Cost Force Sensors Embedded in Physical Human–Machine Interfaces: Concept, Exemplary Realization on Upper-Body Exoskeleton, and Validation
Previous Article in Journal
Let the Cat out of the Bag: Popular Android IoT Apps under Security Scrutiny
Previous Article in Special Issue
An Overview of Machine Learning and 5G for People with Disabilities
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Sensors
Volume 22
Issue 2
10.3390/s22020514
sensors-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Augmented Humanity: A Systematic Mapping Review

by
Graciela Guerrero
1,2,
Fernando José Mateus da Silva
3,
Antonio Fernández-Caballero
2,4,5 and
António Pereira
3,6,*
1
Departamento de Ciencias de la Computación, Universidad de las Fuerzas Armadas ESPE, Sangolqui 171103, Ecuador
2
Instituto de Investigación en Informática de Albacete, 02071 Albacete, Spain
3
Computer Science and Communication Research Center, School of Technology and Management, Polytechnic of Leiria, 2411-901 Leiria, Portugal
4
Departamento de Sistemas Informáticos, Universidad de Castilla-La Mancha, 02071 Albacete, Spain
5
CIBERSAM (Biomedical Research Networking Centre in Mental Health), 28029 Madrid, Spain
6
Information and Communications Technologies Unit, INOV INESC Innovation, Delegation Office at Leiria, 2411-901 Leiria, Portugal
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(2), 514; https://doi.org/10.3390/s22020514
Submission received: 19 November 2021 / Revised: 4 January 2022 / Accepted: 6 January 2022 / Published: 10 January 2022
(This article belongs to the Special Issue Internet of Things for Ambient Assisted Living)
Browse Figures
Versions Notes

Abstract

:
Augmented humanity (AH) is a term that has been mentioned in several research papers. However, these papers differ in their definitions of AH. The number of publications dealing with the topic of AH is represented by a growing number of publications that increase over time, being high impact factor scientific contributions. However, this terminology is used without being formally defined. The aim of this paper is to carry out a systematic mapping review of the different existing definitions of AH and its possible application areas. Publications from 2009 to 2020 were searched in Scopus, IEEE and ACM databases, using search terms “augmented human”, ”human augmentation” and “human 2.0”. Of the 16,914 initially obtained publications, a final number of 133 was finally selected. The mapping results show a growing focus on works based on AH, with computer vision being the index term with the highest number of published articles. Other index terms are wearable computing, augmented reality, human–robot interaction, smart devices and mixed reality. In the different domains where AH is present, there are works in computer science, engineering, robotics, automation and control systems and telecommunications. This review demonstrates that it is necessary to formalize the definition of AH and also the areas of work with greater openness to the use of such concept. This is why the following definition is proposed: “Augmented humanity is a human–computer integration technology that proposes to improve capacity and productivity by changing or increasing the normal ranges of human function through the restoration or extension of human physical, intellectual and social capabilities”.

1. Introduction

Humans are increasingly dependent on technology. Technology has changed not only humans’ behavior and values but also the way they think, communicate and act [1]. However, recent scientific discoveries and inventions have demonstrated that technology is also beginning to modify human capabilities, pushing them beyond their natural limits [2,3,4]. With the advance of technology, the interaction between humans and machines has been “improved”, “augmented” or even “redesigned” [5,6,7,8]. This has made it not only interesting and intriguing but also viable and arising as a serious concept of scientific research and development [9,10]. A term related to this technology advancement is Augmented Humanity (AH).
The term AH was coined in 2010 at the Internationale Funk Ausstellung conference [11,12], indicating that different devices which at first glance seem unconnected to each other will in the future offer a convergence between technologies and devices that aim to interact naturally with the user. The Isobar Trend Report [13] introduces AH as technologies that can work in harmony with humans in ways that enrich life, enhance the human experience and drive sustainable progress for the benefit of people, which will involve investing and engaging underserved audiences in the process. Working together, human and artificial agents must learn and bring these terms into close collaboration between human and artificial agents. These dilemmas are largely due to the differences between human and artificial capabilities and potentialities, and the resulting tensions in their collaboration [14,15,16]. Some researchers directly interchange the terms AH and augmented reality (AR). For instance, when AR is deeper and augments the human being, it is called an augmented human [17]. Another article exposes AR as a means to create an augmented human [18]. AH is a discipline that is linked to AR, but the difference between both is not clear [19]. However, these concepts can be clarified with the example of glasses, which can be AR or AH. When the glasses complement the view, then this will be AH; if the glasses have an external functionality, for example to perform a calculation, then it is AR.
Hence, the definition of AH is currently not concrete enough, because there are several “definitions” that are not interconnected one to another. Therefore, this research presents some of the definitions obtained from the analysis of works related to the term AH. Moreover, as many works indicate that they are based on AH and have proposed devices, systems, prototypes, etc., this paper fills the need to establish a systematic mapping review for a better understanding of AH. A systematic mapping review is a type of review that allows the contextualization of systematic literature reviews within a broad literature and the identification of gaps in scientific literature. It is a review that seeks to identify not only the results of the works but also the existing links between the works carried out [20,21,22]. Therefore, the aim of this paper is to offer a systematic mapping review in order to (1) obtain a precise definition of AH to clarify the concept and use of AH and that it is not misused and (2) list the potential areas of application of AH.
This paper is structured as follows. In Section 2, we present the systematic mapping review methodology, research questions, study search strategy, data extraction and analysis and data collection efforts, providing the answers to the research questions posed. In Section 3, we discuss the results obtained from the research questions. Finally, in Section 4, we present the main conclusions of the paper and the risks that may have affected the quality of the study and how they have been mitigated or avoided.

2. Materials and Methods

This section introduces information on the applied research methodology, including the research protocol related to the preliminary research questions, search strategy and selection criteria. It also includes inclusion and exclusion criteria used in the research and the applied search process.

2.1. Research Methodology

Regarding the research methodology, in the first instance, it is necessary to mention the existing interests and objectives intended to carry out the systematic mapping review. The systematic mapping review study has been reinforced with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement [23] in conducting and reporting our review, ensuring a holistic and unbiased sampling of all published and peer-reviewed articles that are relevant to the proposed topic.
In order to achieve the proposed objectives, this research work has been structured in the following steps: The first step in this research is to obtain, through a broad analysis of the literature, summaries of different works (publications) that have utilized AH as a solution to their proposals.In this regard, the search terms employed were “augmented human”, ”human augmentation” and “human 2.0”. The second step is to obtain a trend through analysis of AH research over time. The third step is to obtain a definition that centralizes the characteristics of AH as expressed in the related works. The fourth step is to expose subthemes or research areas in AH for future research to work on from the present systematic mapping study.
The objectives mentioned are presented in Figure 1 as a process to follow in the systematic mapping review of this work. The process consists of three phases. (1) The subject of the research work to be dealt with is defined, the objectives to be met are identified and then the preliminary research questions to be answered throughout the development of this work are posed. (2) The collection of the information presented by the relevant documents found after the execution of the search chains. (3) Finally, in phase 3, the results of the keywords obtained from the relevant articles are presented. After performing the above phases, the systematic mapping is formed with the existing literature in order to answer the questions posed in the research.

2.2. Research Protocol

Knowing the topic of study to be addressed (in this case, AH) and the objectives established, this phase proposes preliminary research questions, search strategy and selection criteria, including an overview of the selected papers in terms of their publication over time [24,25]. Four research questions (RQ) have been defined for the present study, focused on obtaining information on the evaluation of AH applications in relation to time, proposed definitions of AH, main areas of interest in which the term AH is used, and exposure of new AH trends:
  • RQ1: How many articles have been published on AH? Is there any relationship between the works that have been published on AH and the years of publication? This research question focuses on studying the number of works in relation with time on which they have been published in order to verify if there is a temporal trend of growth in publications related to AH.
  • RQ2: What definitions of AH do these present and what new definition can be obtained? From this context, it is sought to determine the number of articles that have been published on AH with the aim of providing a common definition of the AH topic.
  • RQ3: What areas of knowledge have been covered through works on the theme of AH? What are the most relevant areas of knowledge related to the subject matter? At this point, it is interesting to study in what areas of research the proposal has been developed and what are the most relevant areas of knowledge in which solutions are proposed with AH. In addition, it is important to obtain information on what other technologies have been able to converge with the proposed theme.
  • RQ4: What future lines of work are presented as subthemes of AH? Finally, it is necessary to know what the authors propose as future research trends, as well as to determine the relevant characteristics of these works. This will allow determining the similarities between the features of those trends and to include them as contributions of the current systematic mapping review of literature.

2.3. Collection Information

For this study, the analysis of exclusion and inclusion of articles is performed by selecting customized search strings in indexed databases such as IEEE, ACM and Scopus. The filtering of information is done manually using inclusion and exclusion criteria based on a complete set of evaluation guidelines as established in the scientific rigor and industrial relevance [26].

2.3.1. Conducting the Research

To help building the search terms, a set of key documents that are directly related to the proposed research questions was identified as a first step. Relevant synonyms were identified, and variations of the keywords were considered and added to the search. Data from the last 10 years from three databases were used to formulate the search chain: ACM, IEEE and Scopus. These databases were selected based on previous experience and advice [27]. Furthermore, Scopus has been added, since it is considered the largest database of abstracts and citations [28]. The last 10 years were taken in relation to the date the term AH was coined [11,12]. The search strings for the databases are shown in Table 1.
The information resulting from the search string shown in Table 1 has been extracted from articles in scientific journals, conferences and journals. The search of the string was carried out on 15 June 2021. Table 2 presents the numerical results obtained for each database.

2.3.2. Relevant Papers

Once the articles had been retrieved from the databases, according to our search protocol, the next step was to examine their relevance. The first phase of this process consisted of examining the relevance of the articles based on their titles. Retrieved articles whose titles were relevant to our study were discarded.

2.3.3. Inclusion and Exclusion Criteria

If a large number of studies are obtained, many of these may be noise or there may be duplication of works among databases [29]. In order to reduce the number of results that were obtained (16,914) by discarding duplicates and noisy data the process is carried out individually.
The following inclusion criteria were applied to titles and abstracts:
I1.
Papers that focus on the subject of AH.
I2.
Papers published between 1 January 2009 and 31 December 2020.
The following criteria were considered for the exclusion of documents:
E1.
Studies that present non-peer reviewed material.
E2.
Studies not published in English.
E3.
Non-formal documents that do not have a proven scientific basis.

2.3.4. Keywords

The relevant research articles from the literature were selected by following a usual process [30]. The process consisted of extracting some keywords and concepts that reflect the contributions from the abstracts of the articles. We then proceeded to read each article in detail. When it was observed that the article did not fit, it was discarded.

2.3.5. Data Extraction and Mapping Process

In this stage of the systematic mapping process, information was extracted from the research articles for meta-analysis and to address the research questions. A total of 10 data items were extracted from each article, as shown in Table 3. In the first six items, basic information about the article was extracted, including the article’s year of publication, title, author(s), type of publication, etc. Items 7 and 8 extracted data about the areas of knowledge and categories in which the articles are classified; this is because WoS performs significantly better than Scopus in terms of the accuracy of its journal ranking system [31,32]. In item 9, the relevant characteristics were extracted after detailed reading of the articles, and finally, item 10 is about the abstract of each article.

3. Results

After applying the search strings, 16,914 articles were retrieved from the three selected databases (see Table 2). The search process and the inclusion and exclusion criteria were applied to these data, resulting in a total of 133 articles (see Figure 2) that were eligible for analysis. This process was performed independently by two researchers who are coauthors of this review, allowing to cross-validate all the cases where there were doubts about the information. Finally, the complete content of the 133 articles was read independently by the authors to make the final decision on including or excluding them for the purpose of this research.
The PRISMA flowchart [23] (see Figure 2) consists of three phases. (1) Identification—search for related papers using the proposed search string in the different databases mentioned above. Duplicate articles, articles whose text is illegible (e.g., scanned), keywords that are not used at all or very little, additional, the context is not focused on the applicability of this research, articles that could not be accessed, articles that are not complete and articles focused on other areas are eliminated (e.g., geosciences, astronomy and astrophysics, chemistry, evolutionary biology, history, etc.). (2) Screening—phase in which the inclusion and exclusion criteria are applied to the different related works obtained by the identification phase. (3) Inclusion—phase in which the inclusion and exclusion criteria are applied to the different related works obtained by the identification phase. Here, we have eliminated those articles that have been eliminated after evaluating the title, abstract and exclusion criteria.

3.1. RQ1: How Many Articles Have Been Published on Augmented Humanity? Is There Any Relationship between the Works That Have Been Published on AH and the Years of Publication?

Table 4 offers the 133 scientific articles selected in this study, showing the databases where it was found and the publication year.
In order to know if there is any relationship between the articles obtained and the time line in which they have been published, a graph has been made (see Figure 3) with the 133 articles published, where it can be seen that there is a significant growth in the year 2017 and a stabilization of the number of articles in 2018 and 2019. For the year 2020, there is an increase of articles compared to the two previous years, 21 articles have been selected. Nonetheless, it is still a lower number than the articles of the year 2017 (27).
Figure 3 shows the number of studies identified within the years 2009–2020. Between the years 2009 and 2015, it can be observed that the AH theme was in development, with highs and lows of articles. A significant rise in the number of publications in those databases can be observed in the years 2016 and 2017. From 2009 to 2020, there is an increase in the number of studies on AH.
As part of the answer to RQ1, we have also considered the number of papers obtained in relation to the databases searched, which, according to Figure 3, contain similar publication numbers by year (after removing duplicates), leaving the IEEE as the database where a larger number of articles dealing with the subject of AH are indexed with 46 articles, followed by Scopus with 45 articles and ACM with 42 articles.

3.2. RQ2: What Definitions of AH Do These Present and What New Definition Can Be Obtained?

The AH definitions that were obtained are shown in Table 5, where only 17 articles out of 133 have been extracted, as they are the only ones that have provided definitions of AH.
In order to obtain a definition of AH that contains the context of the 17 articles that already define the subject, we considered the number of citations regardless of the fact that most of the articles were published in the last 11 years, justifying the need to consider the number of views of each one of them as well, as shown in Table 6.
Finally, the four articles whose definitions attempt to encompass the entire context of AH were selected. From these articles, those with the greatest number of views and citations were selected [35,36,87,110,116], allowing us to propose the following definition:
Augmented humanity is a human–computer integration technology that proposes to improve capacity and productivity by changing or increasing the normal ranges of human function, through the restoration or extension of human physical, intellectual and social capabilities.
The justification of this new formal definition of AH is detailed next as regards the constituent parts of which it is made up:
  • Technology: In accordance with [163], AH is described as a technology in relation to its “inputs” and “outputs”, where the inputs of technology are knowledge, resources and labor, while the outputs are material culture and modification of the environment. Since technology is the immediate point of contact between people and environment, the consideration of the term technology acknowledges the limiting and shaping functions of the physical and social environment [164]. Furthermore, the content of technology can be conceived in terms of knowledge, applications or norms [164,165].
  • Human–computer integration: The definition also expounds on the concept of human–computer integration, which is the symbiotic partnership or relationship in which humans and software give rise to patterns of behavior that must be considered holistically [35,166].
  • Improvement of capacity and productivity: Augmentation is the most common term in the interdisciplinary research community that focuses on interactive digital extensions of human capabilities [95]. The related concepts of augmented human and human 2.0 [167] refer to technologies that augment human productivity or capability or add to the human body or mind [168]. Human augmentation will serve the user by providing essential and timely information for common tasks [95] such as working, driving and so on.
  • Change or increase of normal ranges of human function: Human augmentation products and/or applications can be made for anyone, from healthy users who wish to improve their human capabilities to users who face temporary or permanent disabilities, physical disabilities or hazardous situations requiring their use [169].
  • When referring to AH as improving the physical, intellectual and social capabilities of human beings, we allude to all possibilities that are framed in each main component of AH. More concretely:
    -
    Augmented physical capabilities are achieved through the interpretation of the augmented senses and the actions they produce. Vision, taste, touch, smell and hearing can be physically augmented.
    -
    Augmented intellectual capacities are achieved through the acquisition of knowledge, cognitive processing and reasoning. Numerical aptitude, verbal comprehension, perceptual speed, inductive reasoning, deductive reasoning, spatial reasoning, abstract reasoning, memory, will and so on can be augmented intellectually.
    -
    Augmented social skills are considered through the interpretation of basic and complex social skills. Empathy, emotional intelligence, assertiveness, listening skills, ability to communicate emotions, ability to define a problem and evaluate solutions, negotiation, presenting oneself and many more can be socially augmented.

3.3. RQ3: What Areas of Knowledge Have Been Covered through the Work on the Theme of Augmented Humanity? What Are the Most Relevant Areas of Knowledge Related to the Subject Matter?

The total number of knowledge areas for the 133 articles is 18. In Figure 4, it can be seen that there are five relevant areas in which the selected research works are focused: computer science (91), engineering (58), robotics (40), automation and control system (15) and telecommunications (12).
Of the 133 articles selected, the repetition rate of the keywords was extracted, the most repeated are: augmented reality; wearable computing; computer vision; human–robot interaction and mixed reality. In relation to the various areas of knowledge, it is clear that most of the articles selected are related to technology, of which the most relevant categories are: (i) computer science; (ii) engineering; (iii) robotics; (iv) automation and control systems; and (v) telecommunications. Figure 5 presents the relevant domains of AH in relation to the number of keyword repetitions per area. There are two relevant fields of study (y-axis) that are clearly outstanding: computer science and automation and control systems.
Besides the obtained research areas, we have also studied the conferences (peer-review), magazines and journals in which the research works have been published. There are 18 venues whose publication repetition index of the 133 articles is higher than 1. The other publications in conferences, magazines or journals have been omitted. The most relevant publications are depicted in Figure 6, where three publication venues of relevant research papers stand out: Augmented Human International Conference (9 publications), CHI Conference on Human Factors in Computing Systems (6 publications) IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (5 publications) and IEEE International Conference on Robotics and Automation (ICRA) (4 publications).
Finally, the index terms of each one of the 133 selected articles are considered for this study. The total number of keywords is 200. The keywords selected for the grouping are those that have been repeated more than twice. Figure 7 shows the major topics covered (top ten) with the respective number of repetitions. Augmented reality is the most popular one, with 18 citations in the keywords of the scientific articles. The five following topics with the highest repetition rate are: wearable computing (13), human–robot interaction (11), computer vision (11), human–computer interaction (10) and mixed reality (9).
It is curious that the keyword human augmentation has a repetition rate of 7 times; this is because although in the titles and text of the publications the word exists, it does not exist as a keyword proposed by the authors. Finally, of the number of publications obtained, it is necessary to mention that they have been published in congresses and conferences with a high impact factor.

3.4. RQ4: What Future Lines of Work Are Presented?

We decided to present a compilation of the proposals for future works from the first five positions of the research (computer science, engineering, robotics, automation and control systems and telecommunications) according to Figure 4 (see Supplementary Materials Table S1). It was also considered to express in Supplementary Materials Table S1 the theme of the research work a brief description of the objective of the work and the proposals presented for future work. The reason why 37 articles are shown in Supplementary Materials Table S1 and not 133 is because we have taken those articles that have been cited in the key words by the authors: wearable computing, computer vision, human–robot interaction and mixed reality.
Table 7 and Figure 8 expose the works related to the theme of AH until 2020. These works are focused on different areas. However there are works that somewhere in its structure mention “augmented humanity” as a feature of the development of the authors.

4. Discussion

This work has introduced a systematic mapping review of the definitions of AH as well as the published research that has been developed under this theme and that have been published in recent years (2009–2020). The results obtained are important and show a global vision of the current state of knowledge in this area. In relation to the definitions obtained about AH, it was not possible to obtain a single formal one from the analysis of the different proposals studied in the analysis of the related works. The results that we retrieved provide a global perception of the state of knowledge and study of the area on the subject of AH. A first certainty of this systematic review was that more research is still needed to characterize, organize and classify the AH terminology within its respective fields of study and translate it into other scientific contributions based on the new definition provided in this research paper. Indeed, our definition can be used not only in technology but in any field looking for human support through human–computer integration.
It is important to emphasize that in relation to the publication venues, the great majority of works were disclosed in conferences (peer-review) and in journals of high impact factor. As for the temporal evolution, there has been the tendency of the slight growth (4.5 publications in average per year) of publications until the year 2016, when it increased (16 publications), and in the year 2017, the peak of the curve was observed; then, for the years 2018 and 2019, the publications between 19 and 18 stabilized. For the year 2020, 21 publications were published up to December 31, compared to the two previous years the related articles went up. The increase is not equal or higher to year 2017. One of the possible reasons may be to the fact that in year 2020 the COVID-19 virus SARS-CoV-2 spread worldwide, causing a decrease of articles published. However, in recent years, there has been an increase in publications in general terms, and this may be an indicator that the AH terminology is gradually becoming a focus of interest to the research community. In the articles reviewed in this paper, it is appreciated that there are several terms in which AH exists. However, it is not directly linked to AH terminology; possible reasons could be lack of knowledge of a concrete definition, publications focus on the specific field and lack of knowledge of a classification of AH.
The results obtained in the present review of systematic mapping on definitions of AH show that in some publications a macro concept of definition is emitted, without this one having been defined by means of a work similar to the present one. In other publications, even, it is only mentioned that some thematic is being done with AH, giving no notion about what it is. This systematic mapping review has introduced a series of scientific publications that define AH from different approaches or perspectives, some of these depending on the area in which the research is focused. All the existing definitions may cause confusion to the reader, hindering the understanding of an exact definition of AH. That is why four research questions were posed to resolve doubts about the number of related works that have used the term AH until December 2020, these being 16,914. However, they did not present a concrete definition on the subject. After applying inclusion and exclusion criteria, only 17 high impact related works presented definitions in which there were significant differences in approach. An analysis of the context of each proposed definition was carried out and we provided our proper definition.
In the third question posed, the knowledge areas relevant to the subject of AH according to WOS, in which AH causes greater impact, being the five areas of study: computer science, engineering, robotics, automation and control systems and telecommunications, showing that AH is an interdisciplinary terminology. In this regard, only a few papers from the significant number of articles mentioning the term AH in the diverse knowledge areas have provided some definition of AH. This has probably lead to confusion about the orientation and purpose of the term. In fact, the term can be used in many areas of knowledge because AH encompasses any technological aspect supporting human beings, whether physically, intellectually or socially. However many researchers did not find it necessary to properly label their conception of AH.
In the fourth research question, the related works closer to the topics about the repetition rate of the most used terms are analyzed and characteristics are extracted and proposals for future works are exposed, leaving open research proposals. These research proposals are focused on the areas of computer science (38.23%), engineering (24.36%), robotics (16.80%), automation and control systems (6.30%) and telecommunications (5.04%). There are other areas where the term is also used, for example: information science and library science, physics, neuroscience and neurology, optics, etc. Regardless of the knowledge areas and keyword repetition rate that indicate an increased use of AH terminology, probably not all users will fully accept human augmentation, which may have caused noise or bias suggestions with respect to augmented human capabilities. In other words, some constraints in defining AH may have arisen from user perception, considering the three main components suggested by our definition. (i) Physical capabilities: users may be slow to accept a physical augmentation, which may be due to habit, resistance to change, etc. (ii) Intellectual capabilities: users may take time to learn to manipulate or augmented humanity applications. This may occur for different reasons such as cognitive-affective management, either training time, prior knowledge of manipulating technological interfaces, etc. (iii) Social capabilities: users do not tend to have a regular pattern; by nature, they are changeable in their tastes, behaviors, feelings, etc.
The keywords with the highest repetition rate were also exposed, being the six main ones: augmented reality (14.4%), wearable computing (10.4%), human–robot interaction (8.8%), computer vision (8.8%), human–computer interaction (8%), mixed reality (7.2%) and others (42.4%). These data indicate the terminology with greater application used in AH research, clearly indicating an orientation with greater experience on the knowledge of what AH means. However, the 42.4% of most used keywords could reflect a lower AH approach, so we think that with the definition proposed in this document these percentages could be raised, opening or positioning those keywords to a greater extent. Yet, the term AH should not be confused with augmented reality, virtual reality and/or mixed reality. Although these can be the tools and/or means for implementing AH applications, AH may use any other means or technology capable of designing applications that contribute to improve or enhance the physical, intellectual or social capabilities of human beings.
Throughout the development of this work, three possible risks that could have affected the systematic mapping review have been considered:
  • The first possible risk [170], is the bias of selective information because the analyses of statistically significant differences are published more frequently. To minimize this risk, three scientific databases have been used as sources for the search process: IEEE, ACM and Scopus. These provide a complete list of articles covering the different aspects of this systematic mapping review. To avoid affecting the validity of the present study, literature from theses, reports, etc., has been excluded, since these types of documents do not have as rigorous of a review process as that of journals.
  • The second possible risk that could affect the study is selection bias. However, for this risk, the inclusion and exclusion criteria were clearly described.
  • The third possible risk that could have affected this research is related to the possibility of classifying a study in different ways. This risk was mitigated by the support and joint work of four researchers, so that when a researcher presented some doubt or there would be discrepancies between the classifications, it was discussed with the working group, allowing to improve the quality of the analysis.
This systematic mapping review also has some limitations. Although the authors attempted to identify as many articles as possible, studies not published in English were excluded from the review, so that some other AH cues may have been missed. Another limitation of our review has to do with ethical issues, as we did not study this aspect in the articles searched. All AH applications are required to adopt ethical commitments since they deal with human beings. For example, they must take care of the privacy of personal data.
In relation to the proposed new definition of AH, there may be a latent limitation due to the fact that the term is novel and AH is only taking its first steps. This means that it is likely that the use of our definition will not land until more researchers engage with the terminology. In addition to this, it may lead to self-interested negativity in the use of the AH definition, as AH is a term that can be used cross-cuttingly in many areas of knowledge and may give way to a desire to formulate more specific definitions focused on each field. Another limitation for the use of our definition is that the studied works emerged in the years where AH was only informally declared. However, in the course of time, studies using AH will continue to be proposed and developed and there may be a breaking point in which it will be necessary to revisit the definition and add additional features.
Finally, it is proposed as future work to carry out a classification or taxonomy of the areas in which the different research approaches in which AH is applied are presented. Additionally, future works of different researchers are presented, whose approaches are based on developing applications, prototypes or research in augmented reality, wearable computing, computer vision, human–robot interaction (HRI), mixed reality and human–computer interaction (HCI). For example, four possible augmented humanity works are cited: (i) Perform augmented writing using a transmissive head-mounted display, such as Microsoft’s HoloLens, where only one user can experience the effects without showing anything in real space. (ii) Develop representative wearable 2.0 applications for health care including chronic disease monitoring, elderly care, medical and health care institution, smart training for athletes, emotion care, etc. These applications can be virtual reality/augmented reality applications based on smart wearables. (iii) Develop a theoretical framework that provides a structural basis for exploring intelligence augmentation. iv) Improve interaction metaphors (image, resolution, flight times, display field of view, etc.) of a drone for remote location visualization.

Supplementary Materials

The following are available online at: https://www.mdpi.com/article/10.3390/s22020514/s1, Table S1: Proposals for future work.

Author Contributions

Conceptualization, A.F.-C. and A.P.; methodology, G.G.; validation, F.J.M.d.S.; data curation, G.G.; writing—original draft preparation, G.G.; writing—review and editing, F.J.M.d.S., A.F.-C. and A.P.; funding acquisition, A.F.-C. and A.P. All authors have read and agreed to the published version of the manuscript.

Funding

This work has been partially supported by the Portuguese Fundação para a Ciência e a Tecnologia – FCT, I.P. under the project UIDB/04524/2020 and by Portuguese National funds through FITEC - Programa Interface, with reference CIT “INOV—INESC Inovação—Financiamento Base“. Grants PID2020-115220RB-C21 and EQC2019-006063-P funded by MCIN/AEI/10.13039/501100011033 and by “ERDF A way to make Europe”. This work was also partially supported by CIBERSAM of the Instituto de Salud Carlos III.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All data generated or analyzed during this study are included in this article. The review protocol is available on reasonable demand from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Wiener, N. The Human Use of Human Beings: Cybernetics and Society, 2nd ed.; Houghton Mifflin: Boston, MA, USA, 1950. [Google Scholar]
  2. Kumar, M.; Dhulipala, V.; Baskar, S. Fuzzy unordered rule induction algorithm based classification for reliable communication using wearable computing devices in healthcare. J. Ambient. Intell. Humaniz. Comput. 2020, 12, 3515–3526. [Google Scholar] [CrossRef]
  3. Parveau, M.; Adda, M. Toward a user-centric classification scheme for extended reality paradigms. J. Ambient Intell. Humaniz. Comput. 2020, 11, 2237–2249. [Google Scholar] [CrossRef]
  4. Caon, M.; Menuz, V.; Roduit, J. We are super-humans: Towards a democratisation of the socio-ethical debate on augmented humanity. In Proceedings of the 7th Augmented Human International Conference, Geneva, Switzerland, 25–27 February 2016; ACM: New York, NY, USA; p. 26. [Google Scholar] [CrossRef]
  5. Castiblanco, J.C.; Mondragon, I.F.; Alvarado-Rojas, C.; Colorado, J.D. Assist-As-Needed Exoskeleton for Hand Joint Rehabilitation Based on Muscle Effort Detection. Sensors 2021, 21, 4372. [Google Scholar] [CrossRef]
  6. Ribeiro, P.; Soares, A.R.; Girão, R.; Neto, M.; Cardoso, S. Spine Cop: Posture Correction Monitor and Assistant. Sensors 2020, 20, 5376. [Google Scholar] [CrossRef] [PubMed]
  7. Roda-Sanchez, L.; Garrido-Hidalgo, C.; García, A.S.; Olivares, T.; Fernández-Caballero, A. Comparison of RGB-D and IMU-based gesture recognition for human-robot interaction in remanufacturing. Int. J. Adv. Manuf. Technol. 2021, 1–13. [Google Scholar] [CrossRef]
  8. Roda-Sanchez, L.; Olivares, T.; Garrido-Hidalgo, C.; de la Vara, J.L.; Fernández-Caballero, A. Human-robot interaction in Industry 4.0 based on an Internet of Things real-time gesture control system. Integr. Comput.-Aided Eng. 2021, 28, 159–175. [Google Scholar] [CrossRef]
  9. Ji, Z.; Hu, W.; Wang, Z.; Yang, K.; Wang, K. Seeing through Events: Real-Time Moving Object Sonification for Visually Impaired People Using Event-Based Camera. Sensors 2021, 21, 3558. [Google Scholar] [CrossRef] [PubMed]
  10. Rekimoto, J. From augmented reality to augmented human. In Proceedings of the 2013 IEEE International Symposium on Mixed and Augmented Reality, Adelaide, Australia, 1–4 October 2013; IEEE: Piscataway, NJ, USA, 2013. [Google Scholar] [CrossRef]
  11. Gannes, L. Eric Schmidt: Welcome to “Age of Augmented Humanity”. 2010. Available online: https://gigaom.com/2010/09/07/eric-schmidt-welcome-to-the-age-of-augmented-humanity/ (accessed on 12 November 2021).
  12. Naughton, L.; Daly, H. Augmented Humanity: Data, Privacy and Security. In Cyber Defence in the Age of AI, Smart Societies and Augmented Humanity; Springer International Publishing: Cham, Switzerland, 2020; pp. 73–93. [Google Scholar] [CrossRef]
  13. McCusker, S. Augmented Humanity–Isobar Insights & Whitepapers. 2020. Available online: https://www.isobar.com/es-es/insights/global/2019/november/isobar-launches-augmented-humanity (accessed on 12 November 2021).
  14. Bryant, P. Toward a Science of Augmented Agency. In Augmented Humanity: Being and Remaining Agentic in a Digitalized World; Springer International Publishing: Cham, Switzerland, 2021; pp. 269–294. [Google Scholar] [CrossRef]
  15. Bryant, P.T. Augmented Humanity: Being and Remaining Agentic in a Digitalized World; Springer Nature: Berlin/Heidelberg, Germany, 2021. [Google Scholar] [CrossRef]
  16. Bryant, P.T. Modeling Augmented Humanity. In Augmented Humanity: Being and Remaining Agentic in a Digitalized World; Bryant, P.T., Ed.; Springer Nature: Berlin/Heidelberg, Germany, 2021; pp. 1–38. [Google Scholar] [CrossRef]
  17. Rekimoto, J. From Augmented Reality to Augmented Human. In The Design Wave; Nurimedia: Seoul, Korea, 2011; pp. 38–54. [Google Scholar]
  18. Narumi, T. Multi-sensorial virtual reality and augmented human food interaction. In Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food Interaction, Tokyo, Japan, 16 November 2016; ACM: New York, NY, USA, 2016; pp. 1–6. [Google Scholar] [CrossRef]
  19. Yasumura, M. Retrospect of Augmented Reality. Augment. Hum. 2012, 1–5. [Google Scholar]
  20. Dallagassa, M.; dos Santos Garcia, C.; Scalabrin, E.; Ioshii, S.O.; Carvalho, D.R. Opportunities and challenges for applying process mining in healthcare: A systematic mapping study. J. Ambient. Intell. Humaniz. Comput. 2021, 1–18. [Google Scholar] [CrossRef]
  21. Saleemi, M.; Anjum, M.; Rehman, M. Ubiquitous healthcare: A systematic mapping study. J. Ambient. Intell. Humaniz. Comput. 2020, 12, 1–26. [Google Scholar] [CrossRef]
  22. Cooper, I. What is a “mapping study?”. J. Med. Libr. Assoc. 2016, 104, 76–78. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. McInnes, M.; Moher, D.; Thombs, B.; McGrath, T.A.; Bossuyt, P.M.; Willis, B.H.; the PRISMA-DTA Group. Preferred reporting items for a systematic review and meta-analysis of diagnostic test accuracy studies: The PRISMA-DTA statement. JAMA 2018, 319, 388–396. [Google Scholar] [CrossRef]
  24. Kitchenham, B.A.; Budgen, D.; Brereton, P. Evidence-Based Software Engineering and Systematic Reviews; Chapman and Hall/CRC: Boca Raton, FL, USA, 2020. [Google Scholar]
  25. Kitchenham, B.; Charters, S. Guidelines for performing Systematic Literature Reviews in Software Engineering; University of Durham: Durham, UK, 2007. [Google Scholar]
  26. Ivarsson, M.; Gorschek, T. A method for evaluating rigor and industrial relevance of technology evaluations. Empir. Softw. Eng. 2011, 16, 365–395. [Google Scholar] [CrossRef]
  27. Dyva, T.; Dingsoyr, T.; Hanssen, G. Applying systematic reviews to diverse study types: An experience report. In Proceedings of the First International Symposium on Empirical Software Engineering and Measurement, Madrid, Spain, 20–21 September 2007; IEEE: Piscataway, NJ, USA, 2007; p. 1. [Google Scholar] [CrossRef]
  28. Kitchenham, B. What’s up with software metrics?—A preliminary mapping study. J. Syst. Softw. 2010, 83, 37–51. [Google Scholar] [CrossRef]
  29. Petticrew, M.; Roberts, H. Systematic reviews in the social sciences: A practical guide. Sociol. Health Illn. 2007, 29, 318–319. [Google Scholar] [CrossRef]
  30. Petersen, K.; Feldt, R.; Mujtaba, S.; Mattsson, M. Systematic mapping studies in software engineering. In Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering, Bari, Italy, 21–25 September 2008; ACM: New York, NY, USA, 2008; pp. 68–77. [Google Scholar]
  31. Wang, Q.; Waltman, L. Large-scale analysis of the accuracy of the journal classification systems of Web of Science and Scopus. J. Inf. 2016, 10, 347–364. [Google Scholar] [CrossRef] [Green Version]
  32. Singh, P.; Piryani, R.; Singh, V.K.; Pinto, D. Revisiting subject classification in academic databases: A comparison of the classification accuracy of web of science, scopus & dimensions. J. Intell. Fuzzy Syst. 2020, 39, 1–6. [Google Scholar] [CrossRef]
  33. Arntz, A.; Eimler, S.C.; Hoppe, H. “The Robot-Arm Talks Back to Me”—Human Perception of Augmented Human-Robot Collaboration in Virtual Reality. In Proceedings of the 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality, Utrecht, The Netherlands, 14–18 December 2020; IEEE Computer Society: Los Alamitos, CA, USA, 2020; pp. 307–312. [Google Scholar] [CrossRef]
  34. He, B.; Huang, H.; Thomas, G.C.; Sentis, L. Complex Stiffness Model of Physical Human-Robot Interaction: Implications for Control of Performance Augmentation Exoskeletons. In Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, Macao, Macau, 4–8 November 2019; pp. 6748–6755. [Google Scholar] [CrossRef] [Green Version]
  35. Mueller, F.F.; Lopes, P.; Strohmeier, P.; Ju, W.; Seim, C.E.; Weigel, M.; Nanayakkara, S.; Obrist, M.; Li, Z.; Delfa, J.; et al. Next steps for human-computer integration. In Proceedings of the CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25– 30 April 2020; ACM: New York, NY, USA, 2020; pp. 1–15. [Google Scholar] [CrossRef]
  36. Yoon, H.; Doh, Y.Y.; Yi, M.Y.; Woo, W. A conceptual framework for augmented smart coach based on quantified holistic self. In Distributed, Ambient, and Pervasive Interactions; Springer International Publishing: Cham, Switzerland, 2018; pp. 498–508. [Google Scholar] [CrossRef]
  37. Shi, J.; Xu, J.; Yao, Y.; Xu, B. Concept learning through deep reinforcement learning with memory-augmented neural networks. Neural Netw. 2019, 110, 47–54. [Google Scholar] [CrossRef] [Green Version]
  38. Hugues, O.; Fuchs, P.; Nannipieri, O. New Augmented Reality Taxonomy: Technologies and Features of Augmented Environment. In Handbook of Augmented Reality; Springer: New York, NY, USA, 2011; pp. 47–63. [Google Scholar] [CrossRef] [Green Version]
  39. Lampen, E.; Lehwald, J.; Pfeiffer, T. A Context-Aware Assistance Framework for Implicit Interaction with an Augmented Human. In Virtual, Augmented and Mixed Reality. Industrial and Everyday Life Applications; Chen, J.Y.C., Fragomeni, G., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 91–110. [Google Scholar]
  40. Chou, Y.C.; Kuo, C.J.; Chen, T.T.; Horng, G.J.; Pai, M.Y.; Wu, M.E.; Lin, Y.C.; Hung, M.H.; Su, W.T.; Chen, Y.C.; et al. Deep-Learning-Based Defective Bean Inspection with GAN-Structured Automated Labeled Data Augmentation in Coffee Industry. Appl. Sci. 2019, 9, 4166. [Google Scholar] [CrossRef] [Green Version]
  41. Al-Shuka, H.F.N.; Song, R.; Ding, C. On high-level control of power-augmentation lower extremity exoskeletons: Human walking intention. In Proceedings of the 2018 Tenth International Conference on Advanced Computational Intelligence, Xiamen, China, 29–31 March 2018; IEEE: New York, NY, USA, 2018; pp. 169–174. [Google Scholar] [CrossRef]
  42. Sinha, K.; Majumder, P.; Manjunath, G. A dynamic microtask scheduling approach for SLO based human-augmented computing. In Proceedings of the 2016 3rd International Conference on Recent Advances in Information Technology, Dhanbad, India, 3–5 March 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 191–196. [Google Scholar] [CrossRef]
  43. Shang, K.; Xu, X.; Su, H. Design and evaluation of an upper extremity wearable robot with payload balancing for human augmentation. In Proceedings of the 2017 International Symposium on Wearable Robotics and Rehabilitation, Houston, TX, USA, 5–8 November 2017; IEEE: Piscataway, NJ, USA, 2017; p. 1. [Google Scholar]
  44. Kaur, B.; Bhattacharya, J. Predictive hierarchical human augmented map generation for itinerary perception. Electron. Lett. 2016, 52, 1381–1383. [Google Scholar] [CrossRef]
  45. Orlov, P.; Shafti, A.; Auepanwiriyakul, C.; Songur, N.; Faisal, A.A. A Gaze-Contingent Intention Decoding Engine for Human Augmentation. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications, Warsaw, Poland, 14–17 June 2018; ACM: New York, NY, USA, 2018. [Google Scholar] [CrossRef]
  46. Kono, M.; Ishiguro, Y.; Miyaki, T.; Rekimoto, J. Design and Study of a Multi-Channel Electrical Muscle Stimulation Toolkit for Human Augmentation. In Proceedings of the 9th Augmented Human International Conference, Seoul, Korea, 7–9 February 2018; ACM: New York, NY, USA, 2018. [Google Scholar] [CrossRef]
  47. Hwang, B.; Jang, Y.M.; Mallipeddi, R.; Lee, M. Probabilistic human intention modeling for cognitive augmentation. In Proceedings of the 2012 IEEE International Conference on Systems, Man, and Cybernetics, Seoul, Korea, 14–17 October 2012; IEEE: Piscataway, NJ, USA, 2012; pp. 2580–2584. [Google Scholar] [CrossRef]
  48. Shakeel, M.H.; Karim, A.; Khan, I. A multi-cascaded model with data augmentation for enhanced paraphrase detection in short texts. Inf. Process. Manag. 2020, 57, 102204. [Google Scholar] [CrossRef] [Green Version]
  49. Lukosch, S. Designing for Augmented Humans and Intelligence. In Proceedings of the 2019 IEEE 23rd International Conference on Computer Supported Cooperative Work in Design, Vila Real, Portugal, 6–8 May 2019; IEEE: Piscataway, NJ, USA, 2019; p. 3. [Google Scholar] [CrossRef]
  50. Hwang, B.; Jang, Y.M.; Lee, M. Probabilistic intention classification for human augmented cognition system. In Proceedings of the XX IMEKO World Congress, Busan, Korea, 9–14 September 2012; IMEKO: Budapest, Hungary, 2012; pp. 1–3. [Google Scholar]
  51. Akata, Z.; Balliet, D.; de Rijke, M.; Dignum, F.; Dignum, V.; Eiben, G.; Fokkens, A.; Grossi, D.; Hindriks, K.; Hoos, H.; et al. A Research Agenda for Hybrid Intelligence: Augmenting Human Intellect With Collaborative, Adaptive, Responsible, and Explainable Artificial Intelligence. Computer 2020, 53, 18–28. [Google Scholar] [CrossRef]
  52. Topp, E.A.; Christensen, H.I. Detecting Region Transitions for Human-Augmented Mapping. IEEE Trans. Robot. 2010, 26, 715–720. [Google Scholar] [CrossRef]
  53. Durkee, K.; Geyer, A.; Pappada, S.; Ortiz, A.; Galster, S. Real-Time Workload Assessment as a Foundation for Human Performance Augmentation. In Foundations of Augmented Cognition; Springer: Berlin/Heidelberg, Germany, 2013; pp. 279–288. [Google Scholar]
  54. Alachouzakis, K.; Veneris, N.D.; Kavvadias, S.; Antoniou, A.; Lepouras, G. A Study of Micro-Augmentations: Personality, Gender, Emotions and Effects on Attention and Brain Waves. In Proceedings of the 22nd Pan-Hellenic Conference on Informatics, Athens, Greece, 29 November–1 December 2018; ACM: New York, NY, USA, 2018; pp. 190–195. [Google Scholar] [CrossRef]
  55. Hwang, B.; Kim, C.S.; Park, H.M.; Lee, Y.J.; Kim, M.Y.; Lee, M. Development of Visualizing Earphone and Hearing Glasses for Human Augmented Cognition. In Proceedings of the 18th International Conference on Neural Information Processing—Volume Part II (ICONIP’11), Shanghai, China, 13–17 November 2011; Springer: Berlin/Heidelberg, Germany, 2011; pp. 342–349. [Google Scholar] [CrossRef]
  56. Oliveira, I.; Grigore, O.; Guimarães, N.; Duarte, L. Relevance of EEG Input Signals in the Augmented Human Reader. In Proceedings of the 1st Augmented Human International Conference, Megève, France, 2–3 April 2010; ACM: New York, NY, USA, 2010. [Google Scholar] [CrossRef]
  57. Kim, B.; Ojha, A.; Lee, M. Active glass-type human augmented cognition system considering attention and intention. Connect. Sci. 2015, 27, 322–339. [Google Scholar] [CrossRef]
  58. Record, I.; Ratto, M.; Ratelle, A.; Ieraci, A.; Czegledy, N. DIY Prosthetics Workshops: ’critical making’ for public understanding of human augmentation. In Proceedings of the 2013 IEEE International Symposium on Technology and Society: Social Implications of Wearable Computing and Augmediated Reality in Everyday Life, Ontario, ON, Canada, 27–29 June 2013; IEEE: Piscataway, NJ, USA, 2013; pp. 117–125. [Google Scholar] [CrossRef]
  59. Harvey, M.; Langheinrich, M.; Ward, G. Remembering through lifelogging: A survey of human memory augmentation. Pervasive Mob. Comput. 2016, 27, 14–26. [Google Scholar] [CrossRef] [Green Version]
  60. Chen, S.; Chen, Z.; Yao, B.; Zhu, X.; Zhu, S.; Wang, Q.; Song, Y. Adaptive Robust Cascade Force Control of 1-DOF Hydraulic Exoskeleton for Human Performance Augmentation. IEEE/ASME Trans. Mechatron. 2017, 22, 589–600. [Google Scholar] [CrossRef]
  61. Erat, O.; Isop, W.; Kalkofen, D.; Schmalstieg, D. Drone-augmented human vision: Exocentric control for drones exploring hidden areas. IEEE Trans. Vis. Comput. Graph. 2018, 24, 1437–1446. [Google Scholar] [CrossRef]
  62. Matsuda, A.; Rekimoto, J. ScalableBody: A Telepresence Robot Supporting Socially Acceptable Interactions and Human Augmentation through Vertical Actuation. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology, Tokyo, Japan, 16–19 October 2016; ACM: New York, NY, USA, 2016; pp. 103–105. [Google Scholar] [CrossRef]
  63. Mangina, E.; Chiazzese, G.; Hasegawa, T. AHA: ADHD Augmented (Learning Environment). In Proceedings of the 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering, Wollongong, Australia, 4–7 December 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 774–777. [Google Scholar] [CrossRef]
  64. Maekawa, A.; Matsubara, S.; Wakisaka, S.; Uriu, D.; Hiyama, A.; Inami, M. Dynamic Motor Skill Synthesis with Human-Machine Mutual Actuation. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25–30 April 2020; ACM: New York, NY, USA, 2020; pp. 1–12. [Google Scholar] [CrossRef]
  65. Weinberg, G. Robotic musicianship and musical human augmentation. In Proceedings of the 2019 14th ACM/IEEE International Conference on Human-Robot Interaction, Daegu, Korea, 11–14 March 2019; ACM: New York, NY, USA, 2019; pp. 305–306. [Google Scholar] [CrossRef]
  66. Tseng, K.S.; Mettler, B. Analysis and augmentation of human performance on telerobotic search problems. IEEE Access 2020, 8, 56590–56606. [Google Scholar] [CrossRef]
  67. Kim, B.; Mallipeddi, R.; Lee, M. Embedded System for Human Augmented Cognition Based on Face Selective Attention Using Eye Gaze Tracking. In Neural Information Processing; Lee, M., Hirose, A., Hou, Z.G., Kil, R.M., Eds.; Springer: Berlin/Heidelberg, Germany, 2013; pp. 729–736. [Google Scholar]
  68. Maettig, B.; Foot, H. Approach to improving training of human workers in industrial applications through the use of intelligence augmentation and human-in-the-loop. In Proceedings of the 2020 15th International Conference on Computer Science Education, Delft, The Netherlands, 18–22 August 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 283–288. [Google Scholar] [CrossRef]
  69. Huynh-The, T.; Hua, C.H.; Kim, D.S. Encoding Pose Features to Images With Data Augmentation for 3-D Action Recognition. IEEE Trans. Ind. Inform. 2020, 16, 3100–3111. [Google Scholar] [CrossRef]
  70. Dinh, Q.H.; Viatcheslav, I.; Seet, G.L.G. See-through and spatial augmented reality—A novel framework for human-robot interaction. In Proceedings of the 3rd International Conference on Control, Automation and Robotics, Chengdu, China, 11–13 August 2018; IEEE: Piscataway, NJ, USA, 2017; pp. 719–726. [Google Scholar] [CrossRef]
  71. Rebolledo, Y.S.A.; van der Putten, P.; Lamers, M.H. Assessing Augmented Creativity: Putting a Lovelace Machine for Interactive Title Generation Through a Human Creativity Test. In Computational Intelligence in Music, Sound, Art and Design; Springer International Publishing: Cham, Switzerland, 2017; Chapter 18. [Google Scholar] [CrossRef]
  72. Hachisu, T.; Bourreau, B.; Suzuki, K. EnhancedTouchX: Smart Bracelets for Augmenting Interpersonal Touch Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK, 4–9 May 2019; ACM: New York, NY, USA, 2019; pp. 1–12. [Google Scholar]
  73. Zagel, C. Service Innovation for Cyborgs – Human Augmentation as a Self-experiment. In Advances in the Human Side of Service Engineering; Springer International Publishing: Cham, Switzerland, 2020; pp. 22–27. [Google Scholar]
  74. Petrič, T.; Goljat, R.; Babič, J. Augmentation of human arm motor control by isotropic force manipulability. In Proceedings of the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems, Daejeon, Korea, 9–14 October 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 696–701. [Google Scholar] [CrossRef]
  75. Lim, G.H.; Kim, K.W.; Chung, B.; Suh, I.H.; Suh, H.; Kim, M. Service-oriented context reasoning incorporating patterns and knowledge for understanding human-augmented situations. In Proceedings of the 19th International Symposium in Robot and Human Interactive Communication, Viareggio, Italy, 12–15 September 2010; IEEE: Piscataway, NJ, USA, 2010; pp. 144–150. [Google Scholar] [CrossRef]
  76. Bahrainian, S.A.; Crestani, F. Augmentation of Human Memory: Anticipating Topics That Continue in the Next Meeting. In Proceedings of the 2018 Conference on Human Information Interaction Retrieval, New Brunswick, NJ, USA, 11–15 March 2018; ACM: New York, NY, USA, 2018; pp. 150–159. [Google Scholar] [CrossRef]
  77. Tobita, H. Ghost-Hack AR: Human Augmentation Using Multiple Telepresence Systems for Network Communication. In Proceedings of the 6th ACM International Symposium on Pervasive Displays, Lugano, Switzerland, 7–9 June 2017; ACM: New York, NY, USA, 2017. [Google Scholar] [CrossRef]
  78. Yokogawa, T.; Zhu, W.; Matsumoto, M.; Zang, J.; Tanaka, A.; Ano, M.; Tobita, H. SitusCall: Location-based mobile communication for group calls and human augmentation. In Proceedings of the 2019 International Conference on Information and Communication Technologies for Disaster Management, Paris, France, 18–20 December 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 1–8. [Google Scholar] [CrossRef]
  79. Shiraishi, R.; Fujita, T.; Inuzuka, K.; Takashima, R.; Sankai, Y. Augmentation of Human Protection Functions Using Wearable and Sensing System. In Proceedings of the 7th Augmented Human International Conference, Geneva, Switzerland, 25–27 February 2016; ACM: New York, NY, USA, 2016. [Google Scholar] [CrossRef]
  80. Huang, R.; Cheng, H.; Guo, H.; Chen, Q.; Lin, X. Hierarchical Interactive Learning for a Human-Powered Augmentation Lower Exoskeleton. In Proceedings of the 2016 IEEE International Conference on Robotics and Automation, Stockholm, Sweden, 16–21 May 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 257–263. [Google Scholar] [CrossRef]
  81. Wei, S.E.; Tang, N.C.; Lin, Y.y.; Weng, M.F.; Liao, H.Y.M. Skeleton-Augmented Human Action Understanding by Learning with Progressively Refined Data. In Proceedings of the 1st ACM International Workshop on Human Centered Event Understanding from Multimedia, Santa Barbara, CA, USA, 12 October 2020; ACM: New York, NY, USA, 2014; pp. 7–10. [Google Scholar] [CrossRef]
  82. Keyvanpour, M.R.; Zolfaghari, S. Augmented feature-state sensors in human activity recognition. In Proceedings of the 2017 9th International Conference on Information and Knowledge Technology, Tehran, Iran, 18–19 October 2017; IEEE: Piscataway, NJ, USA, 2017; pp. 71–75. [Google Scholar] [CrossRef]
  83. Lee, J.; Kim, E.; Yu, J.; Kim, J.; Woo, W. Holistic quantified self framework for augmented human. In Distributed, Ambient and Pervasive Interactions: Technologies and Contexts; ACM: New York, NY, USA, 2018; pp. 188–201. [Google Scholar] [CrossRef]
  84. Kim, H.; Kim, M.; Yang, S.; Kim, K.; Son, H.; Lee, Y. Smart wearable robot glasses for human visual augmentation based on human intention and scene understanding. In Proceedings of the 2010 International Symposium on Optomechatronic Technologies, Toronto, ON, Canada, 25–27 October 2010; IEEE: Piscataway, NJ, USA, 2010; pp. 1–5. [Google Scholar] [CrossRef]
  85. Singathiya, R.; Jangid, N.; Gupta, P.; Deb, S. Augmented Human Interaction with Remote Devices Using Low Cost DTMF Technology. In Proceedings of the Third International Conference on Soft Computing for Problem Solving, ew Delhi, India, 21–24 September 2016; Pant, M., Deep, K., Nagar, A., Bansal, J.C.N., Eds.; N Springer: Berlin/Heidelberg, Germany, 2014; pp. 125–132. [Google Scholar]
  86. Yamada, Y.; Irie, K.; Gushima, K.; Ishizawa, F.; Sada, M.A.; Nakajima, T. HoloMoL: Human Memory Augmentation with Mixed-Reality Technologies. In Proceedings of the 21st International Academic Mindtrek Conference, Tampere, Finland, 20–21 September 2017; ACM: New York, NY, USA, 2017; pp. 235–238. [Google Scholar] [CrossRef]
  87. Matarić, M. Socially assistive robotics: Human augmentation versus automation. Sci. Robot. 2017, 2, 1–2. [Google Scholar] [CrossRef]
  88. Brun, D.; Gouin-Vallerand, C.; George, S. Augmented human mind: Case of reasoning. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2017 ACM International Symposium on Wearable Computers, Maui, HI, USA, 11–15 September 2017; ACM: New York, NY, USA, 2017; pp. 717–723. [Google Scholar] [CrossRef]
  89. Zhu, H.; Elfar, M.; Pajic, M.; Wang, Z.; Cummings, M.L. Human Augmentation of UAV Cyber-Attack Detection. In Augmented Cognition: Users and Contexts; Schmorrow, D.D., Fidopiastis, C.M., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 154–167. [Google Scholar]
  90. Kim, C.; Yoon, H.C.; Kim, D.H.; Do, Y.R. Spectroscopic Influence of Virtual Reality and Augmented Reality Display Devices on the Human Nonvisual Characteristics and Melatonin Suppression Response. IEEE Photonics J. 2018, 10, 1–11. [Google Scholar] [CrossRef]
  91. Chalvatzaki, G.; Papageorgiou, X.S.; Tzafestas, C.S.; Maragos, P. Augmented Human State Estimation Using Interacting Multiple Model Particle Filters With Probabilistic Data Association. IEEE Robot. Autom. Lett. 2018, 3, 1872–1879. [Google Scholar] [CrossRef]
  92. Fernandes, T. The business of UX: Human Augmentation-Beyond Wearables. Interactions 2016, 23, 66–68. [Google Scholar] [CrossRef]
  93. Fan, K.; Huber, J.; Nanayakkara, S.; Inami, M. SpiderVision: Extending the Human Field of View for Augmented Awareness. In Proceedings of the 5th Augmented Human International Conference, Kobe, Japan, 7–9 March 2014; ACM: New York, NY, USA, 2014. [Google Scholar] [CrossRef]
  94. Suzuki, K. Augmented Human Technology. In Cybernics: Fusion of Human, Machine and Information Systems; Springer: Tokyo, Japan, 2014; pp. 111–131. [Google Scholar] [CrossRef]
  95. Raisamo, R.; Rakkolainen, I.; Majaranta, P.; Salminen, K.; Rantala, J.; Farooq, A. Human augmentation: Past, present and future. Int. J. Hum. Comput. Stud. 2019, 131, 131–143. [Google Scholar] [CrossRef]
  96. Lau, H.F.; Sutrisno, A.; Chong, T.H.; Braun, D.J. Stiffness Modulator: A Novel Actuator for Human Augmentation. In Proceedings of the 2018 IEEE International Conference on Robotics and Automation, Brisbane, Australia, 21–25 May 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 7742–7748. [Google Scholar] [CrossRef]
  97. Woo, W. Augmented human: Augmented reality and beyond. In Proceedings of the 3rd International Workshop on Multimedia Alternate Realities, Seoul, Korea, 22 October 2018; ACM: New York, NY, USA, 2018. [Google Scholar] [CrossRef]
  98. Kim, S.; Cheong, H.; Park, J.; Park, S. Human augmented mapping for indoor environments using a stereo camera. In Proceedings of the 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, MO, USA, 10–15 October 2009; IEEE: Piscataway, NJ, USA, 2009; pp. 5609–5614. [Google Scholar] [CrossRef]
  99. Kunze, K.; Minamizawa, K.; Lukosch, S.; Inami, M.; Rekimoto, J. Superhuman Sports: Applying Human Augmentation to Physical Exercise. IEEE Pervasive Comput. 2017, 16, 14–17. [Google Scholar] [CrossRef]
  100. Moritz, J. Augmented humanity. Technoetic Arts 2017, 15, 341–352. [Google Scholar] [CrossRef]
  101. Oertelt, N.; Arabian, A.; Brugger, E.; Choros, M.; Farahany, N.; Payne, S.; Rosellini, W. Human by design: An ethical framework for human augmentation. IEEE Technol. Soc. Mag. 2017, 36, 32–36. [Google Scholar] [CrossRef]
  102. Bright, L.Z. Supernumerary Robotic Limbs for Human Augmentation in Overhead Assembly Tasks. Master’s Thesis, Massachusetts Institute of Technology, Cambridge, MA, USA, 2017. [Google Scholar]
  103. Abroug, N.; Lamy, X.; Laroche, E. Human force augmentation: Optimal control parameters tuning using structured H∞ synthesis. In Proceedings of the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems, Daejeon, Korea, 9–14 October 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 702–709. [Google Scholar] [CrossRef]
  104. Hafi, L.E.; Isobe, S.; Tabuchi, Y.; Katsumata, Y.; Nakamura, H.; Fukui, T.; Matsuo, T.; Ricardez, G.A.G.; Yamamoto, M.; Taniguchi, A.; et al. System for augmented human—robot interaction through mixed reality and robot training by non-experts in customer service environments. Adv. Robot. 2020, 34, 157–172. [Google Scholar] [CrossRef]
  105. Becker, V. Augmented humans interacting with an augmented world. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services, Barcelona, Spain, 3–6 September 2018; ACM: New York, NY, USA, 2018; pp. 428–429. [Google Scholar] [CrossRef]
  106. Casebeer, W.D.; Ziegler, M.; Kraft, A.E.; Poleski, J.; Russell, B. Human Performance Augmentation in Context: Using Artificial Intelligence to Deal with Variability—An Example from Narrative Influence. In Augmented Cognition: Users and Contexts; Springer International Publishing: Cham, Switzerland, 2018; pp. 32–42. [Google Scholar]
  107. Roth, D.; Bente, G.; Kullmann, P.; Mal, D.; Purps, C.; Vogeley, K.; Latoschik, M. Technologies for social augmentations in user-embodied virtual reality. In Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology, Parramatta, Australia, 12–15 November 2019; ACM: New York, NY, USA, 2019; p. 5. [Google Scholar] [CrossRef] [Green Version]
  108. Vatavu, R.D. Augmented photoware interfaces for affective human-human interactions. In Proceedings of the 3rd International Workshop on Affective Interaction in Natural Environments, Firenze, Italy, 29 October 2010; ACM: New York, NY, USA, 2010; pp. 93–96. [Google Scholar] [CrossRef]
  109. Humphrey, C.M.; Adams, J.A. Human roles for robot augmented first response. In Proceedings of the 2015 IEEE International Symposium on Safety, Security, and Rescue Robotics, West Lafayette, IN, USA, 18–20 October 2015; IEEE: Piscataway, NJ, USA, 2015; pp. 1–6. [Google Scholar] [CrossRef]
  110. Daily, M.; Oulasvirta, A.; Rekimoto, J. Technology for human augmentation. Computer 2017, 50, 12–15. [Google Scholar] [CrossRef]
  111. Yumura, T.; Nakamura, S. Augmented typing: Augmentation of keyboard typing experience by adding visual and sound effects. In Proceedings of the Asian CHI Symposium 2019: Emerging HCI Research Collection, Glasgow, UK, 4–9 May 2019; ACM: New York, NY, USA, 2019; pp. 53–59. [Google Scholar] [CrossRef]
  112. Yang, S.H.; Kim, H.W.; Kim, M.Y. Human visual augmentation using wearable glasses with multiple cameras and information fusion of human eye tracking and scene understanding. In Proceedings of the 2011 6th ACM/IEEE International Conference on Human-Robot Interaction, Lausanne, Switzerland, 6–9 March 2011; ACM: New York, NY, USA, 2011; pp. 287–288. [Google Scholar]
  113. Doswell, J.; Anderson, M.; Wilson, K.; Kazanzides, P. Wearable augmented reality for medical first response & situational awareness. In Proceedings of the Medicine Meets Virtual Reality NextGen Conference, Newport Beach, CA, USA, 9–12 February 2012; IOS Press: Amsterdam, The Netherlands, 2012. [Google Scholar]
  114. Li, L.; Cui, M. Human-system cooperative hybrid augmented intelligence based dynamic dispatching framework of semiconductor wafer fabrication facility. In Proceedings of the 2018 IEEE International Conference on Smart Manufacturing, Industrial Logistics Engineering, Hsinchu, Taiwan, 8–9 February 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 1–5. [Google Scholar] [CrossRef]
  115. Xia, C.; Maes, P. The design of artifacts for augmenting intellect. In Proceedings of the 4th Augmented Human International Conference, Stuttgart, Germany, 7–8 March 2013; ACM: New York, NY, USA, 2013; pp. 154–161. [Google Scholar] [CrossRef] [Green Version]
  116. Schmidt, A. Augmenting human intellect and amplifying perception and cognition. IEEE Pervasive Comput. 2017, 16, 6–10. [Google Scholar] [CrossRef]
  117. Ueda, T.; Iwai, D.; Hiraki, T.; Sato, K. Illuminated focus: Vision augmentation using spatial defocusing via focal sweep eyeglasses and high-speed projector. IEEE Trans. Vis. Comput. Graph. 2020, 26, 2051–2061. [Google Scholar] [CrossRef] [Green Version]
  118. Seigneur, J.M. The Emotional Economy for the Augmented Human. In Proceedings of the 2nd Augmented Human International Conference, Tokyo, Japan, 13 March 2011; ACM: New York, NY, USA, 2011. AH’11. [Google Scholar] [CrossRef]
  119. Bâce, M. Augmenting human interaction capabilities with proximity, natural gestures, and eye gaze. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services, Vienna, Austria, 4–7 September 2017; ACM: New York, NY, USA, 2017; p. 71. [Google Scholar] [CrossRef]
  120. Zhu, Z.; Blanke, U.; Tröster, G. Inferring Travel Purpose from Crowd-Augmented Human Mobility Data. In Proceedings of the First International Conference on IoT in Urban Space, Rome, Italy, 27–28 October 2014; Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering: Brussels, Belgium, 2014; pp. 44–49. [Google Scholar] [CrossRef] [Green Version]
  121. Maier, M.; Ebrahimzadeh, A.; Chowdhury, M. The Tactile Internet: Automation or Augmentation of the Human? IEEE Access 2018, 6, 41607–41618. [Google Scholar] [CrossRef]
  122. Kim, S.; Dey, A. Augmenting human senses to improve the user experience in cars: Applying augmented reality and haptics approaches to reduce cognitive distances. Multimed. Tools Appl. 2016, 75, 9587–9607. [Google Scholar] [CrossRef]
  123. Ahmed, A.I.A.; Cheng, H.; Liu, H.; Lin, X.; Atieno, M.J. Interaction Force Convex Reduction for Smooth Gait Transitions on Human-Power Augmentation Lower Exoskeletons. In Cognitive Systems and Signal Processing; Sun, F., Liu, H., Hu, D., Eds.; Springer: Singapore, 2017; pp. 398–407. [Google Scholar]
  124. Dias, A.; Ordaz, M.; Cruz-Cunha, M. The wisdom innovation model - Adjusting new insights and hosting new perspectives to human augmented reality. In ENTERprise Information Systems; Springer International Publishing: Cham, Switzerland, 2011; pp. 73–85. [Google Scholar] [CrossRef]
  125. Xie, H.; Mitsuhashi, K.; Torii, T. Augmenting human with a tail. In Proceedings of the 10th Augmented Human International Conference, Reims, France, 11–12 March 2019; ACM: New York, NY, USA, 2019; p. 35. [Google Scholar] [CrossRef]
  126. Topp, E.A. Interaction patterns in human augmented mapping. Adv. Robot. 2017, 31, 258–267. [Google Scholar] [CrossRef]
  127. Popovici, I.; Vatavu, R.D. Towards visual augmentation of the television watching experience: Manifesto and agenda. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video, Salford, UK, 5–7 June 2019; ACM: New York, NY, USA, 2019; pp. 199–204. [Google Scholar] [CrossRef]
  128. Niforatos, E.; Laporte, M.; Bexheti, A.; Langheinrich, M. Augmenting Memory Recall in Work Meetings: Establishing a Quantifiable Baseline. In Proceedings of the 9th Augmented Human International Conference, Seoul, Korea, 7–9 February 2018; ACM: New York, NY, USA, 2018. [Google Scholar] [CrossRef]
  129. Huang, R.; Cheng, H.; Chen, Q.; Tran, H.T.; Lin, X. Interactive learning for sensitivity factors of a human-powered augmentation lower exoskeleton. In Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems, Hamburg, Germany, 28 September–2 October 2015; IEEE: Piscataway, NJ, USA, 2015; pp. 6409–6415. [Google Scholar] [CrossRef]
  130. Wakisaka, S.; Hiyama, A.; Inami, M. Transmission of Experiences with Augmented Human Techniques. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, Maui, HI, USA, 11–15 September 2017; ACM: New York, NY, USA, 2017; pp. 740–744. [Google Scholar] [CrossRef]
  131. Chen, Z.; Tong, W.; Wang, Q.; Bach, B.; Qu, H. Augmenting Static Visualizations with PapARVis Designer. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25–30 April 2020; ACM: New York, NY, USA, 2020; pp. 1–12. [Google Scholar] [CrossRef]
  132. Rekimoto, J. Internet of abilities: Human augmentation, and beyond 2017 (keynote). In Proceedings of the 2017 IEEE Symposium on 3D User Interfaces, Los Angeles, CA, USA, 18–19 March 2017; IEEE: Piscataway, NJ, USA, 2017. [Google Scholar] [CrossRef] [Green Version]
  133. Materna, Z.; Kapinus, M.; Beran, V.; SmrĚ, P.; Giuliani, M.; Mirnig, N.; Stadler, S.; Stollberger, G.; Tscheligi, M. Using persona, scenario, and use case to develop a human-robot augmented reality collaborative workspace. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, Vienna, Austria, 6–9 March 2017; ACM: New York, NY, USA, 2017; pp. 201–202. [Google Scholar] [CrossRef]
  134. Huseynov, E.; Seigneur, J. Beacon authpath: Augmented human path authentication. In Proceedings of the 2016 IEEE 10th International Conference on Application of Information and Communication Technologies, Baku, Azerbaijan, 12–16 October 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 1–5. [Google Scholar] [CrossRef] [Green Version]
  135. Kymäläinen, T. Introduction to the special session: Design and research for advanced human augmentation. In Proceedings of the 2016 12th International Conference on Intelligent Environments, London, UK, 14–16 September 2016; IEEE: Piscataway, NJ, USA, 2016. [Google Scholar] [CrossRef]
  136. Braun, D.J.; Chalvet, V.; Chong, T.H.; Apte, S.S.; Hogan, N. Variable stiffness spring actuators for low-energy-cost human augmentation. IEEE Trans. Robot. 2019, 35, 1435–1449. [Google Scholar] [CrossRef]
  137. Bowles, B.; Hancock, M.; Kirshner, M.; Shaji, T. Biomimetic Design in Augmented Cognition. In Proceedings of the International Conference on Human-Computer Interaction, Copenhagen, Denmark, 19–24 July 2020; Springer International Publishing: Cham, Switzerland, 2020; pp. 226–240. [Google Scholar]
  138. Kasahara, S.; Rekimoto, J. JackIn: Integrating first-person View with out-of-body vision generation for human-human augmentation. In Proceedings of the 5th Augmented Human International Conference, Kobe, Japan, 7–9 March 2014; ACM: New York, NY, USA, 2014; p. 46. [Google Scholar] [CrossRef]
  139. Nijholt, A. Virtual and Augmented Reality Animals in Smart and Playful Cities: (Invited Paper). In Proceedings of the 2020 Joint 9th International Conference on Informatics, Electronics Vision and 2020 4th International Conference on Imaging, Vision Pattern Recognition, Kitakyushu, Japan, 16–20 August 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 1–7. [Google Scholar] [CrossRef]
  140. Marcheschi, S.; Salsedo, F.; Fontana, M.; Bergamasco, M. Body Extender: Whole body exoskeleton for human power augmentation. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011; IEEE: Piscataway, NJ, USA, 2011; pp. 611–616. [Google Scholar] [CrossRef]
  141. Obushi, N.; Wakisaka, S.; Kasahara, S.; Hiyama, A.; Inami, M. MagniFinger: Fingertip-mounted microscope for augmenting human perception. In Proceedings of the ACM SIGGRAPH 2019 Posters, Los Angeles, CA, USA, 28 July 2019; ACM: New York, NY, USA, 2019; p. 2. [Google Scholar] [CrossRef]
  142. Hartholt, A.; Mozgai, S.; Fast, E.; Liewer, M.; Reilly, A.; Whitcup, W.; Rizzo, A. Virtual humans in augmented reality: A first step towards real-world embedded virtual roleplayers. In Proceedings of the 7th International Conference on Human-Agent Interaction, Kyoto, Japan, 6–10 October 2019; ACM: New York, NY, USA, 2019; pp. 205–207. [Google Scholar] [CrossRef]
  143. Ras, E.; Wild, F.; Stahl, C.; Baudet, A. Bridging the Skills Gap of Workers in Industry 4.0 by Human Performance Augmentation Tools: Challenges and Roadmap. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments (PETRA’17), Rhodes Greece, 21–23 June 2017; ACM: New York, NY, USA, 2017; pp. 428–432. [Google Scholar] [CrossRef] [Green Version]
  144. Altarriba Bertran, F.; Jhaveri, S.; Lutz, R.; Isbister, K.; Wilde, D. Making Sense of Human-Food Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK, 4–9 May 2019; ACM: New York, NY, USA, 2019; pp. 1–13. [Google Scholar]
  145. Ioannou, C.; Archard, P.; O’Neill, E.; Lutteroth, C. Virtual performance augmentation in an immersive jump & run exergame. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK, 4–9 May 2019; ACM: New York, NY, USA, 2019; p. 158. [Google Scholar] [CrossRef]
  146. Chen, S.; Chen, Z.; Yao, B.; Zhu, X.; Zhu, S.; Wang, Q.; Song, Y. Cascade force control of lower limb hydraulic exoskeleton for human performance augmentation. In Proceedings of the 42nd Annual Conference of the IEEE Industrial Electronics Society, Florence, Italy, 24–27 October 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 512–517. [Google Scholar] [CrossRef]
  147. Koay, T.; Yeo, S.; Tan, G.; Tan, S.; Seekings, P.; Chitre, M. Measuring the augmented sound localization ability of humans in the underwater environment. In Proceedings of the OCEANS 2010 MTS/IEEE SEATTLE, Seattle, WA, USA, 20–23 September 2010; IEEE: Piscataway, NJ, USA, 2010; pp. 1–6. [Google Scholar] [CrossRef]
  148. Helin, K.; Karjalainen, J.; Kuula, T.; Philippon, N. Virtual/Mixed/Augmented Reality Laboratory Research for the Study of Augmented Human and Human-Machine Systems. In Proceedings of the 2016 12th International Conference on Intelligent Environments, London, UK, 14–16 September 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 163–166. [Google Scholar] [CrossRef]
  149. Buruk, O.O.; Özcan, O.; Baykal, G.E.; Göksun, T.; Acar, S.; Akduman, G.; Baytaş, M.A.; Beşevli, C.; Best, J.; Coşkun, A.; et al. Children in 2077: Designing Children’s Technologies in the Age of Transhumanism. In Proceedings of the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25–30 April 2020; ACM: New York, NY, USA, 2020; pp. 1–14. [Google Scholar] [CrossRef]
  150. Peltason, J.; Siepmann, F.H.; Spexard, T.P.; Wrede, B.; Hanheide, M.; Topp, E.A. Mixed-initiative in human augmented mapping. In Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan, 12–17 May 2009; IEEE: Piscataway, NJ, USA, 2009; pp. 2146–2153. [Google Scholar] [CrossRef] [Green Version]
  151. Azbell, J.P.H. Closed-loop tactile augmentation by transcutaneous stimulation on either the foot sole or the palm to improve lateral postural balance. In Proceedings of the 2019 9th International IEEE/EMBS Conference on Neural Engineering, San Francisco, CA, USA, 20–23 March 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 1072–1075. [Google Scholar] [CrossRef]
  152. Ahmed, A.I.A.; Cheng, H.; Abdalla, A.R.; Hongliang, G. Modified admittance control for maneuverable human-powered augmentation lower exoskeleton systems. In Proceedings of the 2017 2nd International Conference on Advanced Robotics and Mechatronics, Hefei and Tai’an, China, 27–31 August 2017; IEEE: Piscataway, NJ, USA, 2017; pp. 7–12. [Google Scholar] [CrossRef]
  153. Chen, M.; Ma, Y.; Li, Y.; Wu, D.; Zhang, Y.; Youn, C. Wearable 2.0: Enabling human-cloud integration in next generation healthcare systems. IEEE Commun. Mag. 2017, 55, 54–61. [Google Scholar] [CrossRef]
  154. Nambi SN, A.U.; Gonzalez, L.; Prasad, R.V. CoachMe: Activity Recognition Using Wearable Devices for Human Augmentation. In Proceedings of the 2017 International Conference on EmbeddedWireless Systems and Networks, Uppsala, Sweden, 20–22 February 2017; Junction Publishing: Junction, TX, USA, 2017; pp. 174–179. [Google Scholar] [CrossRef]
  155. Brown, G.; Wu, M.; Huang, F.; Gordon, K. Movement augmentation to evaluate human control of locomotor stability. In Proceedings of the 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Jeju, Korea, 11–15 July 2017; IEEE: Piscataway, NJ, USA, 2017; pp. 66–69. [Google Scholar] [CrossRef]
  156. Danry, V.; Pataranutaporn, P.; Mao, Y.; Maes, P. Wearable Reasoner: Towards Enhanced Human Rationality Through A Wearable Device With An Explainable AI Assistant. In Proceedings of the Augmented Humans International Conference, Kaiserslautern, Germany, 16–17 March 2020; ACM: New York, NY, USA, 2020. [Google Scholar] [CrossRef]
  157. Langheinrich, M.; Davies, N. Co-creation and Risk-Taking—In Pursuit of New Technology for Human Augmentation: An Interview with Pranav Mistry. IEEE Pervasive Comput. 2018, 17, 44–49. [Google Scholar] [CrossRef]
  158. Schmidt, A.; Schneegass, S.; Kunze, K.; Rekimoto, J.; Woo, W. Workshop on Amplification and Augmentation of Human Perception. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Denver, CO, USA, 6–11 May 2017; ACM: New York, NY, USA, 2017; pp. 668–673. [Google Scholar] [CrossRef]
  159. Sidaoui, A.; Elhajj, I.H.; Asmar, D. Collaborative human augmented SLAM. In Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, Macau, China, 3–8 November 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 2131–2138. [Google Scholar] [CrossRef]
  160. Doswell, J.; Skinner, A.; Schmorrow, D.; Fidopiastis, C. Augmenting human cognition with adaptive augmented reality. In Foundations of Augmented Cognition. Advancing Human Performance and Decision-Making through Adaptive Systems; Springer International Publishing: Cham, Switzerland, 2014; pp. 104–113. [Google Scholar] [CrossRef]
  161. Gupta, A.; Lin, B.; Ji, S.; Patel, A.; Vogel, D. Replicate and Reuse: Tangible Interaction Design for Digitally-Augmented Physical Media Objects. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25–30 April 2020; ACM: New York, NY, USA, 2020; p. 3376139. [Google Scholar] [CrossRef]
  162. Sadin, E. La Humanidad Aumentada: La Administración Digital del Mundo; Caja Negra: Buenos Aires, Argentina, 2017. [Google Scholar]
  163. Spier, R.F. From the Hand of Man: Primitive and Preindustrial Technologies; Houghton Mifflin: Boston, MA, USA, 1970. [Google Scholar]
  164. Bleed, P. Content as Variability, Result as Selection: Toward a Behavioral Definition of Technology. Archaeol. Pap. Am. Anthropol. Assoc. 1997, 7, 95–104. [Google Scholar] [CrossRef]
  165. Salomon, J. What is technology? The issue of its origins and definitions. Hist. Technol. 1984, 1, 113–156. [Google Scholar] [CrossRef]
  166. Farooq, U.; Grudin, J.; Shneiderman, B.; Maes, P.; Ren, X. Human Computer Integration versus Powerful Tools. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Denver, CO, USA, 6–11 May 2017; ACM: New York, NY, USA, 2017; pp. 1277–1282. [Google Scholar] [CrossRef]
  167. Alicea, B. An integrative introduction to human augmentation science. arXiv 2018, arXiv:1804.10521. [Google Scholar]
  168. Romero, D.; Bernus, P.; Noran, O.; Stahre, J.; Fast-Berglund, A. The Operator 4.0: Human Cyber-Physical Systems & Adaptive Automation Towards Human-Automation Symbiosis Work Systems. In Advances in Production Management Systems Initiatives for a Sustainable World; Naas, I., Vendrametto, O., Mendes Reis, J., Gonçalves, R.F., Silva, M.T., von Cieminski, G., Kiritsis, D., Eds.; Springer International Publishing: Berlin/Heidelberg, Germany, 2016; pp. 677–686. [Google Scholar] [CrossRef] [Green Version]
  169. De Boeck, M.; Vaes, K. Structuring human augmentation within product design. Proc. Des. Soc. 2021, 1, 2731–2740. [Google Scholar] [CrossRef]
  170. Higgins, J.P.T.; Altman, D.G. Assessing risk of bias in included studies. In Cochrane Handbook for Systematic Reviews of Interventions; John Wiley & Sons, Ltd.: Hoboken, NJ, USA, 2008; pp. 187–241, Chapter 8. [Google Scholar] [CrossRef]
Sensors 22 00514 g001 550
Figure 1. Process followed to obtain the systematic mapping review on AH [24].
Figure 1. Process followed to obtain the systematic mapping review on AH [24].
Sensors 22 00514 g001
Sensors 22 00514 g002 550
Figure 2. Process followed to obtain the AH systematic mapping.
Figure 2. Process followed to obtain the AH systematic mapping.
Sensors 22 00514 g002
Sensors 22 00514 g003 550
Figure 3. Total number of articles published per year that mention AH.
Figure 3. Total number of articles published per year that mention AH.
Sensors 22 00514 g003
Sensors 22 00514 g004 550
Figure 4. Web of Science research areas assigned to the 133 publications.
Figure 4. Web of Science research areas assigned to the 133 publications.
Sensors 22 00514 g004
Sensors 22 00514 g005 550
Figure 5. Number of keyword repetitions per area.
Figure 5. Number of keyword repetitions per area.
Sensors 22 00514 g005
Sensors 22 00514 g006 550
Figure 6. Publication venues of research articles.
Figure 6. Publication venues of research articles.
Sensors 22 00514 g006
Sensors 22 00514 g007 550
Figure 7. Top Keywords with repetition.
Figure 7. Top Keywords with repetition.
Sensors 22 00514 g007
Sensors 22 00514 g008 550
Figure 8. Number of article citations and article views per year of publication.
Figure 8. Number of article citations and article views per year of publication.
Sensors 22 00514 g008
Table
Table 1. Search strings.
Table 1. Search strings.
DatabaseSearch String
ACM[[[Publication Title: augmented] AND [Publication Title: human]] OR [[Publication Title: human] AND [Publication Title: augmentation]] OR [Publication Title: human +] OR [Publication Title: “2.0”]] AND [[[Abstract: augmented] AND [Abstract: human]] OR [[Abstract: human] AND [Abstract: augmentation]] OR [Abstract: human +] OR [Abstract: “2.0”]] AND [[[Keywords: augmented] AND [Keywords: human]] OR [[Keywords: human] AND [Keywords: augmentation]] OR [Keywords: human +] OR [Keywords: “2.0”]] AND [Publication Date: (01/01/2009 TO 31/12/2020)]
IEEE(((((((((”Document Title”:augmented human) OR “Document Title”:human augmentation) OR “Document Title”:human 2.0) OR “Author Keywords”:augmented human) OR “Author Keywords”:human augmentation) OR “Author Keywords”:human 2.0) OR “Abstract”:augmented human) OR “Abstract”:human augmentation) OR “Abstract”:human 2.0)
ScopusTITLE-ABS-KEY((augmented AND (human OR humanity)) OR (human AND (augmentation OR “2.0”))) AND (LIMIT-TO(SUBJAREA, “COMP”)) AND (LIMIT-TO (LANGUAGE, “English”))
Table
Table 2. Database search results.
Table 2. Database search results.
DatabaseNumerical StudiesTotal Studies
ACM3424
IEEE164516,914
Scopus11,845
Table
Table 3. Extracted data items.
Table 3. Extracted data items.
#Data ItemDescription
1IdentifierPaper identification
2YearPublication year
3TitleTitle of the paper
4AuthorsAuthors of the paper
5Publication channelChannel for publishing the paper
6KeywordsKeywords of the paper
7Research areaResearch areas taken from Web of Science
8CategoryResearch categories taken from Web of Science
9Paper contributionsMain contributions of the paper
10SummaryOur own summary or abstract of the paper
Table
Table 4. Articles that contain the search keywords in their title.
Table 4. Articles that contain the search keywords in their title.
ArticleDatabaseYearArticleDatabaseYearArticleDatabaseYear
[33]IEEE, Scopus2020[34]IEEE, Scopus2019[35]ACM, Scopus2020
[36]Scopus2014[37]Scopus2019[38]ACM, Scopus2011
[39]Scopus2020[40]Scopus2019[41]IEEE, Scopus2018
[42]IEEE, Scopus2016[43]IEEE2017[44]IEEE, Scopus2016
[45]ACM, Scopus2018[46]ACM, Scopus2018[47]IEEE, Scopus2012
[48]Scopus, ACM2020[49]IEEE2019[50]Scopus, IEEE2012
[51]IEEE, Scopus, ACM2020[52]IEEE, Scopus2010[53]Scopus2013
[54]ACM, Scopus2018[55]Scopus, ACM2011[56]ACM, Scopus2010
[57]Scopus, ACM2015[58]IEEE, Scopus2013[59]Scopus2016
[60]IEEE, Scopus2017[61]Scopus, IEEE, ACM2018[62]Scopus, ACM2020
[63]Scopus, IEEE2018[64]ACM2020[65]ACM, Scopus, IEEE2019
[66]IEEE, Scopus2020[67]Scopus, ACM2013[62]ACM, Scopus2016
[68]IEEE, Scopus2020[69]Scopus, IEEE2020[70]Scopus, IEEE2017
[71]Scopus2017[72]Scopus, ACM2019[73]Scopus2020
[74]IEEE, Scopus, ACM2016[10]IEEE2013[75]Scopus, IEEE2010
[76]ACM, Scopus2018[77]ACM, Scopus2017[78]IEEE, Scopus2019
[79]ACM, Scopus2016[80]IEEE, Scopus, ACM2016[81]ACM, Scopus2014
[82]IEEE, Scopus2017[83]Scopus2018[84]IEEE, Scopus2010
[85]Scopus2014[86]Scopus, ACM2017[87]Scopus2017
[88]ACM, Scopus2017[89]Scopus2018[90]IEEE, Scopus2018
[91]IEEE, Scopus2018[92]ACM, Scopus2016[93]ACM, Scopus2014
[94]Scopus2014[95]Scopus2019[96]IEEE, Scopus2018
[97]ACM, Scopus2018[98]IEEE, Scopus, ACM2009[99]IEEE, Scopus, ACM2017
[100]Scopus2017[101]IEEE2017[102]Scopus2017
[12]Scopus2020[103]IEEE, Scopus, ACM2016[104]Scopus2020
[105]ACM2018[106]Scopus2018[107]ACM, Scopus2019
[108]ACM, Scopus2010[109]IEEE, Scopus, ACM2015[110]IEEE2017
[111]ACM, Scopus2019[112]ACM, Scopus, IEEE2011[92]Scopus, ACM2016
[113]Scopus2014[114]IEEE, Scopus2018[115]ACM, Scopus2013
[116]IEEE, Scopus, ACM2017[117]IEEE, Scopus2020[118]ACM, Scopus2011
[119]ACM, Scopus2017[120]ACM2014[121]IEEE, Scopus2018
[122]Scopus, ACM2016[123]Scopus2017[124]Scopus2011
[125]ACM2019[126]Scopus2017[127]ACM, Scopus2019
[128]ACM, Scopus2018[129]IEEE, Scopus2015[130]ACM, Scopus2017
[131]Scopus, ACM2020[132]IEEE2017[133]Scopus, ACM2017
[134]IEEE, Scopus2016[135]IEEE, Scopus2016[136]IEEE, Scopus, IEEE2019
[137]Scopus2020[138]ACM, Scopus2014[139]Scopus, IEEE2020
[140]IEEE, Scopus2011[141]ACM, Scopus2019[142]ACM, Scopus2019
[143]ACM, Scopus2017[144]ACM, Scopus2019[145]ACM, Scopus2019
[146]IEEE, Scopus2016[147]IEEE, Scopus2010[148]IEEE, Scopus2020
[149]ACM, Scopus2020[150]IEEE, Scopus, ACM2009[4]ACM, Scopus2016
[151]Scopus, IEEE2019[152]IEEE, Scopus2017[153]Scopus, ACM, IEEE2017
[154]ACM, Scopus2017[155]IEEE, Scopus2017[156]ACM, Scopus2020
[157]Scopus, IEEE2018[18]ACM, Scopus2016[158]ACM, Scopus2017
[159]IEEE, Scopus2020[160]Scopus2014[161]Scopus, ACM2020
Table
Table 5. Definitions of Augmented Humanity.
Table 5. Definitions of Augmented Humanity.
ArticleDefinition
[119]Augmented Humanity is the improvement of traditional human–human and human–machine interaction by augmenting humans with portable technology and developing new user interfaces.
[105]Computers augmenting humans enable instant information access. Yet, interactions between these two sides, the augmented human within an augmented world, are still different from human–human and from device–device interactions.
[83]Augmented human is a human whose physical, intellectual and social ability are enhanced by the augmented/virtual reality and the smart ICT technology.
[100]Google CEO, Eric Schmidt, has called this “augmented humanity”, where networked devices “just work and understand autonomously” [11].
[87]Human augmentation amplifies and enhances human ability to do work. Encompasses many technologies: prosthetics, orthotics and physically assistive devices that replace missing or lost functions; exoskeletons that extend physical abilities; collaborative systems that work alongside people to fill in and complement human abilities; and socially assistive robots that monitor and motivate human work and effort.
[135]Advanced human augmentation suggests technologies that augment human actions, senses and cognition in new, as yet unexplored ways, in order to enhance human senses, to provide assistive augmentation and to create a seamless technology environment for human interaction.
[97]An augmented human is a person who is able to use AR effectively to expand the physical, intellectual and social abilities of the user.
[162]Augmented humanity refers to the digital administration of the world, where the human converges with computer electronic devices and instruments, generating a natural environment for the user, where even the user is not aware of the new technologies that he is using for himself.
[36]Augmented human refers to a research direction of enhancing or augmenting human abilities by human–computer integration.
[132]Augmented human introduces a fundamental paradigm shift in HCI: from human–computer interaction to human–computer integration, and abilities will be mutually connected through the networks (what we call IoA, or Internet of Abilities, as the next step of IoT, Internet of Things).
[101]Human augmentation is a deliberate act. It is a permanent or temporary bodily intervention that changes or augments otherwise normal ranges of human function.
[110]Technologies that enhance human productivity and improve or restore capabilities of the human body or mind are an area of computing we refer to as human augmentation.
[116]Augmenting human intellect and amplifying perception and cognition as various technologies designed to augment the human intellect and amplify human perception and cognition.
[35]Human–computer integration (HInt) is considered a new paradigm with the key property that computers integrate closely with the user. Such integration occurs primarily at the individual level through sensory fusion, with computers providing information directly to the human senses rather than through symbolic representations and understanding the implicit and precognitive needs of the user through biosensitization. However, there is also the observation that this integration occurs at a social level, where the human being and the interface agents make a coordinated effort to achieve a common goal.
[95]Human augmentation is an interdisciplinary field that addresses methods, technologies and their applications for enhancing sensing, action and/or cognitive abilities of a human. This is achieved through sensing and actuation technologies, fusion and fission of information and artificial intelligence methods.
[12]AH involves augmenting humans with devices that can collect data from the individual and the individuals’ environment and transmit this data to an external device or service.
[64]Human augmentation is an approach to enhancing and empowering human functions with information technologies utilizing robotics and sensing devices.
Table
Table 6. Number of citations and readings to publications defining AH.
Table 6. Number of citations and readings to publications defining AH.
ArticleCitationsViewsYearArticleCitationsViewsYear
[119]22062017[132]12052017
[105]0872018[101]411482017
[83]211002018[110]525952017
[100]0102017[116]2811732017
[87]103(*)2017[35]4718192020
[135]02332016[95]412022019
[97]22182018[12]011002020
[162]011012017[64]46392020
[36]524,0002014
(*) No information provided.
Table
Table 7. Number of citations and readings of publications related to AH.
Table 7. Number of citations and readings of publications related to AH.
ArticleCitationsViewsArticleCitationsViewsArticleCitationsViews
[108]0191[145]22744[159]2180
[98]11225[142]9398[78]040
[84]2627[111]258[66]3352
[61]603484[117]6256[95]41202
[88]1158[127]11148[37]1573
[138]1041181[141]0230[151]5115
[18]18742[107]311247[33]1149
[134]2140[65]1202[39]31300
[160]132400[125]13299[149]5403
[70])17733[115]31422[139]088
[124]21300[136]131333[148]7724
[133]5231[68]295[156]2493
[153]2553720
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Guerrero, G.; da Silva, F.J.M.; Fernández-Caballero, A.; Pereira, A. Augmented Humanity: A Systematic Mapping Review. Sensors 2022, 22, 514. https://doi.org/10.3390/s22020514

AMA Style

Guerrero G, da Silva FJM, Fernández-Caballero A, Pereira A. Augmented Humanity: A Systematic Mapping Review. Sensors. 2022; 22(2):514. https://doi.org/10.3390/s22020514

Chicago/Turabian Style

Guerrero, Graciela, Fernando José Mateus da Silva, Antonio Fernández-Caballero, and António Pereira. 2022. "Augmented Humanity: A Systematic Mapping Review" Sensors 22, no. 2: 514. https://doi.org/10.3390/s22020514

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop