Skip to Content

Multimodal Technologies and Interaction, Volume 2, Issue 3

2018 September - 27 articles

  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (27)

  • Article
  • Open Access
79 Citations
12,179 Views
19 Pages

Perceptions on Authenticity in Chat Bots

  • Mario Neururer,
  • Stephan Schlögl,
  • Luisa Brinkschulte and
  • Aleksander Groth

In 1950, Alan Turing proposed his concept of universal machines, emphasizing their abilities to learn, think, and behave in a human-like manner. Today, the existence of intelligent agents imitating human characteristics is more relevant than ever. Th...

  • Article
  • Open Access
22 Citations
7,491 Views
27 Pages

Educational content of many kinds and from many disciplines are increasingly presented in the form of short videos made broadly accessible via platforms such as YouTube. We argue that understanding how such communicative forms function effectively (o...

(This article belongs to the Special Issue Multimodal Learning)
  • Article
  • Open Access
1 Citations
5,045 Views
12 Pages

Architecting 3D Interactive Educational Applications for the Web: The Case Study of CrystalWalk

  • Fernando Bardella,
  • Rafael Castilho de Moraes,
  • Thanos Saringelos,
  • Alexandros Karatzaferis,
  • Andre Montes Rodrigues,
  • Andre Gomes da Silva and
  • Ricardo Mendes Leal Neto

This paper describes the technical development of CrystalWalk, a crystal editor and visualization software designed for teaching materials science and engineering aiming to provide an accessible and interactive platform to students, professors and re...

  • Review
  • Open Access
195 Citations
21,422 Views
24 Pages

Review of Deep Learning Methods in Robotic Grasp Detection

  • Shehan Caldera,
  • Alexander Rassau and
  • Douglas Chai

For robots to attain more general-purpose utility, grasping is a necessary skill to master. Such general-purpose robots may use their perception abilities to visually identify grasps for a given object. A grasp describes how a robotic end-effector ca...

  • Article
  • Open Access
15 Citations
4,984 Views
12 Pages

Tele-Guidance System to Support Anticipation during Communication

  • Takuya Yamamoto,
  • Mai Otsuki,
  • Hideaki Kuzuoka and
  • Yusuke Suzuki

Tele-guidance systems for the remote monitoring and maintenance of equipment have been extensively investigated. Such systems enable a remote helper to provide guidance to a local worker while perceiving local conditions. In this study, we propose a...

  • Article
  • Open Access
2 Citations
5,224 Views
17 Pages

Tangible technologies are considered promising tools for learning, by enabling multimodal interaction through physical action and manipulation of physical and digital elements, thus facilitating representational concrete–abstract links. A key c...

(This article belongs to the Special Issue Multimodal Learning)
  • Review
  • Open Access
16 Citations
5,683 Views
10 Pages

The purpose of this paper is to review the scholarly works regarding social embodiment aligned with the design of non-player characters in virtual reality (VR)-based social skill training for autistic children. VR-based social skill training for auti...

(This article belongs to the Special Issue Emotions in Robots: Embodied Interaction in Social and Non-Social Environments)
  • Article
  • Open Access
34 Citations
19,591 Views
39 Pages

Social robots are being designed to help support people’s well-being in domestic and public environments. To address increasing incidences of psychological and emotional difficulties such as loneliness, and a shortage of human healthcare worker...

(This article belongs to the Special Issue Emotions in Robots: Embodied Interaction in Social and Non-Social Environments)
  • Review
  • Open Access
11 Citations
13,170 Views
14 Pages

Animals Make Music: A Look at Non-Human Musical Expression

  • Reinhard Gupfinger and
  • Martin Kaltenbrunner

The use of musical instruments and interfaces that involve animals in the interaction process is an emerging, yet not widespread practice. The projects that have been implemented in this unusual field are raising questions concerning ethical principl...

  • Article
  • Open Access
60 Citations
10,067 Views
19 Pages

Maker Literacies and Maker Citizenship in the MakEY (Makerspaces in the Early Years) Project

  • Jackie Marsh,
  • Hans Christian Arnseth and
  • Kristiina Kumpulainen

In this paper, the potential relationship between creative citizenship and what may be termed ‘maker literacies’ is examined in the light of emergent findings from an international project on the use of makerspaces in early childhood, &ld...

(This article belongs to the Special Issue Multimodal Learning)
  • Article
  • Open Access
12 Citations
9,970 Views
17 Pages

This article is concerned with digital, multimodal feedback that supports learning and assessment within education. Drawing on the research literature alongside a case study from a postgraduate program in digital education, I argue that approaching f...

(This article belongs to the Special Issue Multimodal Learning)
  • Article
  • Open Access
35 Citations
10,024 Views
27 Pages

There is an increasing interest in the use of intelligent virtual agents (IVAs) to work in teams with humans. To achieve successful outcomes for these heterogeneous teams, many of the aspects found in successful human teams will need to be supported....

  • Review
  • Open Access
480 Citations
27,627 Views
12 Pages

In this review the application of deep learning for medical diagnosis is addressed. A thorough analysis of various scientific articles in the domain of deep neural networks application in the medical field has been conducted. More than 300 research a...

  • Article
  • Open Access
2 Citations
6,182 Views
16 Pages

Analyzing Iterative Training Game Design: A Multi-Method Postmortem Analysis of CYCLES Training Center and CYCLES Carnivale

  • Adrienne Shaw,
  • Brian McKernan,
  • Rosa M. Martey,
  • Jennifer Stromer-Galley,
  • Emilie T. Saulnier,
  • Elizabeth McLaren,
  • Matthew G. Rhodes,
  • James E. Folkestad,
  • Sarah M. Taylor and
  • Tomek Stralkowski
  • + 2 authors

That games can be used to teach specific content has been demonstrated numerous times. However, although specific game features have been conjectured to have an impact on learning outcomes, little empirical research exists on the impact of iterative...

  • Article
  • Open Access
19 Citations
6,480 Views
15 Pages

EyeSpot: Leveraging Gaze to Protect Private Text Content on Mobile Devices from Shoulder Surfing

  • Mohamed Khamis,
  • Malin Eiband,
  • Martin Zürn and
  • Heinrich Hussmann

As mobile devices allow access to an increasing amount of private data, using them in public can potentially leak sensitive information through shoulder surfing. This includes personal private data (e.g., in chat conversations) and business-related c...

  • Article
  • Open Access
1 Citations
4,568 Views
11 Pages

Flavours of Glenroy (2013–4) was an action research project where artists imagined mobile edible gardens as a way to connect and engage with locals through project presentation and execution. As a socially engaged art project, it focused on dev...

  • Review
  • Open Access
15 Citations
5,922 Views
7 Pages

The impact of an aging population on healthcare and the sustainability of our healthcare system are pressing issues in contemporary society. Technology has the potential to address these challenges, alleviating pressures on the healthcare system and...

  • Article
  • Open Access
49 Citations
7,856 Views
19 Pages

The aim of this article is to broadly elaborate on how programming can be understood as a new teaching scope in preschools, focusing specifically on debugging as one of the phases involved in learning to program. The research question How can debuggi...

(This article belongs to the Special Issue Multimodal Learning)
  • Article
  • Open Access
12 Citations
5,758 Views
15 Pages

An increasing body of work provides evidence of the importance of bodily experience for cognition and the learning of mathematics. Sensor-based technologies have potential for guiding sensori-motor engagement with challenging mathematical ideas in ne...

(This article belongs to the Special Issue Multimodal Learning)
  • Article
  • Open Access
6 Citations
5,719 Views
12 Pages

Animal-to-Animal Data Sharing Mechanism for Wildlife Monitoring in Fukushima Exclusion Zone

  • Hill Hiroki Kobayashi,
  • Keijiro Nakagawa,
  • Ko Makiyama,
  • Yuta Sasaki,
  • Hiromi Kudo,
  • Baburam Niraula and
  • Kaoru Sezaki

We propose an animal-to-animal data sharing mechanism that employs wildlife-borne sensing devices to expand the size of monitoring areas in which electricity, information, and road infrastructures are either limited or nonexistent. With the proposed...

  • Article
  • Open Access
17 Citations
8,322 Views
23 Pages

The keystroke-level model (KLM) is commonly used to predict the time it will take an expert user to accomplish a task without errors when using an interactive system. The KLM was initially intended to predict interactions in conventional set-ups, i.e...

  • Article
  • Open Access
13 Citations
6,264 Views
20 Pages

Theories of embodied cognition argue that human processes of thinking and reasoning are deeply connected with the actions and perceptions of the body. Recent research suggests that these theories can be successfully applied to the design of learning...

(This article belongs to the Special Issue Multimodal Learning)
  • Article
  • Open Access
1 Citations
5,258 Views
15 Pages

While the mobile phone is the world’s most popular media device, it is actually not one single medium, but is effectively used as a different medium by different user groups. The article characterizes polymodal differences in mobile apps usage...

  • Article
  • Open Access
18 Citations
7,807 Views
40 Pages

Documenting embodied ideation activities is challenging, as they often result in ephemeral design constructs and elusive design knowledge difficult to document and represent. Here, we explore documentation forms designers can use internally during th...

(This article belongs to the Special Issue Designing for the Body)
  • Article
  • Open Access
18 Citations
8,127 Views
20 Pages

An Exploratory Study of the Uses of a Multisensory Map—With Visually Impaired Children

  • Emeline Brulé,
  • Gilles Bailly,
  • Anke Brock,
  • Annie Gentès and
  • Christophe Jouffrais

This paper reports an empirical study of a multisensory map used by visually impaired primary school pupils, to study human habitats and differences between urban, suburban and rural areas using a local example. Using multimodal analysis, we propose...

(This article belongs to the Special Issue Multimodal Learning)
  • Article
  • Open Access
1 Citations
5,345 Views
20 Pages

Wunderkammers: Powerful Metaphors for ‘Tangible’ Experiential Knowledge Building

  • Patricia Charlton,
  • Adamantios Koumpis,
  • Christos Kouroupetroglou and
  • Muriel Grenon

Research problem: The paper identifies the need to support powerful metaphors that capture innovations of new emerging human computer interaction (HCI) technologies and innovative question and answering (Q&A) systems in the context of spatial lea...

XFacebookLinkedIn
Multimodal Technol. Interact. - ISSN 2414-4088