Robotics, Volume 9, Issue 2 (June 2020) – 29 articles

We present an efficient and generic algorithm for approximating second-order linear boundary value problems through spline collocation. In contrast to the majority of other approaches, our algorithm is designed for over-determined problems. These typically occur in control theory, where a system, e.g., a robot, should be transferred from a certain initial state to a desired target state while respecting characteristic system dynamics. Our method uses polynomials of maximum degree three/five as base functions and generates a cubic/quintic spline, which is ${\mathcal{C}}^2$ / ${\mathcal{C}}^4$ continuous and satisfies the underlying ordinary differential equation at user-defined collocation sites. Moreover, the approximation is forced to fulfill an over-determined set of two-point boundary conditions, which are specified by the given control problem. The algorithm is suitable for time-critical applications, where accuracy only plays a secondary role. For consistent boundary conditions, we experimentally validate convergence towards the analytic solution, while for inconsistent boundary conditions our algorithm is still able to find a “reasonable” approximation. However, to avoid divergence, collocation sites have to be appropriately chosen. The proposed scheme is evaluated experimentally through comparison with the analytical solution of a simple test system. Furthermore, a fully documented C++ implementation with unit tests as example applications is provided. Full article

This article examines the problems of multi-robot coverage and persistent monitoring of regions of interest with limited sensing robots. A group of robots, each equipped with only contact sensors and a clock, execute a simple trajectory by repeatedly moving straight and then bouncing at perimeter boundaries by rotating in place. We introduce an approach by finding a joint trajectory for multiple robots to cover a given environment and generating cycles for the robots to persistently monitor the target regions in the environment. From a given initial configuration, our approach iteratively finds the joint trajectory of all the robots that covers the entire environment. Our approach also computes periodic trajectories of all the robots for monitoring of some regions, where trajectories overlap but do not involve robot-robot collisions. We present experimental results from multiple simulations and physical experiments demonstrating the practical utility of our approach. Full article

The agriculture industry is in need of substantially increasing crop yield to meet growing global demand. Selective breeding programs can accelerate crop improvement but collecting phenotyping data is time- and labor-intensive because of the size of the research fields and the frequency of the work required. Automation could be a promising tool to address this phenotyping bottleneck. This paper presents a Robotic Operating System (ROS)-based mobile field robot that simultaneously navigates through occluded crop rows and performs various phenotyping tasks, such as measuring plant volume and canopy height using a 2D LiDAR in a nodding configuration. The efficacy of the proposed 2D LiDAR configuration for phenotyping is assessed in a high-fidelity simulated agricultural environment in the Gazebo simulator with an ROS-based control framework and compared with standard LiDAR configurations used in agriculture. Using the proposed nodding LiDAR configuration, a strategy for navigation through occluded crop rows is presented. The proposed LiDAR configuration achieved an estimation error of 6.6% and 4% for plot volume and canopy height, respectively, which was comparable to the commonly used LiDAR configurations. The hybrid strategy with GPS waypoint following and LiDAR-based navigation was used to navigate the robot through an agricultural crop field successfully with an root mean squared error of 0.0778 m which was 0.2% of the total traveled distance. The presented robot simulation framework in ROS and optimized LiDAR configuration helped to expedite the development of the agricultural robots, which ultimately will aid in overcoming the phenotyping bottleneck. Full article

Learning skills from kinesthetic demonstrations is a promising way of minimizing the gap between human manipulation abilities and those of robots. We propose an approach to learn sequential force interaction skills from such demonstrations. The demonstrations are decomposed into a set of movement primitives by inferring the underlying sequential structure of the task. The decomposition is based on a novel probability distribution which we call Directional Normal Distribution. The distribution allows infering the movement primitive’s composition, i.e., its coordinate frames, control variables and target coordinates from the demonstrations. In addition, it permits determining an appropriate number of movement primitives for a task via model selection. After finding the task’s composition, the system learns to sequence the resulting movement primitives in order to be able to reproduce the task on a real robot. We evaluate the approach on three different tasks, unscrewing a light bulb, box stacking and box flipping. All tasks are kinesthetically demonstrated and then reproduced on a Barrett WAM robot. Full article

To effectively communicate with people, social robots must be capable of detecting, interpreting, and responding to human affect during human–robot interactions (HRIs). In order to accurately detect user affect during HRIs, affect elicitation techniques need to be developed to create and train appropriate affect detection models. In this paper, we present such a novel affect elicitation and detection method for social robots in HRIs. Non-verbal emotional behaviors of the social robot were designed to elicit user affect, which was directly measured through electroencephalography (EEG) signals. HRI experiments with both younger and older adults were conducted to evaluate our affect elicitation technique and compare the two types of affect detection models we developed and trained utilizing multilayer perceptron neural networks (NNs) and support vector machines (SVMs). The results showed that; on average, the self-reported valence and arousal were consistent with the intended elicited affect. Furthermore, it was also noted that the EEG data obtained could be used to train affect detection models with the NN models achieving higher classification rates Full article

This paper proposes the design and 3D printing of a compact omnidirectional wheel optimized to create a small series of three-wheeled omnidirectional mobile robots. The omnidirectional wheel proposed is based on the use of free-rotating passive wheels aligned transversally to the center of the main wheel and with a constant separation gap. This paper compares a three inner-passive wheels design based on mass-produced parts and 3D printed elements. The inner passive wheel that better combines weight, cost, and friction is implemented with a metallic ball bearing fitted inside a 3D printed U-grooved ring that holds a soft toric joint. The proposed design has been implemented using acrylonitrile butadiene styrene (ABS) and tough polylactic acid (PLA) as 3D printing materials in order to empirically compare the deformation of the weakest parts of the mechanical design. The conclusion is that the most critical parts of the omnidirectional wheel are less prone to deformation and show better mechanical properties if they are printed horizontally (with the axes that hold the passive wheels oriented parallel to the build surface), with an infill density of 100% and using tough PLA rather than ABS as a 3D printing material. Full article

Just as laparoscopic surgery provided a giant leap in safety and recovery for patients over open surgery methods, robotic-assisted surgery (RAS) is doing the same to laparoscopic surgery. The first laparoscopic-RAS systems to be commercialized were the Intuitive Surgical, Inc. (Sunnyvale, CA, USA) da Vinci and the Computer Motion Zeus. These systems were similar in many aspects, which led to a patent dispute between the two companies. Before the dispute was settled in court, Intuitive Surgical bought Computer Motion, and thus owned critical patents for laparoscopic-RAS. Recently, the patents held by Intuitive Surgical have begun to expire, leading to many new laparoscopic-RAS systems being developed and entering the market. In this study, we review the newly commercialized and prototype laparoscopic-RAS systems. We compare the features of the imaging and display technology, surgeons console and patient cart of the reviewed RAS systems. We also briefly discuss the future directions of laparoscopic-RAS surgery. With new laparoscopic-RAS systems now commercially available we should see RAS being adopted more widely in surgical interventions and costs of procedures using RAS to decrease in the near future. Full article

Under special circumstances, a cable-driven parallel robot (CDPR) may leave its wrench-feasible-workspace. Standard approaches for the computation of set-point cable forces are likely to fail in this case. The novel nearest corner method for calculating appropriate cable forces when the CDPR is outside of its wrench-feasible-workspace was introduced in former work of the authors. The obtained cable force distributions aim at continuity and generate wrenches close to the desired values. The method employs geometrical operations in the cable force space and promises real-time usability because of its non-iterative structure. In a simplified simulation, a cable break scenario was used to carry out more detailed testing of the method regarding different parameters, a higher number of cables, and the numerical efficiency. A brief discussion about the continuity of the method when entering the wrench-feasible-workspace is presented. Full article

This study was conducted to develop original benchmark datasets that simultaneously include indoor–outdoor visual features. Indoor visual information related to images includes outdoor features to a degree that varies extremely by time, weather, and season. We obtained time-series scene images using a wide field of view (FOV) camera mounted on a mobile robot moving along a 392-m route in an indoor environment surrounded by transparent glass walls and windows for two directions in three seasons. For this study, we propose a unified method for extracting, characterizing, and recognizing visual landmarks that are robust to human occlusion in a real environment in which robots coexist with people. Using our method, we conducted an evaluation experiment to recognize scenes divided up to 64 zones with fixed intervals. The experimentally obtained results using the datasets revealed the performance and characteristics of meta-parameter optimization, mapping characteristics to category maps, and recognition accuracy. Moreover, we visualized similarities between scene images using category maps. We also identified cluster boundaries obtained from mapping weights. Full article

Research and development in socially assistive robotics have produced several novel applications in the care of senior people. However, some are still unexplored such as their use as psychometric tools allowing for a quick and dependable evaluation of human users’ intellectual capacity. To fully exploit the application of a social robot as a psychometric tool, it is necessary to account for the users’ factors that might influence the interaction with a robot and the evaluation of user cognitive performance. To this end, we invited senior participants to use a prototype of a robot-led cognitive test and analyzed the influence of personality traits and user’s empathy on the cognitive performance and technology acceptance. Results show a positive influence of a personality trait, the “openness to experience”, on the human-robot interaction, and that other factors, such as anxiety, trust, and intention to use, are influencing technology acceptance and correlate the evaluation by psychometric tests. Full article

In this paper, the inequivalence of the direct-contact mechanisms and their equivalent four-bar linkages in jerk analysis is discussed. Kinematic analyses for three classical types of direct-contact mechanisms consisting of: (a) higher pairs with permanently invariant curvature centers, (b) higher pairs with suddenly changed curvature, and (c) higher pairs with continuously varying curvature are performed, respectively, through their representative case studies. The analyzed results show that the equivalent four-bar linkage cannot give a correct value of jerk for most situations in the three case studies. Subsequently, the concept of “equivalent six-bar linkage” for direct-contact mechanisms is proposed in order to discuss the infeasibility of the equivalent four-bar linkage for jerk analysis. It is found that the suddenly changed or continuously varying curvature of the higher pairs is not considered in sudden or continuous link-length variations of the equivalent four-bar linkage, which further leads to inconsistency between the angular accelerations of the coupler and the contact normal, and finally results in the infeasibility of the equivalent four-bar linkage for jerk analysis of most direct-contact mechanisms. It is also found that the concept of equivalent six-bar linkage could be applied to evaluate more higher-order time derivatives for most direct-contact mechanisms. The presented case studies and discussion can give demonstrations for understanding the inequivalence of the direct-contact mechanisms and their equivalent four-bar linkages in the aspect of jerk analysis. Full article

Smartphone technology is rapidly evolving, adding sensors of growing accuracy and precision. Structural engineers are among customers who indirectly benefit from such technological advances. This paper tests whether accelerometers installed in new generations of smartphones can reach the accuracy of professional accelerometers created for vibration monitoring of civil engineering structures, and how they can be useful. The paper describes an experimental study designed to measure walking-induced vibrations of a slender prefabricated prestressed concrete slab. Both traditional, high-accuracy, accelerometers and those integrated into commercial smartphones were used for experimental data collection. Direct comparison of the recordings yielded two key findings: the accuracy of smartphone accelerometers largely depends on the specific smartphone model, and nevertheless is satisfactory for preliminary modal testing at the very least. Furthermore, the smartphone measured accelerations of the lower back were used successfully to indirectly measure pedestrian walking loads. Full article

Accurately matching the LIDAR scans is a critical step for an Autonomous Land Vehicle (ALV). Whilst most previous works have focused on the urban environment, this paper focuses on the off-road environment. Due to the lack of a publicly available dataset for algorithm comparison, a dataset containing LIDAR pairs with varying amounts of offsets in off-road environments is firstly constructed. Several popular scan matching approaches are then evaluated using this dataset. Results indicate that global approaches, such as Correlative Scan Matching (CSM), perform best on large offset datasets, whilst local scan matching approaches perform better on small offset datasets. To combine the merits of both approaches, a two-stage fusion algorithm is designed. In the first stage, several transformation candidates are sampled from the score map of the CSM algorithm. Local scan matching approaches then start from these transformation candidates to obtain the final results. Four performance indicators are also designed to select the best transformation. Experiments on a real-world dataset prove the effectiveness of the proposed approach. Full article

(1) Background: in the last decade, various investigations into the field of robotics have created several opportunities for further innovation to be possible in student education. However, despite scientific evidence, there is still strong scepticism surrounding the use of robots in some social fields, such as personal care and education. (2) Methods: in this research, we present a new tool named the HANCON model, which was developed merging and extending the constructs of two solid and proven models—the Unified Theory of Acceptance and Use of Technology (UTAUT) model used to examine the factors that may influence the decision to use a telepresence robot as an instrument in educational practice, and the Post Acceptance Model used to evaluate acceptability after the actual use of a telepresence robot. The new tool is implemented and used to study the acceptance of a double telepresence robot by 112 pre-service teachers in an educational setting. (3) Results: the analysis of the experimental results predicts and demonstrate a positive attitude towards the use of telepresence robot in a school setting and confirm the applicability of the model in an educational context. (4) Conclusions: the constructs of the HANCON model could predict and explain the acceptance of social telepresence robots in social contexts. Full article

(1) Background: The technologies of Industry 4.0 are increasingly promoting an operation of human motion prediction for improvement of the collaboration between workers and robots. The purposes of this study were to fuse the spatial and inertial data of human upper limbs for typical industrial pick and place movements and to analyze the collected features from the future perspective of collaborative robotic applications and human motion prediction algorithms. (2) Methods: Inertial Measurement Units and a stereophotogrammetric system were adopted to track the upper body motion of 10 healthy young subjects performing pick and place operations at three different heights. From the obtained database, 10 features were selected and used to distinguish among pick and place gestures at different heights. Classification performances were evaluated by estimating confusion matrices and F1-scores. (3) Results: Values on matrices diagonals were definitely greater than those in other positions. Furthermore, F1-scores were very high in most cases. (4) Conclusions: Upper arm longitudinal acceleration and markers coordinates of wrists and elbows could be considered representative features of pick and place gestures at different heights, and they are consequently suitable for the definition of a human motion prediction algorithm to be adopted in effective collaborative robotics industrial applications. Full article

This paper presents a survey on mobile robots as systems that can move in different environments with walking, flying and swimming up to solutions that combine those capabilities. The peculiarities of these mobile robots are analyzed with significant examples as references and a specific case study is presented as from the direct experiences of the authors for the robotic platform HeritageBot, in applications within the frame of Cultural Heritage. The hybrid design of mobile robots is explained as integration of different technologies to achieve robotic systems with full mobility. Full article

Developing dialogue services for robots has been promoted nowadays for providing natural human–robot interactions to enhance user experiences. In this study, we adopted a service-oriented framework to develop emotion-aware dialogues for service robots. Considering the importance of the contexts and contents of dialogues in delivering robot services, our framework employed deep learning methods to develop emotion classifiers and two types of dialogue models of dialogue services. In the first type of dialogue service, the robot works as a consultant, able to provide domain-specific knowledge to users. We trained different neural models for mapping questions and answering sentences, tracking the human emotion during the human–robot dialogue, and using the emotion information to decide the responses. In the second type of dialogue service, the robot continuously asks the user questions related to a task with a specific goal, tracks the user’s intention through the interactions and provides suggestions accordingly. A series of experiments and performance comparisons were conducted to evaluate the major components of the presented framework and the results showed the promise of our approach. Full article

This article covers the signal processing for a human–robot remote controlled welding application. For this purpose, a test and evaluation system is under development. It allows a skilled worker to weld in real time without being exposed to the associated physical stress and hazards. The torch movement of the welder in typical welding tasks is recorded by a stereoscopic sensor system. Due to a mismatch between the speed of the acquisition and the query rate for data by the robot control system, a prediction has to be developed. It should generate a suitable tool trajectory from the acquired data, which has to be a $C^2$ -continuous function. For this purpose, based on a frequency analysis, a Kalman-Filter in combination with a disturbance observer is applied. It reproduces the hand movement with sufficient accuracy and lag-free. The required algorithm is put under test on a real-time operating system based on Linux and Preempt_RT in connection to a KRC4 robot controller. By using this setup, the welding results in a plane are of good quality and the robot movement coincides with the manual movement sufficiently. Full article

In this contribution, we develop a feedback controller in the form of a parametric function for a mobile inverted pendulum. The control both stabilizes the system and drives it to target positions with target orientations. A design of the controller based only on a cost function is difficult for this task, which is why we choose to train the controller using imitation learning on optimized trajectories. In contrast to popular approaches like policy gradient methods, this approach allows us to shape the behavior of the system by including equality constraints. When transferring the parametric controller from simulation to the real mobile inverted pendulum, the control performance is degraded due to the reality gap. A robust control design can reduce the degradation. However, for the framework of imitation learning on optimized trajectories, methods that explicitly consider robustness do not yet exist to the knowledge of the authors. We tackle this research gap by presenting a method to design a robust controller in the form of a recurrent neural network, to improve the transferability of the trained controller to the real system. As a last step, we make the behavior of the parametric controller adjustable to allow for the fine tuning of the behavior of the real system. We design the controller for our system and show in the application that the recurrent neural network has increased performance compared to a static neural network without robustness considerations. Full article

There are many reasons why engineering structures are at risk of losing their loading capacity during their long-term exploitation, which may lead to hazardous states. In such cases, structures must be strengthened. The most popular technique of strengthening is based on the use of composite materials—fiber-reinforced polymer (FRP) elements attached to the structure with the special resins. FRP elements are applied externally, often in hard to reach places, which makes it difficult to diagnose the durability and quality of such a connection. In this study, a combination of a modern thermographic method was proposed, which makes it possible to assess the degree of damage to the contact of the structure with the composite material along with the running platform (wheeled robot) equipped with a set of diagnostic sensors. The development potential of such a solution for subsequent projects was also indicated. Full article

This paper presents an analysis of the geometric errors of joint assembly that affect the end-effector for a six-axis industrial robot. The errors were composed of 30 parameters that come from the Geometric Dimensioning and Tolerancing (GD&T) design, which is not the normal way to describe them. Three types of manufacturing tolerancing—perpendicularity, parallelism and position—were introduced and investigated. These errors were measured by the laser tracker. The measurement data were calculated with an analysis of the circle fitting method. The kinematic model and error model based on a combination of translations methods were used. The experiment was carried out in order to calculate the tolerancing of geometric error. Then, the positions of the end-effector in the actual measurement from laser tracker and exact performance were compared. The discrepancy was compensated by offline programming. As a result, the position errors were reduced by 90%. Full article

This paper proposes a pressing method for wall-climbing robots to prevent them from falling. In order to realize the method, the properties of the utilized suction cup are studied experimentally. Then based on the results, a guide rail is designed to distribute the attached suction cup force and implement the pressing method. A prototype of a wall-climbing robot that utilizes passive suction cups and one motor is used to demonstrate the proposed method. An experimental test-bed is designed to measure the force changes of the suction cup when the robot climbs upwards. The experimental results validate that the suction cup can completely attach to the surface by the proposed method, and demonstrate that the robot can climb upwards without falling. Full article

This paper describes an interactive storytelling system, accessible through the SoftBank robotic platforms NAO and Pepper. The main contribution consists of the interpretation of the story characters by humanoid robots, obtained through the definition of appropriate cognitive models, relying on the ACT-R cognitive architecture. The reasoning processes leading to the story evolution are based on the represented knowledge and the suggestions of the listener in critical points of the story. They are disclosed during the narration, to make clear the dynamics of the story and the feelings of the characters. We analyzed the impact of such externalization of the internal status of the characters to set the basis for future experimentation with primary school children. Full article

A bilateral teleoperation system can become unstable in the presence of a modest time delay. However, the wave variable algorithm provides stable operation for any fixed time delay using passivity arguments. Unfortunately, the wave variable method produces wave reflection that can degrade teleoperation performance when a mismatched impedance exists between the master and slave robot. In this work, we develop a novel bandstop wave filter and experimentally verify that the technique can mitigate the effects of wave reflections in bilaterally teleoperated systems. We apply the bandstop wave filter in the wave domain and filtered the wave signal along the communication channel. We placed the bandstop wave filter in the master-to-slave robot path to alleviate lower frequency components of the reflected signal. With the lower frequency components reduced, wave reflections that degrade teleoperation performance were mitigated and we obtained a better transient response from the system. Results from our experiment show that the bandstop wave filter performed better by 67% when compared to the shaping wave filter respectively. Full article

Locomotion over different terrain types, whether flat or uneven, is very important for a wide range of service operations in robotics. Potential applications range from surveillance, rescue, or hospital assistance. Wheeled-legged hexapod robots have been designed to solve these locomotion tasks. Given the wide range of feasible operations, one of the key operation planning issues is related to the robot balancing during motion tasks. Usually this problem is related with the pose of the robot’s center of mass, which can be addressed using different mathematical techniques. This paper proposes a new practical technique for balancing wheeled-legged hexapod robots, where a Biodex Balance System model SD (for static & dynamic) is used to obtain the effective position of the center of mass, thus it can be recalculated to its optimal position. Experimental tests are carried out to evaluate the effectiveness of this technique and modify and improve the position of hexapod robots’ center of mass. Full article

The design of Multi-Input Multi-Output nonlinear control systems for a quadrotor can be a difficult task. Nature inspired optimization techniques can greatly improve the design of non-linear control systems. Two recently proposed hunting-based swarm intelligence inspired techniques are the Grey Wolf Optimizer (GWO) and the Ant Lion Optimizer (ALO). This paper proposes the use of both GWO and ALO techniques to design a Sliding Mode Control (SMC) flight system for tracking improvement of altitude and attitude in a quadrotor dynamic model. SMC is a nonlinear technique which requires that its strictly coupled parameters related to continuous and discontinuous components be correctly adjusted for proper operation. This requires minimizing the tracking error while keeping the chattering effect and control signal magnitude within suitable limits. The performance achieved with both GWO and ALO, considering realistic disturbed flight scenarios are presented and compared to the classical Particle Swarm Optimization (PSO) algorithm. Simulated results are presented showing that GWO and ALO outperformed PSO in terms of precise tracking, for ideal and disturbed conditions. It is shown that the higher stochastic nature of these hunting-based algorithms provided more confidence in local optima avoidance, suggesting feasibility of getting a more precise tracking for practical use. Full article

Augmented reality (AR) is used to enhance the perception of the real world by integrating virtual objects to an image sequence acquired from various camera technologies. Numerous AR applications in robotics have been developed in recent years. The aim of this paper is to provide an overview of AR research in robotics during the five year period from 2015 to 2019. We classified these works in terms of application areas into four categories: (1) Medical robotics: Robot-Assisted surgery (RAS), prosthetics, rehabilitation, and training systems; (2) Motion planning and control: trajectory generation, robot programming, simulation, and manipulation; (3) Human-robot interaction (HRI): teleoperation, collaborative interfaces, wearable robots, haptic interfaces, brain-computer interfaces (BCIs), and gaming; (4) Multi-agent systems: use of visual feedback to remotely control drones, robot swarms, and robots with shared workspace. Recent developments in AR technology are discussed followed by the challenges met in AR due to issues of camera localization, environment mapping, and registration. We explore AR applications in terms of how AR was integrated and which improvements it introduced to corresponding fields of robotics. In addition, we summarize the major limitations of the presented applications in each category. Finally, we conclude our review with future directions of AR research in robotics. The survey covers over 100 research works published over the last five years. Full article

This paper proposes a classification of all non-isomorphic anatomies of an orthogonal metamorphic manipulator according to the topology of workspace considering cusps and nodes. Using symbolic algebra, a general kinematics polynomial equation is formulated, and the closed-form parametric solution of the inverse kinematics is obtained for the coming anatomies. The metamorphic design space was disjointed into eight distinct subspaces with the same number of cusps and nodes plotting the bifurcating and strict surfaces in a cartesian coordinate system $\left\{{\mathsf{\theta }}_{{\mathsf{\pi }}_1}{,\mathsf{\theta }}_{{\mathsf{\pi }}_2}{,\mathrm{d}}_4\right\}$ . In addition, several non-singular, smooth and continuous trajectories are simulated to show the importance of this classification. Full article