Search Results (18)

In the last decade, Smart Glasses (SG) and augmented reality (AR) technology have gained considerable interest in all production sectors. In the agricultural field, an SG can be considered a valuable device to support farmers and agricultural operators. SGs can be distinguished by technical specification, type of display, interaction system, and specific features. These aspects can affect their integration into farms, influencing users’ experience and the consequent level of performance. The aim of the study was to compare four SGs for AR with different technical characteristics to evaluate their potential integration in agricultural systems. This study analyzed the capability of QR code reading in terms of distance and time of visualization, the audio–video quality of image streaming during conference calls and, finally, the battery life. The results showed different levels of performance in QR code reading for the selected devices, while the audio–video quality in conference calls demonstrated similar results for all the devices. Moreover, the battery life of the SGs ranged from 2 to 7 h per charge cycle, and it was influenced by the type of usage. The findings also underlined the potential use and integration of SGs to support operators during farm management. Specifically, SGs might enable farmers to obtain fast and precise augmented information using markers placed at different points on the farm. In conclusion, the study highlights how the different technical characteristics of SG represent an important factor in the selection of the most appropriate device for a farm. Full article

This study presents Portal Display, a screen-based telepresence system that mediates the interaction between two distinct spaces, each using a single display system. The system synchronizes the users’ viewpoint with their head position and orientation to provide stereoscopic vision through this single monitor. This research evaluates the impact of graphically rendered and video-streamed backgrounds and remote user representations on social telepresence, usability, and concentration during conversations and collaborative tasks. Our results indicate that the type of background has a negligible impact on these metrics. However, point cloud streaming of remote users significantly improves social telepresence, usability, and concentration compared with graphical avatars. This study implies that Portal Display can operate more efficiently by substituting the background with graphical rendering and focusing on higher-resolution 3D point cloud streaming for narrower regions for remote user representations. This configuration may be especially advantageous for applications where the remote user’s background is not essential to the task, potentially enhancing social telepresence. Full article

The blended classroom is a unique space for face-to-face (F2F) interaction and online learning. The blended classroom has three distinct interaction types: in-person synchronous, virtual synchronous, and virtual asynchronous; each of these modalities lends itself to different forms of extended reality. This case study looks at using a virtual reality (VR) classroom for an online synchronous weekly meetings for three upper-division or advanced (junior and senior level) higher education design classes at a university. The use of social web VR for a classroom can offer a collaborative, real-time environment that bridges the gap between virtual video conferences and gaming platforms. This paper examines how to use social web VR in a virtual classroom. Mixed methods were used to collect usability data at the end of the semester survey. The system usability scale (SUS) and several qualitative questions gathered student feedback. Overall, the students enjoyed using the VR classroom, but audio issues seemed to be the most significant pain point. While the overall response was positive, this study will address several areas for improvement from both the student and instructor perspectives. Social, web-based VR offers promising potential. Designing a human-centered virtual environment and considering all participants’ total user experience is critical to a successful learning tool. Full article

Traditional learning has faced major changes due to the COVID-19 pandemic, highlighting the necessity for innovative education methods. Virtual reality (VR) technology has the potential to change teaching and learning paradigms by providing a gamified, immersive, and engaging education. The purpose of this study is to evaluate the impact of virtual reality in academic context by using a VR software instrument (called EduAssistant). The system’s features such as virtual amphitheater, search by voice recognition, whiteboard, and a video conference system have fostered a sense of connection and community interaction. The study involved 117 students for VR experience, out of which 97 watched a pre-recorded video and 20 students used the VR headset, and an additional 20 students for traditional learning. The students who used the VR headset achieved a significantly higher mean quiz score of 8.31 compared to 7.55 for the traditional learning group with a two-tailed p-value of 0.0468. Over 80% of the total number of participants were satisfied (4 or 5 out of 5) with the experience and the confidence level when searching through voice recognition was over 90%. The study demonstrates that virtual reality is an excellent approach for changing conventional education. The research results, based on samples, simulations, and surveys, revealed a positive impact of VR and its gamification methods on the students’ cognitive performance, engagement, and learning experience. Immersion provided by a virtual assistant tool helped to promote active and deep learning. Experiments based on EduAssistant features suggest that virtual reality is also an effective strategy for future research related to students with disabilities. Full article

This paper describes a robotic system that supports the remote teaching of technical drawing. The aim of the system is to enable a remote class of paper-based technical drawing, where the students draw the drawing in a classroom, and the teacher gives instructions to the students from a remote place while confirming the paper drawing. The robotic system has a document camera for confirming the paper, a projector, a flat screen to project a cursor on the paper, and a video conference system for communication between the teacher and the students. We conducted two experiments. The first experiment verified the usefulness of a projected cursor. Eight participants evaluated the comprehensibility of the drawing check instruction with or without the projected cursor, and the results suggested that the use of the cursor made the instructions more comprehensible. The second experiment was conducted in a real drawing class. We asked the students in the class to answer a questionnaire to evaluate the robotic system. The result showed that the students had a good impression (useful, easy to use, and fun) of the system. The contribution of our work is twofold. First, it enables a teacher in a remote site to point to a part of the paper to enhance the interaction. Second, the developed system enabled both the students and the teacher to view the paper from their own viewpoints. Full article

Tele-conference systems are widely used as a form of communication media between remote sites. In order to overcome the limitations of video-based tele-conference systems with the continued technological innovations in mixed reality (MR), the use of a three-dimensional teleported avatar, in which a remote participant is teleported into a local environment, would be an effective future tele-conference system that would allow natural movement and interaction in the same location. However, technical difficulties must be resolved to enable control of the teleported avatar adapted to the environmental differences of the remote location and the user’s situation. This paper presents a novel method to adjust automatic gaze alignment of the teleported avatar with matching in the local site for MR collaborative environments. We ran comparative validation experiments to measure spatial accuracy of the gaze and evaluate the user’s communication efficiency using our method. In a quantitative experiment, the degree of gaze matching error in various environments was found to form a mirror-symmetrical U-shape, and the necessity of gaze matching gain was also recognized. Additionally, our experimental study showed that participants felt a greater co-presence during communication than in an idle situation without conversation. Full article

Traditional video conference systems depend largely on computational complexity to ensure system security, but with the development of high-performance computers, the existing encryption system will be seriously threatened. To solve this problem, a hybrid encryption scheme for quantum secure video conferencing combined with blockchain is proposed in this study. In the system solution architecture, first, the quantum key distribution network is embedded in the classic network; then, the “classical + quantum” hybrid encryption scheme is designed according to the secret level required for the video conference content. Besides, the real-time monitoring module of the quantum key distribution network is designed to ensure that users can check the running state of the network at any time. Meeting minutes can be shared by combining with blockchain. In order to quickly query meeting minutes, a cache-efficient query method based on B+ tree is proposed. The experimental results show that compared with the traditional video conference system, the quantum secure video conference system sufficiently integrates the technical advantages of the quantum key distribution to resist the security threats such as channel eavesdropping and high-performance computational attacks while ensuring the stable operation of the classic system, thus providing a video conference system with a higher security level. Meanwhile, the query time cost of blockchain with different lengths is tested, and the query efficiency of the proposed method is 3.15-times higher than the original query efficiency of blockchain. Full article

The COVID-19 pandemic forced the reorganization of the multidisciplinary healthcare system for Duchenne muscular dystrophy (DMD). Digital solutions seemed to be an optimal way for providing rehabilitation during this time. The aim of our study was to investigate whether it is possible to conduct respiratory physical therapy with the use of telerehabilitation methods in boys with Duchenne muscular dystrophy. Methods: The study was conducted during the online conference ‘DMD—Let’s be together’ for Polish families with DMD. During the physical therapy panel, we showed the video with the instructions of respiratory exercises: glossopharyngeal breathing, positive inspiratory pressure, and positive expiratory pressure. All participants (n = 152) were asked to fill in the online survey evaluating the quality of the instructions, its acceptance, and understanding. Results: The survey was filled in by 31 (20.4%) participants; the mean age of the patients was 13.8, and 19 (61.3%) were ambulant. The video was displayed 127 times. The overall mean rating of the session was 4.77/5, and intelligibility was rated 4.74/5. Fourteen (45.2%) patients declared that they had performed the exercises by themselves or with their caregiver’s assistance; all caregivers declared that it is possible to perform the proposed exercises a few times a week or daily. Only two respondents replied to the invitation for an individual online session. Conclusions: The findings from the study show that respiratory telerehabilitation may be implemented in DMD patients; however, the interest in digital rehabilitation among caregivers of DMD boys in Poland is low. The reason for this situation requires further research. Full article

Background and Purpose—Systemic thrombolysis represents the main proven therapy for acute ischemic stroke, but safe treatment is reported only in well-established stroke units. To extend the use of tissue plasminogen activator (tPA) treatment in primary care hospitals on isolated areas through telemedic was the purpose of specific initiatives in southern Umbria, Italy. Methods—The stroke center of Foligno established a telestroke network to provide consultations for three local hospitals in southern Umbria. The telemedic system consists of a digital network that includes a two-way video conference system and imaging sharing. The main network hospital established specialized stroke wards/teams in which qualified teams treat acute stroke patients. Physicians in these hospitals are able to contact the stroke centers 24 h per day. Quality data are available to support the safe implementation of the stroke procedures. Those available from governmental authorities and local datasets are volume of hospitalization, in-hospital mortality, 30-days mortality, and discharge setting. Objective of the study was to assess the annual hospitalization volume in both the hub and spoke hospitals for ischemic stroke and appraise the performance of the network after the introduction of the telestroke system. Results—A total of 225 systemic thrombolyses were performed in time period indicated above all hospitals. In the main spoke hospital, 41 procedures were performed after teleconsultations were made available. The thrombolysis rate in the hub hospital ranged between 10% in 2016 and 20% in 2019, while in the spoke hospital was below 5% in 2016 and raised to 15% in 2019. The statistically significant difference, in the number of procedures, between hub and spoke in the beginning of the observation time disappeared after introduction of the telestroke network. No increase of the mortality was found. Conclusions—The present data suggest that systemic thrombolysis indicated via stroke experts in the setting of teleconsultation shows similar complication rates to those reported in the National Institute of Neurological Disorders and Stroke trial. Therefore, tPA treatment is also safe in this context and can be extended to primary hospitals. Full article

The emergence of various types of commercial cameras (compact, high resolution, high angle of view, high speed, and high dynamic range, etc.) has contributed significantly to the understanding of human activities. By taking advantage of the characteristic of a high angle of view, this paper demonstrates a system that recognizes micro-behaviors and a small group discussion with a single 360 degree camera towards quantified meeting analysis. We propose a method that recognizes speaking and nodding, which have often been overlooked in existing research, from a video stream of face images and a random forest classifier. The proposed approach was evaluated on our three datasets. In order to create the first and the second datasets, we asked participants to meet physically: 16 sets of five minutes data from 21 unique participants and seven sets of 10 min meeting data from 12 unique participants. The experimental results showed that our approach could detect speaking and nodding with a macro average f1-score of 67.9% in a 10-fold random split cross-validation and a macro average f1-score of 62.5% in a leave-one-participant-out cross-validation. By considering the increased demand for an online meeting due to the COVID-19 pandemic, we also record faces on a screen that are captured by web cameras as the third dataset and discussed the potential and challenges of applying our ideas to virtual video conferences. Full article

The study tried to analyze the implication of one year of online education in the Romanian education system. To achieve this goal, the authors of this study analyzed all the levels of education, primary education, lower secondary education, upper secondary education, and even the early childhood system, but also one of the smallest Romanian universities, considered representative for grade 1 universities representing 60% of the Romanian universities. The study is based on four online questionnaires for investigation, first with more than 2500 respondents from the primary and secondary Romanian education system, and the other three applied to more than 800 students and professors from the University of Petroșani. The investigation took place during 29 January 2021 and 11 February 2021. The authors had investigated the main feature of a standard online or a classical e-learning solution, such as the meeting solution or the video conference software, the collaborative work, such as homework or projects, and the testing method or the quizzes from both perspectives of the students and of the professors. The study results could influence the expected future hybrid educational system because these results were not covered in the previous literature but proved to be necessary for relevant knowledge strategies to be implemented in the new pandemic and also in the future context. Full article

Background: The COVID-19 pandemic forced reorganization of the multidisciplinary healthcare system for Duchenne muscular dystrophy. Digital solutions seem to be optimal for providing rehabilitation at this time. The aim of this study was to investigate whether it is possible to conduct respiratory physical therapy with the use of telerehabilitation in Duchenne muscular dystrophy. Methods: The study was conducted during an online conference for families with DMD. During the physical therapy panel we showed the video with the instructions of respiratory exercises. All participants (n = 152) were asked to fill in the online survey evaluating the quality, acceptance, and understanding of the instructions. Results: The survey was filled in by 45 (29.6%) participants. The mean rating of satisfaction was 4.70/5, and for intelligibility was 4.78/5. Thirty-seven (82.2%) patients declared that they had performed the exercises, all caregivers declared that it was possible to perform the proposed exercises a few times a week or daily, and only two respondents replied to invitations to individual online sessions. Conclusions: Findings from the study show that respiratory telerehabilitation may be implemented for DMD patients; however, the interest in digital rehabilitation among caregivers of DMD boys in Poland is low. The reasons for this situation require further research. Full article

Image segmentation plays a central role in a broad range of applications, such as medical image analysis, autonomous vehicles, video surveillance and augmented reality. Portrait segmentation, which is a subset of semantic image segmentation, is widely used as a preprocessing step in multiple applications such as security systems, entertainment applications, video conferences, etc. A substantial amount of deep learning-based portrait segmentation approaches have been developed, since the performance and accuracy of semantic image segmentation have improved significantly due to the recent introduction of deep learning technology. However, these approaches are limited to a single portrait segmentation model. In this paper, we propose a novel approach using an ensemble method by combining multiple heterogeneous deep-learning based portrait segmentation models to improve the segmentation performance. The Two-Models ensemble and Three-Models ensemble, using a simple soft voting method and weighted soft voting method, were experimented. Intersection over Union (IoU) metric, IoU standard deviation and false prediction rate were used to evaluate the performance. Cost efficiency was calculated to analyze the efficiency of segmentation. The experiment results show that the proposed ensemble approach can perform with higher accuracy and lower errors than single deep-learning-based portrait segmentation models. The results also show that the ensemble of deep-learning models typically increases the use of memory and computing power, although it also shows that the ensemble of deep-learning models can perform more efficiently than a single model with higher accuracy using less memory and less computing power. Full article

Power consumption is a critical design factor in modern mobile chip design, in which the memory system with dynamic random-access memory (DRAM) consumes more than half of the entire system’s power. Without DRAM bandwidth compression, extreme multimedia operations such as 8K high dynamic range (HDR) recording and 8K video conference calling are not possible without sacrificing image quality or trimming because of thermal limitations or battery time sustainability constraints. Since heterogeneous processors are substantially involved in managing various types of fallbacks or software solutions, complicated compression algorithms for high-compression ratios are not actually adaptable owing to timing closure problems or high throughput requirements. In this paper, we propose evaluation metrics to assess lossless embedded compression (LEC) algorithms to reflect realistic design considerations for mobile multimedia scenarios. Furthermore, we introduce an optimized LEC implementation for contemporary multimedia applications in mobile devices based on the proposed metrics. The proposed LEC implementation enhances the compression ratio of LEC algorithms in other commercial application processors for contemporary premium smartphones by up to 9.2% on average, while maintaining the same timing closure condition. Full article

During a lifetime, a person can have many wonderful and memorable moments that he/she wants to keep. With the development of technology, people now can store a massive amount of lifelog information via images, videos or texts. Inspired by this, we develop a system to automatically generate caption from lifelog pictures taken from wearable cameras. Following up on our previous method introduced at the SoICT 2018 conference, we propose two improvements in our captioning method. We trained and tested the model on the baseline MSCOCO datasets and evaluated on different metrics. The results show better performance compared to our previous model and to some other image captioning methods. Our system also shows effectiveness in retrieving relevant data from captions and achieve high rank in ImageCLEF 2018 retrieval challenge. Full article