Next Article in Journal
Electromagnetic Characterization of Engineered Materials Using Capacitively Loaded Aperture Sensors
Previous Article in Journal
Greenhouse Detection from Color Infrared Aerial Image and Digital Surface Model
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Proceeding Paper

Wireless Channel Assessment of Auditoriums for the Deployment of Augmented Reality Systems for Enhanced Show Experience of Impaired Persons †

by
Imanol Picallo
1,
Aida Vidal-Balea
2,3,
Peio Lopez-Iturri
1,4,*,
Paula Fraga-Lamas
2,3,
Hicham Klaina
5,
Tiago M. Fernández-Caramés
2,3 and
Francisco Falcone
1,4
1
Department of Electric, Electronic and Communication Engineering, Public University of Navarre, 31006 Pamplona, Navarra, Spain
2
Department of Computer Engineering, Faculty of Computer Science, Universidade da Coruña, 15071 A Coruña, Spain
3
Centro de Investigación CITIC, Universidade da Coruña, 15071 A Coruña, Spain
4
Institute for Smart Cities, Public University of Navarre, 31006 Pamplona, Navarra, Spain
5
Department of Signal theory and Communications, University of Vigo, 36310 Vigo, Spain
*
Author to whom correspondence should be addressed.
Presented at the 6th International Electronic Conference on Sensors and Applications, 15–30 November 2019; Available online: https://ecsa-6.sciforum.net/.
Proceedings 2020, 42(1), 30; https://doi.org/10.3390/ecsa-6-06587
Published: 14 November 2019

Abstract

:
Auditoriums and theaters are buildings in which concerts, shows, and conferences are held, offering a diverse and dynamic cultural program to citizens. Unfortunately, people with impairments usually have difficulties in fully experiencing all the provided cultural activities, since such environments are not totally adapted to their necessities. For example, in an auditorium, visually impaired users have to be accompanied to their seats by staff, as well as when the person wants to leave the event in the middle of the show (e.g., to go to the toilet), or when he/she wants to move around during breaks. This work is aimed at improving the autonomy of disabled people within the mentioned kinds of environments, as well as enhancing their show experiences by deploying wireless sensor networks and wireless body area networks connected to an augmented reality device (Microsoft HoloLens smart glasses). For that purpose, intensive measurements have been taken in a real scenario (the Baluarte Congress Center and Auditorium of Navarre) located in the city of Pamplona. The results show that this kind of environment presents high wireless interference at different frequency bands, due to the existing wireless systems deployed within them, such as multiple WiFi access points, wireless microphones, or wireless communication systems used by the show staff. Therefore, radio channel simulations have been also performed with the aim of assessing the potential deployment of the proposed solution. The presented work can lead to the deployment of augmented reality systems within auditoriums and theaters, boosting the development of new applications.

1. Introduction

According to the latest World Health Organization (WHO) reports [1], 2.2 billion people suffer from some type of visual impairment. Diseases that can cause severe visual impairment or even blindness are glaucoma, diabetic retinopathy, or macular degeneration.
In the literature, numerous studies have presented assistive devices for people with visual impairments; specifically, smart glasses for the recognition of obstacles that send information to the person with disabilities through audio [2]. In this work [3], a detection intelligent stick is added to the smart glasses for objects that are outside the user’s viewing area. This stick provides fall detection, sending the GPS coordinates of the user to a predefined contact. In indoor environments, the solution is complicated, as it requires the deployment of ZigBee or BLE (Bluetooth Low Energy) sensors to determine the paths that people with disabilities have to follow [4,5].
In environments such as auditoriums or theaters, there are usually devices for people with hearing impairments that may be mild (hearing devices) or severe (modulated frequency systems transmitters for users wearing cochlear implants), but no guidance devices are available for people with visual disabilities. This work wants to overcome this barrier, and for this, a network of wireless sensors and body area sensors connected to an augmented reality (AR) device like Microsoft HoloLens smart glasses [6] is proposed to improve the autonomy of people with these disabilities as well as their experience in this type of environment. The deployment will be carried out in the Baluarte Palace of Congresses and Auditorium of Navarre, located in the city of Pamplona, in the main auditorium that is inside. The objective is therefore that people with visual disabilities can move freely throughout the auditorium, without the help of hostess services.
The radio characterization has been carried out through simulations based on 3D-ray-launching software (3D RL), where the dimensions of the auditorium have been considered together with the dielectric properties of the obstacle materials, such as the dielectric constant and the conductivity. The results show that optimized radio planning could be a key issue, due mainly to the interference levels present within the auditorium.

2. AR Solution for Visually Impaired People

AR has evolved significantly since the 1960s from the technological and business standpoint. Recently, it has been pointed out as a key technology enabler for Industry 4.0 [7] due to its potential applications. Nevertheless, its use to enhance leisure activities is still very incipient. In the case of people with visual impairments, AR has the potential to enable a wide range of user-friendly and real-time applications, like providing information and assistance (e.g., vibrations for haptic feedback, sign-reading assistance [8]), locating items, guidance and navigation, interacting with internet of things (IoT) devices, or augmented collaboration.
Among the different commercial AR devices, Microsoft HoloLens smart glasses were chosen since they are one the most promising AR headsets on the market [7]. HoloLens contains a custom-built holographic processing unit (HPU 1.0), 2 GB of RAM and 64 GB of Flash, embedded sensors, see-through holographic lenses, automatic pupillary distance calibration, and human-machine interfaces (voice support, gaze tracking, spatial sound, and gesture recognition). In addition, the smart glasses can be connected to other devices through WiFi (IEEE 802.11 ac) or Bluetooth 4.1, and its battery lasts approximately 2 to 3 h with active use and up to two weeks in stand-by mode.

3. Radio Characterization of the Auditorium

In order to characterize the radio channel within the proposed auditorium scenario, intensive measurement campaigns, both to characterize the radio channel and to assess the present interference levels have been carried out. In addition, simulations by means of the 3D RL in-house developed code have been performed. The algorithm is based on geometrical optics (GO) and geometrical theory of diffraction (GTD). The code has been programmed in Matlab, and an exhaustive description of its operation procedure is presented in [9].

3.1. Auditorium under Analysis

The scenario object of the radio-planning studio is the Baluarte Congress Center and Auditorium of Navarre, which is located in the city of Pamplona. Baluarte is composed of different rooms, among which the main auditorium stands out for its size, as can be seen in Figure 1. It has a total capacity of 1568 seats, which are divided into 1036 in the room and 532 in the auditorium box. It has dimensions of 65.26 m × 30.58 m × 16 m (length × width × height). The room is paneled in beech wood and the seats are made of leather. Table 1 shows the parameters of the materials that the auditorium is composed of and which have been considered in the simulations.
During the measurement campaign, several spectrograms were measured to analyze potential interfering systems in the auditorium and thus be able to plan the placement of the wireless sensor network. Such spectrograms were obtained with an Agilent’s FieldFox N9912A spectrum analyzer. In Figure 2 and Figure 3, the spectrograms are shown in the 2.4 GHz and 5 GHz bands, where the amount of interfering systems in Baluarte mainly shows WiFi channels in both bands. This is important to keep in mind, since Microsoft HoloLens glasses operate both at 2.4 GHz and 5 GHz using IEEE 802.11ac and Bluetooth 4.1.

3.2. Simulation Versus Measured Results

In this section, the simulation results obtained with the 3D RL tool are presented in order to compare them with real power measurements obtained with the spectrum analyzer for the frequencies of 2.4 GHz and 5.5 GHz, at different points of the auditorium to fully characterize it. In Figure 3, the Baluarte auditorium model created with the 3D RL is presented, where the transmitter (represented by a green square) is located on the audiovisual cabin shelf, 1.55 m above the ground, and the measurement points (represented by blue circles) are at the height of the seats, 1 m above the ground.
The transmitter is a VCO (voltage controlled oscillator) that operates with a different transmission power according to the operating frequency. At 2.4 GHz, the ZX95-2500 model was used, where the maximum VCO power is 8.38 dBm, while for 5.5 GHz the ZX95-5400 model was employed, where the maximum VCO power is −4.3 dBm. For both cases, a dual-band antenna was used, which works in the ranges 2.4–2.5 GHz and 5.2–5.8 GHz. Table 2 shows a summary of the parameters configured in the simulations.
Figure 4 shows compares the measurement and simulation results for 2.4 GHz and 5.5 GHz. As shown in the figure, for both working frequencies the 3D RL method is validated due to the similarity between measurements and simulations. For the higher operating frequency, lower power reception levels are obtained, mainly due to the increase in propagation losses and the lower transmission power. Specifically, at 2.4 GHz a 0.78 dB mean error and a 0.6 dB standard deviation are obtained, while for 5.5 GHz a 2.38 dB mean error and a 2.7 dB standard deviation are obtained. These results indicate that the 3D RL tool is valid for planning the deployment of the wireless sensor network.

4. Discussion

This paper presents a first assessment of the wireless channel for both 2.4 GHz and 5 GHz operation frequencies. Measurements within the auditorium under analysis show that the environment presents high interference levels at both frequency bands, due mainly to the WiFi networks of the auditorium. In order to gain insight into the radio channel behavior, simulations by means of the in-house 3D RL algorithm as well as RF (Radio Frequency) signal propagation measurements have been performed with the aim of studying the viability of deploying WSN/WBAN connected to an AR device (Microsoft HoloLens smart glasses). Future works will consist of the development of applications for the improvement of the autonomy and the show experience of visually impaired people.

Author Contributions

Conceptualization, I.P. and P.L.-I.; methodology, P.L.-I. and F.F.; software, I.P. and A.V.-B.; validation, I.P., H.K. and A.V.-B.; formal analysis, I.P. and A.V.-B.; investigation, I.P. and P.F.-L.; data curation, P.L.-I.; writing—original draft preparation, I.P.; writing—review and editing, T.M.F.-C. and P.F.-L.; visualization, I.P. and H.K.; supervision, P.L.-I. and F.F.; project administration, F.F. and T.M.F.-C.; funding acquisition, F.F. and T.M.F.-C. All authors have read and agreed to the published version of the manuscript.

Funding

This research and APC was funded by Xunta de Galicia (ED431C 2016-045, ED431G/01) and Project RTI2018-095499-B-C31, Funded by Ministerio de Ciencia, Innovación y Universidades, Gobierno de España (MCIU/AEI/FEDER,UE).

Acknowledgments

We thank the staff of Baluarte Congress Center and Auditorium of Navarre for their support for the experiments.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. World Health Organization (WHO). Available online: https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment (accessed on 8 October 2019).
  2. Bai, J.; Liu, Z.; Lin, Y.; Li, Y.; Lian, S.; Liu, D. Wearable Travel Aid for Environment Perception and Navigation of Visually Impaired People. Electronics 2019, 8, 697. [Google Scholar] [CrossRef]
  3. Liang-Bi, C.; Jian-Ping, S.; Ming-Che, C.; Wan-Jung, C.; Ching-Hsiang, Y.; Cheng-You, S. An Implementation of an Intelligent Assistance System for Visually Impaired/Blind People. In Proceedings of the IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA, 11–12 January 2019; pp. 1–2. [Google Scholar]
  4. Al-Qutayri, M.; Jeedella, J.; Al-Shamsi, M. An integrated wireless indoor navigation system for visually impaired. In Proceedings of the 2011 IEEE International Systems Conference, Montreal, QC, Canada, 4–7 April 2011; pp. 17–23. [Google Scholar]
  5. Murata, M.; Ahmetovic, D.; Sato, D.; Takagi, H.; Kitani, K.M.; Asakawa, C. Smartphone-based Indoor Localization for Blind Navigation across Building Complexes. In Proceedings of the 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom), Athens, Greece, 19–23 March 2018; pp. 1–10. [Google Scholar]
  6. Microsoft HoloLens Official Web Page. Available online: https://www.microsoft.com/en-us/hololens (accessed on 12 October 2019).
  7. Fernández-Caramés, T.M.; Fraga-Lamas, P.; Suárez-Albela, M.; Vilar-Montesinos, M. A Fog Computing and Cloudlet Based Augmented Reality System for the Industry 4.0 Shipyard. Sensors 2018, 18, 1798. [Google Scholar] [CrossRef] [PubMed]
  8. Huang, J.; Kinateder, M.; Dunn, M.J.; Jarosz, W.; Yang, X.-D.; Cooper, E.A. An augmented reality sign-reading assistant for users with reduced vision. PLoS ONE 2019, 14, e0210630. [Google Scholar] [CrossRef] [PubMed]
  9. Azpilicueta, L.; Rawat, M.; Rawat, K.; Ghannouchi, F.; Falcone, F. Convergence Analysis in Deterministic 3D Ray Launching Radio Channel Estimation in Complex Environments. ACES J. 2014, 29, 256–271. [Google Scholar]
  10. BALUARTE Pamplona—Palacio de Congresos y Auditorio de Navarra. Available online: http://www.baluarte.com/eng/salas-y-servicios/salas/main-auditorium (accessed on 10 October 2019).
Figure 1. Baluarte Congress Center and Auditorium of Navarre [10]: (a) outside view; (b) main auditorium front view; (c) main auditorium back view.
Figure 1. Baluarte Congress Center and Auditorium of Navarre [10]: (a) outside view; (b) main auditorium front view; (c) main auditorium back view.
Proceedings 42 00030 g001
Figure 2. Measured spectrograms at: (a) 2.4 GHz band; (b) 5 GHz band.
Figure 2. Measured spectrograms at: (a) 2.4 GHz band; (b) 5 GHz band.
Proceedings 42 00030 g002
Figure 3. Auditorium scenario from upper view for the 3D-ray-launching simulations with the transmitter (green square) and receivers (blue circles).
Figure 3. Auditorium scenario from upper view for the 3D-ray-launching simulations with the transmitter (green square) and receivers (blue circles).
Proceedings 42 00030 g003
Figure 4. Comparison between measurements and simulations results: (a) 2.4 GHz; (b) 5.5 GHz.
Figure 4. Comparison between measurements and simulations results: (a) 2.4 GHz; (b) 5.5 GHz.
Proceedings 42 00030 g004
Table 1. Material properties for ray-launching simulations (at 2.4 GHz).
Table 1. Material properties for ray-launching simulations (at 2.4 GHz).
MaterialεrConductivity (S/m)
Beech wood2.04730.0527
Seat leather1.20.24
Concrete8.50.02
Metal4.537.8×106
Table 2. Ray-launching simulation parameters.
Table 2. Ray-launching simulation parameters.
ParametersValues for 2.4 GHzValues for 5.5 GHz
Transmitted power8.38 dBm−4.3 dBm
Antenna type/gainMonopole/0.3 dBMonopole/3.74 dB
Launched rays resolution1 degree1 degree
Permitted maximum rebounds66
Cuboids size (mesh resolution)50 cm × 50 cm × 50 cm50 cm × 50 cm × 50 cm
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Picallo, I.; Vidal-Balea, A.; Lopez-Iturri, P.; Fraga-Lamas, P.; Klaina, H.; Fernández-Caramés, T.M.; Falcone, F. Wireless Channel Assessment of Auditoriums for the Deployment of Augmented Reality Systems for Enhanced Show Experience of Impaired Persons. Proceedings 2020, 42, 30. https://doi.org/10.3390/ecsa-6-06587

AMA Style

Picallo I, Vidal-Balea A, Lopez-Iturri P, Fraga-Lamas P, Klaina H, Fernández-Caramés TM, Falcone F. Wireless Channel Assessment of Auditoriums for the Deployment of Augmented Reality Systems for Enhanced Show Experience of Impaired Persons. Proceedings. 2020; 42(1):30. https://doi.org/10.3390/ecsa-6-06587

Chicago/Turabian Style

Picallo, Imanol, Aida Vidal-Balea, Peio Lopez-Iturri, Paula Fraga-Lamas, Hicham Klaina, Tiago M. Fernández-Caramés, and Francisco Falcone. 2020. "Wireless Channel Assessment of Auditoriums for the Deployment of Augmented Reality Systems for Enhanced Show Experience of Impaired Persons" Proceedings 42, no. 1: 30. https://doi.org/10.3390/ecsa-6-06587

Article Metrics

Back to TopTop