Search Results (72)

Indoor navigation poses persistent challenges due to the limitations of traditional positioning systems within buildings. In this study, we propose a novel approach to address this issue—not by continuously tracking the user’s location, but by estimating their position based on how closely their observed behavior matches the expected progression along a predefined route. This concept, while not universally applicable, is well-suited for specific indoor navigation scenarios, such as guiding couriers or delivery personnel through complex residential buildings. We explore this idea in detail in our paper. To implement this behavior-based localization, we introduce an LSTM-based method for classifying user behavior patterns, including standing, walking, and using stairs or elevators, by analyzing velocity sequences derived from smartphone sensors’ data. The developed model achieved 75% accuracy for individual activity type classification within one-second time windows, and 98.6% for full-sequence classification through majority voting. These results confirm the viability of real-time activity recognition as the foundation for a navigation system that aligns live user behavior with pre-recorded patterns, offering a cost-effective alternative to infrastructure-heavy indoor positioning systems. Full article

Data over sound (DoS) is an established technique that has experienced a resurgence in recent years, finding applications in areas such as contactless payments, device pairing, authentication, presence detection, toys, and offline data transfer. This study introduces CardiaWhisper, a system that extends the DoS concept to the medical domain by using a medical data-over-sound (MDoS) framework. CardiaWhisper integrates wearable biomedical sensors with home care systems, edge or IoT gateways, and telemedical networks or cloud platforms. Using a transmitter device, vital signs such as ECG (electrocardiogram) signals, PPG (photoplethysmogram) signals, RR (respiratory rate), and ACC (acceleration/movement) are sensed, conditioned, encoded, and acoustically transmitted to a nearby receiver—typically a smartphone, tablet, or other gadget—and can be further relayed to edge and cloud infrastructures. As a case study, this paper presents the real-time transmission and processing of ECG signals. The transmitter integrates an ECG sensing module, an encoder (either a PLL-based FM modulator chip or a microcontroller), and a sound emitter in the form of a standard piezoelectric speaker. The receiver, in the form of a mobile phone, tablet, or desktop computer, captures the acoustic signal via its built-in microphone and executes software routines to decode the data. It then enables a range of control and visualization functions for both local and remote users. Emphasis is placed on describing the system architecture and its key components, as well as the software methodologies used for signal decoding on the receiver side, where several algorithms are implemented using open-source, platform-independent technologies, such as JavaScript, HTML, and CSS. While the main focus is on the transmission of analog data, digital data transmission is also illustrated. The CardiaWhisper system is evaluated across several performance parameters, including functionality, complexity, speed, noise immunity, power consumption, range, and cost-efficiency. Quantitative measurements of the signal-to-noise ratio (SNR) were performed in various realistic indoor scenarios, including different distances, obstacles, and noise environments. Preliminary results are presented, along with a discussion of design challenges, limitations, and feasible applications. Our experience demonstrates that CardiaWhisper provides a low-power, eco-friendly alternative to traditional RF or Bluetooth-based medical wearables in various applications. Full article

As Location-Based Services (LBSs) rapidly develop, indoor localization technology is garnering significant attention as a critical component. Smartphones have become tools for indoor localization due to their highly integrated sensors, fast-evolving computational capabilities, and widespread user adoption. With the rapid advancement of smartphones, methods for smartphone-based indoor localization have increasingly attracted attention. Although there are reviews on indoor localization, there is still a lack of systematic reviews focused on smartphone-based indoor localization methods. In particular, existing reviews have not systematically analyzed smartphone-based indoor localization methods or considered the combination of smartphone sensor data with prior knowledge of the indoor environment to enhance localization performance. In this study, through systematic retrieval and analysis, the existing research was first categorized into three types to dissect the strengths and weaknesses based on the types of data sources integrated, i.e., single sensor data sources, multi-sensor data fusion, and the combination of spatial context with sensor data. Then, four key issues are discussed and the research gaps in this field are summarized. Finally, a comprehensive conclusion is provided. This paper offers a systematic reference for research and technological applications related to smartphone-based indoor localization methods. Full article

Dead reckoning is a promising yet often overlooked smartphone-based indoor localization technology that relies on phone-mounted sensors for counting steps and estimating walking directions, without the need for extensive sensor or landmark deployment. However, misalignment between the phone’s direction and the user’s actual movement direction can lead to unreliable direction estimates and inaccurate location tracking. To address this issue, this paper introduces SWiLoc (Smartphone and WiFi-based Localization), an enhanced direction correction system that integrates passive WiFi sensing with smartphone-based sensing to form Correction Zones. Our two-phase approach accurately measures the user’s walking directions when passing through a Correction Zone and further refines successive direction estimates outside the zones, enabling continuous and reliable tracking. In addition to direction correction, SWiLoc extends its capabilities by incorporating a localization technique that leverages corrected directions to achieve precise user localization. This extension significantly enhances the system’s applicability for high-accuracy localization tasks. Additionally, our innovative Fresnel zone-based approach, which utilizes unique hardware configurations and a fundamental geometric model, ensures accurate and robust direction estimation, even in scenarios with unreliable walking directions. We evaluate SWiLoc across two real-world environments, assessing its performance under varying conditions such as environmental changes, phone orientations, walking directions, and distances. Our comprehensive experiments demonstrate that SWiLoc achieves an average 75th percentile error of 8.89 degrees in walking direction estimation and an 80th percentile error of 1.12 m in location estimation. These figures represent reductions of 64% and 49%, respectively for direction and location estimation error, over existing state-of-the-art approaches. Full article

With the rapid development of high-precision positioning service applications, there is a growing demand for accurate and seamless positioning services in indoor and outdoor (I/O) scenarios. To address the problem of low localization accuracy in the I/O transition area and the difficulty of achieving fast and accurate I/O switching, a Kalman filter based on the salp swarm algorithm (SSA) for seamless multi-source fusion positioning of global positioning system/inertial navigation system/smartphones (GPS/INS/smartphones) is proposed. First, an Android smartphone was used to collect sensor measurement data, such as light, magnetometer, and satellite signal-to-noise ratios in different environments; then, the change rules of the data were analyzed, and an I/O detection algorithm based on the SSA was used to identify the locations of users. Second, the proposed I/O detection service was used as an automatic switching mechanism, and a seamless indoor–outdoor localization scheme based on improved Kalman filtering with K-L divergence is proposed. The experimental results showed that the SSA-based I/O switching model was able to accurately recognize environmental differences, and the average accuracy of judgment reached 97.04%. The localization method achieved accurate and continuous seamless navigation and improved the average localization accuracy by 53.79% compared with a traditional GPS/INS system. Full article

Wi-Fi round-trip time (RTT) ranging has proven successful in indoor localization. Here, it is shown to be useful outdoors as well—and more accurate than smartphone code-based GNSS when used near buildings with Wi-Fi access points (APs). A Bayesian grid with observation and transition models is used to update a probability distribution of the position of the user equipment (UE). The expected value (or the mode) of this probability distribution provides an estimate of the UE location. Localization of the UE using RTT ranging depends on knowing the locations of the Wi-Fi APs. Determining these positions from floor plans can be time-consuming, particularly when the APs may not be accessible (as is often the case in order to prevent unauthorized access to the network). An alternative is to invert the Bayesian grid method for locating the UE—which uses distance measurements from the UE to several APs with known position. In the inverted method we instead locate the AP using distance measurements from several known positions of the UE. In localization using RTT, at any given time, a decision has to be made as to which APs to range to, given that there is a cost associated with each “range probe” and that some APs may not respond. This can be problematic when the APs are not uniformly distributed. Without a suitable ranging strategy, one can enter a dead-end state where there is no response from any of the APs currently being ranged to. This is a particular concern when there are local clusters of APs that may “capture” the attention of the RTT app. To avoid this, a strategy is developed here that takes into account distance, signal strength, time since last “seen”, and the distribution of the directions to APs from the UE—plus a random contribution. We demonstrate the method in a situation where there are no line-of-sight (LOS) connections and where the APs are inaccessible. The localization accuracy achieved exceeds that of the smartphone code-based GNSS. Full article

Robust and accurate three-dimensional localization is essential for personal navigation, emergency rescue, and worker monitoring in indoor environments. For localization technology to be employed in various applications, it is necessary to reduce infrastructure dependence and limit the maximum error bound. This study aims to accurately estimate the location of various people using smartphones in a building with a cloud platform-based localization system. The proposed technology is modularized in a hierarchical structure to sequentially estimate the floor and location. This system comprises four localization modules: course level detection, fine level detection (FLD), fine location tracking (FLT), and level change detection (LCD). Each module operates organically according to the current user status. The position estimation range is defined as a total of three phases, and an appropriate location estimation module suitable for the corresponding phase operates to estimate the user’s location gradually and precisely. When the user’s floor is determined by an FLD, the two-dimensional position of the user is estimated by an FLT module that tracks the user’s position by comparing the received signal strength indicator vector sequence and radio map. Also, LCD recognizes the user’s floor change and converts the user’s phase. To verify the proposed technology, various experiments were conducted in a six-story building, and an average accuracy of less than 2 m was obtained. Full article

Due to the unavailability of GPS indoors, various indoor pedestrian positioning approaches have been designed to estimate the position of the user leveraging sensory data measured from inertial measurement units (IMUs) and wireless signal receivers, such as pedestrian dead reckoning (PDR) and received signal strength (RSS) fingerprinting. This study is similar to the previous study in that it estimates the user position by fusing noisy positional information obtained from the PDR and RSS fingerprinting using the Bayes filter in the indoor pedestrian positioning system. However, this study differs from the previous study in that it uses an enhanced state estimation approach based on the ensemble transform Kalman filter (ETKF), called QETKF, as the Bayes filer for the indoor pedestrian positioning instead of the SKPF proposed in the previous study. The QETKF estimates the updated user position by fusing the predicted position by the PDR and the positional measurement estimated by the RSS fingerprinting scheme using the ensemble transformation, whereas the SKPF calculates the updated user position by fusing them using both the unscented transformation (UT) of UKF and the weighting method of PF. In the field of Earth science, the ETKF has been widely used to estimate the state of the atmospheric and ocean models. However, the ETKF algorithm does not consider the model error in the state prediction model; that is, it assumes a perfect model without any model errors. Hence, the error covariance estimated by the ETKF can be systematically underestimated, thereby yielding inaccurate state estimation results due to underweighted observations. The QETKF proposed in this paper is an efficient approach to implementing the ETKF applied to the indoor pedestrian localization system that should consider the model error. Unlike the ETKF, the QETKF can avoid the systematic underestimation of the error covariance by considering the model error in the state prediction model. The main goal of this study is to investigate the feasibility of the pedestrian position estimation for the QETKF in the indoor localization system that uses the PDR and RSS fingerprinting. Pedestrian positioning experiments performed using the indoor localization system implemented on the smartphone in a campus building show that the QETKF can offer more accurate positioning results than the ETKF and other ensemble-based Kalman filters (EBKFs). This indicates that the QETKF has great potential in performing better position estimation with more accurately estimated error covariances for the indoor pedestrian localization system. Full article

Researchers in academics and companies working on location-based services (LBS) are paying close attention to indoor localization based on pedestrian dead reckoning (PDR) because of its infrastructure-free localization method. PDR is the fundamental localization technique that utilize human motion to perform localization in a relative sense with respect to the initial position. The size, weight, and power consumption of micromechanical systems (MEMS) embedded into smartphones are remarkably low, making them appropriate for localization and positioning. Traditional pedestrian PDR methods predict position and orientation using stride length and continuous integration of acceleration in step and heading system (SHS)-based PDR and inertial navigation system (INS)-PDR, respectively. However, these two approaches provide accumulations of error and do not effectively leverage the inertial measurement unit (IMU) sequences. The PDR navigation solution relays on the standard of the MEMS, which yields PDR with the acceleration and angular velocity from the accelerometer and gyroscope, respectively. However, low-cost small MEMSs endure enormous error sources such as bias and noise. Hence, MEMS assessments lead to navigation solution drifts when utilized as inputs to the PDR. As a consequence, numerous methods have been proposed to mitigate and model the errors related to MEMS. Deep learning-based dead reckoning algorithms are provided to address aforementioned issues owing to the end-to-end learning framework. This paper proposes a hybrid convolutional neural network (CNN) and long short-term memory network (LSTM)-based inertial PDR system that extracts inertial measurement units (IMU) sequence features. The end-to-end learning framework is introduced to leverage the efficiency of low-cost MEMS because data-driven solutions provide more complete knowledge of the ever-increasing data volume and computational power over the filtering model approach. A CNN-LSTM model was employed to capture local spatial and temporal features. Experiments conducted on odometry datasets collected from multi-sensor backpack devices demonstrated that the proposed architecture outperformed previous traditional PDR methods, demonstrating that the root mean square error (RMSE) for the best user was 0.52 m. On the handheld smartphone-only dataset the best achieved R² metric was 0.49. Full article

Currently, outdoor navigation systems have widely been used around the world on smartphones. They rely on GPS (Global Positioning System). However, indoor navigation systems are still under development due to the complex structure of indoor environments, including multiple floors, many rooms, steps, and elevators. In this paper, we present the design and implementation of the Indoor Navigation System using Unity and Smartphone (INSUS). INSUS shows the arrow of the moving direction on the camera view based on a smartphone’s augmented reality (AR) technology. To trace the user location, it utilizes the Simultaneous Localization and Mapping (SLAM) technique with a gyroscope and a camera in a smartphone to track users’ movements inside a building after initializing the current location by the QR code. Unity is introduced to obtain the 3D information of the target indoor environment for Visual SLAM. The data are stored in the IoT application server called SEMAR for visualizations. We implement a prototype system of INSUS inside buildings in two universities. We found that scanning QR codes with the smartphone perpendicular in angle between ${60}^{\circ }$ and ${100}^{\circ }$ achieves the highest QR code detection accuracy. We also found that the phone’s tilt angles influence the navigation success rate, with ${90}^{\circ }$ to ${100}^{\circ }$ tilt angles giving better navigation success compared to lower tilt angles. INSUS also proved to be a robust navigation system, evidenced by near identical navigation success rate results in navigation scenarios with or without disturbance. Furthermore, based on the questionnaire responses from the respondents, it was generally found that INSUS received positive feedback and there is support to improve the system. Full article

Indoor location-based services constitute an important part of our daily lives, providing position and direction information about people or objects in indoor spaces. These systems can be useful in security and monitoring applications that target specific areas such as rooms. Vision-based scene recognition is the task of accurately identifying a room category from a given image. Despite years of research in this field, scene recognition remains an open problem due to the different and complex places in the real world. Indoor environments are relatively complicated because of layout variability, object and decoration complexity, and multiscale and viewpoint changes. In this paper, we propose a room-level indoor localization system based on deep learning and built-in smartphone sensors combining visual information with smartphone magnetic heading. The user can be room-level localized while simply capturing an image with a smartphone. The presented indoor scene recognition system is based on direction-driven convolutional neural networks (CNNs) and therefore contains multiple CNNs, each tailored for a particular range of indoor orientations. We present particular weighted fusion strategies that improve system performance by properly combining the outputs from different CNN models. To meet users’ needs and overcome smartphone limitations, we propose a hybrid computing strategy based on mobile computation offloading compatible with the proposed system architecture. The implementation of the scene recognition system is split between the user’s smartphone and a server, which aids in meeting the computational requirements of CNNs. Several experimental analysis were conducted, including to assess performance and provide a stability analysis. The results obtained on a real dataset show the relevance of the proposed approach for localization, as well as the interest in model partitioning in hybrid mobile computation offloading. Our extensive evaluation demonstrates an increase in accuracy compared to traditional CNN scene recognition, indicating the effectiveness and robustness of our approach. Full article

In the process of determining positioning point by constructing geometric relations on the basis of the positions and poses obtained from multiple pairs of epipolar geometry, the direction vectors will not converge due to the existence of mixed errors. The existing methods to calculate the coordinates of undetermined points directly map the three-dimensional direction vector to the two-dimensional plane and take the intersection points that may be at infinity as the positioning result. To end this, an indoor visual positioning method with three-dimensional coordinates using built-in smartphone sensors based on epipolar geometry is proposed, which transforms the positioning problem into solving the distance from one point to multiple lines in space. It combines the location information obtained by the accelerometer and magnetometer with visual computing to obtain more accurate coordinates. Experimental results show that this positioning method is not limited to a single feature extraction method when the source range of image retrieval results is poor. It can also achieve relatively stable localization results in different poses. Furthermore, 90% of the positioning errors are lower than 0.58 m, and the average positioning error is less than 0.3 m, meeting the accuracy requirements for user localization in practical applications at a low cost. Full article

These recent years have witnessed the importance of indoor localization and tracking as people are spending more time indoors, which facilitates determining the location of an object. Indoor localization enables accurate and reliable location-based services and navigation within buildings, where GPS signals are often weak or unavailable. With the rapid progress of smartphones and their growing usage, smartphone-based positioning systems are applied in multiple applications. The smartphone is embedded with an inertial measurement unit (IMU) that consists of various sensors to determine the walking pattern of the user and form a pedestrian dead reckoning (PDR) algorithm for indoor navigation. As such, this study reviewed the literature on indoor localization based on smartphones. Articles published from 2015 to 2022 were retrieved from four databases: Science Direct, Web of Science (WOS), IEEE Xplore, and Scopus. In total, 109 articles were reviewed from the 4186 identified based on inclusion and exclusion criteria. This study unveiled the technology and methods utilized to develop indoor localization systems. Analyses on sample size, walking patterns, phone poses, and sensor types reported in previous studies are disclosed in this study. Next, academic challenges, motivations, and recommendations for future research endeavors are discussed. Essentially, this systematic literature review (SLR) highlights the present research overview. The gaps identified from the SLR may assist future researchers in planning their research work to bridge those gaps. Full article

Nowadays, smartphones have become indispensable in people’s daily work and life. Since various sensors and communication chips have been integrated into smartphones, it has become feasible to provide indoor positioning using phones. This paper proposes such a solution based on a smartphone, combining Bluetooth low energy (BLE) and pedestrian dead reckoning (PDR) in the particle filter framework to realize real-time and reliable indoor positioning. First, the smartphone’s built-in accelerometer, magnetometer, and gyroscope are used to provide data measurements and formulate a feasible method for PDR. Second, a range-free weighted centroid algorithm is proposed to realize BLE-based localization with low computation complexity. However, a single positioning technology has limitations, e.g., the cumulative error of PDR and the received signal strength fluctuation of BLE. Finally, to exploit the complementary strengths of each technology, a fusion framework utilizing a particle filter is proposed to combine PDR and BLE-based methods and provides more stable and accurate positioning results. Experiments are conducted on a floor in a campus building. Experimental results show that our proposed fused positioning method offers more accurate and stable performance in the long run compared with single PDR or BLE-based positioning. The achieved average positioning error is 1.34 m, which is reduced by 24.16% compared with PDR positioning and 10.60% compared with BLE-based positioning. Moreover, about 95% of the positioning errors are smaller than 1.7 m. The proposed fused positioning method has a vast application prospect in indoor navigation, indoor user tracking, and interactive experience for indoor visitors. Full article

Independent wayfinding is a major challenge for blind and visually impaired (BVI) travelers. Although GPS-based localization approaches enable the use of navigation smartphone apps that provide accessible turn-by-turn directions in outdoor settings, such approaches are ineffective in indoor and other GPS-deprived settings. We build on our previous work on a localization algorithm based on computer vision and inertial sensing; the algorithm is lightweight in that it requires only a 2D floor plan of the environment, annotated with the locations of visual landmarks and points of interest, instead of a detailed 3D model (used in many computer vision localization algorithms), and requires no new physical infrastructure (such as Bluetooth beacons). The algorithm can serve as the foundation for a wayfinding app that runs on a smartphone; crucially, the approach is fully accessible because it does not require the user to aim the camera at specific visual targets, which would be problematic for BVI users who may not be able to see these targets. In this work, we improve upon the existing algorithm so as to incorporate recognition of multiple classes of visual landmarks to facilitate effective localization, and demonstrate empirically how localization performance improves as the number of these classes increases, showing the time to correct localization can be decreased by 51–59%. The source code for our algorithm and associated data used for our analyses have been made available in a free repository. Full article