Next Article in Journal
Initial Study Using Electrocardiogram for Authentication and Identification
Next Article in Special Issue
Sensing System for Plegic or Paretic Hands Self-Training Motivation
Previous Article in Journal
Non-Destructive Testing for Cavity Damages in Automated Machines Based on Acoustic Emission Tomography
Previous Article in Special Issue
Comparison of Empirical Mode Decomposition and Singular Spectrum Analysis for Quick and Robust Detection of Aerodynamic Instabilities in Centrifugal Compressors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Wireless Capsule Endoscope Localization with Phase Detection Algorithm and Adaptive Body Model

by
Paweł Oleksy
* and
Łukasz Januszkiewicz
Institute of Electronics, Lodz University of Technology, Politechniki 10 Street, 93-590 Lodz, Poland
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(6), 2200; https://doi.org/10.3390/s22062200
Submission received: 17 January 2022 / Revised: 9 March 2022 / Accepted: 10 March 2022 / Published: 11 March 2022

Abstract

:
Wireless capsule endoscopes take and send photos of the human digestive tract, which are used for medical diagnosis. The capsule’s location enables exact identification of the regions with lesions. This can be carried out by analyzing the parameters of the electromagnetic wave received from the capsule. Because the human body is a complex heterogeneous environment that impacts the propagation of wireless signals, determining the distance between the transmitter and the receiver based on the received power level is challenging. An enhanced approach of identifying the location of endoscope capsules using a wireless signal phase detection algorithm is presented in this paper. For each capsule position, this technique uses adaptive estimation of human body model permittivity. This approach was tested using computer simulations in Remcom XFdtd software using a numerical, heterogeneous human body model, as well as measurements with physical phantom. The type of transmitting antenna employed in the capsule also has a significant impact on the suggested localization method’s accuracy. As a result, the helical antenna, which is smaller than the dipole, was chosen as the signal’s source. For both the numerical and physical phantom studies, the proposed technique with adaptive body model enhances localization accuracy by roughly 30%.

1. Introduction

Diagnosis of the gastrointestinal tract can now be performed with the use of capsule endoscopes, which provide doctors with a lot of valuable information. Such capsules are fitted with tiny cameras that allow them to detect anatomical changes without causing any discomfort to the patient. When using such endoscopes for medical examinations, the picture delivered from the capsule must be complemented by information regarding its precise location. It is critical for surgical or precise medication delivery in the therapy of the diagnosed disease. It is crucial to know not just where the capsule is located along the gastrointestinal system, but also where it is in three dimensions to correlate data from the capsule with results of other medical imaging techniques (e.g., magnetic resonance imaging—MRI). Many methods for locating endoscopic capsules have been presented [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17], with the following approaches standing out: analysis of the picture captured by the endoscopic capsule [1,2,3,4,5,6], analysis of the electromagnetic field [7,8,9,10,11,12,13,14,15,16,17] and analysis and tracking of capsule movement using inertial sensors [4,14].
The detection of capsule location along the digestive tract can be carried out using image analysis methods. A motion tracking model is utilized in these systems, which is based on the analysis of characteristic features of subsequently recorded picture frames [1,2,3,4,5,6]. The objective is to detect and track the relevant feature point that is identical in two recorded frames. These points are assigned to different positions on the recorded frames as the capsule travels relative to them. This type of tracking necessitates the employment of an intestinal model to calculate the distance traveled by the capsule between two captured photos. As a result, the estimation accuracy in this technique is dependent on the parameters of the selected model as well as the quality of the recorded picture, and it may reach 86% on average. The speed of the capsules in the digestive tract limits image processing methods. The number of distinctive points in future frames collected by the camera reduces as the capsule’s speed rises. If the capsule speed is less than 4 mm/s, methods that estimate capsule speed can achieve accuracy of up to 93% [2].
There are also hybrid methods that employ data from a variety of sources or sensors to detect the capsule’s position and orientation in the digestive tract. The usage of a camera with a DSP (digital signal processor) to perform image processing algorithms is one example. It is used with a DMP (digital motion processor) in an inertial sensor to estimate the capsule’s orientation [3]. With the use of video-based approaches, this hybrid system can identify capsule position in three-dimensional space.
To find the location of the capsule in three dimensions, methods based on electromagnetic field analysis are applied. In a wireless capsule endoscope system, procedures based on electromagnetic field analysis can produce good results. The capsule was located with an accuracy of below 20 mm using an algorithm based on the distribution of the magnetic field [7,8]. Especially in a solution that uses a planar cable driven parallel robot (CDPR) and measurements of the quasistatic magnetic field of a Hall effect sensor, the localization error may be at the level of a few millimeters. In this method, by combining the hall sensor matrix—which is used to track permanent magnet movement in capsule—with the planar CDPR tracking control, the position of the capsule can be obtained by solving forward kinematics of CPRD [8]. This system is placed under the patient’s bed, which disqualifies the possibility of using this solution in wearable systems. In addition, taking into account the time of passage of the capsule through the digestive tract, proposed solution may require the patients to lie on their back for 8 h. Other methods use algorithms to estimate capsule position based on received signal parameters, such as power level, radio wave propagation delay or phase shift between the waves received by different receivers [9,10,11,12,13,14,15,16,17,18]. However, because of the complicated propagation environment within the body, converting received power or phase delay to the distance between the capsule and external receivers is problematic. It is caused by the human body’s complex heterogeneous structure, which has a significant impact on the received signal. Individual patient body models generated with the use of an MRI scanner can provide additional information that improves location accuracy. Unfortunately, due to the expense and time required for such scans, this strategy is unworkable. As a result, capsules employ inertial sensors and algorithms that may include digital filters devoted to movement tracking, such as particle or unscented Kalman filter (UKF) [3,11].
Algorithms based on phase detection can also be used to locate transmitters that are within the body. With the use of software-defined radio modules and RFID-enabled tags, such a system may be implemented in a realistic way that is both cost effective and provides useful item positioning precision [18]. A similar method may be used to locate an endoscope capsule; however, the complex environment of the human body makes such a device challenging to build due to wireless signal propagation effects. As a result, human tissue parameters, such as conductivity and dielectric permittivity, have a considerable impact on received signal parameters. Therefore, the authors suggested a new method in which a received signal phase detection algorithm is combined with a reduced human body model [17]. In the presented approach, the reduced human body model is a simplified human body model that, for each capsule location, approximates the body with homogenous material—the permittivity of which is adjusted for a particular location of the capsule. This model imitates only selected parameters or parts of the human body. In the case of the model used in the measurement experiment, the shape of the model and its internal structure were reduced. It was assumed that the model will have a size and shape similar to the human torso and electrical properties similar to the average value for the entire human body εr = 52, which is commonly used in wearable system research.
In the case of capsule endoscope localization, the approach for verifying the localization algorithms is quite difficult and various verification setups were delivered to test proposed techniques. Received signal analysis is the most typical approach for verification based on computer simulations with numerical models of the human body [7,10,15,17]. Systems that use tracking and image processing are verified mainly with the images recorded by the endoscopes [1,2,3,4,5,6]. The next step is then the validation with the use of physical models and dedicated measuring devices. They can be made in the form of thin vessels filled with liquid simulating tissues and animal tissues, such as intestines. Robotic arms are typically used to imitate the capsule’s movement in such experiments. However, the validation of the performance of the algorithm for locating the capsule endoscope in the human digestive system is not possible. Such experiments that utilize prototype transmitters could be dangerous and, moreover, require the consent of the bioethical commission, which is not achievable at the initial stage of the research. For this reason, various physical phantoms are used with parameters and dimensions similar to the human body [16]. Another solution is to use animal tissues and organs [7], where the pig’s intestine can be used to verify the algorithms based on video analysis [3]. In the case of algorithms based on the analysis of the electromagnetic field, a heterogeneous numerical model of body is sufficient for verification because it allows taking into account phenomena such as a variation in the velocity of wave propagation and reflections and diffraction at the boundary of materials with different electrical parameters.
In this article, the research on wireless localization of endoscopic capsule that uses detection of the phase of the electromagnetic wave is presented. The results of the preliminary study on the algorithm were presented in [19], where the verification of simplified algorithm was performed with the use of computer simulations and heterogenous human body model in Remcom XFdtd software. Here, an enhanced version of the algorithm, in which the proposed function of localization error is minimized by iterative modification of model permittivity, is described. Compared to the previous version [19], it is supplemented now with additional calibration procedure that is required for localization based on measurement data. In this paper the measurement verification of localization algorithm is presented. Additionally, the antennas used in measurements are presented together with their impedance matching analysis.
The advantage of the proposed method over other techniques is that it does not require knowledge of the thickness and electrical parameters of individual tissues of the human body. That is why the suggested approach of wireless capsule localization has the benefit of being adaptable to patients of diverse body proportions. In contrast to the methods that use image analysis, it enables the localization of the endoscopic capsule in three-dimensional space. Therefore, the combination of these two methods makes it possible to locate capsule both along the digestive system and in the three-dimensional space.

2. Materials and Methods

Numerical models of the human body are widely used to design wireless systems that operate in this complex environment [20]. Depending on the exact application of such models, they differ in shape and internal structure [21]. They can be made of one material (homogeneous models) or from many materials of different electric properties (heterogeneous models). Additionally, the shape and size of models can be either identical with human body (anthropomorphic models) or different from this (simplified models). The last one mentioned can be used not only for the design of antennas and the analysis of the radio link in wearable systems but also for the localization of radio transmitters inside the body.
To estimate the velocity of wave propagation in the human body, the proposed localization technique employs a simplified body model. The wave velocity is mostly determined by the tissue relative permittivity, εr, in the human body. The average value for the entire human body, εr = 52, is commonly used in wearable system research, such as wearable antenna radiation pattern analysis. This approach is insufficient for endoscope capsule localization because local changes in body permittivity affect the phase of the wave received from the interior of the body. Average permittivity varies also depending on the anatomy of the patient in the thoracic area. Furthermore, because there are multiple tissues in the digestive tract with different permittivity values, the average value will fluctuate for each specific position of the capsule. Despite this, in the method that uses received signal analysis, the complex interaction of electromagnetic wave and the human body results in a particular phase shift. It can be interpreted, as the phase shift was not introduced by multi-tissue media but a uniform, homogenous material that is between two antennas. Such virtual material has its permittivity adjusted for a particular location of the endoscope in the body. This directly affects the distance determined from Equation (1).
Permittivity is the main feature of the implemented model, but in the proposed approach it has constant value for specified position of the capsule. In the proposed algorithm, the model has same value of permittivity towards each receiver, but it may be different for each capsule position. The algorithm implements a homogeneous model, which has an average permittivity value for a given capsule position, but model permittivity depends on the capsule position. As a consequence, in the suggested technique, the permittivity of a homogeneous model of the human body is automatically modified for each capsule position to increase the accuracy of the predicted position compared with findings achieved with constant permittivity.
The phase difference of arrival (PDoA) technique is used to determine capsule coordinates [10]. The phase difference of two transmitted signals with frequencies f1 and f2, the coordinates of the N-th receiving antennas (shown in Figure 1), and the permittivity of a simplified human body model are all required for this procedure. The distances dn between the capsule and the receivers are determined in the first stage of the procedure (1). Because this necessitates knowledge of the model permittivity, the value ɛr = 52 is assumed at the initial step. Because average permittivity towards each antenna may differ in a diverse environment, estimated distances dn (1) are only approximate.
d n = c 2 π ε r Δ φ n Δ f
dn—distance of the capsule from the N-th antenna placed on the human body; c—velocity of an electromagnetic wave in a vacuum; ɛr—model permittivity; ∆φn—phase difference of the received signals sent on two frequencies f1 and f2; ∆f—difference between frequency f1 and f2.
The Gauss–Newton algorithm is then used to estimate capsule coordinates, looking for coordinates (u, v, x) that allow the following function S to be minimized (2).
S = n = 1 N r n 2
N—number of receiving antennas placed on the body,
r n = d n x u n 2 + y v n 2 + z w n 2
x, y, z—estimated capsule coordinates; un, vn, wn—coordinates of antennas placed on the body.
The error function erri (3) is obtained for each estimated position. This represents the distance between the positions obtained in the last two iterations of the Gauss–Newton algorithm.
e r r i = x i x i 1 2 + y i y i 1 2 + z i z i 1 2
erri—error of the i-th iteration of the least squares method; xi, yi, zi—capsule coordinates estimated in the i-th iteration of the least squares algorithm, where 0 < i < 50.
The erri Function (3) was minimized using ɛr that was modified for each iteration step in the initial version of the proposed algorithm [17]. The convergence criterion erri < 20 was not reached in that method for most capsule positions predicted for starting permittivity ɛr = 52. For a transmitted signal frequency of 400 MHz, the difference between the final two approximations is bigger than the dimensions of a tuned dipole antenna.
The flowchart of an enhanced algorithm for capsule tracking inside the human body is shown in Figure 1. The initial permittivity is set to the average value for human tissue ɛr = 52 at the starting point for the capsule, which is specified at the beginning of the digestive system. Verification of the algorithm performance in measurements with physical phantoms compared with the simulation [19] requires a calibration procedure at the beginning. The calibration data, which are the phase differences measured for each receiver placed directly at the capsule antenna, allow researchers to reduce the impact of the antennas construction, e.g., its case or cable connector on the localization accuracy. The capsule position is then determined using the Gauss–Newton technique based on recorded phase discrepancies. An additional step in the algorithm was included to increase the method’s accuracy. This minimizes the function S(2), according to Formula (4), by modifying the value of the model permittivity ɛr, but only in the range for which the Gauss–Newton technique has achieved convergence in the previous phase. Practically, its value is in the range from 1 to 60.
S m i n = min ε r   ϵ   < 1 , 60 > | S ( ε r ) |
The proposed minimization procedure is an iterative process that can have up to 50 iterations or is repeated until the convergence criterion of Gauss–Newton is met. This allows finding the best value of model permittivity ɛr for which the sum of squares of residuals described by S Functions (2) reaches its minimum value Smin (4). The limit of iteration numbers in this step was introduced to prevent software deadlock caused by differences in tissue characteristics between the capsule and receiving antennas. Figure 1 shows the added step in the algorithm as a blue frame. When compared to the original version of the algorithm from [17], not only was the Gauss–Newton method’s convergence condition met, but the degree of accuracy of the S(2) function was also improved, implying that the difference between the distance computed with Equation (1), and the distance estimated by the Gauss–Newton method was reduced. The Gauss–Newton algorithm does not approach convergence for each measurement of the received signal phase due to the heterogeneous nature of the human body and the reflections of the electromagnetic wave. Because the phase of the received signal may change nonlinearly with frequency, the estimated distances to the following receiving antennas are ambiguous. The precision of the estimation obtained for the permittivity value for which the sum of the differences S(2) is the smallest is validated in the suggested technique by examining the values of the S and erri functions according to Formula (5) and (6). The value of the S function was assumed to be limited to Sth = N*rn2, where N denotes the number of external antennas and rn denotes the distance between capsule estimate and its real position.
In case of the simulation, the value rn was 30 mm and, respectively, for measurements to 150 mm, which is about 4 times the antenna’s maximum dimension. It was expected that the erri function’s result could not be more than the height of the intended antenna multiplied by four. The estimation found using this selection approach can be discarded in the tracking process, and the position will be revised based on new measurements. If the estimated position is affected by significant error (S and erri function above limits), then updating starting point may cause error propagation to the next estimation. Therefore, usage of determined values of the permittivity and position in next estimation depends on whether the S and erri functions can meet the described criteria. Figure 1 shows the introduced step of the algorithm in a green frame.
S ε r , Δ φ     N r n 2
N—number of receiving antennas; rn—distance between capsule estimate and its real position, constant value: 30 mm for simulation and 150 mm for measurements
e r r i ε r , Δ φ   <   4 H  
H—helical antenna high used in simulation; practically the same value is also sufficient in case of localization based on measurement data.
It is feasible to adjust capsule position when new phase data become available to the algorithm. Although the variable parameter update in the first step has no effect on the final estimate, it does allow for a reduction in the number of algorithm iterations. With the data received for the latest successful estimation, the starting location and permittivity are updated. If the conditions in the green frame in Figure 1 are not satisfied, this step is skipped in order to prevent the mistake from propagating to the next location. If the conditions in the green frame (see Figure 1) are satisfied, then the capsule’s beginning position is updated with the predicted position.

3. Results

The algorithm’s verification consists of two steps. The verification in the first step was based on data gathered as from the computer simulation, whereas the data in the second stage came from measurements performed with simplified physical phantom. Computer simulations were obtained with Remcom XFdtd software version 7.8.1 [22] with the use of NMR heterogenous human body model with a 5 mm voxel size available in this tool. The set of 70 predefined positions of transmitting antenna in the area of the human digestive system was assumed in simulation scenario. The dimensions of the model are as follows: lx = 330 mm, ly = 290 mm, lz = 650 mm.
Due to the size of the capsule endoscope (which is about 2 cm in longest dimension) and the size of the human gastrointestinal tract, it is desired to reduce antenna size as much as possible. On the other hand, the antenna size is limited by the signal frequency and is inversely proportional to it. In the case of capsule endoscopy, the frequency is strictly limited to the MICS band. The overall size of the antenna can be reduced by changing its structure, e.g., by forming the radiator in the shape of a spiral, yet maintaining satisfactory impedance matching. In the research presented here, we have focused on experimental verification of the algorithm. To perform the experiment, we had to fabricate small antennas that operate well in considered frequency band. Unlike endoscopic antennas, our experimental antennas had to be fed with coaxial cable that was connected to the network analyser. Due to this limitation, and considering the manufacturing technologies available in our laboratory, we decided to fabricate the antennas that were large enough to be soldered to coaxial probes. Since, in a real system, the antenna would be connected directly to the transceiver in the capsule, the antenna size was not the subject of our deep analysis here. Figure 2a [17] shows the half-wave dipole transmitting antenna utilized in the initial algorithm testing. The results in this article were obtained using the helical transmitting antennas shown in Figure 2b [23]. As external receivers, dipole antennas matched to 400 MHz in close proximity to the human body were utilized, which are the same as the dipole shown on Figure 2a [17].
The receiving antennas were situated as near to the model as possible to reduce the influence of wave reflections, especially at the interface between the body model and the air. This resulted in antenna detuning; however, in the case of an external receiver, this was corrected by antenna length, which has no size limit in computer simulations. With the use of Equation (1), the placements of external antennas have been improved to reduce distance estimate inaccuracy. The antennas positioned on the torso in the front of the body gave the best accuracy [17]. In comparison to prior study, the addition of the extra receiver (A5 in Figure 3) enhanced localization accuracy. Figure 3 illustrates the simulation setup utilized in the algorithm’s numerical evaluation.
Because endoscopic capsules operate in the MICS band (from 401 MHz to 406 MHz), simulations for signals with frequencies of 403 MHz and 406 MHz were carried out [24]. Using the coordination system shown in Figure 4, the capsule location was modified in the range of x = 100 mm, y = 80 mm and z = 150 mm. The beginning of the coordinate system was regarded as the starting point for the Gauss–Newton localization algorithm.
The distance between the real and estimated positions of the transmitting antenna was defined as the localization error at a given point, which was defined by (7).
L e = x t x e s t 2 + y t y e s t 2 + z t z e s t 2
xt, yt, zt—actual position; xest, yest, zest—coordinates of the estimated position.
The value of S can be minimized with model permittivity value. When examining the position estimate error, it was shown that both S and Le approach a minimum for similar values of ɛr [19]. In this method the localization error can be reduced by decreasing the S function value. However, this method has a limitation resulting from the arrangement of external receivers. Reducing the location error in the proposed method is possible in about 80% of cases, as long as the capsule is located in the area limited in x- and z-axes by external receivers, but it grows considerably in other circumstances [19].
The proposed localization method performance investigated in the simulation for different algorithm versions, transmitting antenna type and configuration of external receivers is presented on Figure 5. The solution with results validation shown in green frame on Figure 1 was used for each case. It can be noticed that both the introduction of the adaptive model of the human body, as well as the modification of the position of external receivers or the use of a different transmitting antenna, allows reduction in the localization error for the method which uses phase detection algorithm. When compared with a half-wave dipole, the helical antenna provides a relatively minor increase in location accuracy, but it has the benefit of being smaller, making it a better alternative for wireless endoscopes. Localization error also depends on the number of external receivers—in changing their number from 4 to 5, it is possible to improve the proposed method’s performance by a few percent.
The algorithm, using the adaptive simplified model, also gives a significant improvement in localization accuracy. Minimization of both the erri and S functions allows a reduction in the mean error by about 30%; additionally, the minimum and maximum errors are reduced. The graph presented in Figure 6 [19] additionally shows the improvement that was achieved by extending the location algorithm by minimizing the S function comparing to its original version [17]. For the proposed antennas configuration and the adopted heterogeneous human body model, the localization error is mainly related to the y- and z-axes in accordance with the coordinate system shown in Figure 4 [19]. The simulations carried out showed that in the case of the x-axis the average localization error oscillates around 10 mm. This value is equivalent to the size of the endoscopic capsule (which in this case is 8 mm in diameter), thus it is deemed to be acceptable.
Considering the location error, the additional information of the signal phase coming from a larger number of receivers may not provide a significant improvement in the algorithm accuracy. Moreover, it may even increase the localization error. Table 1 shows the results of the capsule position estimation on the basis on information on the signal phase from nine external receivers arranged in in the form of a matrix, as presented in Figure 7. Presented results were obtained for 70 different capsule positions in the area of human digestive system. By introducing additional four receivers, the average localization error increased by about 9 mm.
Algorithm verification with measurement experiment was preceded with antennas and human body phantom design. Both external and capsule antennas are helical dipoles that were designed to obtain good impedance matching in MICS band. The proposed antenna used as capsule transmitter is presented in Figure 8. The transmitter antenna is placed in the tissue simulant liquid and requires the usage of additional case that limits the detuning effect. That is why the transmitting antenna (corresponding to the capsule endoscope) was surrounded by a case made of epoxy resin of relative permittivity 3.6 that is presented in Figure 8b. The impedance matching of this antenna is presented in Figure 9 for free space and location in tissue simulant liquid. It is well tunned for the 400 MHz band. The helical dipole for the external receiver it is presented in Figure 10. It was tuned to operate in desired frequency range being attached to the side of body phantom. Figure 11 shows that also this antenna is matched to MICS band for desired location.
At this stage, it was assumed that physical phantom would be a homogeneous model made in the form of a thin-walled cylinder with a diameter of 25 cm and a height of 30 cm, as presented in Figure 12. For the purpose of this model, the measurements of electric properties of tissue simulating fluids were performed. Basing on data given in the literature, it was decided to use fluid with electrical parameters similar to the average parameters for the tissues of the human body. In the proposed experiment, it was assumed that the model parameters should be similar to the average values that are used in the case of electromagnetic simulation and experiments for wearable systems [20]. Electric parameters, as well as the proportions of the prepared solution, were defined experimentally to be as close as possible to permittivity ɛr = 52 and the electrical conductivity σ = 1.8 S/m. For this sake, a solution of water, sugar and salt was prepared in the following proportions: 1 L water, 350 g sugar and 15 g salt. The exact values of permittivity and conductivity of prepared solution may vary additionally on the source of water and the frequency of interest. In the case of the water, the presence of additional minerals may change the parameters of the final solution. For this reason, both the permittivity and the conductivity of the prepared fluid were measured with DiLine measurement setup procedure by Index Sar Company. This uses TEM lines filled with liquid and vector network analyser that measures the change of electric length and loss of line [25]. The permittivity of tissue simulant solution, measured at the temperature of 23 °C at 400 MHz, was equal to εr = 57, and the conductivity was σ = 0.75 S/m.
Measurements of phase difference between antennas were carried out with the use of Anritsu Vector Star MS4647B vector network analyzer (VNA), connected to capsule and external antennas via measurement cable. The calibration plane was placed at the connection point between the antenna and the measurement cable. Phase difference was measured as group delay, which is the rate of change of phase over a specified frequency aperture. In consequence Equation (1) will take the following form (8):
d n = c ε r t g
dn—distance of the capsule from the N-th antenna placed on the human body; c—velocity of light in a vacuum; ɛr—model permittivity;   t g = 1 2 π Δ φ n Δ f —group delay.
The capsule antenna was attached to the precise linear positioner controlled by computer. It allowed us to change the capsule position inside simplified model (Figure 13). A holder arm made of wood was used to minimize the positioner’s influence on the measurements. The computer application allows the capsule to be moved by a given distance. After setting the capsule in the given position, the measurement of group delay is performed.
There are some technical limitations of this positioner that had an impact on the experiment. It only allowed us to change the position of the capsule along one axis. For the purpose of the experiment, the position of the model was manually changed to change the direction of capsule path. Another limitation of this positioner is that it can only move with a constant speed, so that the speed of the capsule was about 2–3 cm/s, which corresponds to the average speed of a peristalsis wave.
In order to verify the error of the endoscopic capsule position estimation, it was necessary to perform a phase measurement for the position for which the actual geometrical coordinates of the capsule are known. For this reason, in the experiment, the capsule was stopped for the short time needed for the measurement, and then it was moved to the next position.
This additional material—the case of the capsule antenna—also impacts the measurement of the group delay in each of the external receivers. During measurements, we noticed that even when the capsule antenna is located directly next to the receiver, the measured group delay is relatively large. For example, the group delay measured directly at one of the receiving antennas was about 3.7 ns, while after the antenna was moved in a straight line by 25 cm, it rose to 4.7 ns. The difference in group delay in these two capsules’ positions is relatively small compared with the value measured directly by the receiver. Therefore, the calibration was applied to find the value of the group delay introduced in the antennas and connecting cables. Such calibration assumes that the antennas are close to each other, and that the delay introduced in the system comes from the antennas and not their separation. Another issue related with calibration is that it requires a known position of the antennas. In a practical case, this is possible when the capsule was just swallowed and is located in the beginning of the digestive tract. That is why we considered the closest distance between the antennas as a candidate solution for calibration procedure.
At the first stage of experiment, a calibration measurement was performed by measuring the group delay for each of the receivers placed successively directly at the capsule antenna. This data is loaded only once in the location algorithm at the beginning after the algorithm initialization procedure, as shown in Figure 1.
Algorithm verification was also preceded by a check of whether the relationship between the value of the S function and the location error Le was similar to the observation for the data obtained as a result of the simulation [19]. It can be seen in Figure 14 that, for similar values of ɛr, in both S and Le functions, it reaches a minimum. Therefore, the proposed algorithm can also be used for measurement data to reduce localization error.
To illustrate the localization error in a better way, we added the presentation of the capsule position in a 2D plane to the manuscript. Figure 15 presents examples of capsule positions obtained with implemented measurements. Due to some positioners limitation, which allows for changing capsule position only on one axis, the capsule moved in straight lines. The main component of the overall estimation error is parallel to the capsule trajectory. This requires further investigation and probably the introduction of additional filtering techniques. Moreover, such an error may be also reduced by connecting the proposed algorithm with a video-based localization method, which gives very good results in cases of endoscopes localization along the digestive system.
Table 2 and Figure 16 present the results of comparing the capsule endoscope localization algorithm with the constant and adaptive model permittivity. Because for the purpose of the experiment, a linear positioner was used with the antenna fixed to ground distance, the capsule position was estimated in 2D, changing its position in the x and y axes. In the case of an algorithm variant with constant permittivity, the value measured with TEM line εr = 57 was applied. It can be noticed that average localization error for algorithm with adaptive model permittivity is reduced more than 2 times. Moreover, the algorithm was able to estimate the capsule position in 90% cases, while for the algorithm with constant model permittivity, it was only able to estimate the capsule position in 50% cases (cases for which the evaluation in Figure 1 in the green frame was positive). Permittivity estimated by the adaptive algorithm was in the range between 2 and 32. Thanks to this, it was possible to compensate for wave reflection in the phantom that impacts signal phase. For the algorithm with adaptive model permittivity, the localization error was only slightly bigger than the antenna size, so it can be assumed that it is at an acceptable level. Figure 15 shows that, for the experiment with the proposed model, the error is the largest along the capsule path.
The received signal is affected not only by the human body but also by the capsule’s orientation. To investigate the impact of the antenna orientation on localization accuracy, both simulation and measurement experiments were carried out. For this purpose, the capsule antenna was rotated by 90° around the x and y axes. Results presented in Figure 17 and Figure 18 show that, in the case of vertical orientation (antenna parallel to z-axis), the localization error was the smallest for both the measurement experiment and simulation.
The computational time of the algorithm and the overall response time of the whole tracking software in each iteration depends mainly on the error in estimating the distance between the capsule and the receivers at this particular location. It has a direct impact on the number of iterations of the Gauss–Newton algorithm. In the case of the simulation, the computation time of the single algorithm iteration was much shorter than in the case of the analysis of measurement data. This is because the Gauss–Newton algorithm achieved the convergence condition in a much smaller number of iterations. To estimate capsule position based on measurement, the algorithm requires around 8 times more steps than in case of simulation. The single position estimation time is equal in average to 0.18 s, while for measurements data, it is 1.52 s.
The proposed tracking software may be applied in two modes: offline and online. In offline mode, the phase difference or group delay are collected in a file, then after the experiment, the algorithm estimates the capsule path. In such an approach, the response time of the whole tracing software is the time needed for single position estimation multiplied by number of measurements. In the case of the experiment in which the capsule position was determined for about 70 cases, this time was, correspondingly, equal to 107 s in case the of measurements, and 12.6 s in the case of simulation data. In the online mode, the total tracking time depends on the speed of the capsule, assuming that the next measurement is performed immediately after the algorithm estimates the position for the previous one.
Practically, in capsule endoscopy, it is important to associate the recorded image with the position along the digestive tract and in 3D space. For this reason, it is not necessary to monitor the position of the endoscope in real time. The reconstruction of the capsule path may take place after the completed examination, just before the analysis of the collected data by the doctor.

4. Discussion

Upon the analysis of simulation and measurement results, it can be observed that the modified algorithm [19] gave better localization accuracy than the original algorithm [17]. The improvement in localization accuracy was observed in approximately 80% of cases when the S function was minimized by changing the value of model permittivity ɛr. The findings in Figure 5 and Figure 6 demonstrate that the localization error has been decreased by roughly 15%. When the transmitter is inside the area confined by receivers in the x and z axes, the proposed technique, minimizing the S (2) function, provides an improvement.
Despite the fact that the presented version of the algorithm improves localization accuracy, estimation error is still higher than in methods based on magnetic field distribution analysis (below 2 cm) [7,8] or those based on the information of a patient’s body structure [13]. Methods based on magnetic field distribution give promising results in applications that require real-time tracking. On the other hand, these methods have some limitations in localization in three dimensions, resulting from the sensitivity of the magnetic field sensors. Moreover, such a solution cannot be applied in wearable systems. Algorithms that track capsules based on recorded pictures also provide acceptable accuracy, with an estimate error of less than 24.9 mm [3]. Most methods have limitations, such as capsule speed or digestive system models, that must be taken into account for each patient. The suggested adaptive body model technique has the benefit of being able to be employed for patients with a variety of body structures. The presented results show that an increased number of external receivers may cause an increase in estimation error. Additionally, the minimum of the S function and the minimum localization error Le may by achieved only if the capsule antenna is located in the area limited by the receiving antennas in the x and z axes. Therefore, development of an algorithm for dynamic selection of 4–5 receiving antennas from a given set might be a potential option.
Based on the simulation findings, it is evident that the type of transmitting antenna used in experiment has an impact on the algorithm’s accuracy, as well as the number of receivers. When a helical antenna and five receivers were used instead of a dipole transmitting antenna and four receivers, the localization error was decreased by around 9 mm.

5. Conclusions

In this paper, the improved method of wireless endoscope capsules localization with the use of phase detection algorithm and simplified human body model with adaptive permittivity was presented.
The suggested approach of wireless capsule localization has the benefit of being adaptable to patients with diverse body proportions. The main advantage of the proposed method is that it does not require knowledge of the internal structure and electrical parameters of individual tissues of the human body. The localization error is still higher than in methods that use information of electromagnetic field distribution, or in models created using NMR scanners that use the human body. The main contribution to the overall estimation error has an error component parallel to the capsule trajectory; therefore, combination of the proposed method, together with a video-based technique, may improve localization accuracy in 3D. The suggested method has a significant benefit in that it not only increases location accuracy, but it also allows researchers to filter out estimations with large errors. Experiments with physical models reveal that the suggested algorithm with the adaptive value of model permittivity not only improves location accuracy, but also allows researchers to reach convergence for a significantly greater number of capsule positions.
The verification of the algorithm with physical phantoms of the human body in three-dimensional coordinate systems, as well as multi-layered phantoms, will be the subject of future study. These tests will allow a final assessment of the suggested approach and the feasibility of its application in the study of the digestive system using wireless endoscopes.

Author Contributions

Conceptualization, P.O. and Ł.J.; formal analysis, Ł.J.; investigation, P.O.; methodology, P.O. and Ł.J.; software, P.O.; validation, P.O.; visualization, P.O.; writing—original draft, P.O. and Ł.J.; writing—review and editing, Ł.J. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The simulation results are available upon email request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Herp, J.; Deding, U.; Buijs, M.; Kroijer, R.; Baatrup, G.; Nadimi, E. Feature Point Tracking-Based Localization of Colon Capsule Endoscope. Diagnostics 2021, 11, 193. [Google Scholar] [CrossRef] [PubMed]
  2. Bao, G.; Mi, L.; Geng, Y.; Zhou, M.; Pahlavan, K. A video-based speed estimation technique for localizing the wireless capsule endoscope inside gastrointestinal tract. In Proceedings of the 2014 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA, 26–30 August 2014; Volume 2014, pp. 5615–5618. [Google Scholar] [CrossRef]
  3. Vedaei, S.S.; Wahid, K.A. A localization method for wireless capsule endoscopy using side wall cameras and IMU sensor. Sci. Rep. 2021, 11, 11204. [Google Scholar] [CrossRef] [PubMed]
  4. Khan, W.; Kabir, S.M.L.; Khan, H.A.; Al Helal, A.; Mukit, M.A.; Mostafa, R. A localization algorithm for capsule endoscopy based on feature point tracking. In Proceedings of the 2016 International Conference on Medical Engineering, Health Informatics and Technology (MediTec), Dhaka, Bangladesh, 17–18 December 2016; pp. 1–5. [Google Scholar]
  5. Iakovidis, D.K.; Spyrou, E.; Diamantis, D.; Tsiompanidis, I. Capsule endoscope localization based on visual features. In Proceedings of the 13th IEEE International Conference on BioInformatics and BioEngineering, Chania, Greece, 10–13 November 2013; pp. 1–4. [Google Scholar]
  6. Liu, L.; Hu, C.; Cai, W.; Meng, M.Q.H. Capsule endoscope localization based on computer vision technique. In Proceedings of the 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA, 3–6 September 2009; Volume 2009, pp. 3711–3714. [Google Scholar]
  7. Cavlu, V.; Brennan, P. Determining the Position and Orientation of In-Body Medical Instruments Using Near-Field Magnetic Field Mapping. IEEE J. Electromagn. RF Microwaves Med. Biol. 2019, 4, 10–16. [Google Scholar] [CrossRef]
  8. Kim, M.-C.; Kim, E.-S.; Park, J.-O.; Choi, E.; Kim, C.-S. Robotic Localization Based on Planar Cable Robot and Hall Sensor Array Applied to Magnetic Capsule Endoscope. Sensors 2020, 20, 5728. [Google Scholar] [CrossRef] [PubMed]
  9. Dey, N.; Ashour, A.S.; Shi, F.; Sherratt, R.S. Wireless Capsule Gastrointestinal Endoscopy: Direction-of-Arrival Estimation Based Localization Survey. IEEE Rev. Biomed. Eng. 2017, 10, 2–11. [Google Scholar] [CrossRef] [PubMed]
  10. Chandra, R.; Johansson, A.J.; Tufvesson, F. Localization of an RF source inside the Human body for Wireless Capsule Endoscopy. In Proceedings of the 8th International Conference on Body Area Networks, Boston, MA, USA, 30 September–2 October 2013; pp. 48–54. [Google Scholar]
  11. Goh, S.T.; Zekavat, S.A.; Pahlavan, K. DOA-Based Endoscopy Capsule Localization and Orientation Estimation via Unscented Kalman Filter. IEEE Sens. J. 2014, 14, 3819–3829. [Google Scholar] [CrossRef]
  12. Nafchi, A.R.; Goh, S.T.; Zekavat, S.A.R. Circular Arrays and Inertial Measurement Unit for DOA/TOA/TDOA-Based Endoscopy Capsule Localization: Performance and Complexity Investigation. IEEE Sens. J. 2014, 14, 3791–3799. [Google Scholar] [CrossRef]
  13. Farhadi, H.; Atai, J.; Skoglund, M.; Nadimi, E.S.; Pahlavan, K.; Tarokh, V. An adaptive localization technique for wireless capsule endoscopy. In Proceedings of the 2016 10th International Symposium on Medical Information and Communication Technology (ISMICT), Worcester, MA, USA, 20–23 March 2016; pp. 1–5. [Google Scholar]
  14. Pourhomayoun, M.; Fowler, M.; Jin, Z. A novel method for medical implant in-body localization. In Proceedings of the 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, USA, 28 August–1 September 2012; Volume 2012, pp. 5757–5760. [Google Scholar]
  15. Vitas, I.; Zrno, D.; Simunic, D.; Prasad, R. Innovative RF localization for wireless video capsule endoscopy. In Proceedings of the ITU Kaleidoscope Academic Conference: Living in a Converged World-Impossible without Standards, St. Petersburg, Russia, 3–5 June 2014; pp. 221–228. [Google Scholar]
  16. Barbi, M.; Perez-Simbor, S.; Garcia-Pardo, C.; Andreu, C.; Cardona, N. Localization for capsule endoscopy at UWB frequencies using an experimental multilayer phantom. In Proceedings of the 2018 IEEE Wireless Communications and Networking Conference Workshops (WCNCW), Barcelona, Spain, 15–18 April 2018; pp. 390–395. [Google Scholar]
  17. Oleksy, P.; Januszkiewicz, Ł. Wireless Capsule Endoscope Localization with Phase Detection Algorithm and Simplified Human Body Model. Int. J. Electron. Telecommun. 2020, 66, 45–51. [Google Scholar] [CrossRef]
  18. Hekimian-Williams, C.; Grant, B.; Liu, X.; Zhang, Z.; Kumar, P. Accurate localization of RFID tags using phase difference. In Proceedings of the 2010 IEEE International Conference on RFID (IEEE RFID 2010), Orlando, FL, USA, 14–16 April 2010; pp. 89–96. [Google Scholar]
  19. Oleksy, P.; Januszkiewicz, L. Improved Wireless Capsule Endoscope Localization with Phase Detection Algorithm. In Proceedings of the 2021 Signal Processing Symposium (SPSympo), Lodz, Poland, 20–23 September 2021; pp. 206–211. [Google Scholar]
  20. Januszkiewicz, L. Simplified human body models for interference analysis in the cognitive radio for medical body area networks. In Proceedings of the 2014 8th International Symposium on Medical Information and Communication Technology (ISMICT), Firenze, Italy, 2–4 April 2014; pp. 1–5. [Google Scholar]
  21. Januszkiewicz, L.; Hausman, S.; Di Barba, P. Human Body Modelling for Wireless Body Area Network Optimization. In Proceedings of the 2020 14th European Conference on Antennas and Propagation (EuCAP), Copenhagen, Denmark, 15–20 March 2020; pp. 1–5. [Google Scholar]
  22. XFdtd 7.5.0.3 Reference Manual; Remcom Inc.: State College, PA, USA, 2012.
  23. Kwak, S.I.; Chang, K.; Yoon, Y.J. The helical antenna for the capsule endoscope. In Proceedings of the 2005 IEEE Antennas and Propagation Society International Symposium, WashIngton, DC, USA, 3–8 July 2005; Volume 2B, pp. 804–807. [Google Scholar]
  24. Savci, H.S.; Sula, A.; Wang, Z.; Dogan, N.S.; Arvas, E. MICS transceivers: Regulatory standards and applications (medical implant communications service). In Proceedings of the IEEE SoutheastCon, Ft. Lauderdale, FL, USA, 8–10 April 2005; pp. 179–182. [Google Scholar]
  25. Toropainen, A.; Vainikainen, P.; Drossos, A. Method for accurate measurement of complex permittivity of tissue equivalent liquids. Electron. Lett. 2000, 36, 32–34. [Google Scholar] [CrossRef]
Figure 1. Improved localization algorithm with minimalization of S function marked in blue frame and results evaluation in green frame supplemented with calibration step for localization based on measurements.
Figure 1. Improved localization algorithm with minimalization of S function marked in blue frame and results evaluation in green frame supplemented with calibration step for localization based on measurements.
Sensors 22 02200 g001
Figure 2. Transmitting antenna (a) half-wave dipole Hd = 22 mm, (b) helical antenna model: H = 5.6 mm, r = 4 mm [23].
Figure 2. Transmitting antenna (a) half-wave dipole Hd = 22 mm, (b) helical antenna model: H = 5.6 mm, r = 4 mm [23].
Sensors 22 02200 g002
Figure 3. Arrangement of the receiving antennas A1–A5 relative to the numerical model used in simulation.
Figure 3. Arrangement of the receiving antennas A1–A5 relative to the numerical model used in simulation.
Sensors 22 02200 g003
Figure 4. Numerical model used in simulations: (a) front view, (b) cross-section in XY plane for z = Z0 and for ZY for x = X0.
Figure 4. Numerical model used in simulations: (a) front view, (b) cross-section in XY plane for z = Z0 and for ZY for x = X0.
Sensors 22 02200 g004
Figure 5. The impact of capsule antenna type, number of receivers and algorithm version on localization error achieved for simulation in XFdtd Remcom and heterogenous human body model [17,19].
Figure 5. The impact of capsule antenna type, number of receivers and algorithm version on localization error achieved for simulation in XFdtd Remcom and heterogenous human body model [17,19].
Sensors 22 02200 g005
Figure 6. Cumulative distribution function (CDF) of localization error [19].
Figure 6. Cumulative distribution function (CDF) of localization error [19].
Sensors 22 02200 g006
Figure 7. External receivers arrangement used to investigate the impact of the number of receivers on the accuracy of the location.
Figure 7. External receivers arrangement used to investigate the impact of the number of receivers on the accuracy of the location.
Sensors 22 02200 g007
Figure 8. Capsule antenna that was located inside phantom (a) without case, (b) with epoxy case.
Figure 8. Capsule antenna that was located inside phantom (a) without case, (b) with epoxy case.
Sensors 22 02200 g008
Figure 9. Impedance matching of the capsule antenna.
Figure 9. Impedance matching of the capsule antenna.
Sensors 22 02200 g009
Figure 10. External receiver antenna.
Figure 10. External receiver antenna.
Sensors 22 02200 g010
Figure 11. Impedance matching of the external receiver antenna.
Figure 11. Impedance matching of the external receiver antenna.
Sensors 22 02200 g011
Figure 12. Simplified model and external antennas configuration used during measurement.
Figure 12. Simplified model and external antennas configuration used during measurement.
Sensors 22 02200 g012
Figure 13. Measurement setup.
Figure 13. Measurement setup.
Sensors 22 02200 g013
Figure 14. The value of S function and localization error (Le) depending on model permittivity.
Figure 14. The value of S function and localization error (Le) depending on model permittivity.
Sensors 22 02200 g014
Figure 15. The example of implemented measurement scenario presented in the cross-section of a physical model. Red markers indicate true capsule positions, blue markers indicate estimated positions and A1–A4 indicate external receivers.
Figure 15. The example of implemented measurement scenario presented in the cross-section of a physical model. Red markers indicate true capsule positions, blue markers indicate estimated positions and A1–A4 indicate external receivers.
Sensors 22 02200 g015
Figure 16. Cumulative distribution function (CDF) of localization error for measurements with physical phantom.
Figure 16. Cumulative distribution function (CDF) of localization error for measurements with physical phantom.
Sensors 22 02200 g016
Figure 17. Impact of antenna orientation on localization error obtained in simulation.
Figure 17. Impact of antenna orientation on localization error obtained in simulation.
Sensors 22 02200 g017
Figure 18. Impact of antenna orientation on localization error obtained in measurements.
Figure 18. Impact of antenna orientation on localization error obtained in measurements.
Sensors 22 02200 g018
Table 1. The impact of the number of receivers on localization accuracy.
Table 1. The impact of the number of receivers on localization accuracy.
Five Receivers and Adaptive ModelNine Receivers and Adaptive ModelFive Receivers and Constant Permittivity
Average error (mm)168066
Standard Deviation (mm)47945
Meadian (mm)26740
Table 2. Localization accuracy for different algorithms.
Table 2. Localization accuracy for different algorithms.
Minimum Error (mm)Maximum Error (mm)Average Error (mm)
Constant epsilon
Localization error168066
Error for X47945
Error for Y26740
Adaptive model
Localization error36230
Error for X25826
Error for Y15020
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Oleksy, P.; Januszkiewicz, Ł. Wireless Capsule Endoscope Localization with Phase Detection Algorithm and Adaptive Body Model. Sensors 2022, 22, 2200. https://doi.org/10.3390/s22062200

AMA Style

Oleksy P, Januszkiewicz Ł. Wireless Capsule Endoscope Localization with Phase Detection Algorithm and Adaptive Body Model. Sensors. 2022; 22(6):2200. https://doi.org/10.3390/s22062200

Chicago/Turabian Style

Oleksy, Paweł, and Łukasz Januszkiewicz. 2022. "Wireless Capsule Endoscope Localization with Phase Detection Algorithm and Adaptive Body Model" Sensors 22, no. 6: 2200. https://doi.org/10.3390/s22062200

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop