Next Article in Journal
Temperature-Independent Fiber Inclinometer Based on Orthogonally Polarized Modes Coupling Using a Polarization-Maintaining Fiber Bragg Grating
Previous Article in Journal
Sensor Fusion of Cameras and a Laser for City-Scale 3D Reconstruction
Previous Article in Special Issue
Toward Real-Time Automated Detection of Turns during Gait Using Wearable Inertial Measurement Units
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Real-Time Localization System for an Endoscopic Capsule Using Magnetic Sensors †

School of Engineering, University of South Australia, Mawson Lakes, South Australia 5095, Australia
*
Author to whom correspondence should be addressed.
Expanded conference paper based on “A real-time localization system for an endoscopic capsule”, 2014 IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).
Sensors 2014, 14(11), 20910-20929; https://doi.org/10.3390/s141120910
Submission received: 13 June 2014 / Revised: 23 August 2014 / Accepted: 22 September 2014 / Published: 5 November 2014
(This article belongs to the Special Issue Biomedical Sensors and Systems)

Abstract

: Magnetic sensing technology offers an attractive alternative for in vivo tracking with much better performance than RF and ultrasound technologies. In this paper, an efficient in vivo magnetic tracking system is presented. The proposed system is intended to localize an endoscopic capsule which delivers biomarkers around specific locations of the gastrointestinal (GI) tract. For efficiently localizing a magnetic marker inside the capsule, a mathematical model has been developed for the magnetic field around a cylindrical magnet and used with a localization algorithm that provides minimum error and fast computation. The proposed tracking system has much reduced complexity compared to the ones reported in the literature to date. Laboratory tests and in vivo animal trials have demonstrated the suitability of the proposed system for tracking a magnetic marker with expected accuracy.

1. Introduction

Colon cancer, Crohn's disease, obscure GI bleeding, etc. are gastrointestinal diseases which are quite common in many countries around the world. Such gastrointestinal diseases are showing increased manifestations in Western societies as well [1]. The 2011 Australian Institute of Health and Welfare (AIHW) report indicated that colon cancer was the second largest cause of death during 2007 and 2010, with a burden of 15% and 19%, respectively [2]. These gastrointestinal diseases contribute to changing the functional characteristics of the gastrointestinal (GI) tract, commonly known as the gut. This phenomenon in turn results in the recurrence of these diseases with worse symptoms. On average, the human GI tract is approximately 9 m long. Traditional instruments such as fiber optic endoscopes and colonoscopes have an average length of about 2.5 m, and therefore cannot probe deeper into the GI tract [3]. Therefore, these instruments are unable to assist with investigations on the nature and causes of functional changes of the gut. Naturally, it will be of immense benefit if medical researchers can have access to technology that is able to reach the mid to distal regions of the GI tract for more precise exploration of the functions of these sections of the tract.

Wireless capsule endoscopes such as the SmartPill, PillCam, Norika etc. have made the examination of the GI tract much easier by eliminating the pain and discomfort associated with the insertion of conventional scopes [4]. However, these technologies lack the ability to examine the functional changes in the GI tract [5]. A possible solution is to deliver biomarkers at or near the affected spots in the gut and then monitor the response through clinical procedures such as breadth tests [6]. This will allow much of the biomarker to reach and act on the target area compared to oral delivery where bulk of the biomarker is absorbed in abdominal fluids. Targeted biomarker delivery is therefore expected to provide much better indication of the gut's functional changes through more credible breadth test response. Delivery of biomarkers to a specific region within the gut requires information about the real-time location of the capsule carrying the payload. This requires a system to track the capsule location in real-time. A variety of technologies can be considered for such in vivo tracking, for example, radio frequency (RF), magnetic and ultrasound technology. RF and ultrasound signals suffer large attenuations when passing through the human body [7,8], while magnetic signals are almost immune to in vivo attenuations [6]. For this reason magnetic technology is more suitable for in vivo capsule tracking.

Recent research literature has revealed that many in vivo magnetic tracking systems have been proposed to date [915]. These tracking systems have a magnet placed inside the capsule. As the magnet travels down the gut, a number of magnetic sensors placed outside the body continually measure the magnetic field strengths. These magnetic field readings are used to determine the location of the capsule. The majority of the proposed systems use a large number of magnetic sensors, often placed in a two dimensional array. Although the accuracies obtained by some of these systems are in the range of millimeters the actual systems are impractical to use in a real application due to their complexity, namely, size, large number of sensors, bulk of cables, etc.

In this paper, we present a tracking system for an endoscopic capsule, which uses a small magnet placed inside the capsule for tracking. A new mathematical model and a tracking algorithm have been developed to determine the location of the capsule from the magnetic field strength readings. The proposed tracking system is much less complex than the tracking systems reported to date. Operation and accuracy of the proposed system have been verified using animal trials involving pigs. The low complexity and good tracking accuracy of the proposed system make it suitable for in vivo tracking of a magnetically marked endoscopic capsule. A concise paper with some preliminary results of the work has been introduced in [16]. In contrast, in this paper, we present the details of the mathematical model, tracking algorithm, details of animal trials with extensive results and comparisons.

2. Mathematical Model for Magnetic Field

The magnetic field produced by a magnet at a certain point is dependent on the distance of the magnet from that point and its orientation relative to that point. We can measure the magnetic field intensity and direction by placing a few magnetic sensors around the point in a suitable arrangement, and then calculate the magnet's distance and orientation parameters using an algorithm. In this section, a mathematical model for the magnetic field created by a permanent magnet is introduced and will be used to find the location and orientation parameters using an optimization algorithm. The optimization algorithm is selected based on the best possible calculation accuracy and lowest execution time.

2.1. Position and Orientation of the Magnet

The endoscopic capsule will contain a small cylindrical magnet, which has a finite length. This means that the magnet can be placed with its center at point P as shown in Figure 1 but its length orientated in different directions in space. To represent the magnet's orientation, we can attach a coordinate system to the magnet itself and then relate this coordinate system to the reference system. Figure 1 shows a coordinate system {XcYcZc} that has been attached to the magnet relative to the reference coordinate system {XYZ}. {XcYcZc} is a vector that specifies only the orientation of the magnet. The relationship between the two coordinate systems can be represented by a rotation matrix, which is the amount of rotation required to align the two systems.

2.2. Existing Magnetic Field Models

Review of relevant literature has revealed that a few mathematical models have been developed to describe the behavior of the magnetic field strength with distance. An empirical model developed in [6] is given as:

D = 55 1 a . e b x
where, D is the distance between the magnet and the sensor, x is the value of magnetic field intensity, while a and b are variables depending on the properties of the magnet used [6]. It addresses the issues with determining the magnetic field intensity when the magnet is at 90° and 180° orientations with respect to the sensor, however it does not incorporate the effects of all other orientation angles [6].

Another mathematical model used widely in existing magnetic tracking systems [1012,1719], is expressed as:

B = K T ( 3 ( H . R ) R R 5 H R 3 )
in which the experiment is conducted, H represents the orientation of the magnetic field and R is the distance between the magnet and the sensor.

2.3. Building a Mathematical Model for a Magnetic Dipole

A dipole model, shown in Figure 2, consisting of two charges, +b and −b, separated by a distance l, produces the same field as a current loop bl = IA = |μ|, where μ is the magnetic dipole moment and is a vector [20]. Since the two models produce the same field, we can use the two-charge dipole model to determine the field.

We'll further assume that the dipole is aligned with the z axis. We want to find the field at point P as shown in Figure 3. P is s assumed to lie in the y-z plane. The field at point P will be the sum of the fields due to charges +b and −b. The distances of P from the origin and the two charges are:

r = z 2 + y 2 r 1 = ( z l 2 ) 2 + y 2 r 2 = ( z + l 2 ) 2 + y 2

For a point charge, if the radius vector at a particular location has angle θ with the z axis and the total field strength at that location is |B|, we have:

B z = | B | cos θ

Summing the fields of the two point charges, we have:

B z = B z ( + b ) + B z ( b ) B z = b [ z l 2 r 1 3 z + l 2 r 2 3 ]

The size of the magnet is usually small, lr.

1 r 1 3 = 1 [ ( y 2 + ( z l 2 ) 2 ] 3 1 r 1 3 = 1 [ ( y 2 + z 2 z l ] 3 = 1 [ r 2 ( 1 z l r 2 ) ] 3 = 1 r 3 ( 1 3 z l 2 r 2 )

Putting (6) into (5), multiplying out, and discarding all terms containing l2, we obtain:

B z = b l r 3 [ 3 z 2 r 2 1 ] = b l r 3 [ 3 cos θ 1 ]

Similarly, to calculate the component By, we start with the field for a point charge:

B y = | B | sin θ

Summing the fields of the two point charges, we get:

B y = B y ( + b ) + B y ( b ) B y = b y ( 1 r 1 3 1 r 2 3 )

Putting (6) into (9) we get:

B y = b y r 3 [ 3 z l 2 r 2 + 3 z l 2 r 2 ]
B y = 3 b l r 3 y z r 2
B y = 3 b l r 3 sin θ cos θ

Finally, we put (7) and (12) together to obtain the total field at point P. If we use φ for the azimuth, the angle of rotation about the z axis, then, using the convention that the unit basis vectors are written with hats, we have:

B = 3 b l r 3 [ sin θ cos θ ( cos φ x ^ + sin φ y ^ ) + ( cos 2 θ 1 3 ) z ^ ]

To express the field in polar coordinates, we write the Cartesian basis vectors in terms of the usual orthonormal polar basis:

x ^ = sin θ cos φ r ^ + cos θ cos φ θ ^ sin φ φ ^ y ^ = sin θ sin φ r ^ + cos θ sin φ θ ^ cos φ φ ^ z ^ = cos θ r ^ sin θ θ ^

In (13), coefficient on is:

sin θ cos θ cos φ ( sin θ cos φ r ^ + cos θ cos φ θ ^ sin φ φ ^ ) = cos θ ( sin 2 θ cos 2 φ r ^ + sin θ cos θ cos 2 φ θ ^ sin θ sin φ cos φ φ ^ )

In (13), coefficient on is:

sin θ cos θ sin φ ( sin θ sin φ r ^ + cos θ sin φ θ ^ cos φ φ ^ ) = cos θ ( sin 2 θ sin 2 φ r ^ + sin θ cos θ sin 2 φ θ ^ sin θ sin φ cos φ φ ^ )

In (13), coefficient on is:

( cos 2 θ 1 3 ) ( cos θ r ^ sin θ θ ^ ) = cos θ ( cos 2 θ r ^ sin θ cos θ θ ^ ) cos θ ( 1 3 r ^ 1 3 tan θ θ ^ )

Putting the above coefficients back in (13) and obtain the coefficient for each , θ̂, φ̂, we have:

Coefficient on is:

cos θ sin 2 θ cos 2 φ + cos θ sin 2 θ sin 2 φ + cos θ ( cos 2 θ 1 3 ) = cos θ ( sin 2 θ cos 2 φ + sin 2 θ sin 2 φ + cos 2 θ 1 3 ) = 2 3 cos θ

Coefficient on θ̂ is:

cos θ ( sin θ cos θ sin θ cos θ + 1 3 tan θ ) = 1 3 sin θ

Coefficient on φ̂ is:

cos θ ( sin θ sin φ cos φ + sin θ sin φ cos φ ) = 0

Finally, we put these coefficients into (13) to obtain the polar coordinate expression for the field for a dipole aligned on the Z axis:

B = b l 3 r 3 [ 2 cos θ r ^ + sin θ θ ^ ]

We can use Equation (15) to calculate the field with only two parameters, angle and radial distance. Using these assumptions, the field components are calculated as shown in Figure 4.

3. The Proposed Tracking System

In the proposed tracking system, a small permanent magnet (neodymium) is used as the source of a static magnetic field. The tracking system also consists of magnetic sensors with on-board microprocessors for data acquisition, data pre-processing and communication. The magnetic sensors are attached to a flat panel, which is to be placed in front of the gut to measure the magnetic field strength. The signals produced by each sensor are sent to its dedicated (on-board) microprocessor, which collects and stores the data and forward to a PC. A tracking algorithm running on the PC uses the magnetic signals from all the sensors and displays the calculated location of the magnet (capsule) in real-time.

3.1. Magnet

For a magnetic tracking system, the selection of material, shape and size of the magnet is very important. It is understood that the rare earth neodymium magnets (Nd2Fe14B) possess the highest field to size ratio [6]. It is also known that the cylindrical or rod shaped magnets produce a higher magnetization in air compared to other shapes like disk, ring, sphere, tube, etc. [21]. In order to select the proper size of the magnet, experiments have been conducted to determine the characteristic curves of several cylindrical neodymium magnets of different sizes. Figure 5 shows the graphs of the magnetic field strength versus distance for magnets having sizes (Length × Diameter in mm) 10 × 2.5, 12 × 6 and 10 × 10. It is pertinent to mention that the magnetoresistive sensor provides the peak reading when the magnet is moved very close to the sensor. The magnetic sensor is in saturation in such a situation. The graphs indicate the points of saturation S1, S2, S3 and the detection ranges D1, D2, D3 for the three magnets respectively. From this, it is obvious that the 10 × 10 magnet has the highest detection range of almost 20 cm, however, its saturation point (S3) starts from a distance of 5 cm from the sensor. The saturation point S1 for the 10 × 2.5 magnet is quite reasonable as it starts from about 1.5 cm from the sensor, but its detection range of 11 cm is insufficient. The detection range for the 12 × 6 magnet is almost 15 cm with the point of saturation (S2) starting from 4 cm. The anatomy of human gut suggests that if the average diameter of the body around the gut is 30 cm then the separation between the outer wall and the small intestine will always be greater than 4 cm from any side. So, it can be concluded from the above experiments that the magnet with size 12 × 6, as shown in Figure 6, is suitable for use with our tracking system.

3.2. Magnetic Sensors

The PNI RM3000 magnetic sensor suite has been used to measure the magnetic field strength. The RM3000 is an integrated magnetic field sensing module with highest accuracy in their class, a large magnetic field measurement range, high resolution, low power consumption, and large signal noise immunity under all conditions. It is also highly stable over temperature. Each RM3000 sensors suite has the ability to detect the magnetic field in three perpendicular axis (X, Y, Z) using three physical sensors. We identify them as SX, SY and SZ. The sensitivity of the sensors is inversely related to the sampling rate, i.e., time required to take one measurement.

  • At the highest sampling rate of 2.4 KHz/Axis, the sensor's resolution is ∼1.4 mG.

  • At the lowest sampling rate of 300 Hz/Axis, the sensor's resolution is ∼0.15 mG.

In the proposed system, the sensor is set at the highest sensitive mode to achieve the highest Signal to Noise Ratio (SNR). The RM3000 sensor suite has a SPI interface for data communication. The SPI interface includes CE (chip enable), MOSI (master output, slave input), MISO (master input, slave output), SCLK (clock), DRDY (data ready) and CLEAR. To read the data from the RM3000 sensor, the microprocessor must read each axis separately. The SPI interface shifts out a 24-bit field measurement value for each of the three axis which represent the three orthogonal components of magnetic field density i.e., Bx, By and Bz. The resultant magnetic field B, its azimuth angle θ and elevation angle φ are calculated from these values using Equations (16)Equation (18), respectively [22]:

| B | = B x 2 + B y 2 + B z 2
θ = tan 1 ( B y B x )
φ = 90 cos 1 ( B z B )

3.3. Processor Board and Communication Module

The PNI RM3000 magnetic sensors suite is connected to a microcontroller board via a daughter board. The microcontroller board is based on the ATmega328 microcontroller. It communicates with the RM3000 sensors via SPI interface. The received magnetic field intensity data can be stored in the internal memory of the microcontroller and transmitted to a PC for further processing. Communication between the microcontroller and the PC is via USB interface. Figure 7 shows the microcontroller board with RM3000 sensor suite.

3.4. Sensor Location

In order to correctly locate the magnet, we must know the field strength as well as the location where the sensor measured the field. This means that the exact location of each of the sensors must be known and this location must be fixed for all measurements. For this reason, the sensors are mounted on a flat plastic base so the sensors are on the same x-y plane. This base ensures that the locations of the sensors do not change and that their relative positions to each other are fixed. The base also provides information about the location of each sensor in 3D.

The reference point (0,0,0) of the system is marked with a blue circle as shown in Figure 8. Location of each sensor is marked with a red circle. From this arrangement, the locations of all four sensors were identified as shown in Table 1.

As stated previously, each sensor board has three physical sensors: SX, SY and SZ. The sensor SX measures the magnetic field along the X-axis, SY measures the field along the Y-axis, and SZ measures the field along the Z-axis. Locations of SX, SY and SZ are shown in Table 1.

3.5. Communication of Magnetic Data to PC

The microcontroller is programmed to control the timing of all the signals. It also processes the data and transmits to a PC via a USB hub. The present system is set up using wired communication between the sensors and the PC. In future, wireless communication can be used using a reliable protocol similar to the one presented in [23].

3.6. Sensor Calibration and Noise Level

Before putting the system into use, calibrations are required for determining the sensitivity of the sensors, adjusting the sensor's reading and normalizing the measurements between the sensor boards. It is important to ensure that each of the three-axis sensors on each sensor board is calibrated properly. The criterion used for calibration of the individual axis sensors (X,Y,Z) is the fact that the overall magnitude of the field |B| (as per Equation (16)) should not vary irrespective of the orientation of the sensor board. The Earth's magnetic field is used as a reference field.

To calibrate the individual axis (X,Y,Z), we aligned the sensor board to a fixed orientation and took the field readings from each individual axis. Then, we rotated the sensor board to swap the axis (for example, swap X axis with Y axis) and took another measurement from each individual axis. From the readings of all possible axis swapping, we were able to determine the scaling factor needed to calibrate the Y-axis and Z-axis to the reference X-axis. The next step of calibration was to normalize the measurements across the four sensor boards. We chose one sensor as the reference sensor and scaled the readings of the other three sensors to the field measured by the reference sensor.

Figure 9 shows the Earth's magnetic field measured before calibration and Figure 10 shows the same field after calibration. Bx, By, Bz are the magnetic field along X, Y and Z axis. B is the overall magnetic field. Clearly, the field magnitude (Figure 10) is much more stable after calibration.

The signal to noise ratio of the system was also determined. Figure 11 shows the white background noise and Figure 12 shows the signal level read from a 6 × 12 mm magnet at a distance of 30 mm. The signals B1–B4 in Figures 11 and 12 show the overall magnetic field of sensor 1–4 in the sensor system. Obviously, the noise range of +/− 3 G is very small compared with the signal level of 6 G.

4. Tracking Algorithm

4.1. Magnet Localization

The magnetic marker contained in the swallowable endoscopic capsule can be tracked inside the GI tract using multiple sensors placed outside the body around the gut region at pre-determined locations. Four 3-axis magnetic sensors are used and their positions on the plastic base were shown in Table 1. The problem can be considered as one of finding the location and orientation of a magnet whose calculated magnetic field most closely matches the field measured by the sensors at their respective locations. The calculation of the magnetic fields are done using mathematical models presented in Section 2. Finding the location and the orientation which make the difference between the measured field and the calculated field minimum is a non-linear optimization problem for the six parameters which describe the position and orientation of the magnet (see Section 2.1).

Several nonlinear minimization algorithms have been reported in literature, e.g., Powell's [24], Downhill Simplex [25], DIRECT [26], and Levenberg-Marquardt Algorithm [27]. The algorithms normally require an initial guess of the parameters, or their bounds, to begin the search for the minimum. If the initial guess is too far away from the solution then the algorithms may fail to provide a solution because there may be many local minima. Besides that, the minimization algorithm should be fast enough to enable real-time implementation and should also be robust to noises in the sensor data. In [17], the authors have thoroughly evaluated the performance of the above algorithms with respect to the localization error, orientation error and computation time required. From their findings, the Levenberg-Marquardt Algorithm (LMA) has the minimum localization and orientation errors. This is particularly so when the error levels of the initial guess of locations are confined within a 20 × 20 × 20 cm3 space, which is the same as the space we have used for testing our tracking system in the laboratory. Moreover, the paper [17] also reports that the Levenberg-Marquardt Algorithm requires the minimum computation time for converging to a solution. Therefore we have decided to use the LMA for implementing the proposed tracking system.

4.2. Expected Tracking Accuracy

The proposed tracking system is intended to provide information on the location of an endoscopic capsule in the GI tract to assist with targeted delivery of biomarkers inside the tract. In traditional oral delivery, much of the biomarker gets absorbed in abdominal fluid before it reaches the intended GI region. If the target area is in the mid to distal regions of the GI tract, then very little of the biomarker delivered orally reaches near the intended spot. Hence gastroenterologists consider oral delivery methods to be problematic for effective functional characterization or diagnosis of problems in the mid to distal regions of the GI tract. Targeted delivery near the region of interest is expected to make such studies much more effective. From this perspective, compared to orally administered methods, biomarker delivery within 5–10 cm of the GI region of interest will be more than sufficient to extract more pronounced response to the biomarker. A tracking system that provides the location information with this level of accuracy (within 10 cm error) is deemed to be adequate for the above purpose.

4.3. Localization Results

The tracking accuracy is evaluated by conducting in vitro tests in the laboratory. The magnet is placed at various locations and orientations within a measurement volume of 20 × 20 × 20 cm3 above the sensor plane. These locations include the worst case (boundary) conditions around the edges of the measurement volume. Figure 13 shows the in vitro experimental set up. Staring from an initial guess, the tracking algorithm keeps on searching for the location of the magnet until it finds a location for which the magnetic field values calculated using the proposed mathematical model closely match the actual magnetic field values measured by the sensors. This means that for this location the difference (error) between the magnetic field values calculated by the algorithm and the actual magnetic field values is the minimum. When the algorithm converges in this manner, the corresponding location coordinates reported by the algorithm are compared with the actual coordinates, i.e., the known physical locations of the magnet. The difference is the localization error or tracking accuracy. The following observations were made from the in vitro tests:

  • For each location, tests were conducted multiple times to determine the error of the system which was found to be approximately 5 mm. In other words, the localization accuracy of the proposed system is approximately 5 mm.

  • Four sensors are enough to obtain the required accuracy (less than 10 cm error) for our application. If more sensors are used, the accuracy is likely to increase, however the complexity and computation time will increase too. The tracking accuracy is higher when the magnet is located in the central area above the sensor plane.

Figure 14 shows some position tracking performed in the laboratory using the four sensors and the 6 × 12 mm magnet. This example shows a test with the magnet moving up and down above the sensor plane. The magnet's trajectory is shown in red and the sensor locations are shown in blue.

4.4. Field Test with Animal Model

The proposed tracking system has been used to track a magnet inside a capsule which was swallowed by pigs. Location of the magnet inside the pig's body is determined by the tracking system. Figure 15 shows the pig under test with the tracking system placed on its side. Four X-rays were taken during the tracking to cross check the magnet's location obtained from the tracking system with those shown on the X-rays. Figure 16 shows the location of the magnet marked on the body of the pig in 2D plane as obtained from the tracking system. This location is verified by X-ray as shown in Figure 17. X-ray is taken intermittently and therefore it does not provide real-time tracking. However, the X-ray provides visual indication of the location of the magnet in 2D for validation against the 2D location from the tracking system.

In order to determine the real-time performance of the proposed tracking system, we have recorded the computation time taken for each of the LMA searches during the animal trial. The computation time is measured from the start of each search to the time when one satisfied location is found. At the end of the animal trial, we have found that the system's average computation time for one search is 7.518 ms which is equivalent to 133 calculations per second.

5. Performance Comparison

In vivo tracking systems can be compared on the basis of accuracy, cost, complexity, portability and patient's comfort etc. Table 2 shows a comparison of the proposed system with existing in vivo magnetic tracking systems reported to date. The 5 mm error reported in Table 2 for the proposed tracking system is the localization error obtained from laboratory measurements conducted for various magnet locations in 3D within a measurement volume of 20 × 20 × 20 cm3. The method of measurement and calculation of error was described in Section 4.2.

Section 4.2 outlined that the localization accuracy expected of a tracking system for targeted delivery of biomarkers in the GI tract is 5–10 cm. The proposed tracking system exceeds this expectation by a very large margin, the tracking accuracy being 5 mm when tested in a volume of 20 × 20 × 20 cm3 in the laboratory. A few millimeters of deviation will not make a noticeable impact on the expected response when compared to orally administered methods. Despite this, a comprehensive comparison of complexity and accuracy of the proposed system is provided in Table 2 for the sake of completeness.

For some existing systems, information on the measurement volume is missing or given partially [13,14,17,18,28]. In [6], the magnet used has a volume that is 1.4 times that of the one used in the proposed system and also testing is conducted in a measurement volume that is eight times smaller. Yet the average error in [6] is two times that of the proposed system. In [11], the error is slightly lower, however it uses 25 sensors as opposed to only four used in the proposed system. In [12], the error is 20% lower than that of the proposed system, however the measurement volume is eight times smaller and uses four times the number of sensors as compared to the proposed system. In [13], although the error is much smaller, the information on measurement volume is incomplete. The systems in [14,18,19,22,28] use a significantly large number of sensors to inhibit their practical use. The error reported in [15,17] are comparable to that of the proposed system but they both use four times the number of sensors compared to the proposed system. Also, [15] uses a complex arrangement of two permanent magnets placed 10 cm apart, and therefore is impractical to use in a swallowable endoscopic capsule. In [29], although the error is lower than that of the proposed system it uses four times the number of sensors and the measurement volume is 8 times smaller than that of the proposed system.

From the above it is clear that the proposed system provides a significant reduction in complexity (number of sensors) for in vivo tracking. This has been possible due to the development of an accurate mathematical model of the magnetic field distribution around a permanent cylindrical magnet and an improved real-time tracking algorithm. Its tracking accuracy is more than adequate for the intended purpose of delivering biomarkers in the proximity of a target location within the GI tract. The tracking accuracy compares well, and in many cases better, than those of majority of the tracking systems reported to date.

6. Conclusions

A new in vivo magnetic tracking system has been presented in this paper to determine the real-time location of an endoscopic capsule. Using only four 3-axis magnetic sensors, the proposed tracking system achieves high localization accuracy. Although there are quite a few tracking systems reported in literature, the majority of them are far too complex for practical implementation. Unlike other tracking systems, the proposed system has been used in animal trials involving pigs, and its operation has been satisfactorily verified. The low complexity and high tracking accuracy of the proposed system make it suitable for in vivo tracking of a magnetically marked endoscopic capsule.

Acknowledgments

This research has been supported by a competitive research grant from the Australian Research Council (Grant ID-LP0990847). The authors would like to thank Professor Ross Butler of the University of South Australia (UniSA) for many interesting discussions during the course of this project. The authors would also like to thank Darren Miller, Michelle Parsons and John Bresland of UniSA, as well as Paul Herde and Tim Kuchel of the Preclinical Imaging and Research Laboratories at the South Australian Health and Medical Research Institute (SAHMRI) for their assistance and support with the animal trials. Thanks to Rezaul Begg of Victoria University, Melbourne for his comments and feedback on the tracking system design and results. The authors acknowledge Nasir Mehmood for his study on literature and field strengths of magnets.

Author Contributions

Australian Research Council awarded funding for a project on the development of an endoscopic capsule in 2009 with Syed Mahfuzul Aziz as the project leader and first named chief investigator. The IT component of this project involved the development of a magnetic tracking system. Aziz developed the original idea behind the tracking system. Duc Minh Pham was employed as a research associate, working under the guidance of Aziz, to design, build and test the tracking system and associated algorithm. Both authors collaborated closely on various aspects of the development. Duc Minh Pham built the sensing hardware, wrote the software, conducted laboratory and field tests, and collected experimental data. He wrote the initial draft of the paper and revised it based on corrections, suggestions and critical feedback provided by Aziz.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Greer, J.B.; Nawaz, H.; Yadav, D. Epidemiology of Gastrointestinal Disease; Springer: New York, NY, USA, 2012; pp. 49–54. [Google Scholar]
  2. AIHW. Australian Health Report 2011. Available online: www.aihw.gov.au/workarea/downloadasset.aspx?id=6442452962 (accessed on 1 October 2014).
  3. Tams, T.R. Gastrointestinal Endoscopy. In Small Animal Endoscopy; Mosby, Inc.: St. Louis, MO, USA, 2011; pp. 27–40. [Google Scholar]
  4. Dario, P.; Moglia, A.; Schurr, M.O.; Menciassi, A. Wireless capsule endoscopy: From diagnostic devices to multipurpose robotic systems. Biomed. Microdevices 2007, 9, 235–243. [Google Scholar]
  5. Kwan, V. Advances in gastrointestinal endoscopy. Internal Med. J. 2012, 42, 116–126. [Google Scholar]
  6. Aziz, S.M.; Grcic, M.; Vaithianathan, T. A Real-Time Tracking System for an Endoscopic Capsule Using Multiple Magnetic Sensors; Springer: Berlin/Heidelberg, Germany, 2008; Volume 20, pp. 201–218. [Google Scholar]
  7. Chirwa, L.C.; Hammond, P.A.; Roy, S.; Cumming, D.R.S. Electromagnetic radiation from ingested sources in the human intestine between 150 MHz and 1.2 GHz. IEEE Trans. Biomed. Eng. 2003, 50, 484–492. [Google Scholar]
  8. Shah, T.; Aziz, S.M.; Vaithianathan, T. Development of a tracking algorithm for an in-vivo rf capsule prototype. Proceedings of International Conference on Electrical and Computer Engineering (ICECE'06), Dhaka, Bangladesh, 19–21 December 2006; pp. 173–176.
  9. Li, M.; Hu, C.; Song, S.; Dai, H.; Meng, M.Q.H. Detection of weak magnetic signal for magnetic localization and orientation in capsule endoscope. Proceedings of 2009 IEEE International Conference on Automation and Logistics (ICAL'09), Shenyang, China, 5–7 August 2009; pp. 900–905.
  10. Hu, C.; Meng, M.Q.H.; Mandal, M.; Wang, X. 3-axis magnetic sensor array system for tracking magnet's position and orientation. Proceedings of the Sixth World Congress on Intelligent Control and Automation (WCICA 2006), Dalian, China, 21–23 June 2006; pp. 5304–5308.
  11. Hu, C.; Ma, T.X.; Meng, M.Q.H. Sensor arrangement optimization of magnetic localization and orientation system. Proceedings of IEEE International Conference on Integration Technology (ICIT'07), Shenzhen, China, 20–24 March 2007; pp. 311–315.
  12. Wang, X.; Meng, M.Q.H.; Hu, C. A localization method using 3-axis magnetoresistive sensors for tracking of capsule endoscope. Proceedings of the 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS'06), New York, NY, USA, 31 August–3 September 2006; pp. 2522–2525.
  13. Hu, C.; Yang, W.; Cheng, D.; Meng, M.Q.H.; Dai, H. An improved magnetic localization and orientation algorithm for wireless capsule endoscope. Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS 2008), Vancouver, BC, Canada, 20–24 August 2008; pp. 2055–2058.
  14. Ren, J.; Li, M.; Hu, C.; Yang, L.; Song, S.; Meng, M.Q.H. Design of a data acquisition system on magnetic signal for magnetic localization and orientation system. Proceedings of the 2010 8th World Congress on Intelligent Control and Automation (WCICA), Jinan, China, 7–9 July 2010; pp. 2142–2147.
  15. Song, S.; Hu, C.; Li, M.; Yang, W.; Meng, M.Q.H. Two-magnet-based 6d-localization and orientation for wireless capsule endoscope. Proceedings of the 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO), Guilin, China, 19–23 December 2009; pp. 2338–2343.
  16. Pham, D.M.; Aziz, S.M. A real-time localization system for an endoscopic capsule. Proceedings of the 2014 IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), Singapore, 21–24 April 2014; pp. 1–6.
  17. Hu, C.; Meng, M.Q.H.; Mandal, M. Efficient magnetic localization and orientation technique for capsule endoscopy. Proceedings of the 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AL, Canada, 2–6 August 2005; pp. 3365–3370.
  18. Yu, K.; Fang, G.; Dutkiewicz, E. Position and orientation accuracy analysis for wireless endoscope magnetic field based localization system design. Proceedings of the 2010 IEEE Wireless Communications and Networking Conference (WCNC), Sydney, Australia, 18–21 April 2010; pp. 1–6.
  19. Song, S.; Hu, C.; Li, M.; Yang, W.; Meng, M.Q.H. Real time algorithm for magnet's localization in capsule endoscope. Proceedings of the IEEE International Conference on Automation and Logistics (ICAL'09), Shenyang, China, 5–7 August 2009; pp. 2030–2035.
  20. Stratton, J.A. Electromagnetic Theory; Wiley-IEEE Press: New Jersey, NJ, USA, 2007; Volume 33. [Google Scholar]
  21. Brown, D.N.; Smith, B.; Ma, B.M.; Campbell, P. The dependence of magnetic properties and hot workability of rare earth-iron-boride magnets upon composition. IEEE Trans. Magn. 2004, 40, 2895–2897. [Google Scholar]
  22. Peng, C.; He, J.; Wu, X.; Fang, X.; Zheng, X.; Hou, W. Wearable magnetic locating and tracking system for mems medical capsule. Sens. Actuators A Phys. 2007, 141, 432–439. [Google Scholar]
  23. Aziz, S.M.; Pham, D.M. Energy efficient image transmission in wireless multimedia sensor networks. IEEE Commun. Lett. 2013, 17, 1084–1087. [Google Scholar]
  24. Powell, M.J. A Fast Algorithm for Nonlinearly Constrained Optimization Calculations. In Numerical Analysis; Springer: Berlin/Heidelberg, Germany, 1978; pp. 144–157. [Google Scholar]
  25. Nelder, J.A.; Mead, R. A simplex method for function minimization. Comput. J. 1965, 7, 308–313. [Google Scholar]
  26. Björkman, M.; Holmström, K. Global optimization of costly nonconvex functions using radial basis functions. Optim. Eng. 2000, 1, 373–397. [Google Scholar]
  27. Marquardt, D.W. An algorithm for least-squares estimation of nonlinear parameters. J. Soc. Ind. Appl. Math. 1963, 11, 431–441. [Google Scholar]
  28. Yang, W.; Hu, C.; Meng, M.Q.H.; Song, S.; Dai, H. A six-dimensional magnetic localization algorithm for a rectangular magnet objective based on a particle swarm optimizer. IEEE Trans. Magn. 2009, 45, 3092–3099. [Google Scholar]
  29. Hu, C.; Meng, M.Q.H.; Mrinal, M. The calibration of 3-axis magnetic sensor array system for tracking wireless capsule endoscope. Proceedings of the 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China, 9–15 October 2006; pp. 162–167.
Figure 1. Position and orientation of the magnet in cartesian coordinate system.
Figure 1. Position and orientation of the magnet in cartesian coordinate system.
Sensors 14 20910f1 1024
Figure 2. Two-charge dipole.
Figure 2. Two-charge dipole.
Sensors 14 20910f2 1024
Figure 3. Distances of point P from the origin and the two charges.
Figure 3. Distances of point P from the origin and the two charges.
Sensors 14 20910f3 1024
Figure 4. Field calculation angle and radial distance.
Figure 4. Field calculation angle and radial distance.
Sensors 14 20910f4 1024
Figure 5. Characteristic curves for cylindrical magnets.
Figure 5. Characteristic curves for cylindrical magnets.
Sensors 14 20910f5 1024
Figure 6. A 12 × 6 mm neodymium magnet.
Figure 6. A 12 × 6 mm neodymium magnet.
Sensors 14 20910f6 1024
Figure 7. Microprocessor board with RM3000 sensor suite.
Figure 7. Microprocessor board with RM3000 sensor suite.
Sensors 14 20910f7 1024
Figure 8. System setup with four 3-axis magnetic sensors.
Figure 8. System setup with four 3-axis magnetic sensors.
Sensors 14 20910f8 1024
Figure 9. Uncalibrated sensor data.
Figure 9. Uncalibrated sensor data.
Sensors 14 20910f9 1024
Figure 10. Sensor data after calibration.
Figure 10. Sensor data after calibration.
Sensors 14 20910f10 1024
Figure 11. Noise level of the sensor system.
Figure 11. Noise level of the sensor system.
Sensors 14 20910f11 1024
Figure 12. Signal level of the sensors system in Gauss.
Figure 12. Signal level of the sensors system in Gauss.
Sensors 14 20910f12 1024
Figure 13. In vitro experimental setup.
Figure 13. In vitro experimental setup.
Sensors 14 20910f13 1024
Figure 14. Up-down trajectory test.
Figure 14. Up-down trajectory test.
Sensors 14 20910f14 1024
Figure 15. Pig under test with the tracking system.
Figure 15. Pig under test with the tracking system.
Sensors 14 20910f15 1024
Figure 16. Location of the magnet is determined and marked on the pig.
Figure 16. Location of the magnet is determined and marked on the pig.
Sensors 14 20910f16 1024
Figure 17. Location of the magnet is verified by X-Ray.
Figure 17. Location of the magnet is verified by X-Ray.
Sensors 14 20910f17 1024
Table 1. Sensor locations.
Table 1. Sensor locations.
Sensor #SX (x,y,z) mmSY (x,y,z) mmSZ (x,y,z) mm
1(−75,−75,0)(−75,−75,0)(−75,−75,0)
2(75,−75,0)(75,−75,0)(75,−75,0)
3(75,75,0)(75,75,0)(75,75,0)
4(−75,75,0)(−75,75,0)(−75,75,0)
Table 2. Comparison with other magnetic tracking systems reported to date.
Table 2. Comparison with other magnetic tracking systems reported to date.
ArticleSensorsVol (cm3)AlgorithmError (mm)
Proposed420 × 20 × 20LMA5
[6]310 × 10 × 10?10
[11]2530 × 30 × 30Linear4.2
[12]1612 × 12 × 10LMA4.0
[13]1624 × 24 × ?LMA2.0
[14]80? × ? × ?LMA2.1
[15]1650 × 50 × 50LMA4.5
[22]6440 × 25 × 40LMA3.9
[17]1624 × 24 × ?LMA4.6
[18]49? × ? × ?LMA3.3
[19]6450 × 50 × 50LMA5.0
[28]64? × ? × ?LMA3.0
[29]1610 × 10 × 10LMA3.3

? indicates unknown dimension or missing information; LMA stands for Levenberg-Marquardt Algorithm.

Share and Cite

MDPI and ACS Style

Pham, D.M.; Aziz, S.M. A Real-Time Localization System for an Endoscopic Capsule Using Magnetic Sensors. Sensors 2014, 14, 20910-20929. https://doi.org/10.3390/s141120910

AMA Style

Pham DM, Aziz SM. A Real-Time Localization System for an Endoscopic Capsule Using Magnetic Sensors. Sensors. 2014; 14(11):20910-20929. https://doi.org/10.3390/s141120910

Chicago/Turabian Style

Pham, Duc Minh, and Syed Mahfuzul Aziz. 2014. "A Real-Time Localization System for an Endoscopic Capsule Using Magnetic Sensors" Sensors 14, no. 11: 20910-20929. https://doi.org/10.3390/s141120910

Article Metrics

Back to TopTop