1. Introduction
Close-range photogrammetry is a technique used to obtain the 3D coordinates of an object from two or more photographs of it. In analog photography, photogrammetric cameras have special features such as fiducial marks or systems to ensure the flatness of the film. The replacement of film with digital sensors removes the need for such elements because the array of pixels can be used to set a camera coordinate system. Although any digital camera can become a measuring instrument, it is agreed that the term “metric camera” should be reserved for those cameras specifically designed for photogrammetric tasks, such as the Rollei D7 Metric [
1]. These cameras have a robust mechanical structure, using well-aligned lenses with low distortion and lack an autofocus or other technologies that can uncontrollably change the internal geometry of the camera. In keeping with this approach, all other cameras should be referred to as non-metric cameras, regardless of whether they may share some features such as a robust sensor body or high quality lenses. In non-metric cameras, technologies such as autofocus, zoom lenses, retrofocus constructions, image stabilisers, among others, are far from being useful to photogrammetrists and can in fact reduce the potential accuracy of a given camera [
2]. In these cameras, we can distinguish two categories from the standpoint of their metric potential: professional (or high-grade, high quality, etc.) grade cameras and consumer (or amateur, low cost, etc.) grade cameras. Professional cameras have features such as a robust structure, a large sensor with high resolution and sensitivity, good lens quality, the ability to exchange lenses, while consumer-grade cameras include models that may include any of these features all the way down to compact cameras, as used in this work, where the lens is packaged together inside the camera.
The most important difference in consumer cameras as compared to professional cameras is their lower geometric stability. This issue involves lower reliability and durability over time of the modellization of the internal geometry of the cameras. In response to this problem algorithms and rapid calibration procedures [
3] have been developed in recent years that allow these cameras to be used for photogrammetric applications [
4,
5].
Some examples of photogrammetric work performed with consumer grade cameras are given in [
6] in which Ricoh 6000 and Kodak DX 3500 cameras are used in documentation of agro-industrial heritage, in [
7], where the Olympus C-5050 is used in architectural surveys, in [
8] in which a Sony DSC-F707 is used to measure the deflection of a loaded beam, [
9], which uses the Olympus E-20 compact camera to measure wrinkling of a gossamer spacecraft membrane and obtains an accuracy of 1/80,000, [
10], in which a Kodak DC290 is used to perform precision measurements in space structures, [
11], which examines the geometric stability of the Nikon Coolpix 5400 camera, [
12], which examines the geometric stability of four consumer cameras, and [
13], in which the Kodak DCS 460 professional camera is compared with the consumer grade Sony DSC-P10, Olympus C3030, and Nikon Coolpix 3100, with the result that the best accuracies are obtained with the Sony camera.
Apart from the use of digital compact cameras, another important aspect in the 3D measurement system presented here is the simultaneous use of four synchronised units. In the scientific literature, there are other optical measuring systems that use synchronised images. Some examples are [
14], in which three CCD camcorders (780 by 582 pixels) are used to measure the deformation of a flexible pipe under a load, [
15] in which two CCD camcorders (1,300 by 1,030 pixels) are used to control the shape of a metal beam during cooling to room temperature, [
16] in which two CCD camcorders (768 by 574 pixels) are used to monitor the rupture of a concrete beam, and [
17] in which two CCD camcorders (720 by 492 pixels) are used to measure the shape of a parachute during air drop tests. Unlike that proposed in this work, the systems mentioned above are generally based on camcorders, which provide less benefit in terms of resolution and dynamic range, in addition to a higher cost in terms of equipment and subsequent data processing.
2. Modelling and Calibration of Cameras
The purpose of modelling the cameras in the context of photogrammetric metrology is to obtain a theoretical model that describes how a scene is transformed into an image [
18]. As a result of modelling, the real camera is idealised or simplified in order to express its behaviour using mathematical expressions which ultimately enable its metric uses. The performance of the measurement system depends largely on the accuracy of the modelling of the cameras.
A camera can be modelled as a spatial system that consists of a planar imaging area (electronic sensor) and a lens with a perspective centre [
19]. The parameters of the interior orientation of a camera define the spatial position of the perspective centre, the principal distance, and the location of the principal point. They also encompass deviations from the principle of central perspective to include radial and tangential distortion and often image affinity and orthogonality.
Figure 1 illustrates the schematic imaging process of a photogrammetric camera. Position and distance of the perspective centre and deviations from the central perspective model are described with respect to the image coordinate system as defined by means of the pixel array. The origin of the image coordinate system is located in the image plane and coincides with the perspective centre. Hence,
H′ is the principal point, the nadir of the perspective centre
O′ with image coordinates (
x′
0,
y′
0) approximately equal to the centre of the image
M′. Principal distance
c is the normal distance to the perspective centre from the image plane, approximately equal to the focal length
f when focused at infinity. Parameters of functions describing imaging errors are dominated by the effect of radial-symmetric distortion Δ
r′ [
19].
If these parameters are known, the (error-free) imaging vector
x′ can be defined with respect to the perspective centre (hence, the principal point):
where
x′
p, y′
p are the measured coordinates of image point
P′,
x′
0,
y′
0 are the coordinates of the principal point
H′, and Δx′, Δy′ are the axis-related correction values for image errors.
Deviations from the ideal central perspective model, attributable to image errors, are expressed in the form correction functions Δx′, Δy′ with respect to the measured image coordinates. In the first instance, measured image coordinates
x′
p, y′
p are corrected by a shift of the principal point
x′
0,
y′
0:
Hence, the image coordinates x°, y° are corrected by x′ = x° − Δx′ and y′ = y° − Δy′. Strictly speaking, the values x°, y° are only approximations since the corrections Δx′, Δy′ must be calculated using the final image coordinates x′, y′. Consequently, correction values must be applied iteratively.
Radial (symmetric) distortion constitutes the major imaging error for most camera systems and is attributable to variations in refraction in the lens system. The radial distortion is usually modelled with a polynomial series with distortion parameters
K1 and
Kn [
20]:
where
is the image radius or distance from the principal point. The software used in this work (Photomodeler 6.0) uses the following variation:
Then, the image coordinates are corrected proportionally:
Radial-asymmetric distortion, often called tangential or decentering distortion, is mainly caused by decentering and misalignment of the lens and can be compensated by the following function [
20]:
Affinity and shear are used to describe deviations of the image coordinate system with respect to orthogonality and uniform scale of the coordinate axes, and can be compensated by the following function:
The individual terms used for modelling the imaging errors of most typical photogrammetric imaging systems can be summarised as follows:
The procedure by which a camera is modelled is called calibration. During calibration, a system of equations is obtained that can include the parameters of interior orientation of a camera as unknowns, including parameters of functions describing imaging errors. The system of equations is then solved by minimizing errors via a procedure called bundle adjustment.
3. Description of the Measurement System
3.1. Components
The measurement system presented in this paper (
Photograph 1) consists of an adjustable structure mounted on a tripod. The cameras are attached to extendable arms (40-70 cm) through a ball mount to improve the pitch. The angle of the arms with the horizontal is adjustable from 10° and 90°. Finally, the arms can rotate freely around the support shaft. This flexible adjustment of the photogrammetric network allows the permissible size of objects in optimum conditions of convergence to range from a few centimeters to 2 m.
Four Pentax Optio A40 cameras were used to take pictures. Among the most outstanding characteristics of this compact camera model (from a photogrammetric point of view), is the possibility of using a single wireless remote shutter for all of the cameras, manual control of aperture and exposure time, manual control of focus, and memory storage for position of the zoom and focus when the camera is turned off. The technical specifications of these cameras are given in
Table 2.
The cameras used as measuring equipment were independently modelled by field calibration using a plane point field (
Photograph 2) and 16 convergent images from four camera stations. At each station, the camera was rotated around the optical axis by 0°, 90°, 180°, and 270°. The parameters and the quality variables for modelling the internal geometry of the cameras are shown in
Table 3.
Figure 2 provides distortion curves for each camera. Zero value to the third radial distortion parameter of the polynomial series was imposed because uncertainty had same magnitude as the value. Furthermore the level of correlation with the second term was over 95%. It also imposed the restriction
C2 = 0 considering the pixels matrix is perfectly orthogonal.
To test the metric potential of the system, 121 white circular targets 6 mm in diameter on a black background were arranged on a flat area, (
Photograph 3). Targets were distributed uniformly in a square field test (750 mm by 750 mm), with a maximum distance between targets of 1,061 mm. The targets had two concentric rings whose discontinuities represent a coding system that allows automatic referencing of homologous points. Subpixel detection algorithms were used for detection of the targets in the images.
The photogrammetric network configuration used during the tests is shown in
Figure 3 and
Table 4. The origin of the coordinate system was established at the target
i6,6, located at the centre of the field test, with coordinates (X
c=1,000, Y
c=1000, Z
c=0). The X-axis was established with the targets
i6,2 and
i6,10 located in the central row. The Y-axis was established at the targets
i10,6 and
i2,6 located in the centre column. The scaling was defined with targets
i6,5 and
i6,8. The location of these points used to define the coordinate system is not arbitrary and were selected as areas of maximum precision.
3.2. Tests for Accuracy Assessment
To study the metric potential of the measuring equipment, three tests were conducted to assess the photogrammetric precision, repeatability of results, and accuracy in the determination of coordinates. The first test was conducted only as a photogrammetric survey. In this test, photogrammetric precision was conceptually related to distances between the incident rays and the calculated position of the target. Formally, the precision values were measured in units of one standard deviation, based on the post-processing covariance matrix of the 3D object points. The photogrammetric precision includes systematic and random errors. Among the systematic errors are those derived from the limitations in modelling of the cameras and the divergence of the central projection as a result of the depth of field. Also included in the random errors are inaccuracies in the detection of targets as a result of limitations in terms of image resolution.
One of the fundamental limitations of the non-metric cameras is geometric instability or inability to maintain a constant internal geometry in the camera over time. The impact of this phenomenon was seen in the test of two situations: (1) using a set of parameters for internal camera geometry obtained just before the test without switching the camera on / off, and (2) using a set of internal parameters of the camera geometry obtained two months prior to the test in which there had been intense use of the cameras, including off / on cycling, and extension / retraction of the zoom.
In the second test of repetitiveness, there were 113 photogrammetric surveys with a total of 452 images. In all of the surveys, the test conditions were kept constant (position of the cameras, lighting, internal geometry parameters of the cameras, etc.). For each of the 113 photogrammetric surveys, 121 points were marked on the images, the external orientation of each camera was calculated (including bundle adjustment) and the coordinate system was defined. The repeatability in this test was analyzed through the standard deviation of the 113 coordinates of each point. The results show the overall repeatability of the method including all of the random errors of the phase of marking targets, those random errors introduced during the process of defining the coordinate system, and also that of scaling. All 113 photogrammetric surveys conducted in this study include the same systematic errors, so deviations in the coordinates are due solely to random errors.
In the third test for accuracy evaluation, the coordinates obtained in the second test were compared with “true” coordinates obtained by a particularly robust photogrammetric survey. It consists in an improved configuration of images (
Figure 4) which provides better ray intersections, higher redundancy and improved use of the image format [
19]. In this survey, only the camera A was used, since it presents the lowest decentering distortion, the lowest marking residuals and the maximum photogrammetric precision (
Table 3). Twenty images were taken from five stations by rotating the camera to 0°, 90°, 180°, and 270° in each station, with the intent to cover the entire test field in the central part of the sensor. With this configuration, the coordinates of 121 points were obtained with photogrammetric precision better than 0.022 mm in all directions of space and at any point of the field test.
Because the mean coordinates of the second test were used for comparison with “true” coordinates, this test is an assessment only of systematic errors resulting from the combined use of the four cameras in the system. This test of accuracy does not take into consideration matters related to the validity of standards used to scale the model.
5. Summary and Conclusions
In this paper, we have presented a medium-accuracy optical measuring equipment system based on four low-cost consumer digital cameras. The cameras are synchronised to allow measurement of moving bodies (e.g., living beings). Tests were conducted to assess the metric potential of this equipment, separating systematic errors from random errors. It was shown that errors resulting from measurement of the coordinates are essentially systematic, and are derived from limitations in geometric modelling of the cameras and from eccentricity in the projected circular targets. Since the errors in determining coordinates are essentially systematic, the standard deviations in crossing of rays or marking residuals are not appropriate variables to describe the metric potential of the measuring equipment. A realistic description of the metric potential should use a confidence interval close to 100%. Finally, we have demonstrated that, with this equipment based in a low-cost multiple-camera and the use of circular targets, the 3D coordinates of any point common to all four cameras can be determined with an error less than 1/3,000 of the maximum size of the object, ie. sub-millimetre accuracy for an object with a size of one meter.