Next Article in Journal
Analysis and Compensation of Phase Current Measuring Error Caused by Sensing Resistor in PMSM Application
Previous Article in Journal
Machine Learning-Based Interpretable Modeling for Subjective Emotional Dynamics Sensing Using Facial EMG
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Calculation and Analysis of Key Parameters of Underwater Optical Imaging System

1
Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (CIOMP), Changchun 130033, China
2
University of Chinese Academy of Sciences, Beijing 100049, China
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(5), 1537; https://doi.org/10.3390/s24051537
Submission received: 10 January 2024 / Revised: 15 February 2024 / Accepted: 24 February 2024 / Published: 28 February 2024
(This article belongs to the Section Sensing and Imaging)

Abstract

:
When photographing objects underwater, it is important to utilize an optical window to isolate the imaging device from the water. The properties of the entire imaging system will change, and the imaging quality will decrease due to the refraction impact of the water and the window. The theoretical calculation method for air imaging is no longer relevant in this context. To analyze the unique rule, this research derives the formulas for key parameters of underwater imaging systems under paraxial circumstances. First, the optical window is modeled, then the formula for the optical window’s focal length in the underwater environment is derived, and the change rule for the focal length of various window forms underwater is condensed. For the ideal imaging system using a domed optical window, the equivalent two-optical group model of the imaging system is established, and the formula for calculating the focal length, working distance, and depth of field of the underwater imaging system is derived through paraxial ray tracing. The accuracy of the formula is verified through the comparative analysis of the formula calculation results and the Zemax modeling simulation results. It provides an important theoretical basis for the in-depth study of underwater imaging technology.

1. Introduction

Underwater imaging technology is the basis for understanding and developing the ocean, optical imaging is currently the primary technological way of underwater imaging [1,2], which is widely used in underwater exploration. Underwater optical imaging still faces considerable challenges [3]. In comparison to air, water is a more complex medium. First of all, the absorption of light energy by water is significantly greater than air, limiting the imaging distance. Selective absorption of water also causes color distortion in the image [4,5]. The non-uniform composition of the water, as well as the presence of various impurities that scatter the light, causes the detector to receive a non-uniform distribution of light energy, degrading the image quality and reducing the contrast [6]. Active lighting must also be taken into account in deep-sea environments, where natural light is almost entirely lost. Additionally, equipment must be designed with a “hard shell” to survive the pressures of deep water [7,8].
Underwater optical imaging equipment often consists of a camera with a sealed, pressure-resistant housing. The housings have transparent windows in the form of a flat or dome to allow light to pass through. These housings safeguard the imaging devices, but they also create new problems. Most windows are made of hard, transparent plastic, glass, sapphire, or ceramics, which are media with a refractive index higher than that of water. Light passes through the water-window interface before entering the imaging device. According to the law of refraction, if the light is not incident perpendicular to the water-window interface, then the light will be refracted at the interface, and the refraction at the interface will change the original propagation path of the light. These light rays that deviate from their original paths tend to reduce the field of view of the imaging device when they pass through a flat window [9], and when they pass through a hemispherical dome window, they create new aberrations in the entire imaging system that can damage the quality of the image [10]. This means that even if these optics are well designed and calibrated in air, they do not meet the requirements of the initial design when working in an underwater environment due to the combined effect of the flat plate or dome window and the water.
Because the object-space medium changes, more refraction occurs before the light enters the imaging system, which causes the separation of the main and nodal planes of the imaging system; G. T. McNeil et al. redefined and standardized underwater photographic optics terminology by proposing that the base point of an underwater lens system translates [11]. In previous studies of the use of optical imaging theory, the case where the spatial medium of the object and image is all air is well established. The study of underwater optical imaging typically falls within the category of multimedia imaging, where multimedia denotes the passage of light through different media before it is collected by the imaging device: the water where the target is located, the window material, and the air in the space where the imaging device is located. When J.-M. Lavest et al. examined sensor calibration in various media, they concluded that the optical laws must be reconsidered when using an underwater camera, extending the pinhole model in different media to a nodal model, and concluded that the focal length of an underwater imaging system is 1.33 times greater than in air [12]. According to P. Agrafiotis et al., the amount of water and air in the overall distance between the camera and the object affects the effective focal length of the camera in dual-media imaging [13]. However, both of these laws only apply to systems that use flat windows. F. Menna et al. also tested a commercial underwater camera in a pool and used photogrammetric techniques to describe the optical phenomena of flat windows and dome windows [14], but they lacked precise calculations. G. Jiang et al. modeled and analyzed the imaging process of an underwater plenoptic camera and proposed an optimization method for an underwater plenoptic camera [15]. However, this method is not generalizable and is only relevant to plenoptic cameras using microlens arrays. In conclusion, while existing research offers several techniques for underwater camera calibration optimization, the lack of direct quantitative calculations and analysis of the effects of water and optical windows (especially dome windows) on imaging equipment, and the lack of a general calculation formula for the properties of underwater imaging system limit the development of underwater imaging technology. Therefore, it is necessary to make accurate calculations on the performance changes of imaging equipment underwater for the special characteristics of underwater imaging.
In this study, we first model the window individually. Subsequently, we derive a formula to determine the focal length of the window within the underwater environment, specifically in the image space, and we explore how the focal length of the window varies when subjected to two distinct shapes of the water-window interface. Secondly, in the case of the dome window, we conducted calculations to assess how the image-square focal length changes in response to variations in the refractive index of water. Additionally, we pinpointed specific shape features that exhibit reduced sensitivity to water-induced effects. To precisely compute the imaging properties of an imaging system featuring a dome window, we devised a simplified geometric model. This model accounts for alterations in the imaging system’s cardinal points and establishes geometric relationships, allowing us to formulate equations for both the total focal length of the system and the underwater front working distance. Based on the reversibility of light, we establish a relationship between the front working distance and the refractive index of the object space. Additionally, we develop a comprehensive depth-of-field formula specifically designed for underwater environments, enhancing the precision of performance evaluations for underwater imaging systems.

2. Underwater Optical Window Imaging Properties

Imaging equipment in the underwater environment, by waterproof shell and optical window to isolate the water. The window functions as a thick lens in the system due to the refractive index of the window material and its thickness to resist water pressure. As a result, underwater imaging has an extra optical element in the construction of the device, unlike aerial imaging technologies that directly picture the target. The target object located in the water first produces a virtual image in front of the window lens, which is also the virtual object of the imaging device, and then the imaging device focuses on it. The virtual object changes the object distance when the imaging device is working. If the position of the virtual object exceeds the focus range of the imaging device, the image will be blurred. More optical structures or other methods need to be added to meet the imaging requirements. According to the definition of applied optics, the position of the virtual image formed by the window lens is closely related to its imaging properties, such as focal length and cardinal point position, so we first analyze the focal length of the window lens and the cardinal points and other imaging properties.
As shown in Figure 1, taking the dome window as an example, the calculation of the focal length and cardinal point of the window follows the definition of geometrical optics, where the focal length represents the distance from the principal point to the focal point. In addition, all our calculations below follow the sign conventions in applied optics: (1) light traveling to the right is positive; (2) the axis segment measured from the lens reference point to the right is positive, while to the left is negative; (3) the vertical axis line segment above the optical axis is considered positive, whereas below is negative.
The working environment of the window is special. The image space is an air medium, the object space is water with a larger refractive index, and the refractive index of water in the actual working environment is not yet fixed [16]. In the case of different media in the object and image space, the focal length formula of the window lens can be varied from the thick lens focal length formula [17]:
n o f o l = n i f i l = n g n o r 1 ( 1 n i n g r 2 d l n g ) + n i n g r 2
where f o l and f i l are the object and image-space effective focal length of the window lens; r 1 and r 2 are the front and rear curvature radius of the window; n o and n i are the refractive index of the object and image space; n g is the refractive index of the window lens; d l is the axial thickness of the window lens.
The left side of Equation (1) is the ratio of the refractive index to the focal length, also known as optical power φ l , which represents the ability of the lens to converge or diverge light rays:
φ l = n g n o r 1 ( 1 n i n g r 2 d l n g ) + n i n g r 2
Substituting Equation (2) into Equation (1) so that the focal lengths in the image and object space of the window lens can be expressed as follows:
{ f i l = n i φ l f o l = n o φ l
From Equations (2) and (3) above, the focal length is a quantity that is influenced by the structural properties of the window lens (radius of curvature, thickness, refractive index of the material) and the refractive index of the object space. In underwater imaging, the refractive index of the object space ( n o ) is the main influencing factor of the change in focal length. In the underwater environment, the differing refractive index of the media on both sides of the window ( n o , n i ) leads to the window lens having two focal lengths, f o l in the object space and f i l in the image space. The magnitude ratio of these focal lengths corresponds precisely to the ratio of the refractive index of the respective media.
Furthermore, the configuration of the water–window interface ( r 1 ) plays a pivotal role in influencing how the refractive index of the object space ( n o ) impacts the focal length of the window lens.
  • When r 1 = , the window interface in contact with the water adopts a flat configuration. Equation (2) becomes:
    φ l = n i n g r 2
In Equation (4), the optical power denoted as φ l is determined solely by the final term, establishing a constant value that remains unaffected by variations in the refractive index of the object space. Then, substituting Equation (4) into Equation (3) provides the following:
{ f i l = n i φ l = n i r 2 n i n g f o l = n o φ l = n o r 2 n i n g
As shown in Equation (5), the focal length in the image space of the window ( f i l ) at r 1 = remains unaffected by the refractive index of the object space ( n o ), maintaining identical values in both air and water. In contrast, the focal length in the object space ( f o l ) is directly proportional to n o , and when underwater, f o l becomes n o times larger than in air.
Consider three distinct structural window types: plano-concave, plano-convex, and flat. Each adheres to the condition r 1 = , with rear curvature radius ( r 2 ) at 50 mm, −50 mm, and infinity, correspondingly, all constructed from sapphire. The image-space focal length variation curves of the three windows in media with different refractive indices are obtained by the calculation of Equation (5). In Figure 2, the depicted lines remain linear regardless of the medium transition from air to seawater or within seawater at different refractive indices. The focal length of the window’s image space for the three structures remains consistently fixed, determined by their individual structural properties, specifically the size of r 2 , and the materials employed. The property of having r 1 = , termed as front-flat, bestows an advantage upon the window: the image-space focal length remains unaffected by alterations in the refractive index of the object space medium. While operating underwater, this front-flat window diminishes the impact of medium changes on the camera. However, it regrettably reduces the camera’s field of view [9].
2.
In cases where r 1 , the window-water interface takes on a curved configuration, leading to increased complexity. This curvature introduces the possibility of an angle forming between the incident infinity ray and the surface’s normal vector. As stipulated by the law of refraction, the angle of outgoing radiation hinges upon both the refractive index of the object space and the angle of incidence. Consequently, the location of the focal point in the dome-shaped window lens undergoes changes contingent on variations in the refractive index of the object space and the configuration of the interface, r 1 and r 2 .
Typically, in underwater applications, curved windows are predominantly of the domed variety, featuring front and rear surfaces that conform to concentric spheres. Specifically, the thickness is d l = r 1 r 2 . The concentric configuration offers the dual benefit of withstanding pressure while ensuring a consistent field of view size [10]. Generally, air serves as the medium between the dome window and the imaging device, thus determining the focal length of the window lens as follows:
n o f o l = 1 f i l = n g n o r 1 ( 1 1 n g r 2 d l n g ) + 1 n g r 2
The complexity of the lens focal length is evident as it depends on both n o and r 1 and r 2 . There is no longer a fixed ratio law for underwater focal length and air either. Parameters for underwater operation cannot be obtained using land-based laboratory calibrations. The window’s focal length value can be determined solely by employing Equation (6) once the refractive index of the water medium is known.
According to Equation (6), the alteration in window focal length primarily results from variations in n o , while the extent of this change is collectively influenced by the surface curvatures r 1 and r 2 . Using an actual window calculation as an example, we delve into examining the specific effects of r 1 and r 2 .
First, we take three windows whose materials are all sapphire, with consistent r 2 values of 40 mm. The thickness of underwater dome windows is generally within 5–15 mm, so the corresponding r 1 values are 45 mm, 50 mm, and 55 mm, respectively. The refractive index of the water is considered within the range of 1.33 to 1.36 [16,18]. In accordance with the predefined parameters and Equation (6), we computed the alteration in the focal length in the image space of the three windows when transitioning from air to water with a refractive index of 1.339. The outcomes are depicted in Figure 3a. Then, we calculated the focal length values in the image space for the three windows while varying the water’s refractive index within the range of 1.33 to 1.35. The findings are presented in Figure 3b. The negative focal length in the image space of the dome window indicates that the window acts as a negative lens. The negative sign of the focal length value represents the relative direction of the focus and the window, signifying that the image focus is situated to the left of the window. The variations in the curves depicted in both figures reveal that the refractive index of the object space ( n o ) exerts the primary influence on the focal length alterations of the window. This effect is particularly pronounced as the refractive index undergoes a substantial shift from air to an aqueous medium, leading to a significant reduction in the window’s focal length. Likewise, the decrease in focal length observed in Figure 3b can be attributed to the elevation of the water’s refractive index. This phenomenon precisely corresponds to the negative lens effect of water [19]; it can be analogized to introducing a negative lens ahead of the window, causing light to diverge away from the optical axis. Importantly, the greater the refractive index of the water, the more pronounced the divergence effect, resulting in a commensurately diminished focal length of the window. The magnitude of the front curvature radius ( r 1 ) of the window plays a pivotal role in defining the extent to which the refractive index of water affects the window’s focal length. This phenomenon is illustrated in Figure 3b, where the three curves of r 1 exhibit varying degrees of sensitivity to changes in the refractive index of water within the range of 1.330 to 1.345. For instance, when r 1 is 45 mm, the window’s focal length experiences a change of approximately 2.59%. However, as r 1 increases to 55 mm, the window’s focal length undergoes a more limited change, approximately 3.17%. This phenomenon becomes notably more pronounced when transitioning from air to an underwater environment, as illustrated in Figure 3a. A greater radius of curvature ( r 1 ) results in reduced susceptibility to negative lensing effects and, consequently, minimized alterations in focal length.
Subsequently, we calculate windows with varying rear curvature radius ( r 2 ). Again, we use the example of three windows, where r 1 values are 50 mm, and r 2 values are 35 mm, 40 mm, and 45 mm, respectively. The remaining parameters are kept consistent with those detailed in the preceding paragraph. Employing Equation (6), we compute and generate the two graphs displayed in Figure 4. Once more, the primary factor driving the curve variations is the refractive index n o within the object space. In Figure 4b, the three curves exhibit varying degrees of change within the seawater refractive index range of 1.330 to 1.335. Notably, the dome window with a 45 mm rear radius of curvature displays a shift in image-space focal length of approximately 3.22%, while the window with a 35 mm rear radius of curvature demonstrates a range of change limited to about 2.51%. The observation depicted in Figure 4b illustrates that a smaller radius of curvature r 2 corresponds to reduced exposure of the window to the negative lensing effect, resulting in a smaller change in focal length.
In underwater applications, two prevalent window types are flat windows and dome windows. The calculations presented above reveal that the focal length in the image space of the flat window remains unaltered in the underwater environment, in contrast to the imaging characteristics of the dome window, which exhibit greater susceptibility to variations in the refractive index of water. Although selecting a dome with appropriate shape characteristics can mitigate the impact of the water refractive index, this factor cannot be disregarded. Hence, to thoroughly assess the imaging of the dome window, more intricate calculations are necessary. In Section 3, we will construct a comprehensive computational model to investigate variations in the imaging of the dome window system.

3. Object-Image Relationships for Underwater Optical Imaging Systems

For the imaging equipment used behind the dome window, the negative lensing effect brought by water cannot be avoided. To gain a deeper understanding of the combined impact of water and the dome window on the imaging system, we developed a simplified model using the equivalent two-optical group method to analyze alterations in system imaging. Figure 5 shows the model, wherein the entire imaging system is partitioned into two distinct components. Component 1 represents the dome window, serving to isolate the water, and component 2 represents the ideal lens, which is used in place of the imaging device. The medium behind the window is air. The radius of curvature of the front and rear surfaces of the optical window are r 1 , r 2 and the thickness is d l . The refractive index of the window material medium is n g , and the refractive index of the object space medium is n o The refractive index of the image space medium is n i .
The dome window will be used in such a way that its center of curvature coincides with the position of the entrance pupil of the subsequent imaging device. This approach offers the benefit of maintaining the unaltered object space field of view of the imaging device while effectively eliminating the dome’s coma, astigmatism, and lateral chromatic aberration, thereby minimizing their impact on image quality.
The entrance pupil is conceptually defined as the image formed by the aperture diaphragm as observed through its front element. The concentric attributes of the dome window introduce a noteworthy characteristic: when the entrance pupil of component 2 aligns with the center of curvature of the dome, the entrance pupil of the entire system co-aligns at this central point. Remarkably, this position remains fixed, remaining impervious to alterations in the object space medium, with only its size subject to modification:
D w = n a n w D A
where D w , D A represent the system’s entrance pupil size in water and air, respectively. And n a , n w represent the refractive index of air and water. In underwater conditions, the entrance pupil diameter of the underwater environmental system is reduced to 1 / n w of its original size. This reduction is one of the contributing factors to the blurring of high-frequency details in underwater images and the subsequent decrease in illuminance.

3.1. Underwater Optical Imaging System Focal Length

Drawing upon the calculations presented in the preceding section, the negative lens effect induced by the water window results in increased light diffusion as it traverses the optical elements. In the case of a single lens, this effect manifests as a reduction in the negative lens focal length and an increase in the positive lens focal length. Nonetheless, given that the optical system comprises multiple components, the alteration in focal length no longer adheres to the same pattern observed in a single lens configuration. The system we have modeled comprises two key components: the water primarily impacts the window component in direct contact, while the subsequent imaging component maintains its imaging properties as it consistently operates in an air medium. The alteration in the imaging properties of the entire system occurs due to changes in the focal length of the water-contacting window and the displacement of its principal plane.
The system’s optical power is determined using the formula applicable to a two-optical group optical system:
φ = φ 1 + φ 2 d φ 1 φ 2
where φ represents the total optical power of the system, φ 1 , φ 2 denote the optical power of the two components, and d stands for the optical spacing between the two components. Specifically, d is defined as the distance extending from the second principal plane of component 1 to the first principal plane of component 2, as illustrated in Figure 6. Mathematically, d is expressed as d = h 1 h 2 .
Subsequently, by utilizing the relationship between the optical power and the image-space focal length, we can determine the image-space focal length of the entire optical system, expressed as follows:
f i = n i f i 2 n i + φ 1 f i 2 φ 1 d
where f i is the image-space focal length of system and f i 2 is the image-space focal length of component 2. Ordinarily, the image space of the optical system is air, n i = 1 . Consequently, the image-space focal length for an underwater imaging system equipped with an optical window is calculated as follows:
f i = f i 2 1 + φ 1 ( f i 2 d )
Component 2 resides within an air medium, and its focal length, denoted as f i 2 , remains unaffected by the properties of the object-space medium; it is a constant value. Consequently, the variation in the total focal length of the system is determined by both the optical power of component 1 ( φ 1 ) and the optical spacing ( d ) between the two components. The optical power of the optical window of component 1 is the reciprocal of its image-space focal length, and the change in focal length has been calculated in the previous section. The optical spacing ( d ) signifies the separation between the principal planes of the two components. Component 2 is situated in an air medium, with its principal plane positions remaining constant. Therefore, to determine the change in d , it suffices to calculate the displacement of component 1’s principal planes.
Component 2 is an ideal lens with both its first and second principal planes always located on its own. And component 1 features a dome window with concentric spherical surfaces, ensuring that its two principal planes perpetually align. In air, these principal planes are precisely centered at the point of curvature. When in water, the principal planes of the dome are shifted forward to more closely resemble the dome. Figure 7 provides a visual representation of the relative positions of the principal planes for both components when submerged.
According to the thick lens cardinal positions formula, the principal plane position of the dome window is obtained as follows:
{ l h o = d l n o ( n g n i ) n g r 2 φ 1 l h i = d l n i ( n o n g ) n g r 1 φ 1
where the first principal plane position, l h o , denotes the distance from the point where the front surface of the window intersects with the optical axis, serving as the starting point, to the first principal point. The second principal plane position, l h i , represents the distance from the point of intersection between the rear surface of the window and the optical axis to the second principal point.
The optical spacing of the two components can be expressed as follows:
d = r 2 l h i = r 2 d l n i ( n o n g ) n g r 1 φ 1
When the object space medium is water, which has a greater refractive index than air, and all other conditions remain unchanged, the optical spacing between the two components increases with the object space refractive index.
In summary, the underwater environment changes the refractive index of the object space medium, resulting in changes to both the focal length of the window and the optical spacing between the two components within the system. In the formula calculation, it is crucial to consider the sign of each quantity, with φ 1 being a variable with a negative value and d being a variable with a positive value. And from Equation (10), we can see that the focal length f i decreases with the increase in the refractive index of the object-space medium.

3.2. Working Distance of Underwater Optical Imaging Systems

The primary issue arising from the change in focal length is its impact on the system’s imaging position. A system calibrated in air and subsequently deployed underwater faces the risk of losing its optimal imaging plane, potentially resulting in image quality no longer meeting observational requirements. Hence, we conducted calculations to determine the underwater front working distance and assess the system’s change in focus.
The distance at which the system can accurately focus is denoted as the front working distance l f . It is defined as the distance from the target object that can be focused to the front vertex of the system, which corresponds to the intersection of the first face of component 1 with the optical axis. This relationship is derived from the geometric representation shown in Figure 8:
l f = l + l H o + l h o
where l H o , l h o are the positions of the first principal planes of the system and component 1. l is the object distance, which is the distance from the second principal plane of the system to the target object. It is obtained from the geometrical optics Gaussian formula as follows:
l = n o f i l f i l = n o f i ( l r l H i ) f i l r + l H i
where l represents the image distance, defined as the distance from the second principal plane of the system to the image plane. l r denotes the rear working distance, which signifies the distance from the rear surface of component 2 to the image plane. l H i is the position of the second principal plane of the system. Therefore, the front working distance can be expressed as follows:
l f = l + l H o + l h o = n o f i ( l r l H i ) f i l r + l H i + d n o 1 + φ 1 ( f i 2 d ) + d l n o ( n g 1 ) n g r 2 φ 1 = n o [ f i ( f i 1 l r + d f i f i f i 1 l r f i 1 d f i + d f i 2 ) + d l ( n g 1 ) n g r 2 φ 1 ]
Furthermore, in underwater conditions, the refractive index of the medium is variable. Fluctuations in temperature, pressure, and salt content can result in the refractive index falling within a range of 1.33–1.36. The extent to which changes in refractive index affect the system’s focus needs to be confirmed.
In Figure 9a, the light is emitted from the object through the imaging system and reaches the image plane, using the reversibility principle of the light path; in Figure 9b, the light returns to the object point. When the system operates in an air medium, it achieves focus on the object in position l 1 . When the system’s working medium is switched to water while keeping the rear working distance constant, the front working distance extends to l 2 .
It can be seen that the disparity in the light path between the two working environments solely exists at the interface of the water window. By using the refractive surface calculation formula for light [20], we can calculate the refracted light path at the water window interface as follows:
n g l n o l = n g n o r 1
where l , l represent the distances from the intersection point of the light ray with the optical axis before and after refraction at the refractive surface of the water window. Since the light path remains consistent after the water window interface, i.e., l remains constant, we can use Equation (16) to derive the relationship formula for the front working distance under varying media as follows:
l 2 = n 2 n 2 n 1 r 1 + n 1 l 1
where l 1 , l 2 are the front working distance in media 1 and 2; n 1 , n 2 are refractive index in media 1 and 2; r 1 denotes the radius of curvature of the water–window interface.
Based on Equations (15) and (17), it becomes apparent that the primary factor driving alterations in the properties of the underwater imaging system is the significant variation in the refractive index of the object-space medium ( n o ). And the magnitude of this change is determined by the focal length of the optical window ( f i l ). The change in the optical window focal length ( f i l ) results from the combined influence of the refractive index ( n o ) and the radius of curvature of the front surface of the window ( r 1 ). Therefore, the selection of the window shape holds significant importance for the underwater imaging system. As calculated in the preceding section, when the radius of curvature of the front surface of the window is larger, the impact of changes in the refractive index of the medium on the system is diminished.
For imaging devices, achieving a closer object focus necessitates a more distant imaging surface. Because the imaging device is encapsulated in a sealed shell, there is a limitation on the length of the fuselage, so the front working distance of the imaging device has a minimum value. When the system working environment from air to water, that is, the refractive index of the medium of the object space becomes larger, the minimum front working distance will become larger. This implies that the system’s ability to capture clear images of nearby targets is compromised when operating in high-refractive-index water environments.

3.3. Simulation Software Verification

In order to verify the accuracy of the calculation formula, we used the optical design software Zemax OpticStudio 19.4 [21] to simulate the paraxial imaging results of the underwater imaging system and compare them with the formula calculation results.

3.3.1. Test on the Ideal System

We first simulated the ideal case by modeling the domed window and thin lens in the simulation software (Zemax OpticStudio 19.4). The optical window material in the model is sapphire, the field of view is the near-axis region, and the model parameters are set for three different cases, as shown in Table 1.
Firstly, the model working environment is set to air, with the system imaging the object at 0.1 m. After the software gives the optimal image position, other quantities are kept constant, and then the environment is changed to seawater, and the object distance is optimized to get the optimal working distance of the model in the underwater environment. We conducted simulations for eight seawater cases, varying the refractive index between 1.33 and 1.36 [16,18]. For each model, we used Equation (15) for the calculations. The final results of the calculations and simulations for all models are shown in Figure 10, where different line shapes are used to distinguish the data for different models, and solid and dashed lines are used to distinguish the calculation from the simulation results. Figure 10b–d present specific data on the front working distance obtained through both methods, corresponding to different models. The data obtained by both methods are consistent, affirming the reliability of the work distance calculation method and the accuracy of Equation (15).
The findings depicted in Figure 10 indicate a substantial increase in the system’s front working distance, expanding multiple times from 0.1 m when transitioning from air to seawater, attributable to water’s negative lensing effect on the imaging system. Additionally, in Figure 10a, the inclination of the lines also suggests that discrepancies in refractive indices within seawater contribute to alterations in the system’s front working distance. These variations may prompt a shift in the imaging system’s focusing position, leading to compromised imaging outcomes, particularly with cameras employing fixed-focus lenses. Hence, it becomes imperative to calculate the extent of change in the system’s front working distance within an underwater environment. The comparison of data among various models in Figure 10 demonstrates that the extent of variation in the front working distance correlates with the radius of curvature of the dome surface, wherein cameras fitted with larger-radius domes exhibit diminished variations in the front working distance across diverse environments, displaying enhanced adaptability. Opting for an appropriate dome window shape proves beneficial for cameras operating in specific underwater environments, as it mitigates the impact of focus point shifts on imaging.

3.3.2. Test on the Real System

To further validate the accuracy of our computational method, we incorporated real lenses behind the dome for simulation. In Figure 11a, we employed the objective lens from the simplest Cooke three-piece set [22] as the real lens configuration behind the dome. The optical parameters are specified in Table 2. Initially, we consider the actual imaging conditions where the imaging area extends beyond the near-axis range to encompass the entire aperture of the imaging system and the off-axis field of view. This expansion enlarges the lateral range of the entire imaging system, resulting in significant aberrations. Under conditions of large aperture and wide field of view, even with an optimized lens configuration, the combination of the dome and water induces unavoidable aberrations, leading to diminished image quality, as illustrated in Figure 11b.
To minimize the effect of aberrations, when using real lenses, the entire system can be approximated as ideal imaging if the conditions are limited to the near-axis case. We employed the three models listed in Table 3, where the dome data remained consistent with the ideal lens scenario but with the use of a real lens group following the spherical shell. The calculation results derived from the formulas and those from Zemax simulations are illustrated in Figure 12. Both approaches demonstrate the same change pattern, with very closely matched data results. While the real lens simulation is based on conditions of near-axis optical imaging, the results further validate the accuracy of our derived formulas for the front working distance and other parameters. This significantly aids in optimizing the calculation of underwater imaging systems and provides valuable guidance for constructing and designing a reasonable and feasible imaging system. In the next step, we will solve the problem of the aberration between the dome window and the water and further realize the qualified imaging quality in the lateral range of the imaging system behind the dome.

3.4. Depth of Field for Underwater Imaging Systems

In practical optical systems, the specific object position corresponding to a clear image is no longer fixed, allowing for a certain degree of variation in the object distance. Objects within the depth of field range can fulfill the conditions required for clear imaging. When the object space environment changes, we need to redefine the depth of field range of the imaging system. When transitioning from an air to an underwater environment, if the change in system focus distance falls within the depth of field, the system initially calibrated on land can meet the requirements for underwater use and simplify the focusing process when operating underwater. To solve this problem, we derive a depth-of-field formula applicable to underwater imaging systems.
Most books on geometrical optics give a formula for the system depth of field [23]:
Δ = 2 δ D f i l ( l + f i ) δ 2 ( l + f i ) 2 D 2 f i 2
where Δ is the depth of field of the system; δ is the maximum permissible dispersion circle diameter; D is the Entrance pupil diameter; l is focus distance; f i is the focal length in the image space of the system.
The formula above applies to systems where the object space is air. As the refractive index of the object space medium is a significant factor influencing the depth of field, a modification is required when the object space medium changes from air to water. The adjusted depth of field formula becomes the following:
Δ n = 2 δ D f i l ( l + n o f i ) δ 2 ( l + n o f i ) 2 D 2 n o 2 f i 2
where Δ n is the new depth of field of the system; n o is the refractive index of the object space medium. From Equation (19), multiple factors exert influence over the depth of field. The focal length, entrance pupil diameter, and focusing distance collectively determine the extent of the depth of field. Additionally, changes in the refractive index of the water introduce variations in the depth of field range. As an illustrative calculation, we selected the system parameters outlined in Section 3.3. And the diameter of the incident pupil is 10 mm, the maximum permissible dispersion circle diameter is 30 μm, the focusing distance is 100–1000 mm and uses Equation (19) to calculate the depth of field ranges in air and seawater, respectively, and the results are shown in Figure 13.
According to Equation (19) and Figure 13, it is evident that the depth of field for the same imaging system expands as the refractive index of the object space medium increases at a consistent focusing distance. And the imaging system will have a greater depth of field underwater compared to in air. However, this relationship is not a straightforward n_o-fold increase, and the depth of field underwater grows much more rapidly with the increase in the focusing distance, which is much more conducive for the imaging system to be used for focusing when the imaging system is used underwater.

4. Conclusions

In contrast to imaging in air, the uniqueness of underwater imaging is due to how water and windows affect light transmission. This paper outlines the principles governing the performance variations of underwater imaging systems. This paper begins by treating the window as a thick lens and deducing the formula for calculating the underwater focal length of the window. It then concludes the rules governing focal length changes under two water–window shapes and identifies the characteristics of the window that is less affected by water. By establishing a geometric model of light propagation and using paraxial geometric optics calculations, the paper proceeds to derive the focal length and working distance of underwater systems and derived a method to calculate the offset in the focusing position when the camera operates underwater. It establishes the change in the refractive index of the object space as the primary influencing factor and corrects the depth-of-field formula. This correction renders the formula suitable for imaging systems operating in underwater environments. In addition, we verified the accuracy through optical design software. In the future, our work will focus on applying the working distance formula to the focusing calculation and image processing of underwater imaging systems to ensure the improvement of underwater imaging quality and to solve the aberration problem introduced by the dome window to further improve the clarity of underwater imaging.

Author Contributions

Conceptualization, G.Z. and Y.L.; Data curation, G.Z. and Y.L.; Formal analysis, J.D.; Methodology, G.Z.; Project administration, Y.L.; Software, G.Z., C.Y. and L.L.; Validation, G.Z., B.D. and J.M.; Writing—original draft, G.Z.; Writing—review and editing, Y.L. and X.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key Research and Development Program of China, grant numbers 2018YFC0308100 and 2018YFC0307900.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Shen, Y.; Zhao, C.; Liu, Y.; Wang, S.; Huang, F. Underwater optical imaging: Key technologies and applications review. IEEE Access 2021, 9, 85500–85514. [Google Scholar] [CrossRef]
  2. Shortis, M. Camera calibration techniques for accurate measurement underwater. In 3D Recording Interpretation for Maritime Archaeology; Springer: Berlin/Heidelberg, Germany, 2019; pp. 11–27. [Google Scholar]
  3. Song, Y.; Nakath, D.; She, M.; Köser, K. Optical imaging and image restoration techniques for deep ocean mapping: A comprehensive survey. PFG–J. Photogramm. Remote Sens. Geoinf. Sci. 2022, 90, 243–267. [Google Scholar] [CrossRef]
  4. Ning, Y.; Jin, Y.-P.; Peng, Y.-D.; Yan, J. Underwater image restoration based on adaptive parameter optimization of the physical model. Opt. Express 2023, 31, 21172–21191. [Google Scholar] [CrossRef] [PubMed]
  5. Ke, K.; Zhang, C.; Tang, Q.; He, Y.; Yao, B. Single underwater image restoration based on descattering and color correction. Optik 2022, 259, 169009. [Google Scholar] [CrossRef]
  6. Zhang, M.; Peng, J. Underwater image restoration based on a new underwater image formation model. IEEE Access 2018, 6, 58634–58644. [Google Scholar] [CrossRef]
  7. She, M.; Nakath, D.; Song, Y.; Köser, K. Refractive geometry for underwater domes. ISPRS J. Photogramm. Remote Sens. 2022, 183, 525–540. [Google Scholar] [CrossRef]
  8. Han, B.; Sun, Y.; Ma, L.; Lv, P. Influence of watertight optical window with plain glass on receiving field for underwater wireless optical communication. Appl. Opt. 2022, 61, 3558–3565. [Google Scholar] [CrossRef] [PubMed]
  9. She, M.; Song, Y.; Mohrmann, J.; Köser, K. Adjustment and calibration of dome port camera systems for underwater vision. In Proceedings of the Pattern Recognition: 41st DAGM German Conference, DAGM GCPR 2019, Dortmund, Germany, 10–13 September 2019; Proceedings 41. pp. 79–92. [Google Scholar]
  10. Menna, F.; Nocerino, E.; Fassi, F.; Remondino, F. Geometric and optic characterization of a hemispherical dome port for underwater photogrammetry. Sensors 2016, 16, 48. [Google Scholar] [CrossRef] [PubMed]
  11. McNeil, G.T. Underwater Photography Some photogrammetric considerations. Photogramm. Eng. 1969, 35, 1135. [Google Scholar]
  12. Lavest, J.-M.; Rives, G.; Lapresté, J.-T. Underwater camera calibration. In Proceedings of the Computer Vision—ECCV 2000: 6th European Conference on Computer Vision, Dublin, Ireland, 26 June–1 July 2000; Proceedings, Part II 6. pp. 654–668. [Google Scholar]
  13. Agrafiotis, P.; Georgopoulos, A. Camera constant in the case of two media photogrammetry. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2015, 40, 1–6. [Google Scholar] [CrossRef]
  14. Menna, F.; Nocerino, E.; Remondino, F. Optical aberrations in underwater photogrammetry with flat and hemispherical dome ports. In Proceedings of the Videometrics, Range Imaging, and Applications XIV, Munich, Germany, 17 March 2017; pp. 28–41. [Google Scholar]
  15. Jiang, G.; Jin, X.; Deng, R.; Sun, K.; Yang, J.; Lv, W. Underwater plenoptic cameras optimized for water refraction. Opt. Express 2023, 31, 21464–21481. [Google Scholar] [CrossRef]
  16. Quan, X.; Fry, E.S. Empirical equation for the index of refraction of seawater. Appl. Opt. 1995, 34, 3477–3480. [Google Scholar] [CrossRef]
  17. McNeil, G.T. Metrical fundamentals of underwater lens system. Opt. Eng. 1977, 16, 128–139. [Google Scholar] [CrossRef]
  18. Huibers, P.D. Models for the wavelength dependence of the index of refraction of water. J. Appl. Opt. 1997, 36, 3785–3787. [Google Scholar] [CrossRef] [PubMed]
  19. Laikin, M. Design of an in-water corrector system. Appl. Opt. 2002, 41, 3777–3780. [Google Scholar] [CrossRef] [PubMed]
  20. Xiaotong, L.; Zhaofeng, C. Geometrical Optics, Aberrations and Optical Design; Zhe Jiang University Press: Zhejiang, China, 2007; pp. 95–121. [Google Scholar]
  21. Zemax. Available online: http://www.zemax.com/products (accessed on 24 December 2023).
  22. Laikin, M. Lens Design, 4th ed.; CRC Press: Boca Raton, FL, USA, 2018; pp. 53–57. [Google Scholar]
  23. Yimo, Z. Applied Optics, 4th ed.; Electronic Industry: Beijing, China, 2015; p. 95. [Google Scholar]
Figure 1. Model of a domed window, with the parameters of the window as a form of lens and the focal points and principal points under the definition of applied optics labeled in the figure.
Figure 1. Model of a domed window, with the parameters of the window as a form of lens and the focal points and principal points under the definition of applied optics labeled in the figure.
Sensors 24 01537 g001
Figure 2. (a) Comparison of the focal length values of three different r 2 of the front flat window in air and seawater, respectively, with the refractive index of seawater taking the value of 1.339; (b) variation of the focal length values of three different r 2 of the front flat window in seawater with different refractive indices.
Figure 2. (a) Comparison of the focal length values of three different r 2 of the front flat window in air and seawater, respectively, with the refractive index of seawater taking the value of 1.339; (b) variation of the focal length values of three different r 2 of the front flat window in seawater with different refractive indices.
Sensors 24 01537 g002
Figure 3. (a) Comparison of the focal length values of three dome windows with different r 1 in air and water, respectively, with the water refractive index taking the value of 1.339; (b) the variation of focal length values for dome windows with three different r 1 in seawater with varying refractive indices.
Figure 3. (a) Comparison of the focal length values of three dome windows with different r 1 in air and water, respectively, with the water refractive index taking the value of 1.339; (b) the variation of focal length values for dome windows with three different r 1 in seawater with varying refractive indices.
Sensors 24 01537 g003
Figure 4. (a) Comparison of the focal length values of three dome windows with different r 2 in air and water, respectively, with the water refractive index taking the value of 1.339; (b) the variation of focal length values for dome windows with three different r 2 in seawater with varying refractive index.
Figure 4. (a) Comparison of the focal length values of three dome windows with different r 2 in air and water, respectively, with the water refractive index taking the value of 1.339; (b) the variation of focal length values for dome windows with three different r 2 in seawater with varying refractive index.
Sensors 24 01537 g004
Figure 5. A computational model consisting of an optical window and an ideal lens is used to simulate the imaging device.
Figure 5. A computational model consisting of an optical window and an ideal lens is used to simulate the imaging device.
Sensors 24 01537 g005
Figure 6. Labeling of the focal length and the principal plane for each component within the computational model (the symbols depicted in the figure exclusively indicate the direction, and the focal length extends from the principal point to the focal point).
Figure 6. Labeling of the focal length and the principal plane for each component within the computational model (the symbols depicted in the figure exclusively indicate the direction, and the focal length extends from the principal point to the focal point).
Sensors 24 01537 g006
Figure 7. Since the first and second principal planes of the two components are each coincident, a blue line is used to represent the principal plane, and h 1 , h 2 are the principal points of the two components, respectively. When transitioning from air to underwater, the principal plane of the concentric window will be shifted from the center of curvature to the direction close to the window with the increase in the refractive index of the object-space medium. This adjustment results in an expansion of the optical spacing ( d = h 1 h 2 ).
Figure 7. Since the first and second principal planes of the two components are each coincident, a blue line is used to represent the principal plane, and h 1 , h 2 are the principal points of the two components, respectively. When transitioning from air to underwater, the principal plane of the concentric window will be shifted from the center of curvature to the direction close to the window with the increase in the refractive index of the object-space medium. This adjustment results in an expansion of the optical spacing ( d = h 1 h 2 ).
Sensors 24 01537 g007
Figure 8. Working distance labeling for system models.
Figure 8. Working distance labeling for system models.
Sensors 24 01537 g008
Figure 9. Variation of the front working distance in different media under the condition that the rear working distance is kept constant. (a) The light path of the system when working in air. (b) the Light path of the system when working underwater, utilizing the reversibility of the light path, where the light returns from the image point to the object point.
Figure 9. Variation of the front working distance in different media under the condition that the rear working distance is kept constant. (a) The light path of the system when working in air. (b) the Light path of the system when working underwater, utilizing the reversibility of the light path, where the light returns from the image point to the object point.
Sensors 24 01537 g009
Figure 10. (a) Computational and simulation results of three models in seawater with multiple refractive indices. Data from different models are distinguished by different colors and line shapes. The solid line represents the calculation results, and the dashed line represents the simulation results; (b) comparison of calculation and simulation for model 1; (c) comparison of calculation and simulation for model 2; (d) comparison of calculation and simulation for model 3.
Figure 10. (a) Computational and simulation results of three models in seawater with multiple refractive indices. Data from different models are distinguished by different colors and line shapes. The solid line represents the calculation results, and the dashed line represents the simulation results; (b) comparison of calculation and simulation for model 1; (c) comparison of calculation and simulation for model 2; (d) comparison of calculation and simulation for model 3.
Sensors 24 01537 g010
Figure 11. Using the real lens, there are large aberrations, and the imaging quality is very poor. (a) The layout of the imaging system using the real lens set; (b) the dot plot of the imaging system using the real lens set. The light spot is highly dispersed, exhibiting significant aberrations.
Figure 11. Using the real lens, there are large aberrations, and the imaging quality is very poor. (a) The layout of the imaging system using the real lens set; (b) the dot plot of the imaging system using the real lens set. The light spot is highly dispersed, exhibiting significant aberrations.
Sensors 24 01537 g011
Figure 12. Computational and simulation results of three real models in seawater with multiple refractive indices.
Figure 12. Computational and simulation results of three real models in seawater with multiple refractive indices.
Sensors 24 01537 g012
Figure 13. Curve of the depth of field versus focusing distance for the same optical system when in air and seawater, respectively.
Figure 13. Curve of the depth of field versus focusing distance for the same optical system when in air and seawater, respectively.
Sensors 24 01537 g013
Table 1. Optical Parameters of the Zemax Model.
Table 1. Optical Parameters of the Zemax Model.
Optical ParametersModel 1Model 2Model 3
Front curvature radius of the window50 mm60 mm80 mm
Rear curvature radius of the window40 mm50 mm70 mm
Axial thickness of the window lens10 mm10 mm10 mm
Focal length of the ideal lens20 mm20 mm20 mm
Table 2. Optical Parameters of the real system.
Table 2. Optical Parameters of the real system.
Optical ParametersReal System
Focal length of ideal lens50 mm
F-number3.5
Entrance pupil position (relative to the first side of the lens)4.103 mm
Distance between the dome and real lens35.897 mm
Front curvature radius of the window50 mm
Rear curvature radius of the window40 mm
Table 3. Parameter settings for the three real models.
Table 3. Parameter settings for the three real models.
Optical ParametersReal Model 1Real Model 2Real Model 3
The radius of curvature of the first surface50 mm60 mm80 mm
The radius of curvature of the second surface40 mm50 mm70 mm
Axial thickness of the window lens10 mm10 mm10 mm
Focal length of the real lens50 mm50 mm50 mm
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhou, G.; Liu, Y.; Dang, B.; Yu, C.; Li, L.; Du, J.; Ma, J.; Liu, X. Calculation and Analysis of Key Parameters of Underwater Optical Imaging System. Sensors 2024, 24, 1537. https://doi.org/10.3390/s24051537

AMA Style

Zhou G, Liu Y, Dang B, Yu C, Li L, Du J, Ma J, Liu X. Calculation and Analysis of Key Parameters of Underwater Optical Imaging System. Sensors. 2024; 24(5):1537. https://doi.org/10.3390/s24051537

Chicago/Turabian Style

Zhou, Guangpeng, Ying Liu, Boshi Dang, Chen Yu, Linhan Li, Jie Du, Junlin Ma, and Xinyue Liu. 2024. "Calculation and Analysis of Key Parameters of Underwater Optical Imaging System" Sensors 24, no. 5: 1537. https://doi.org/10.3390/s24051537

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop