Next Article in Journal
Single-Shot Wavefront Sensing in Focal Plane Imaging Using Transformer Networks
Next Article in Special Issue
High-Myopia Diagnosis by Reciprocal of Circle Radius in Choroidal Image
Previous Article in Journal
Acetone Absorption Cross-Section in the Near-Infrared of the Methyl Stretch Overtone and Application for Analysis of Human Breath
Previous Article in Special Issue
Photoacoustic Imaging of Human Skin for Accurate Diagnosis and Treatment Guidance
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Liquid Lens Optical Design for Adjustable Laser Spot Array for the Laser-Based Three-Dimensional Reconstruction of Vocal Fold Oscillations

1
Institute of Photonic Technologies, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91052 Erlangen, Germany
2
SAOT—Erlangen Graduate School in Advanced Optical Technologies, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91052 Erlangen, Germany
3
University Hospital Erlangen at Friedrich-Alexander Universität Erlangen-Nürnberg, 91054 Erlangen, Germany
*
Author to whom correspondence should be addressed.
Optics 2025, 6(1), 10; https://doi.org/10.3390/opt6010010
Submission received: 13 January 2025 / Revised: 26 February 2025 / Accepted: 7 March 2025 / Published: 12 March 2025
(This article belongs to the Special Issue Advanced Optical Imaging for Biomedicine)

Abstract

:
Standard endoscopy of vocal folds is in general limited to two-dimensional imaging. Laser-based 3D imaging offers not only absolute measurements but also the possibility of assessing all three spatial directions. However, due to human inter-individuality, a fixed grid configuration (with fixed edge length and spot size) does not necessarily provide the best coverage and resolution. We present a liquid lens optical design for a diffractive spot array generator with dynamic adjustment capabilities for both array size and spot size. The tunable nature of the liquid lenses enables precise control over the spot array generated by a diffractive optical element (DOE). The first liquid lens controls the spot divergence in the observation plane, while the second liquid lens adjusts the zoom factor. The optical configuration provides a dynamic range of 1.8 with respect to array size, significantly enhancing adaptability in imaging across various applications.

1. Introduction

Beam shaping based on diffractive optical elements enables the generation of spatial light patterns that can serve as markers for the observation of the tissue’s motion. Depending on what modality is to be observed, e.g., photoacoustics [1], vocal fold oscillations [2], etc., different properties of the back-scattered light should be used to evaluate the motion of the tissue. While in the case of vocal fold, 2D imaging techniques such as stroboscopy, videokymography [3], phonovibrogram [4], or high-speed videoendoscopy do not sufficiently reflect the complex 3D vocal fold dynamics (see Figure 1), the observation of the apparent motion of the spots of a laser spot array through stereo-triangulation can be used to determine the 3D motion of the vocal folds [5]. Early systems used individual laser points [6,7] or lines perpendicular to the glottal midline [8,9,10], whereas later systems used regular grids for optimal coverage of the glottal plane, generated from microlens arrays [5,11,12] or diffractive optical elements [2]. This way, the vocal fold vibrations can be tracked at high frame repetition rates in both the vertical and lateral directions.
While such systems enable non-invasive in vivo observation of the vocal fold oscillations, the best results for coverage and resolution are only achieved for patients with suitable sizes of the vocal folds as well as suitable recording distances between endoscope and larynx (typically 10–15 mm VF length @ 40–70 mm recording distance in adults). For this, the divergence angle of the laser spot array and the focal plane positions of the beams need to be well chosen. Otherwise, the reconstruction of the vocal fold motion might be severely compromised as follows: (1) either by having too few points to secure sufficient coverage, (2) too large points, limiting the detection accuracy, or (3) too many points, which overlap and render the point detection impossible. In principle, this problem can be solved by commercially available dynamic diffractive optical elements [13] as they would enable full control of, e.g., the divergence angle of the spot array, the number of beams in the array, and the focal plane position of each beam. Unfortunately, the current dynamic devices do not have the necessary small footprint to integrate them into an endoscope.
One possible solution for the above-mentioned problem is to use a static optical element to generate the spot array and then use liquid lenses to control the divergence of the spot array and the spot size by adapting the focal plane position. The versatility of liquid lenses arises from their ability to achieve large dynamic focusing ranges with rapid response times and non-mechanical actuation [14,15]. In electro-wetting liquid lenses, a focus variation can be induced by changing the curvature of the liquid–liquid interface between two immiscible transparent liquids with differing refractive indexes by applying a voltage via electrodes to the conductive liquid [16]. This allows for precise adjustments within fractions of a second, making liquid lenses highly adaptable and effective, especially in many space-restricted applications. Because of this, the use of liquid lens systems plays an important role in endoscopic imaging, for beam shaping, steering, and beam delivery.
Various liquid lens-based zoom systems have been explored for compact imaging applications [17,18,19]. For instance, Zhang et al. present a theoretical design and optimization of a micro zoom system employing liquid lenses for general imaging purposes [20]. In contrast, our approach specifically targets laser spot array generation for endoscopic 3D reconstruction. Many aspects have to be considered when designing a spatially structured laser pattern for endoscopic illumination applications. This includes the device miniaturization aspects, robustness, flexibility, and patient safety. In this paper, as a proof-of-principle, we present a free-space optical system for non-mechanical beam manipulation using two liquid lenses and a static diffractive optical element (DOE). A DOE is basically a type of holographic grating that allows for a lens-free generation of arbitrary intensity patterns through diffraction; see [21,22,23] for further reading. The specific DOE used here generates a laser spot array consisting of 21 × 21 individual beams and is placed between two electro-wetting liquid lenses so that the combination of the static DOE and the varioptic lenses functions as a dynamic spot array generator. The first tunable liquid lens controls the spot divergence in the final spot array, while the second liquid lens adjusts the zoom factor of the projected pattern. The system thus provides both an adjustable array size and spot size, making it particularly useful for endoscopic applications [2]. While Semmler et al. [2,11,24] provide in-depth detail of the imaging and diagnostic reasoning, this paper focuses on the specific features of the liquid lens optical design for illumination. Even though we describe our system from the viewpoint of laryngoscopy, we are positive that there are many other potential applications in the medical field, e.g., in laparoscopy [25,26].

2. Materials and Methods

Figure 2 shows the schematic of the free-space optical setup. A diffractive optical element (DOE) custom-made from HOLOEYE is placed between two liquid lenses from Corning Inc., (New York, NY, USA), Type A-25HX-D0, whose focal lengths can be varied by adjusting the input voltage, between −35 m−1 to +35 m−1, with 7.75 mm outer diameter and 2.5 mm clear aperture. The DOE generates from a collimated laser beam at 532 nm a spot array of 21 × 21 beamlets of the same size and divergence as the input beam, with the 0th diffraction order suppressed down to the same intensity as the other beamlets. The divergence angle between the beamlets is 0.5°. We consider for the design of the optical system a dynamic zoom factor as follows:
We denote the physical distances between the successive optical elements as d1, d2, and d3; see Figure 2. A collimated laser beam with a beam radius of ω1 = 179 µm is incident on the first liquid lens L1, with the focal length f1. The angles of the beamlets of the spot array generated by the DOE at plane 2 can be defined by the opening angle θ between the outermost beamlet and the optical axis. The corresponding ray vector v2, intended for the optimization of the setup via the ABCD matrix formalism (see e.g., [27]), can be consequently defined as v2 = {0,θ}. Similarly, v3 and v4 are the ray vectors after planes 3 and 4, respectively. The liquid lens 2, with variable focal length f2, is responsible for the zoom factor of the spot array and defines the spot array distribution at plane 4. xs is the lateral half-width of the final intensity pattern at plane 4.
The spot array at plane 4 can be characterized in terms of the final grid size and the size of the individual spots. Both can be varied by changing the physical distances within the optical setup, as well as by adjusting the focal lengths of both the liquid lenses. In the next section, we provide the theory necessary to evaluate the operational boundaries of the tunable laser spot array generated using the given setup. An ideal dataset can be achieved by adjusting the values of d1, d2, θ, w1, f1, and f2.

2.1. Dynamic Zoom Factor

The main design objective is to maximize the dynamic zoom factor, γ, which we define as
γ = m a x ( x s ) m i n ( x s )
where max (xs) and min (xs) denote the maximum and minimum possible half-widths of the spot array, respectively. We note that the first lens does not affect v2, because v2 originates from a ray that runs on the optical axis in plane 1. γ is thus independent of d1 and f1.
In order to express γ in terms of the remaining system parameters d2, θ, and f2, we set up the ray-transfer-matrix from plane 2 to plane 4 as follows:
M 24 = L ( d 3 ) .   F f 2 .   L ( d 2 )
M 24 = 1 d 3 f 2 d 3 + d 2 d 2 d 3 f 2 1 f 2 1 d 2 f 2
where L(d) is the ray-transfer-matrix for the propagation of distance d in air and F(f) is the ray-transfer-matrix for a thin lens of focal length f. We know that v2 is located on the optical axis and defined by the maximum beamlet deflection angle θ given by the DOE
v 2 =   0 θ  
We can then calculate v4:
v 4 = M 24 .     0 θ  
=   d 2 θ + d 3 θ d 2 d 3 θ / f 2 θ d 2 θ / f 2
=   x s θ 4  
where x s will be determined by the system specifications, and as θ is fixed by the DOE, θ 4 is dependent only on the variables d2 and f2, which can be chosen freely (within the boundaries of the setup and available equipment). Since we do not restrict θ 4 , Equations (5) and (6) are reduced to
x s = d 2 + d 3 d 2 d 3 f 2 θ
and consequently,
γ = d 2 + d 3 d 2 d 3 / f 2 m a x d 2 + d 3 d 2 d 3 / f 2 m i n
where f 2 m a x and f 2 m i n are the focal lengths that correspond to the maximum and minimum x s , respectively.
Equation (7) shows that the adjustment of the spot array size is dependent on the focal length of the second lens. Equation (8) demonstrates that γ is independent of θ. Hence, we are, in principle, also free to pick θ. Equation (8) diverges for 1 d 3 + 1 d 2 = 1 f 2 m i n , which corresponds to the well-known single-lens imaging condition from plane 2 to plane 4, and thus results in min (xs) = 0 for that condition. Taking the first derivative of Equation (8) with respect to d2, we realize that γ increases strictly monotonously in the relevant region from d2 = 0 mm, to the point where d2 obeys the imaging condition. Therefore, stacking the DOE and the second lens closely together (i.e., small d2), results in diminishing the dynamic zoom factor. Large distances (i.e., large d2), however, require large clear apertures of the second lens, as θ is significantly larger than zero; see Figure 2. Picking a liquid lens component should therefore aim at a maximum clear aperture while keeping the component diameter small enough for an endoscope. Equally important, the selected component should have the largest possible dynamic adjusting range. We choose, therefore, the variable focus lens (Type A-25HX-D0) from Corning Inc. with a diopter range from −35 m−1 to +35 m−1 and a3 = 2.5 mm clear aperture (7.75 mm outer diameter) over the A-16F variable focus lens with an outer diameter of 6.2 mm but only 1.6 mm free aperture [28].
Given these constraints, we allow for v3, a maximum aperture utilization of 66%, in order to prevent clipping for beam diameters up to 500 µm. Basic trigonometric considerations give
d 2 t a n θ < 0.66   a 3 2 ,
where a 3 is the clear aperture in plane 3. Correspondingly, d2 should be kept smaller than 9.4 mm. We set for our setup d 2 = 9   m m .

2.2. Conservation of Étendue

Due to the conservation of Étendue [29,30,31,32], the area of illumination will change (e.g., the spot size ω4) whenever the second lens changes the array opening angle. A smaller opening angle leads to larger spots and the spots will be spaced out on a smaller area. As a consequence, the spots will interfere for too small opening angles. In contrast, larger opening angles lead to smaller spots with a wider spacing. However, in this case, the laser fluence might increase (due to the smaller spot size) far enough to potentially lead to tissue damage and should thus be taken into account.
Since in both cases, the adjustment of the magnification factor leads to an undesired change in the spot size at plane 4, the spot size must be precompensated by the liquid lens 1 before the beamlets pass the DOE and lens 2. To determine how to adjust the focal length of lens 1 according to the magnification factor set by lens 2, we use the q-parameter method for Gaussian beams. In plane 1, q is given by
q 1 = z 1 + z R 1 i
where z is the axial distance to the beam waist (i.e., the focal spot position), i is the imaginary unit, and zR1 is the Rayleigh length, given by
z R 1 = π   ω 1 2 λ
where ω1 is the beam waist (radius) and λ is the wavelength. The system is arranged such that the beam waist is located in plane 1 and hence z1 = 0. We can prepare the transfer matrix from plane 1 to plane 4 as follows:
A B C D 14 = L d 3 . F f 2 . L d 2 . L d 1 . F ( f 1 )
and calculate the beam parameter in plane 4 as
q 4 = A q 1 + B C q 1 + D
The real part of q4 will yield z4 and the imaginary part will yield zR4. We can use Equation (11) and zR4 in order to obtain ω04, the corresponding beam waist—which is axially shifted from plane 4 by z4. We can then calculate the actual beam radius in plane 4 using
ω 4 = ω 04 1 + z 4 z R 4 2
Here, ω4 is predefined by system requirements. As the dynamic ranges of the liquid lenses are symmetric around zero diopters, we set the incident beam radius ω1 such that the desired beam radius in plane 4 is realized for zero refractive power applied at both lenses. Taking the successful motion tracking of the vocal fold in [2] as a reference, we choose for our case ω4 = 200 µm and d3 = 75 mm. With this and f1 = f2 = , Equation (14) gives ω1 = 179 µm. We set this value in our experiment by placing an adjustable demagnifying telescope into the collimated 532 nm laser beam in front of the lenses shown in Figure 2.

3. Results

For the investigation of the performance of the optical design, we recorded plane 4 on a camera sensor for five different working distances d3, ranging from 40–70 mm, as is typical for laryngoscopy [11]. For each working distance, we changed the liquid lens voltages such that we obtained a recording of the smallest possible spot array, one medium-sized spot array, and the largest spot array, defined by the value xs, the half-width of the spot array size. For each of these array sizes, we also recorded the smallest possible spot size, a medium spot size, and one too large a spot size ω4. By large spot sizes, we mean significant intensity overlap between spots.
The process was conducted on two camera sensors: One was a beam profiling camera (Coherent LaserCam HR, Saxonburg, PA, USA, sensor size 8.576 mm × 6.860 mm, pixel pitch 6.7 µm) with a high dynamic range but a small image sensor, which therefore cropped the number of observable beamlets. The other sensor was a digital single lens camera sensor (a Nikon D610 camera, Tokyo, Japan, with a sensor size of 36 mm × 24 mm and a pixel pitch of 6.0 µm), with a sufficiently large area to observe all beamlets but not with the high dynamic range of the beam profiling camera. This way it was possible to investigate the action of the liquid lenses on both the spot size, spot array magnification, and any potential aberrations (see Section 4) and uniformity deviations of all the beamlets generated by the DOE. Exemplary recordings of the beamlet array are shown in Figure 3.
In order to accommodate the measurements for any potentially necessary hardware to encapsulate the liquid lenses, their electronic control busses as well as the DOE, we apportion 10 mm additional space behind lens 2. We thus define our working distance zWD for future reference as
z W D = d 3 10   m m .

3.1. Spot Array Sizes

The typical working distance for laryngoscopy ranges from 40 mm to 70 mm. Due to the physical location of the camera sensor inside the housing of each of the used cameras, the smallest possible working distance was 42 mm. Therefore, we recorded at working distances of 42 mm, 47.5 mm, 55 mm, 62.5 mm, and 70 mm. In order to analyze the spot array size, we used the Nikon D610 camera (without lens or objective), set to the manual mode. Figure 4 shows the theoretical and experimental values of the spot array size at the above-discussed working distances. Since the spot array size is dependent only on the focal length of the second lens (Equation (7)), the experiment is conducted with the refractive power of lens 1 being kept constant, while the refractive power of lens 2 is set to −35 m−1 (circles), 0 m−1 (triangles), and +35 m−1 (squares). We find that the theory from Section 2 adequately matches the measurement. In order to receive the optic design dynamic zoom factor, we divide the slope of the −35 m−1 line (with circles) and the slope of the +35 m−1 line (with squares) and get γ = 1.8.

3.2. Spot Sizes at 55 mm Working Distance

Figure 5 shows the theoretical predictions for the individual laser spot sizes as a function of the refractive powers of both liquid lenses (lens 1 and lens 2) at a working distance of 55 mm. This provides a visual representation of the entire dynamic range at this working distance. Since the array size is solely dictated by the refractive power of lens 2, a horizontal line in Figure 5 would refer to a fixed array size. By adjusting the refractive power of lens 1, the actual working point on this horizontal line can be chosen freely, and consequently, the spot size adjusted. Spot sizes smaller than 100 µm are colored in red, and spot sizes larger than 600 µm are colored in yellow, as those cases are undesired. The colors for spot sizes between 100 µm and 600 µm are specified using the color range shown in the color bar of Figure 5. The dashed curve indicates the contour where 100 µm waist diameter will be achieved somewhere along the beam direction; i.e., at a different working distance than 55 mm. We nevertheless plot this curve as it shows a parameter region that should be avoided at all costs due to possible laser safety issues.
The minimum possible spot sizes for each array magnification and each working distance were further investigated using the Coherent LaserCam HR. Measurement and theory are shown in Figure 6. The spot sizes of each beamlet were calculated by fitting each spot on the camera sensor using a two-dimensional Gaussian model with rotational freedom. Taking the mean value of all fits from one recording gives the spot sizes (1/e2 diameter) depicted in Figure 6.

3.3. Minimum Focal Spot Sizes

Because the beamlets undergo diffraction during propagation to the tissue’s surface, the actual spot size on the tissue will not only depend on the actual chosen refractive powers of both lenses, but also on the actual distance of the tissue to the endoscope’s end; i.e., on the three-dimensional shape of the vocal fold. Since too small spot sizes are particularly critical due to possible tissue damage, the transverse beam profile outside the endoscope’s housing must be carefully evaluated. To be on the safe side, we calculate for each possible refractive power setting at lens 1 and 2 the spot size of the beam waist (i.e., the focal spot diameter) independently of how far away it might be located from the exit of the endoscope. Figure 7 shows the beam waist diameter 2ω04. In contrast, Figure 5 shows the spot diameter at a working distance of 55 mm. The dashed curve indicates again the contour where the focal spot size would become 100 µm or smaller. Spot sizes smaller than this should be avoided. This is because, for the recording of the oscillations of the vocal fold, a high-speed camera (typically around 4000 fps with only 250 µs exposure duration per frame) is used that requires, due to signal-to-noise ratio (SNR) considerations, an illumination intensity while still complying with laser safety regulations [2]. Going towards 100 µm spot diameter or below would restrict the applicable laser power, thus significantly degrading the achievable SNR of the high-speed camera.

4. Discussion

To date, all previous studies in the field of 3D imaging of the human larynx were based on a fixed geometry of the laser projection unit. There are setups with one or more laser lines as well as regular laser dot grids. There are approaches with microlens arrays or DOEs [2,5,10,11]. However, none of the previous approaches allow the laser projection to be adapted to the anatomical conditions of the subject during the recording.
As the distance from the endoscope to the larynx and the vocal fold length vary depending on the sex and age of the test subjects, in a fixed laser spot array without the proposed liquid lens design, the laser grid can only be optimized for a certain spot-to-spot distance and an average vocal fold length. Due to the necessary divergence of the laser beams between the exit window (2 mm) at the endoscope and the vocal folds in the larynx (10–20 mm), the laser points could unnecessarily hit the laryngeal tissue around the vocal folds, or conversely, the points could be so close that they overlap with each other. Compounding the problem further, the diameter of the laser spots can, in a static case, only be adjusted to lie within a certain spot size range, which means that the laser spots may be too large for exact detection. By adjusting the spot distance and spot diameter, we are able to tailor the laser grid for each larynx size so that the vocal folds are completely covered while the points can still be clearly distinguished from each other. With the achieved zoom factor of 1.8 (see Section 3.1), the design is matched to the recording situation during human in vivo laryngoscopy, including the distance from the oral cavity to the vocal folds (40–70 mm) as well as the vocal fold length (10–20 mm).
However, just adjusting the size or edge length of the spot array by lens 2 only would lead to problems, as illustrated by Figure 7. This is because, at higher refractive powers of lenses 1 and 2 (i.e., especially when lens 2 is used for getting shorter edge lengths of the beamlet array), there is a chance to achieve a beam spot below 100 µm, as depicted by the dashed line. This poses the risk of exceeding laser safety regulations. As this must be safeguarded against, lens 1 needs to be set to smaller diopters, even below zero, in order to increase the spot size. On the other hand, when lens 2 is used to generate large array sizes, the divergence of the beamlets increases significantly. In order to have for the high-speed camera sufficiently bright beamlets, their spot size must be smaller than their size if only lens 2 were to be involved.

Uniformity

Optical aberrations, induced by the change in refractive power of lens 2 when setting the magnification factor, could have serious effects on the visibility of individual spots and the resolution the spot array can offer. While lens 1 might also induce optical aberrations as long as the laser beam entering into lens 1 remains small enough and enters in the center along the optical axis, the aberrations should remain nearly negligible, because even for an imperfect lens, a paraxial approximation would be valid in this case. However, into lens 2, enters an already spread-out beamlet array, where the paraxial approximation might no longer be valid. Thus, refractive aberrations, such as cushion/barrel distortions, might cause a varying inter-spot distance across the spot array, while other types of aberrations, e.g., vignetting, coma, spherical aberrations, etc., might change the spot shapes and certainly decrease the available maximum intensity at aberrated spots. Therefore, they would heavily depend on the zoom factor, as the zoom factor is effectively set by controlling the curvature of the liquid in the lens.
To investigate the presence and strength of potential aberrations due to the refractive power modulation of lens 2, we measured the standard deviation of the spot-to-spot distance, the spot diameters’ standard deviation, and the standard deviation of the spot intensities depending on the refractive powers at lens 2 for different working distances. We measured at the refractive powers +35 m−1, 0 m−1, and −35 m−1. All spots of a spot array using the Coherent camera sensor, shown in Figure 8, were fitted with a two-dimensional Gaussian model, taking into account principal axis transformation. Measuring the spot positions, diameters, and amplitudes from the fit parameters, standard deviations σ were calculated.
We chose the standard deviation because it reveals the strength of the variation in a group of measurements. The expectation is that with increasing aberrations, the standard deviation for spots of the spot array will also increase. To show only changes induced by the refractive power setting we chose to normalize the standard deviation measurements to their respective average value for all variational parameters. The graphical results are presented in Figure 9, while the numerical results are given in Table 1, for the sake of completeness.
As can be seen, there is no clear tendency for the standard deviations to increase when modifying the refractive power or the working distance. This is good because any clear trend would hint at the presence of optical aberrations. Furthermore, standard deviations for the spot diameter and the spot intensity seem to be rather constant, with the inter-spot distance having an exception at 47.5 mm working distance and −35 m−1 refractive power. Nevertheless, the standard deviation at this point is still only 1.2% and thus still negligible. With the standard deviations for beamlet distances below 1.2%, the beamlet’s size below 5.2%, and the beamlet’s amplitude below 10.8%, the system easily meets the requirements for three-dimensional endoscopic imaging at different working distances and magnification settings.

5. Conclusions

In this work, we introduced a dual-liquid-lens optical design that flexibly adjusts the spot size and spot distance in a laser grid generated from a static DOE. Our experiments demonstrated a dynamic zoom factor of approximately 1.8 across clinically relevant working distances and confirmed that this adaptable configuration maintains optimal coverage of the vocal folds and minimal optical aberrations. These findings establish that using tunable liquid lenses for laser-based 3D laryngoscopy can effectively address inter-patient variability, such as differing vocal fold sizes and variable laryngoscope-to-larynx distances, thereby paving the way for improved 3D reconstructions of vocal fold oscillations.
Although our proof-of-concept system has not yet been incorporated into a fully miniaturized endoscope, it serves as a conceptual foundation for future integration demonstrating the feasibility of liquid lenses in laser projection. We have shown that the combination of a static DOE with two variable focus liquid lenses offers the flexibility needed to adapt illumination parameters in real time, which is an essential step toward truly personalized and optimized laryngoscopic 3D imaging. By enabling precise control of both the laser spot array size and individual spot diameters, our approach promises to enhance reconstruction accuracy and clinical utility, and ultimately addresses many of the practical and methodological concerns surrounding next-generation endoscopic imaging systems. We anticipate that further engineering for miniaturization and control systems will facilitate the application of this design in a clinical setting, thereby offering a valuable advance over existing fixed-geometry laser projection units for endoscopy.
One issue in integrating the liquid lens principle of the current setup is the large size of the liquid lenses, as they have an outer diameter of 7.75 mm; see Section 2. As a consequence, the placing of these lenses, and consequently the DOE, needs to occur as far as possible from the distal end of the endoscope. However, this bears the challenge of how to relay the beamlet array with its angles and beamlet divergences. One possible solution for this would be to use after lens 2, a long gradient index lens (GRIN lens) [33] that can relay the aperture of lens 2 through 1:1 imaging of the lens’s plane. This way the spot array can be easily extended by a large margin, similar to in [34,35]. While commercially available GRIN lenses that offer a suitable numerical aperture to support the beamlets’ divergence angles used in the here-described setup do exist, GRIN lenses are known for inducing aberrations on abaxial beams [36,37]. This might lead to a non-uniform spacing of the laser spots as well as a deterioration of the spot quality at the edges. While these aberrations can be measured and precompensated in principle [38] by using a suitably designed DOE, this is beyond the scope of this work, as we implemented a custom-designed static DOE with a regular beamlet array, which is far easier to design and manufacture. Consequently, for a miniaturization into an endoscopic setup, the interplay between the DOE and the GRIN lenses would need to be re-evaluated in greater detail.

Author Contributions

Conceptualization: C.R.; methodology: C.R.; software: C.R.; validation: R.M., K.C. and M.S. (Marion Semmler); formal analysis: B.H.; investigation: B.H.; data curation: B.H. and C.R.; writing—original draft preparation: B.H. and C.R.; writing—review and editing: R.M., K.C., M.S. (Michael Schmidt), M.D. and M.S. (Marion Semmler); visualization: R.M., K.C. and M.S. (Marion Semmler); supervision: M.S. (Michael Schmidt) and M.D.; project administration: K.C., M.S. (Michael Schmidt), M.D. and M.S. (Marion Semmler); funding acquisition: M.S. (Michael Schmidt) and M.D. All authors have read and agreed to the published version of the manuscript.

Funding

The authors gratefully acknowledge support by the Deutsche Forschungsgemeinschaft through the Grant Nos. DO 1247/16-1 and SCHM 2115/86-1 and the Graduate School in Advanced Optical Technologies (SAOT) of the Friedrich-Alexander-Universität Erlangen-Nürnberg.

Data Availability Statement

The datasets presented in this article are not readily available because of time limitations. Requests to access the datasets should be directed to Kristian Cvecek.

Conflicts of Interest

The authors declare no conflicts of interest. The funders had no role in the design of this study; the collection, analyses, or interpretation of the data; the writing of the manuscript; or the decision to publish the results.

References

  1. Vorobev, V.; Weidmann, D.; Agdarov, S.; Beiderman, Y.; Shabairou, N.; Benyamin, M.; Klämpfl, F.; Schmidt, M.; Gorin, D.; Zalevsky, Z. Full-optical photoacoustic imaging using speckle analysis and resolution enhancement by orthogonal pump patterns projection. Sci. Rep. 2023, 13, 18081. [Google Scholar] [CrossRef] [PubMed]
  2. Semmler, M.; Kniesburges, S.; Parchent, J.; Jakubaß, B.; Zimmermann, M.; Bohr, C.; Schützenberger, A.; Döllinger, M. Endoscopic Laser-Based 3D Imaging for Functional Voice Diagnostics. Appl. Sci. 2017, 7, 600. [Google Scholar] [CrossRef]
  3. Švec, J.G.; Schutte, H.K. Videokymography: High-speed line scanning of vocal fold vibration. J. Voice 1996, 10, 201–205. [Google Scholar] [CrossRef] [PubMed]
  4. Lohscheller, J.; Eysholdt, U. Phonovibrogram visualization of entire vocal fold dynamics. Laryngoscope 2008, 118, 753–758. [Google Scholar] [CrossRef] [PubMed]
  5. Luegmair, G.; Mehta, D.D.; Kobler, J.B.; Döllinger, M. Three-Dimensional Optical Reconstruction of Vocal Fold Kinematics Using High-Speed Video With a Laser Projection System. IEEE Trans. Med. Imaging 2015, 34, 2572–2582. [Google Scholar] [CrossRef]
  6. Larsson, H.; Hertegård, S. Calibration of high-speed imaging by laser triangulation. Logop. Phoniatr. Vocology 2004, 29, 154–161. [Google Scholar] [CrossRef]
  7. Patel, R.R.; Donohue, K.D.; Johnson, W.C.; Archer, S.M. Laser projection imaging for measurement of pediatric voice. Laryngoscope 2011, 121, 2411–2417. [Google Scholar] [CrossRef]
  8. Wurzbacher, T.; Voigt, I.; Schwarz, R.; Döllinger, M.; Hoppe, U.; Penne, J.; Eysholdt, U.; Lohscheller, J. Calibration of laryngeal endoscopic high-speed image sequences by an automated detection of parallel laser line projections. Med. Image Anal. 2008, 12, 300–317. [Google Scholar] [CrossRef]
  9. Patel, R.R.; Donohue, K.D.; Lau, D.; Unnikrishnan, H. In Vivo measurement of pediatric vocal fold motion using structured light laser projection. J. Voice 2013, 27, 463–472. [Google Scholar] [CrossRef]
  10. George, N.A.; de Mul, F.F.M.; Qiu, Q.; Rakhorst, G.; Schutte, H.K. Depth-kymography: High-speed calibrated 3D imaging of human vocal fold vibration dynamics. Phys. Med. Biol. 2008, 53, 2667–2675. [Google Scholar] [CrossRef]
  11. Semmler, M.; Kniesburges, S.; Birk, V.; Ziethe, A.; Patel, R.; Döllinger, M. 3D Reconstruction of Human Laryngeal Dynamics Based on Endoscopic High-Speed Recordings. IEEE Trans. Med. Imaging 2016, 35, 1615–1624. [Google Scholar] [CrossRef] [PubMed]
  12. Patel, R.R.; Döllinger, M.; Jakubaß, B.; Pinhack, H.; Katz, U.; Semmler, M. Analyzing Vocal Fold Frequency Dynamics Using High-Speed 3D Laser Video Endoscopy. Laryngoscope 2024, 134, 3267–3276. [Google Scholar] [CrossRef]
  13. Schmidt, M.; Cvecek, K.; Duflou, J.; Vollertsen, F.; Arnold, C.B.; Matthews, M.J. Dynamic beam shaping—Improving laser materials processing via feature synchronous energy coupling. CIRP Ann. 2024, 73, 533–559. [Google Scholar] [CrossRef]
  14. Liu, C.; Zheng, Y.; Yuan, R.-Y.; Jiang, Z.; Xu, J.-B.; Zhao, Y.-R.; Wang, X.; Li, X.-W.; Xing, Y.; Wang, Q.-H. Tunable Liquid Lenses: Emerging Technologies and Future Perspectives. Laser Photonics Rev. 2023, 17, 2300274. [Google Scholar] [CrossRef]
  15. Chen, L.; Liang, S.; Chen, Z.; Liang, X.; Chen, Q. Electrically Tunable Lenses for Imaging and Light Manipulation. Micromachines 2023, 14, 319. [Google Scholar] [CrossRef] [PubMed]
  16. Nelson, W.C.; Kim, C.-J. Droplet Actuation by Electrowetting-on-Dielectric (EWOD): A Review. J. Adhes. Sci. Technol. 2012, 26, 1747–1771. [Google Scholar] [CrossRef]
  17. Jiang, Z.; Wang, D.; Zheng, Y.; Liu, C.; Wang, Q.-H. Continuous optical zoom microscopy imaging system based on liquid lenses. Opt. Express 2021, 29, 20322–20335. [Google Scholar] [CrossRef]
  18. Li, H.; Cheng, X.; Hao, Q. An Electrically Tunable Zoom System Using Liquid Lenses. Sensors 2015, 16, 45. [Google Scholar] [CrossRef]
  19. Cheng, Y.; Cao, J.; Tang, X.; Hao, Q. Optical zoom imaging systems using adaptive liquid lenses. Bioinspir. Biomim. 2021, 16, 041002. [Google Scholar] [CrossRef]
  20. Zhang, W.; Li, D.; Guo, X. Optical Design and Optimization of a Micro Zoom System with Liquid Lenses. J. Opt. Soc. Korea 2013, 17, 447–453. [Google Scholar] [CrossRef]
  21. Zhang, Q.; He, Z.; Xie, Z.; Tan, Q.; Sheng, Y.; Jin, G.; Cao, L.; Yuan, X. Diffractive optical elements 75 years on: From micro-optics to metasurfaces. Photonics Insights 2023, 2, R09. [Google Scholar] [CrossRef]
  22. Gabor, D. Holography, 1948–1971. Science 1972, 177, 299–313. [Google Scholar] [CrossRef] [PubMed]
  23. Goodman, J.W. Introduction to Fourier Optics, 4th ed.; W.H. Freeman Macmillan Learning: New York, NY, USA, 2017; ISBN 1319119166. [Google Scholar]
  24. Semmler, M.; Döllinger, M.; Patel, R.R.; Ziethe, A.; Schützenberger, A. Clinical relevance of endoscopic three-dimensional imaging for quantitative assessment of phonation. Laryngoscope 2018, 128, 2367–2374. [Google Scholar] [CrossRef]
  25. Huang, B.; Nguyen, A.; Wang, S.; Wang, Z.; Mayer, E.; Tuch, D.; Vyas, K.; Giannarou, S.; Elson, D.S. Simultaneous Depth Estimation and Surgical Tool Segmentation in Laparoscopic Images. IEEE Trans. Med. Robot. Bionics 2022, 4, 335–338. [Google Scholar] [CrossRef] [PubMed]
  26. Maurice, X.; Albitar, C.; Doignon, C.; de Mathelin, M. A structured light-based laparoscope with real-time organs’ surface reconstruction for minimally invasive surgery. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2012, 2012, 5769–5772. [Google Scholar] [CrossRef]
  27. Martin-Sanchez, D.; Li, J.; Marques, D.M.; Zhang, E.Z.; Munro, P.R.T.; Beard, P.C.; Guggenheim, J.A. ABCD transfer matrix model of Gaussian beam propagation in Fabry-Perot etalons. Opt. Express 2022, 30, 46404–46417. [Google Scholar] [CrossRef]
  28. Corning Varioptic Lenses. Available online: https://www.corning.com/worldwide/en/products/advanced-optics/product-materials/corning-varioptic-lenses.html (accessed on 6 March 2025).
  29. Winston, R. Light Collection within the Framework of Geometrical Optics*. J. Opt. Soc. Am. 1970, 60, 245. [Google Scholar] [CrossRef]
  30. Winston, R.; Ning, X. Constructing a conserved flux from plane waves. J. Opt. Soc. Am. A 1986, 3, 1629. [Google Scholar] [CrossRef]
  31. Ohno, H.; Usui, T. Gradient-index dark hole based on conformal mapping with etendue conservation. Opt. Express 2019, 27, 18493–18507. [Google Scholar] [CrossRef]
  32. Markvart, T. The thermodynamics of optical étendue. J. Opt. A Pure Appl. Opt. 2008, 10, 15008. [Google Scholar] [CrossRef]
  33. Moore, D.T. Gradient-index optics: A review. Appl. Opt. 1980, 19, 1035–1038. [Google Scholar] [CrossRef]
  34. Kučikas, V.; Werner, M.P.; Schmitz-Rode, T.; Louradour, F.; van Zandvoort, M.A.M.J. Two-Photon Endoscopy: State of the Art and Perspectives. Mol. Imaging Biol. 2023, 25, 3–17. [Google Scholar] [CrossRef] [PubMed]
  35. Dilipkumar, A.; Al-Shemmary, A.; Kreiß, L.; Cvecek, K.; Carlé, B.; Knieling, F.; Gonzales Menezes, J.; Thoma, O.-M.; Schmidt, M.; Neurath, M.F.; et al. Label-Free Multiphoton Endomicroscopy for Minimally Invasive In Vivo Imaging. Adv. Sci. 2019, 6, 1801735. [Google Scholar] [CrossRef] [PubMed]
  36. Rohra, A. Ray-trace aberrations of curved graded-index media. Appl. Opt. 1983, 22, 391–395. [Google Scholar] [CrossRef] [PubMed]
  37. Easum, J.A.; Campbell, S.D.; Nagar, J.; Werner, D.H. Analytical surrogate model for the aberrations of an arbitrary GRIN lens. Opt. Express 2016, 24, 17805–17818. [Google Scholar] [CrossRef]
  38. Sattin, A.; Nardin, C.; Daste, S.; Moroni, M.; Reddy, I.; Liberale, C.; Panzeri, S.; Fleischmann, A.; Fellin, T. Aberration correction in long GRIN lens-based microendoscopes for extended field-of-view two-photon imaging in deep brain regions. eLife 2024, 13, RP101420. [Google Scholar] [CrossRef]
Figure 1. Schematic overview of the endoscopic recording situation (left) and a top view of vocal folds from the perspective of the endoscope tip (right); adapted from [2].
Figure 1. Schematic overview of the endoscopic recording situation (left) and a top view of vocal folds from the perspective of the endoscope tip (right); adapted from [2].
Optics 06 00010 g001
Figure 2. Schematic drawing of the optical system consisting of one liquid lens with focal length f1, followed by a distance called d1, followed by a DOE, a distance d2, a lens f2, and a distance d3 to the screen. We number the planes from 1 to 4. M24 is the ray-transfer-matrix from plane 2 to plane 4. v2 is the central ray vector of the mid spot of the outermost spot-row of the spot array in plane 2 directly behind the DOE, and v4 the same ray in plane 4. θ is the angle between v2 and the optical axis. xs is the distance of v4 to the optical axis.
Figure 2. Schematic drawing of the optical system consisting of one liquid lens with focal length f1, followed by a distance called d1, followed by a DOE, a distance d2, a lens f2, and a distance d3 to the screen. We number the planes from 1 to 4. M24 is the ray-transfer-matrix from plane 2 to plane 4. v2 is the central ray vector of the mid spot of the outermost spot-row of the spot array in plane 2 directly behind the DOE, and v4 the same ray in plane 4. θ is the angle between v2 and the optical axis. xs is the distance of v4 to the optical axis.
Optics 06 00010 g002
Figure 3. Nikon sensor raw data recordings for working distance of 42 mm. White scale bars indicate a width of 1 cm. The first column shows the minimum possible spot size, and the second and third columns show medium spot sizes and very large spot sizes, respectively. The first, second, and third rows demonstrate the minimum possible, medium, and maximum possible array sizes, respectively. The second row gives the array size for zero refractive power at the second liquid lens. EL stands for array edge length, SpS stands for 1/e2 spot diameter (spot size), and SD stands for spot distance.
Figure 3. Nikon sensor raw data recordings for working distance of 42 mm. White scale bars indicate a width of 1 cm. The first column shows the minimum possible spot size, and the second and third columns show medium spot sizes and very large spot sizes, respectively. The first, second, and third rows demonstrate the minimum possible, medium, and maximum possible array sizes, respectively. The second row gives the array size for zero refractive power at the second liquid lens. EL stands for array edge length, SpS stands for 1/e2 spot diameter (spot size), and SD stands for spot distance.
Optics 06 00010 g003
Figure 4. Measurement of minimum (square), medium (triangle), and maximum (circles) spot array edge length for different working distances with expectations from theory.
Figure 4. Measurement of minimum (square), medium (triangle), and maximum (circles) spot array edge length for different working distances with expectations from theory.
Optics 06 00010 g004
Figure 5. Theoretical expectations of spot sizes (1/e2-diameters) at 55 mm working distance for each pair of refractive powers of the first and second lenses. The dashed curve indicates a 100 µm beam waist diameter that occurs somewhere along the longitudinal direction of each beamlet and should not be disregarded due to laser safety issues.
Figure 5. Theoretical expectations of spot sizes (1/e2-diameters) at 55 mm working distance for each pair of refractive powers of the first and second lenses. The dashed curve indicates a 100 µm beam waist diameter that occurs somewhere along the longitudinal direction of each beamlet and should not be disregarded due to laser safety issues.
Optics 06 00010 g005
Figure 6. Measurement of minimum possible spot sizes for an array of minimum (square), medium (triangle), and maximum (circles) edge lengths for different working distances, together with expectations from theory.
Figure 6. Measurement of minimum possible spot sizes for an array of minimum (square), medium (triangle), and maximum (circles) edge lengths for different working distances, together with expectations from theory.
Optics 06 00010 g006
Figure 7. Theoretical expectations for beam waist diameter. The dashed curve gives the 100 µm contour. Parameters above the dashed line must be avoided, since the intensity would otherwise exceed laser safety regulations or, in case the laser power is reduced, the SNR of the high-speed recording might become too low for reliable evaluation.
Figure 7. Theoretical expectations for beam waist diameter. The dashed curve gives the 100 µm contour. Parameters above the dashed line must be avoided, since the intensity would otherwise exceed laser safety regulations or, in case the laser power is reduced, the SNR of the high-speed recording might become too low for reliable evaluation.
Optics 06 00010 g007
Figure 8. Beam camera sensor data for a 55 mm working distance with the optical power of lens 2 set to +35 m−1 (left), ±0 m−1 (center), and −35 m−1 (right). The white scale bars indicate a width of 2 mm. Horizontal and vertical intensity profiles are extracted for the yellow dashed lines in the horizontal and vertical directions.
Figure 8. Beam camera sensor data for a 55 mm working distance with the optical power of lens 2 set to +35 m−1 (left), ±0 m−1 (center), and −35 m−1 (right). The white scale bars indicate a width of 2 mm. Horizontal and vertical intensity profiles are extracted for the yellow dashed lines in the horizontal and vertical directions.
Optics 06 00010 g008
Figure 9. Variations of the inter-spot distance, spot size, and intensity, which are dependent on the refractive power of lens 2 and the working distance.
Figure 9. Variations of the inter-spot distance, spot size, and intensity, which are dependent on the refractive power of lens 2 and the working distance.
Optics 06 00010 g009
Table 1. Relative standard deviations σ of spot array features: For each working distance zWD (in mm) and system setting (optical power p2 of lens 2 in Dpt), the standard deviations (relative to the respective mean value) for the distances between neighboring spots, the spot diameters, and the amplitudes within one spot array are given.
Table 1. Relative standard deviations σ of spot array features: For each working distance zWD (in mm) and system setting (optical power p2 of lens 2 in Dpt), the standard deviations (relative to the respective mean value) for the distances between neighboring spots, the spot diameters, and the amplitudes within one spot array are given.
zWD in mmp2 in Dptσ Distanceσ Diameterσ Amplitude
40.000.49%4.1%7.6%
40.0−350.52%4.4%8.0%
40.0350.69%3.6%8.2%
47.500.45%3.6%8.1%
47.5−350.67%4.1%7.5%
47.5351.20%4.0%8.3%
55.000.47%5.2%7.2%
55.0−350.54%4.4%8.2%
55.0350.74%3.7%10.8%
62.500.47%4.3%8.0%
62.5−350.53%5.2%8.0%
62.5350.51%3.2%7.7%
70.000.51%3.9%7.6%
70.0−350.45%4.8%8.1%
70.0350.49%2.5%7.7%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Haas, B.; Mary, R.; Cvecek, K.; Roider, C.; Schmidt, M.; Döllinger, M.; Semmler, M. Liquid Lens Optical Design for Adjustable Laser Spot Array for the Laser-Based Three-Dimensional Reconstruction of Vocal Fold Oscillations. Optics 2025, 6, 10. https://doi.org/10.3390/opt6010010

AMA Style

Haas B, Mary R, Cvecek K, Roider C, Schmidt M, Döllinger M, Semmler M. Liquid Lens Optical Design for Adjustable Laser Spot Array for the Laser-Based Three-Dimensional Reconstruction of Vocal Fold Oscillations. Optics. 2025; 6(1):10. https://doi.org/10.3390/opt6010010

Chicago/Turabian Style

Haas, Benjamin, Rose Mary, Kristian Cvecek, Clemens Roider, Michael Schmidt, Michael Döllinger, and Marion Semmler. 2025. "Liquid Lens Optical Design for Adjustable Laser Spot Array for the Laser-Based Three-Dimensional Reconstruction of Vocal Fold Oscillations" Optics 6, no. 1: 10. https://doi.org/10.3390/opt6010010

APA Style

Haas, B., Mary, R., Cvecek, K., Roider, C., Schmidt, M., Döllinger, M., & Semmler, M. (2025). Liquid Lens Optical Design for Adjustable Laser Spot Array for the Laser-Based Three-Dimensional Reconstruction of Vocal Fold Oscillations. Optics, 6(1), 10. https://doi.org/10.3390/opt6010010

Article Metrics

Back to TopTop