Next Article in Journal
Advances in Plasmonic Sensing at the NIR—A Review
Next Article in Special Issue
Biomedical Photoacoustic Imaging and Sensing Using Affordable Resources
Previous Article in Journal
A Hybrid Tracking System of Full-Body Motion Inside Crowds
Previous Article in Special Issue
Enhancement of Photoacoustic Signal Strength with Continuous Wave Optical Pre-Illumination: A Non-Invasive Technique
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Remote Photoacoustic Sensing Using Single Speckle Analysis by an Ultra-Fast Four Quadrant Photo-Detector

1
Institute of Photonic Technologies, University Erlangen-Nürnberg (FAU), Konrad-Zuse-Straße 3/5, 91052 Erlangen, Germany
2
Erlangen Graduate School in Advanced Optical Technologies (SAOT), Paul-Gordan-Straße 6, 91052 Erlangen, Germany
3
Sensor Technology, University Erlangen-Nürnberg (FAU), Paul-Gordan-Straße 3/5, 91052 Erlangen, Germany
4
Laboratory for Electrical Instrumentation and Embedded Systems, Department of Microsystems Engineering—IMTEK, University of Freiburg, Georges-Koehler-Allee 106, 79110 Freiburg, Germany
5
Faculty of Engineering, Bar-Ilan University, Ramat-Gan 52900, Israel
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(6), 2109; https://doi.org/10.3390/s21062109
Submission received: 22 January 2021 / Revised: 9 March 2021 / Accepted: 11 March 2021 / Published: 17 March 2021

Abstract

:
The need for tissue contact makes photoacoustic imaging not applicable for special medical applications like wound imaging, endoscopy, or laser surgery. An easy, stable, and contact-free sensing technique might thus help to broaden the applications of the medical imaging modality. In this work, it is demonstrated for the first time that remote photoacoustic sensing by speckle analysis can be performed in the MHz sampling range by tracking a single speckle using a four quadrant photo-detector. A single speckle, which is created by self-interference of surface back-reflection, is temporally analyzed using this photo-detector. Phantoms and skin samples are measured in transmission and reflection mode. The potential for miniaturization for endoscopic application is demonstrated by fiber bundle measurements. In addition, sensing parameters are discussed. Photoacoustic sensing in the MHz sampling range by single speckle analysis with the four quadrant detector is successfully demonstrated. Furthermore, the endoscopic applicability is proven, and the sensing parameters are convenient for photoacoustic sensing. It can be concluded that a single speckle contains all the relevant information for remote photoacoustic signal detection. Single speckle sensing is therefore an easy, robust, contact-free photoacoustic detection technique and holds the potential for economical, ultra-fast photoacoustic sensing. The new detection technique might thus help to broaden the field of photoacoustic imaging applications in the future.

1. Introduction

Photoacoustic imaging (PA) is a new, rising imaging technique since it combines a high penetration depth with a good image contrast [1]. As PA is based on the absorption of a short light pulse and the subsequent acoustic signal generation, the absorption characteristics define the imaging contrast. As the absorption coefficients for different tissue absorbers differ greatly, it is possible to obtain a high image contrast. Hence, PA is especially attractive for displaying blood vessels due to the high hemoglobin absorption compared to other tissue constituents in the visible and near-infrared range [2]. This high contrast is combined with a high penetration depth of several millimeters since the acoustic scattering is up to a factor of 1000 less than the optical scattering [3]. Thus, higher imaging depths than for purely optical methods can be achieved with ease.
Since piezo element transducers, which are contact based, are the state-of-the-art detection technique, PA requires tissue contact. As a consequence, PA may not be suitable for special medical applications, such as wound imaging or laser surgery. Furthermore, transducer miniaturization is challenging, and small elements suffer from low sensitivity, which limits their usage for photoacoustic endoscopy. Therefore, a remote and stable detection system would be beneficial.
Air-coupled transducers could overcome this issue. However, they suffer from poor sensitivity and are still too big for minimally-invasive medical applications [4]. For the non-contact beam deflection technique, the deflection of a probe beam that is positioned above the tissue is monitored by a position sensitive detector [5,6]. A small fraction of the photoacoustic signal is transmitted to the surrounding air and deflects the probe beam. Since the probe beam needs to be scanned above the whole tissue surface, this modality is unsuitable for surgical usage. In addition, the detection bandwidth is limited due to the probe beam size. Interferometric detection methods offer non-contact sensing and a higher detection bandwidth. Here, the surface displacement after photoacoustic signal generation is monitored for the initial pressure reconstruction inside the object [7,8,9,10]. Nevertheless, interferometric systems are expensive and require a complicated setup that is noise sensitive [11]. In addition, interferometric setups only monitor the surface displacement correctly, if the surface is properly tilted, which cannot be guaranteed for clinical application. There are also non-interferometric approaches for remote acoustic signal detection. Clark et al. detected surface acoustic waves by tracking the movement of multiple speckles using simple diode detection systems [12,13]. For this approach, however, the speckles are imaged in the near-field, and thus, Fresnel diffraction applies. In this case, the movement of the speckles is dependent on three types of movement, which cannot be separated and occur simultaneously: transverse, axial, and tilt [14]. Due to this disadvantage, the acoustic sensing approach of Clark et al. may not be suitable for photoacoustic imaging. Hajireza et al. sensed the photoacoustic signal directly at its origin by a non-interferometric system [15]. This system monitors the reflection of a probe beam that is sensitive to the elasto-optic index modulation induced by the photoacoustic initial pressure transients. This approach allows non-interferometric, non-contact photoacoustic sensing. However, it provides only penetration depths in the mm-range due to the high optical attenuation for the probe beam. In addition, it is only applicable for photoacoustic microscopy and not suited for photoacoustic tomography since it does not provide temporally resolved acquisition of the acoustic signal and thus requires depth scanning for image acquisition.
Remote speckle analysis is an easy, robust, and non-interferometric vibration sensing technique whose potential for photoacoustic tomography we already demonstrated in previous publications [16,17,18]. By tracking the movement of multiple speckles, it was possible to remotely reconstruct the photoacoustic signal. However, in these proof-of-concept studies, the acoustic sensing bandwidth and thus resolution were limited to the frame rate of the expensive, high-resolution camera used at approximately 800 kHz.
In the present publication, it is demonstrated for the first time that remote photoacoustic sensing with a sampling rate of 8 MHz can be performed by tracking the movement of a single speckle with only four diodes. The speckle tracking by only four diodes proves the applicability of an economical position sensitive diode for speckle analysis. Polymer phantoms and skin tissue samples are measured in transmission mode and reflection mode. In addition, the capability of easy miniaturization and endoscopic usage of the single speckle analysis is shown by fiber bundle measurements. The new technique is an essential step for the implementation of a remote photoacoustic imaging system using speckle analysis. Therefore, this work might help to broaden the applications of PA in special applications like wound imaging, endoscopy, or guiding laser surgeries.

2. Materials and Methods

2.1. Speckle Sensing by Multiple Speckles’ Tracking

The speckle sensing technique is based on the time-resolved detection of the position of a speckle pattern. It is possible to extract the tilt change of a laser illuminated surface by tracking the speckle pattern movement [14]. The left side of Figure 1 shows a tilting object surface, and the right side illustrates the speckle sensing technique.
If the observation plane distance Z for the generated objective speckle pattern fulfills the far-field approximation (Z > ( D i l l 2 )/(4 λ ), illuminated diameter D i l l ), the objective speckle pattern movement ( δ o ) is only dependent on the surface tilt change Δ α and Z. By imaging the objective speckle pattern using an imaging system with the magnification M, a subjective speckle pattern is created on the imaging sensor whose lateral movement ( δ s ) is also linearly proportional to Δ α assuming small angle approximation. Equation (1) explains the relation between the speckle movements, M and Z [19].
δ s = δ o · M = t a n ( Δ α ) · Z · M
By acquiring a speckle pattern video sequence with the imaging system, it is thus possible to measure the surface tilt. Correlation analysis of the image frames allows the reconstruction of the speckle pattern movement along the sensor axes x and y, which are representative of the surface tilts along these two axes’ directions [19]. In this article, it is shown for the first time that speckle sensing is feasible by tracking the movement of a single speckle in contrast to the described correlation analysis of a multiple speckle image. Therefore, it is proven that a single speckle contains all necessary information for photoacoustic signal detection.

2.2. Imaging Systems and Setups

Two imaging systems are established for this work and described here in detail: the free-space setup, which is capable of far distance PA sensing, and the fiber based setup, which is suitable for endoscopy.

2.2.1. Free-Space Single Speckle Sensing

Figure 2 shows the established diode based, free-space imaging system. The imaging system consists of a microscope objective (10 × ) , a beamsplitter and a lens (f = 100 mm) used for image magnification on a camera (DCC1545M, Thorlabs, Newton, NJ, USA), and an avalanche-photodiode sensor (APS; APDcam, Fusion Instruments, Budapest, Hungary). A bandpass filter for the speckle wavelength is placed after the objective in order to block the photoacoustic excitation and room light. The magnification of the system is calculated at 5 with a microscope test target (M = 5). The camera is used as a reference for image calibration and alignment. The calibration is done with a multi-mode fiber (AFS105/125Y, Thorlabs, Newton, NJ, USA) to which a halogen light source (HL-2000, Ocean Optics, Ostfildern, Germany) is coupled. The fiber tip is then imaged on the camera and APS (Figure 2e), and the co-alignment of the camera image and the APS can be verified. The APS consists of a 4 × 8 avalanche-diode array (pixel size: 1.6 mm) and therefore offers 32 pixels. Of these 32 pixels, only the four central pixels are used for the tracking of a single speckle in order to maximize the acquisition rate.
The speckles are generated by cw illumination (532 nm, 80 mW, diameter: 0.75 mm) of the sample surface and imaged at Z = 20 cm. First, a convenient speckle is found by manually moving the imaging system using mechanical stages and visually tracking the camera image. A speckle is considered as convenient for the measurement if it is in the center of the camera and therefore in the center of the diode array (see Figure 3). Furthermore, the speckle size needs to be in the range of the pixel size of the diode array (1.6 mm). This is ensured by comparing the tracked speckle size to the inner circle (diameter 1.4 mm) of the illustrated target in Figure 3, which can be displayed by the camera software.
For the photoacoustic measurements, the samples are excited with a short laser pulse (Q-Smart 450, Quantel laser, Les Ulis, France). The laser parameters are as follows: λ = 1064 nm, pulse duration 5 ns, beam diameter 7 mm, pulse energy 90 mJ. These parameters result in an exposure of 230 mJ cm 2 , which is above the maximum permitted exposure (MPE) for single pulse excitation at 1064 nm (100 J cm 2 ). This, however, is desired to achieve a high signal amplitude for the demonstrated proof-of-concept experiments. The laser pulse triggers the acquisition start of the imaging system with a sampling rate of 8 MHz.
In order to prove the safe applicability of the sensing system, ex vivo skin measurements are performed with a total exposure below the MPE. This is achieved by replacing the described cw laser with a temporally pulsed laser diode (IBEAM-SMART-405-S-HP, Toptica Photonics, Gräfelfing, Germany) and by reducing the photoacoustic excitation energy. The laser diode pulse ( λ = 405 nm) is temporally triggered by the short laser pulse for photoacoustic excitation and illuminates the tissue only for a duration of 30 μs after photoacoustic excitation at a peak power of 35 mW with an illumination radius of 300 μm at the tissue surface. This temporal speckle illumination together with a reduced excitation energy of 35 mW results in a total exposure that is below the MPE for soft tissue [21].

2.2.2. Fiber-Based Single Speckle Sensing

Figure 4 shows the imaging unit and setup for the fiber based approach and camera images of a USAF 1951 Test Target and a selected speckle.
In contrast to the free-space approach, an imaging fiber bundle (30,000 fibers, imaging resolution 1 μm, working distance 30 μm, field of view diameter 240 μm) that can be used in endoscopy is used for speckle pattern imaging. At the proximal fiber bundle end, the speckles are imaged by the diode based imaging system mentioned in Section 2.2.1. In contrast to the free-space system previously described, a 20× magnification objective (WC95248318, Mitutoyo, Japan, 20×) is used. Furthermore, the imaging lens in the diode array arm is changed to f = 200 mm. Together with the magnification of the imaging fiber bundle ( M = 2.5 ), these changes result in a magnification of M = 50 for the diode array arm and M = 25 for the camera arm. These higher optical magnifications allow speckle sensing at a near imaging distance of Z = 2 mm, which is desired for endoscopic usage.
The speckles are generated by focused cw illumination (532 nm, 100 mW, D i l l = 50 μm) of the sample surface and imaged by the fiber bundle and APS system at Z = 2 mm. A convenient speckle is found and automatically centered inside the measurement area of the four photodiodes by analyzing the camera image and moving the proximal fiber bundle end in lateral directions. For the photoacoustic measurements, the phantoms are excited with a short laser pulse (Q-Smart 450, Quantel laser, Les Ulis, France), and the laser parameters are the following: λ = 1064 nm, pulse duration 5 ns, beam radius 7 mm, pulse energy 110 mJ. These parameters result in an exposure dose of 285 mJ cm 2 , which is above the MPE for single pulse excitation at 1064 nm (100 J cm 2 ). This, however, is desired to achieve a high signal amplitude for the proof-of-concept experiments. The laser pulse triggers the acquisition start of the APS with a sampling rate of 8 MHz.

2.3. Measurement Modes and Samples

Using the described free-space and fiber based imaging systems, the samples are measured in transmission mode and reflection mode. For transmission mode, the photoacoustic excitation and speckle sensing take place at opposite sample sides, whereas they are on the same side for reflection mode.
The phantoms used in this work are made of the soft polymer PVCP (polyvinyl chloride plastisol; Standard Lure flex (medium), Lure Factors, Great Britain) and consist of two parts: absorber and scattering matrix. In order to adjust the optical properties for these parts, additives are used during the plastisol preparation process. A black plastic color changes the absorption coefficient μ a , and TiO 2 -particles (titanium(IV)-oxide, Sigma Aldrich, Taufkirchen, Germany) adjust the reduced scattering coefficient μ s . In this work, a color concentration of 7-vol-% and a TiO 2 -concentration of 4 mg mL ( PVCP ) is used for the absorbing and scattering phantom parts, respectively. The optical properties for these concentrations were determined at the excitation wavelength 1064 nm using spectrophotometric measurements and inverse adding doubling. The absorption coefficient for the absorbing phantom part is 106 cm 1 , and the reduced scattering coefficient for the scattering part is 21 cm 1 . The scattering coefficient for the absorbing part and the absorbing coefficient for the scattering part can be neglected.
For the measurements using the free-space setup, three different PVCP phantoms (PhAT1, PhAT2, PhAT3) with increasing distances between the absorber surface and detection surface (d) are measured in transmission mode. The “Ph” in the phantom name stands for phantom, “A” for the free-space setup, and “T” for transmission mode. Two PVCP phantoms are measured in reflection mode (PhAR4, PhAR5). The “R” in the sample name stands for reflection mode. Two skin tissue samples (skinAT1, skinAT2p) are measured in transmission mode. The “p” in the sample name stands for the pulsed speckle illumination, which ensures a total exposure below the MPE for the experiments with the skin tissue. The skin tissue was obtained from bisected pig heads, which were obtained from the local slaughterhouse (Unifleisch GmbH, Erlangen, Germany). Therefore, the approval of the Ethics Committee was not necessary. The tissue sample was prepared manually using a scalpel. For skinAT1, a PVCP-absorber was placed at the sample bottom by cutting out a hole in the tissue. For skinAT2, a PVCP-absorber was placed between a fat layer, which was obtained from a local supermarket, and a skin layer. In order to ensure good contact between the sample constituents, ultrasound gel was used, and for skinAT2p, a metallic sample holder gently pressed the tissues.
The speed of sound for the prepared skin sample was measured at 1300 m s and for the PVCP phantoms at 1330 m s with an ultrasound thickness measurement device (Mini Test 430, Elektro Physik, Germany). For each sample measured with the free-space setup, fifteen measurements were analyzed in order to ensure statistical relevance.
For the measurements using the fiber based imaging setup, two PVCP phantoms (PhBT1, PhBT2) were measured in transmission mode. The “B” in the sample name stands for the fiber based setup. The speed of sound for these samples were measured at 1349 m s with an ultrasound thickness measurement device (Mini Test 430, Elektro Physik, Germany). For these two phantoms, ten measurements were analyzed in order to ensure statistical relevance.
The density ρ of all PVCP phantoms was measured by the volume displacement of ethanol at 1200 kg m 2 s . The resulting acoustic impedance ( Z a c = ρ c ) of the used phantoms in this work was therefore in the range of 1.60 × 10 6 kg m 2 s 1.62 × 10 6 kg m 2 s , which is in good agreement with the values of soft tissue: the impedance of fat tissue is 1.4 × 10 6 kg m 2 s and for muscle 1.62 × 10 6 kg m 2 s [22].
Figure 5 sketches the phantom position in regard to the excitation and illumination laser for the two measurement modes and shows the corresponding detection distances d of all samples. The absorber thickness is 3 mm for all samples, and d is varied by adjusting the thickness for the scattering sample part. For all samples, the mean detection times by automated single speckle analysis and their standard deviations are compared to the theoretical detection time.

2.4. Data Analysis for Single Speckle Analysis

Figure 6 shows a speckle, which is initially in the center of the four measurement diodes P1, P2, P3, and P4 and moves to a different position due to the PA signal.
By using the temporal signals of the four diodes, it is possible to compute the temporal center of gravity of the speckle C s p ( x s p , y s p ) and its total vector length L by using Equations (2)–(4), similar to a four quadrant position sensitive diode [23]. Since the speckle moves if the surface tilts, this center of gravity is related to the photoacoustic signal, and it is possible to reconstruct the absorber depth d.
x s p = ( P 1 + P 3 ) ( P 2 + P 4 ) ( P 1 + P 2 + P 3 + P 4 )
y s p = ( P 1 + P 2 ) ( P 3 + P 4 ) ( P 1 + P 2 + P 3 + P 4 )
L = x s p 2 + y s p 2
In order to prove the usability of the sensing system for remote photoacoustic detection, the detection times of x s p , y s p , and L are shown for the free-space approach. For L, the mean detection time t m e a n and its standard deviation σ are computed for all samples and verified to t t h e o for the acoustic signal, which is calculated using d and c.

2.5. Sensing Parameter Evaluation for Single Speckle Analysis

2.5.1. Sensitivity

The sensitivity in terms of minimal detectable tilt S d , α is limited by the noise floor σ n f of the PA measurements. The noise level σ n f is computed by taking the standard deviation of a PA measurement data set before excitation. For this standard deviation computation, one-hundred fifty data points before PA excitation are used. By determining the noise floor σ n f and taking into account the relevant imaging parameters (Z, pixel size d p x , magnification M, illumination diameter D i l l ), S d , α can be determined. The minimal detectable speckle shift δ s , m i n is equal to the multiplication of d p x and σ n f . By considering Equation (1), it is then possible to compute the minimal detectable tilt S d , α : tan ( S d , α ) = δ s , m i n Z M . Under the assumption that the investigated speckle pattern or single speckle consists of reflections from the complete illuminated surface area with the diameter D i l l , the minimal detectable axial surface deformation is estimated by S d , n m = tan ( S d , α ) · D i l l . The minimal detectable pressure S d can be determined according to Equation (5) [24].
S d = π Z a c S d , n m f
The parameter f defines the frequency of the acoustic wave that should be detected, and Z a c is the acoustic impedance. For the established system here, the maximum detectable frequency is half the frame rate. For the established free-space and fiber based sensing system, the described sensitivities are computed and compared to the literature and to contact ultrasound transducers.

2.5.2. Sensing Range

The sensing range, i.e., the tilt interval that is covered by the remote speckle analysis, is dependent on the sensitivity, speckle size, and sensor size. The sensitivity defines the minimal detectable tilt as treated in the previous section. The maximal detectable tilt α m a x is defined by the sensor and speckle size. The sensing range for the single speckle analysis is discussed.

2.5.3. Linearity

Simulations were carried out in order to evaluate the linearity and robustness against neighboring speckles, meaning speckles that are not situated inside the original image, but appear in the shifted speckle image. Four speckle patterns with a centralized speckle were analyzed. Figure 7 shows these speckle patterns. The images are moved in the horizontal direction with a shift amplitude of −0.26 to 0.26 ( x s p , r e a l ) of the diode pixel size with a shift resolution of 0.025. For each shifted image, the horizontal center of gravity x s p for the fixed sensing diodes region, which is indicated in Figure 7, is computed according to Equation (2). The values of x s p are computed for all shifts and speckle images, compared to x s p , r e a l and compared to linear behavior.

3. Results and Discussion

3.1. Photoacoustic Measurements

Figure 8 shows measurement results in transmission mode of the three phantoms PhAT1, PhAT2, and PhAT3. They illustrate the speckle vector length L, which represents the temporal vibration profile of the surface under investigation. The detection time of the first peak in these profiles is marked with a black circle, because this time point corresponds to the photoacoustic signal. The surface expansion after the photoacoustic excitation results in a surface tilt change and thus in a speckle movement, which can be seen in L. For the phantoms PhAT1-PhAT3, the acquisition times increase as expected with increasing acoustic travel distance d. Considering t s p , the acquisition time increases as follows: 3.13 μs, 3.63 μs, and 4.38 μs. By using the speed of sound (1330 m s ), the following acoustic travel distances are calculated: 4.163 mm, 4.828 mm, and 5.825 mm. Thus, for each phantom, the acquisition time of the photoacoustic signal by speckle analysis corresponds to the geometrical phantom dimensions (d: 4 mm, 5 mm, 6 mm), taking into account the phantom production uncertainty.
Table 1 summarizes t m e a n for all photoacoustic acquisition times of all samples considering L, their σ , and the theoretical acoustic transit time t t h e o . For illustration purpose, these results are also plotted in Figure 9.
It is clearly visible that the speckle analysis mean detection times increase with bigger phantom dimensions and that they match the acoustic transit times. The small differences between the mean and theoretical detection time can be explained with inaccuracies for the phantom manufacturing and measuring process. The low standard deviations prove the repeatability and the fact that single speckle sensing allows precise photoacoustic sensing compared to the previous high-speed camera experiments. The standard deviation is in the range of approximately 0.1 μs, which results in a precision of 0.13 mm considering the speed of sound.
Based on the repeatability and successful verification with the theoretical transit time t t h e o of the transmission mode and reflection mode measurements, it can be concluded that free-space and fiber based single speckle sensing is a reliable technique for the photoacoustic detection on phantoms and on skin tissue samples. Furthermore, the less expensive low-resolution diode sensor, in contrast to the previously used high-speed camera, reaches a high sampling rate of 8 MHz, which allows precise photoacoustic sensing.

3.2. Sensing Parameters

3.2.1. Sensitivity

Table 2 summarizes the relevant parameters for the determination of S d , n m and S d for the established sensing systems. For the purpose of comparison, f is selected at 1 MHz and 4 MHz, which represents the maximal detectable acoustic frequency for the established sensing system in this work.
With the systems developed in this work, axial deformations of approximately 5 nm can be detected, which results in a pressure sensitivity of approximately 20 kPa for a 1 MHz acoustic wave. Horstmann et al. reached the following sensitivity parameters with a full-field speckle interferometry approach: S d , nm = 1 nm and S d , 1 MHz = 1.5 kPa with a sensing bandwidth of 80 MHz [10]. These values, however, were achieved for measurements on silicone, which has a lower impedance ( 0.94 × 10 6 kg m 2 s ) than PVCP, which results in low S d . Piezoelectric contact transducers that are especially designed and optimized for broadband PA detection achieve high sensitivities, which are dependent on the size and detection bandwidth. For a detection of acoustic frequencies in the range of 10 MHz to 50 MHz with an element size of 30 mm 2 , S d can be estimated to lie between 1.5 Pa and 3.5 Pa [25]. Arrays have a smaller active area per detector element and thus lower sensitivity. An optimized ultrasonic line array can have a sensitivity of 110 Pa for a single element [26]. These sensitivities are better than the sensitivity for the established sensing system in this work. However, as explained in the Introduction, the interferometric setup is more complicated than the speckle analysis applied in the present investigation, and in comparison to the transducer, the single speckle analysis is contact-free. In addition, the speckle analysis sensitivity might even be improved by the usage of smaller photodiodes, tighter focusing of the cw illumination, or new data analysis techniques.

3.2.2. Sensing Range

The single speckle analysis tracks the center of gravity of a single speckle that is positioned in the center of the four measurement diodes (Equations (2) and (3)). In general, the maximal detectable center of gravity coordinates ( x s p , m a x , y s p , m a x ) are defined by the single speckle diameter l s and the diode size ( d p x ) by Equation (6). For a larger speckle shift in regards to the sensor center, the single speckle would not be on the sensor completely, which leads to measurement errors. The maximum allowable speckle diameter is defined by twice the diode size. When assuming a speckle diameter of the pixel size, the maximum detectable center of gravity coordinates ( x s p , m a x , y s p , m a x ) are thus half the diode size.
x / y s p , m a x = ( 1 l s 2 d p x ) d p x
Table 3 gives an overview of the maximal detectable tilts in the horizontal and vertical direction ( α m a x , x , α m a x , y ). For the single speckle analysis, x / y s p , m a x can be determined according to Equation (6) with l s = 0.6 d p x .
The detectable tilt interval can be defined at [ 55 × 10 5 ; 0.0642 ] for the diode system. These intervals can be converted according to the computations from Table 2 to pressure interval [31.67 kPa; 3690 kPa] for a PVCP surface and a 1 MHz acoustic wave. These values result in a dynamic range factor for the pressure detection of approximately 116, which is convenient for PA sensing.

3.2.3. Linearity

Figure 10 illustrates the computed value for x s p for all shifts and speckle images and compares the results to linear behavior.
Though we tried to centralize the speckle inside the camera image, x s p is not zero for a zero shift (see Figure 10a). This can be explained by the speckle surrounding signal, which also falls into the diode sensing regions. Due to this effect, there is an offset for the computed x s p compared to linear behavior. This offset can be corrected, although there is still a clear difference between the computed x s p and linear behavior (see Figure 10b), which depends on the central speckle size and intensity distribution. Furthermore, the connection between x s p , r e a l and x s p might be surjective. This means that there can be multiple values of x s p for one x s p , r e a l . This effect occurs for Speckle Image B, as neighboring speckles that are shifted into the diode sensing region lower the signal strongly for higher shift magnitudes. The non-linearity problem can be corrected since each extracted shift can be mapped to a real shift when assuming a non-surjective behavior for the connection between x s p and x s p , r e a l . This could be assured by an automated speckle finding software that analyzes the camera image and potential values for x s p , r e a l and identifies a suitable speckle automatically.

4. Conclusions and Outlook

In previous studies, we already demonstrated the feasibility of remote photoacoustic sensing by multiple speckles analysis [16,17,18,20]. However, in these previous works, expensive detector systems were used and multiple speckles were analyzed, which limits the achievable sensing rate and thus also the resolution. Furthermore, the detection systems used were not fiber based and thus not suitable for endoscopic applications.
This study reports on a new, purely optical, non-interferometric modality for PA signal acquisition in the MHz range by analyzing a single speckle with four diodes and demonstrates its suitability for endoscopy. Based on the repeatability and successful verification of the transmission mode and reflection mode measurements, it can be concluded that a single speckle provides the information required for reliable PA detection on phantoms that mimic the optical and mechanical properties of tissue and skin samples. The successful fiber based measurements demonstrate the usability of the approach for endoscopic applications. These results are essential steps toward the future application of the technique in a potential imaging device or as a smart feedback system for laser procedures.
However, several challenge arise for the implementation of a future imaging system. Higher sensing rates need to be achieved in order to provide better sensing resolutions. For this work, the frame rate was limited to 8 MHz by the APS, which could be replaced by an economical four quadrant position sensitive diode [27]. With appropriate hardware, this PSD allows higher acquisition rates and thus better sensing resolutions. An array of four quadrant diodes could be developed, and a measurement would be started if speckles were in a convenient position. Therefore, this sensor array would make a positioning unit obsolete and lower the costs of the sensing system significantly since a standard camera could be used for speckle position and shape tracking. Furthermore, the sensing sensitivity needs to be improved, which could be achieved by new hardware and a more precise speckle shift extraction algorithm [23]. This improved sensing sensitivity would reduce the required PA excitation exposure, which was above the MPE for soft tissue in most of the experiments for this investigation. A scan pattern of 10 × 10 , which is considered to be sufficient for imaging, and a single photoacoustic measurement time of 10 μs result in a total measurement time of 1 ms per image, thus allowing imaging rates of 1 kHz. These mentioned steps together with appropriate reconstruction algorithms will allow PA imaging in the future [28].

Author Contributions

Conceptualization, B.L. and F.K.; formal analysis, B.L.; investigation, B.L. and D.S.; methodology, B.L., M.H., and Z.Z.; supervision, M.S. (Michael Schmidt), Z.Z., and F.K.; visualization, B.L.; writing—original draft, B.L.; writing—review and editing, M.H., M.S. (Moritz Späth), D.S., M.W., S.J.R., M.S. (Michael Schmidt), Z.Z., and F.K. All authors read and agreed to the published version of the manuscript.

Funding

This work was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation)—Project Number 397972545. In addition, funding of the Erlangen Graduate School in Advanced Optical Technologies (SAOT) by the DFG in the framework of the German excellence initiative is gratefully acknowledged.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data that supports the findings of the study are provided within the article.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
APSavalanche-photodiode sensor
MPEmaximum permitted exposure
PAPhotoacoustic
PhATphantom Setup A transmission mode
PhARphantom Setup A reflection mode
PhBTphantom Setup B transmission mode
PVCPpolyvinyl chloride plastisol
skinAT1skin sample Setup A transmission mode
skinAT2pskin sample Setup A transmission mode pulsed illumination

References

  1. Yao, J.; Xia, J.; Wang, L.V. Multiscale functional and molecular photoacoustic tomography. Ultrason. Imaging 2016, 38, 44–62. [Google Scholar] [CrossRef] [Green Version]
  2. Jacques, S.L. Optical properties of biological tissues: A review. Phys. Med. Biol. 2013, 58, R37. [Google Scholar] [CrossRef]
  3. Yao, J.; Wang, L.V. Photoacoustic microscopy. Laser Photonics Rev. 2013, 7, 758–778. [Google Scholar] [CrossRef]
  4. Kolkman, R.G.; Blomme, E.; Cool, T.; Bilcke, M.; van Leeuwen, T.G.; Steenbergen, W.; Grimbergen, K.A.; den Heeten, G.J. Feasibility of noncontact piezoelectric detection of photoacoustic signals in tissue-mimicking phantoms. J. Biomed. Opt. 2010, 15, 055011. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Barnes, R.A.; Maswadi, S.; Glickman, R.; Shadaram, M. Probe beam deflection technique as acoustic emission directionality sensor with photoacoustic emission source. Appl. Opt. 2014, 53, 511–519. [Google Scholar] [CrossRef] [PubMed]
  6. Johnson, J.L.; van Wijk, K.; Caron, J.N.; Timmerman, M. Gas-coupled laser acoustic detection as a non-contact line detector for photoacoustic and ultrasound imaging. J. Opt. 2016, 18, 024005. [Google Scholar] [CrossRef] [Green Version]
  7. Carp, S.A.; Guerra, A., III; Duque, S.Q., Jr.; Venugopalan, V. Optoacoustic imaging using interferometric measurement of surface displacement. Appl. Phys. Lett. 2004, 85, 5772–5774. [Google Scholar] [CrossRef]
  8. Hochreiner, A.; Bauer-Marschallinger, J.; Burgholzer, P.; Jakoby, B.; Berer, T. Non-contact photoacoustic imaging using a fiber based interferometer with optical amplification. Biomed. Opt. Express 2013, 4, 2322–2331. [Google Scholar] [CrossRef] [Green Version]
  9. Rousseau, G.; Gauthier, B.; Blouin, A.; Monchalin, J.P. Non-contact biomedical photoacoustic and ultrasound imaging. J. Biomed. Opt. 2012, 17, 061217. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Horstmann, J.; Spahr, H.; Buj, C.; Münter, M.; Brinkmann, R. Full-field speckle interferometry for non-contact photoacoustic tomography. Phys. Med. Biol. 2015, 60, 4045. [Google Scholar] [CrossRef] [Green Version]
  11. Wissmeyer, G.; Pleitez, M.A.; Rosenthal, A.; Ntziachristos, V. Looking at sound: Optoacoustics with all-optical ultrasound detection. Light. Sci. Appl. 2018, 7, 1–16. [Google Scholar] [CrossRef] [PubMed]
  12. Clark, M. Optical detection of ultrasound on rough surfaces using speckle correlated spatial filtering. J. Phys. Conf. Ser. IOP Publ. 2011, 278, 012025. [Google Scholar] [CrossRef]
  13. Sharpies, S.; Light, R.; Achamfuo-Yeboah, S.; Clark, M.; Somekh, M.G. The SKED: Speckle knife edge detector. J. Phys. Conf. Ser. IOP Publ. 2014, 520, 012004. [Google Scholar] [CrossRef] [Green Version]
  14. Zalevsky, Z.; Beiderman, Y.; Margalit, I.; Gingold, S.; Teicher, M.; Mico, V.; Garcia, J. Simultaneous remote extraction of multiple speech sources and heart beats from secondary speckles pattern. Opt. Express 2009, 17, 21566–21580. [Google Scholar] [CrossRef] [Green Version]
  15. Hajireza, P.; Shi, W.; Bell, K.; Paproski, R.J.; Zemp, R.J. Non-interferometric photoacoustic remote sensing microscopy. Light. Sci. Appl. 2017, 6, e16278. [Google Scholar] [CrossRef]
  16. Lengenfelder, B.; Mehari, F.; Hohmann, M.; Heinlein, M.; Chelales, E.; Waldner, M.J.; Klämpfl, F.; Zalevsky, Z.; Schmidt, M. Remote photoacoustic sensing using speckle analysis. Sci. Rep. 2019, 9, 1–11. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Lengenfelder, B.; Mehari, F.; Hohmann, M.; Löhr, C.; Waldner, M.J.; Schmidt, M.; Zalevsky, Z.; Klämpfl, F. Contact-free endoscopic photoacoustic sensing using speckle analysis. J. Biophotonics 2019, 12, e201900130. [Google Scholar] [CrossRef] [Green Version]
  18. Lengenfelder, B.; Mehari, F.; Hoppe, L.; Klämpfl, F.; Tenner, F.; Zalevsky, Z.; Schmidt, M. Remote photoacoustic tomography using speckle sensing with a high-speed camera. In Optics and the Brain; Optical Society of America: Washington, DC, USA, 2016; p. JM3A–16. [Google Scholar]
  19. Lengenfelder, B.; Hohmann, M.; Röhm, M.; Schmidt, M.; Zam, A.; Zalevsky, Z.; Klämpfl, F. Image reconstruction for remote photoacoustic tomography using speckle analysis. Tissue Opt. Photonics 2020, 11363, 113631F. [Google Scholar]
  20. Lengenfelder, B.; Jarkas, H.; Shabairou, N.; Hohmann, M.; Schmidt, M.; Zalevsky, Z.; Klämpfl, F. Remote photoacoustic tomography using diode-array and speckle analysis. Tissue Opt. Photonics 2020, 11363, 1136308. [Google Scholar]
  21. Horstmann, J. Kontaktlose Photoakustische Tomographie: Realisierung und Evaluation einer Optisch-Holographischen Detektionsmethode; Infinite Science Publishing: Lübeck, Germany, 2016. [Google Scholar]
  22. Culjat, M.O.; Goldenberg, D.; Tewari, P.; Singh, R.S. A review of tissue substitutes for ultrasound imaging. Ultrasound Med. Biol. 2010, 36, 861–873. [Google Scholar] [CrossRef]
  23. Wu, J.; Chen, Y.; Gao, S.; Li, Y.; Wu, Z. Improved measurement accuracy of spot position on an InGaAs quadrant detector. Appl. Opt. 2015, 54, 8049–8054. [Google Scholar] [CrossRef]
  24. Shabairou, N.; Lengenfelder, B.; Hohmann, M.; Klämpfl, F.; Schmidt, M.; Zalevsky, Z. All-optical, an ultra-thin endoscopic photoacoustic sensor using multi mode fiber. Sci. Rep. 2020, 10, 1–8. [Google Scholar] [CrossRef] [PubMed]
  25. Winkler, A.M.; Maslov, K.I.; Wang, L.V. Noise-equivalent sensitivity of photoacoustics. J. Biomed. Opt. 2013, 18, 097003. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Wang, X.; Fowlkes, J.B.; Cannata, J.M.; Hu, C.; Carson, P.L. Photoacoustic imaging with a commercial ultrasound system and a custom probe. Ultrasound Med. Biol. 2011, 37, 484–492. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Position Sensitive Diode, First Sensor. Available online: https://www.first-sensor.com/en/products/optical-sensors/detectors/quadrant-apds-qa/ (accessed on 31 August 2020).
  28. Huang, C.; Wang, K.; Nie, L.; Wang, L.V.; Anastasio, M.A. Full-wave iterative image reconstruction in photoacoustic tomography with acoustically inhomogeneous media. IEEE Trans. Med. Imaging 2013, 32, 1097–1110. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Speckle sensing theory: An object tilt results in a speckle pattern movement, which can be reconstructed with an imaging system. Figure after [19].
Figure 1. Speckle sensing theory: An object tilt results in a speckle pattern movement, which can be reconstructed with an imaging system. Figure after [19].
Sensors 21 02109 g001
Figure 2. (a) Experimental setup (transmission mode) for the remote photoacoustic measurements using the diode array sensing system. The imaging system can be moved mechanically in lateral directions, which is indicated by the red marks. (b) Picture of the sensing system. (c) The magnification of the sensing system is calculated at 5 using a USAF 1951 Test Target. (d,e) The camera position of the sensing system is calibrated using a multi-mode fiber. The diode signals and the camera image are shown when an illuminated fiber is placed in their center. Figures after [20].
Figure 2. (a) Experimental setup (transmission mode) for the remote photoacoustic measurements using the diode array sensing system. The imaging system can be moved mechanically in lateral directions, which is indicated by the red marks. (b) Picture of the sensing system. (c) The magnification of the sensing system is calculated at 5 using a USAF 1951 Test Target. (d,e) The camera position of the sensing system is calibrated using a multi-mode fiber. The diode signals and the camera image are shown when an illuminated fiber is placed in their center. Figures after [20].
Sensors 21 02109 g002
Figure 3. The camera image of an exemplary speckle used for photoacoustic measurement is shown. The speckle is placed in the center of the reference camera (blue target) and thus in the center of four measurements diodes P1/P2/P3/P4 (red) by manually moving the complete imaging system.
Figure 3. The camera image of an exemplary speckle used for photoacoustic measurement is shown. The speckle is placed in the center of the reference camera (blue target) and thus in the center of four measurements diodes P1/P2/P3/P4 (red) by manually moving the complete imaging system.
Sensors 21 02109 g003
Figure 4. Experimental setup and imaging unit for the remote photoacoustic measurements using the fiber based approach (a). The proximal fiber bundle end can be moved in lateral directions, which is indicated by the red marks. The magnification for the camera arm is determined at 50 using a USAF 1951 Test Target (b). A convenient speckle that is centralized inside the photodiode measurement area is illustrated (c).
Figure 4. Experimental setup and imaging unit for the remote photoacoustic measurements using the fiber based approach (a). The proximal fiber bundle end can be moved in lateral directions, which is indicated by the red marks. The magnification for the camera arm is determined at 50 using a USAF 1951 Test Target (b). A convenient speckle that is centralized inside the photodiode measurement area is illustrated (c).
Sensors 21 02109 g004
Figure 5. The transmission setup (T) is sketched, and the phantom parts are marked (a). The reflection setup (R) is illustrated (b). Pictures of the two skin tissue samples are shown: skinAT1 with an absorber at the bottom (c) and skinAT2p with an absorber between skin and fat (d). The corresponding detection distances, theoretical detection times, and measurement modes are summarized in the table (e).
Figure 5. The transmission setup (T) is sketched, and the phantom parts are marked (a). The reflection setup (R) is illustrated (b). Pictures of the two skin tissue samples are shown: skinAT1 with an absorber at the bottom (c) and skinAT2p with an absorber between skin and fat (d). The corresponding detection distances, theoretical detection times, and measurement modes are summarized in the table (e).
Sensors 21 02109 g005
Figure 6. A perfectly round speckle, which is initially in the center of the measurement diodes is shown (a). The diode signals (P1, P2, P3, P4) can be used to compute its center of gravity C s p ( x s p , y s p ) and its total vector length L in order to detect speckle movements (b).
Figure 6. A perfectly round speckle, which is initially in the center of the measurement diodes is shown (a). The diode signals (P1, P2, P3, P4) can be used to compute its center of gravity C s p ( x s p , y s p ) and its total vector length L in order to detect speckle movements (b).
Sensors 21 02109 g006
Figure 7. Speckle images (AD) that are evaluated for their single speckle sensing capability. The diode sensing regions are indicated by the red rectangles.
Figure 7. Speckle images (AD) that are evaluated for their single speckle sensing capability. The diode sensing regions are indicated by the red rectangles.
Sensors 21 02109 g007
Figure 8. The speckle vector length t s p is illustrated for measurements of phantoms PhAT1–PhAT3. For the three samples, the detection times of the initial generated photoacoustic signal are noted, and the corresponding signal peaks are marked.
Figure 8. The speckle vector length t s p is illustrated for measurements of phantoms PhAT1–PhAT3. For the three samples, the detection times of the initial generated photoacoustic signal are noted, and the corresponding signal peaks are marked.
Sensors 21 02109 g008
Figure 9. Mean detection times ( t m e a n ) and their standard deviation σ for the photoacoustic measurements. The sample names can be explained as follows: Ph stands for a phantom, A for the free-space setup, B for the fiber based setup, T for transmission mode, R for reflection mode, and p for pulsed speckle illumination below the MPE. The theoretical transit time of the photoacoustic signal is used for verification.
Figure 9. Mean detection times ( t m e a n ) and their standard deviation σ for the photoacoustic measurements. The sample names can be explained as follows: Ph stands for a phantom, A for the free-space setup, B for the fiber based setup, T for transmission mode, R for reflection mode, and p for pulsed speckle illumination below the MPE. The theoretical transit time of the photoacoustic signal is used for verification.
Sensors 21 02109 g009
Figure 10. The computed values for x s p are shown over the x s p , r e a l without (a) and with zero offset correction (b).
Figure 10. The computed values for x s p are shown over the x s p , r e a l without (a) and with zero offset correction (b).
Sensors 21 02109 g010
Table 1. The mean value t m e a n for all photoacoustic acquisition times of all samples considering, its standard deviation σ , and the theoretical acoustic transit time t t h e o are listed.
Table 1. The mean value t m e a n for all photoacoustic acquisition times of all samples considering, its standard deviation σ , and the theoretical acoustic transit time t t h e o are listed.
Sample t mean (μs) σ (μs) t theo (μs)
PhAT13.190.063.01
PhAT23.710.093.76
PhAT34.480.174.51
PhAR42.150.162.26
PhAR52.990.063.01
skinAT17.720.227.69
skinAT2p2.930.253.04
PhBT15.910.0575.56
PhBT23.530.0933.71
Table 2. Relevant parameters for the determination of S d , n m and S d for the established sensing systems.
Table 2. Relevant parameters for the determination of S d , n m and S d for the established sensing systems.
Free-SpaceFiber-Guided
PVCPskinPVCP
σ n f 0.0060.0070.0057
d p x in μm160016001600
M5550
Z in cm20200.2
S d , α in 10 5 55.064.2522
D i l l in mm0.750.750.05
S d , n m in nm7.28.44.56
Z a c in 10 6 kg m 2 s 1.41.991.4
S d , 1 MHz in kPa31.6752.5220.06
S d , 4 MHz in kPa12721080
Table 3. Overview of the sensor size and surface tilt sensing ranges for the single speckle sensing approach.
Table 3. Overview of the sensor size and surface tilt sensing ranges for the single speckle sensing approach.
Single Speckle Analysis
d p x in μm1600
x / y s p , m a x in μm1120
α m a x , x / y in 0.0642
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lengenfelder, B.; Hohmann, M.; Späth, M.; Scherbaum, D.; Weiß, M.; Rupitsch, S.J.; Schmidt, M.; Zalevsky, Z.; Klämpfl, F. Remote Photoacoustic Sensing Using Single Speckle Analysis by an Ultra-Fast Four Quadrant Photo-Detector. Sensors 2021, 21, 2109. https://doi.org/10.3390/s21062109

AMA Style

Lengenfelder B, Hohmann M, Späth M, Scherbaum D, Weiß M, Rupitsch SJ, Schmidt M, Zalevsky Z, Klämpfl F. Remote Photoacoustic Sensing Using Single Speckle Analysis by an Ultra-Fast Four Quadrant Photo-Detector. Sensors. 2021; 21(6):2109. https://doi.org/10.3390/s21062109

Chicago/Turabian Style

Lengenfelder, Benjamin, Martin Hohmann, Moritz Späth, Daniel Scherbaum, Manuel Weiß, Stefan J. Rupitsch, Michael Schmidt, Zeev Zalevsky, and Florian Klämpfl. 2021. "Remote Photoacoustic Sensing Using Single Speckle Analysis by an Ultra-Fast Four Quadrant Photo-Detector" Sensors 21, no. 6: 2109. https://doi.org/10.3390/s21062109

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop