Next Article in Journal
A Reflective Photonic Crystal Fiber Temperature Sensor Probe Based on Infiltration with Liquid Mixtures
Next Article in Special Issue
Rice Seed Cultivar Identification Using Near-Infrared Hyperspectral Imaging and Multivariate Data Analysis
Previous Article in Journal
Gait-Based Person Identification Robust to Changes in Appearance
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Estimation of Melanin and Hemoglobin Using Spectral Reflectance Images Reconstructed from a Digital RGB Image by the Wiener Estimation Method

1
Graduate School of Bio-applications and Systems Engineering, Tokyo University of Agriculture and Technology, 2-24-16, Naka-cho, Koganei-shi, 184-8588 Tokyo, Japan
2
Department of Mechanical Engineering, Kushiro National College of Technology, 2-32-1, Otanoshike-Nishi, Kushiro-Shi, 084-0916 Hokkaido, Japan
3
Graduate School of Bio-system Engineering, Yamagata University, 4-3-16, Jonan, Yonezawa-Shi, 992-8510 Yamagata, Japan
4
College of Design and Manufacturing Technology, Muroran Institute of Technology, 27-1 Mizumoto-cho, Muroran-shi, 050-8585 Hokkaido, Japan
*
Author to whom correspondence should be addressed.
Sensors 2013, 13(6), 7902-7915; https://doi.org/10.3390/s130607902
Submission received: 30 April 2013 / Revised: 12 June 2013 / Accepted: 17 June 2013 / Published: 19 June 2013
(This article belongs to the Special Issue Spectral Imaging at the Microscale and Beyond)

Abstract

: A multi-spectral diffuse reflectance imaging method based on a single snap shot of Red-Green-Blue images acquired with the exposure time of 65 ms (15 fps) was investigated for estimating melanin concentration, blood concentration, and oxygen saturation in human skin tissue. The technique utilizes the Wiener estimation method to deduce spectral reflectance images instantaneously from an RGB image. Using the resultant absorbance spectrum as a response variable and the extinction coefficients of melanin, oxygenated hemoglobin and deoxygenated hemoglobin as predictor variables, multiple regression analysis provides regression coefficients. Concentrations of melanin and total blood are then determined from the regression coefficients using conversion vectors that are numerically deduced in advance by the Monte Carlo simulations for light transport in skin. Oxygen saturation is obtained directly from the regression coefficients. Experiments with a tissue-like agar gel phantom validated the method. In vivo experiments on fingers during upper limb occlusion demonstrated the ability of the method to evaluate physiological reactions of human skin.

1. Introduction

Quantitative evaluation of the melanin and blood concentrations and the blood oxygenation is important for detecting various skin diseases including cancers, monitoring health status and tissue metabolism, and evaluating convalescence. Major chromophores in the superficial skin layer are melanin, oxygenated hemoglobin, and deoxygenated hemoglobin, which show distinctive optical absorption properties in the visible wavelength range. If the concentration of each chromophore varies, then, the corresponding change may be made on diffusely reflected light from the skin tissue in this wavelength range. Therefore, analysis of the diffuse reflectance spectra may provide us with useful information on tissue activities and functions that are related to the melanin and hemoglobin. Diffuse reflectance spectroscopy (DRS) has been widely used for the evaluation of human skin chromophores at a single location [110]. Multi-spectral imaging based on diffuse reflectance spectroscopy has been widely employed for evaluating the spatial distribution of chromophore contents in living tissue using a series of discrete narrow-band filters or a liquid crystal tunable filter [1113]. A simple method for imaging concentrations of melanin and blood and imaging oxygen saturation in human skin tissue based on the diffuse reflectance images at six wavelengths (500, 520, 540, 560, 580 and 600 nm) using multiple regression analysis aided by the Monte Carlo simulations has been previously proposed [14]. In this method, however, use of a monochromatic charge coupled device (CCD) camera with mechanical rotatory filters required 12 s for reflectance images at the six wavelengths.

To achieve rapid multispectral imaging, use of an acousto-optical tunable filter [15] and the combination of a lenslets array with narrow-band filters [16] have been proposed. On the other hand, the reconstruction of multispectral images from a red green blue (RGB) image acquired by a digital RGB camera is promising to perform rapid and cost-effective multispectral imaging. Several reconstruction techniques for the multispectral images, such as pseudo-inverse method [1720], finite-dimensional modeling [19,21], nonlinear estimation method [22], and Wiener estimation method (WEM) [2325] has been studied. Among these reconstruction techniques, WEM is one of the most promising methods for practical uses because of its simplicity, cost-effectiveness, accuracy, time efficiency, and possibility of high resolution image acquisition. In this paper, simple and cost-effective multi-spectral imaging based on that method [14] designed to estimate melanin concentration, blood concentration, and oxygen saturation in the skin using the spectral reflectance images reconstructed from a single snap shot of RGB image by WEM is described.

2. Principle

2.1 Reconstruction of Spectral Image by Wiener Estimation Method

The response of a digital color camera in spatial coordinates (x, y) with ith (i = 1, 2, 3) color channel, or Red, Green, and Blue, can be calculated as:

v i ( x , y ) = u i ( λ ) E ( λ ) S ( λ ) r ( x , y ; λ ) d λ
where λ is wavelength, ui(λ) is transmittance spectrum of the ith filter, E(λ) is the spectrum of the illuminant, S(λ) is the sensitivity of the camera, and r (x, y; λ) is the reflectance spectrum in the spatial coordinates (x, y). For convenience, Equation (1) is expressed by discrete vector notation as:
v = Fr
where v is a vector with three element column and r is a vector with a k element column which corresponds to the reflectance spectrum of a pixel of an image. F is a 3 × k matrix and expressed as:
F = UES
where U = [u1, u2, u3] T. Column vector ui denotes the transmittance spectrum of the ith filter and [ ] T represents the transposition of a vector. E and S are k × k diagonal matrices and represent the spectrum of illuminant and the sensitivity of the camera, respectively. In this study, we use the known spectral profiles of illuminant and camera which has been published by the manufacturers. The Wiener estimation of r is given by:
r ˜ = Wv
where W is the Wiener estimation matrix. The purpose of W is to minimize the minimum square error between original and estimated reflectance spectrum. In this case, the minimum square error is expressed as:
e = ( r - r ˜ ) t ( r - r ˜ )

From Equations (4) and (5), the minimum square error is rewritten as:

e = ( r - r ˜ ) t ( r - r ˜ ) = r t r - W r t v - W t v t r + W t W v t v

The minimization of the minimum square error requires the condition that partial derivative of e with respect to W is zero as:

e W = - r t v + W t v t v = 0

From the condition of Equation (7), the matrix W is derived as:

W = rv T vv T - 1 = rv T F T ( F rr T F T ) - 1
where, 〈 〉 is an ensemble-averaging operator. To derive the matrix W, the autocorrelation matrix 〈rrT〉 is required. In this study, we determined 〈rrT〉on the basis of 341 different reflectance spectra obtained from human skins of five volunteers (all men, mean age 23 ± 1 years; under the various physiological conditions induced by upper arm occlusions. Discrete reflectance values ranged from 450 to 690 nm at 10 nm intervals were extracted from the raw reflectance spectrum measured by spectrometer and assigned to the 25 elements of vector r . A matrix rrT with 25 × 25 elements was derived by multiplying the vector r and its transposition vector rT. This procedure was applied to each reflectance sample and the 341 different matrices of rrT were derived. The autocorrelation matrix 〈rrT〉 was calculated by averaging the corresponding elements over all samples.

To test the accuracy in spectral reconstruction, the estimated spectrum by WEM is compared with the measured spectrum by spectrometer using a goodness-of -fit coefficient (GFC) [26]. The GFC is based on the inequality of Schwartz and it is described as:

GFC = | j r mes ( λ j ) r est ( λ j ) | | j [ r mes ( λ j ) ] 2 | | j [ r est ( λ j ] 2 |
where rmes (λj) is the measured original spectral data at the wavelength λj and rest (λj) is the estimated spectral data at the wavelength λj . Hernández-Andrés et al. [26] suggested that colorimetrically accurate rmes (λj) requires a GFC > 0.995; a “good” spectral fit requires a GFC ≥ 0.999, and GFC ≥ 0.999 is necessary for an “excellent” spectral fit.

2.2 Estimation of Chromophores Based on Multiple Regression Analysis

An absorbance spectrum A(λ) is defined as:

A ( λ ) = - log 10 r ( λ )
where r(λ) is the diffuse reflectance spectrum normalized by the incident light spectrum. According to the Lambert-Beer law, A (λ) is expressed by the sum of absorbances due to major chromophores in skin tissue as:
A ( λ ) = C m l e ( λ , C m ) ε m ( λ ) + C ob l d ( λ , C ob , C db ) ε ob ( λ ) + C db l d ( λ , C ob , C db ) ε db ( λ ) + D ( λ )
where C is the concentration, l is the mean optical path length, ε (λ) is the extinction coefficient, and D (λ) indicates attenuation due to light scattering in the tissue. Subscripts e, d, m, ob and db denote epidermis, dermis, melanin, oxygenated blood and deoxygenated blood, respectively. By using the absorbance spectrum as the response variable and extinction coefficients as the predictor variables the multiple regression analysis (MRA1) can be applied to Equation (11) as:
A ( λ ) = a m ε m ( λ ) + a ob ε ob ( λ ) + a db ε db ( λ ) + a 0
where am, aob, adb, and a0 are the regression coefficients [8]. The regression coefficients, am, aoh,adh, and a0 describe the degree of contribution of each extinction coefficient to A (λ) and are closely related to the concentrations Cm, Cob and Cdb. The total blood concentration is defined as the sum of the concentrations of oxygenated blood and deoxygenated blood Cob+Cdb. Tissue oxygen saturation is determined as:
S t O 2 % = 100 × a o b a o b + a d b = 100 × a o b a t b

Then, multiple regression analysis (MRA2) is further used with the regression coefficients obtained from Equation (12) [8]. In this case, Cm and Ctb are regarded as the response variables, and the 4 regression coefficients from Equation (12) and their higher order terms are regarded as the predictor variables. Thus, their relations are written as:

C m = b m . a
C t b = b t b a
a = [ 1 , a m , a t b , a o , a m × a t b , a m × a o , higher order terms ] T
b m = [ b m , 0 , b m , 1 , b m , 2 , , b m , z - 1 ]
b t b = [ b t b , 0 , b t b , 1 , b t b , 2 , , b t b , z - 1 ]

Coefficients bm,i and btb,i (i = 0, 1, 2, …) are unknown and must be determined before the analysis. The number of components in vectors a, bm and btb is assumed to be z. Monte Carlo simulations (MCS) [27] were adopted as the foundation to establish reliable values of bm,i and btb,i. In the present MCS, the absorption coefficients μa converted from the concentrations are provided as input to simulation, while the diffuse reflectance is produced as output. The input concentrations and the output reflectance are helpful as the data set in specifying the values of bm,i and btb,i statistically. The skin tissue model consisted of an epidermis and a dermis layer. The absorption coefficient of melanin μa,m [28] for Cm = 1 to 10% at intervals of 1% were input to the epidermis. The sum of the absorption coefficient of oxygenated and deoxygenated blood μa,ob+ μa,db, which represents the absorption coefficient of total blood μa,otb for Ctb= 0.2, 0.4, 0.6, 0.8, and 1.0% were input to the dermis [8]. Oxygen saturation, StO2= 0, 20, 40, 60, 80, and 100% were determined from the relation μa,ob/μa,tb. The scattering coefficient μs, anisotropy factor g, refractive index n, the layer thickness are given as constants in this study. Typical values for μs and g for both the epidermis and dermis were used [8]. The thicknesses of the epidermis and dermis were set to be 0.06 mm and 4.94 mm, respectively. The value of n for each layer was assumed to be 1.4. In total, 300 diffuse reflectance spectra were simulated under various combinations of Cm,Ctb, and StO2 in the range from 500 to 600 nm at intervals of 20 nm. MRA1 for each simulated spectrum based on Equation (12) generated the 300 sets of vector a and concentrations Cm and Ctb. The vectors bm and btb were determined by performing MRA2. The number of z was 14. Once bm and btb were obtained, Cm and Ctb were calculated from am,atb and a0 derived from MRA1 without MCS, for each pixel of a multi-spectral reflectance image.

3. Experiments

Figure 1 shows a schematic illustration of experimental system used in this study. A White light emitting diode (LED) (LA-HDF158A, Hayashi Watch Works Co., Ltd, Tokyo, Japan) illuminated the skin surface via a light guide and a ring illuminator with a polarizer. Diffusely reflected light was received by a 24-bit RGB CCD camera (DFK-31BF03, Imaging Source LLC, Charlotte, NC, USA) with a camera lens and an analyzer to acquire an RGB image of 1,024 × 768 pixels. The spectral profiles of illuminant and camera are shown in Figure 2(a,b), respectively. The primary polarization plate (ring-shaped polarizer) and the secondary polarization plate (analyzer) were set to be a crossed Nicols alignment in order to reduce specular reflection from the skin surface. A standard white diffuser was used to regulate the camera white balance. To evaluate accuracy of WEM, the reflectance spectra of skin were simultaneously measured by a fiber-coupled spectrometer (USB2000, Ocean Optics Inc., Dunedin, FL, USA) at 110 ms of integration time as reference data. Before the sequential measurements of RGB images and reflectance spectra, a measured area by the spectrometer was confirmed by projecting light from a halogen lamp on the skin surface via one lead of bifurcated fiber, lens, and beam splitter. The RGB image of skin surface including the spot of light illuminated by the halogen lamp was stored into the PC, and then, the size and coordinates of the spot were specified as the measured area by spectrometer. After the halogen lamp was turned off, the sequential measurements of RGB images and reflectance spectra were simultaneously performed. The region of interest, or ROI on the image of skin surface was selected to be the same as the measured area by the spectrometer. Using WEM, reflectance images ranged from 450 to 690 nm at intervals of 10 nm were reconstructed from a RGB image acquired at 65 ms of exposure time. This means that the spectral images at 25 wavelengths can be obtained with a temporal resolution of 15 fps. Images at 6 wavelengths (500 to 600 nm at intervals of 20 nm) were then used to estimate the Cm,Ctb, and StO2 images according to the above process.

Before the in vivo experiments, preliminary experiments were carried out with tissue-like agar gel phantoms. Figure 3 shows the cross sectional photograph of the phantom. The phantom consisted of an epidermis and a dermis layer. An agar solution was prepared by diluting agar powder with saline. In order to make a base material with a scattering condition, Intralipid solution was added to the agar solution. A coffee solution was added into the base material as a substitute for melanin and this mixture was used to simulate an epidermis. Thus, the variable Cc was used for the epidermis layer in the phantom experiments. Several materials, such as an India ink, have been used to mimic the absorption properties of melanin [29]. We first tried to mimic the absorption spectrum using an India ink solution. We investigated the absorbance spectrum of India ink (R591217, Rotring, Hamburg, Germany) based on the transmittance measurement in the preliminary experiment. The absorption spectrum of the India ink solution decays linearly as the wavelength increases, whereas that of melanin decays exponentially as the wavelength increases [30].

Therefore, it was difficult to reproduce the diffuse reflectance spectra of human skin over the visible wavelength range using India ink. Thus, we used a coffee solution to mimic the absorption spectrum of melanin. The coffee solution contained a brown pigment called melanoidin [31]. The absorption spectrum of melanoidin [32,33] has been reported to be similar to that of melanin. We observed the absorbance spectrum of coffee solution within a cuvette based on transmittance measurements and confirmed that the absorption spectrum of the coffee solution decays exponentially as the wavelength increases [30]. An oxygenated dermis was simulated by adding a small amount of fully oxygenated horse blood with a 44% hematocrit to the base material. Deoxygenated dermis was prepared by dropping a sufficient amount of Na2S2O4 saline solution on the surface of the oxygenated dermis. All of these layers were hardened in various molds having the required thickness and size by cooling at approximately 5.5 °C for 30 min. The thicknesses of the epidermis and dermis layer were 1.0 and 5.0 mm, respectively, while the area of each layer was 26 × 23 mm2. Details of preparing the phantoms and their optical parameters were published previously [8,30].

To confirm the validity of the proposed imaging method for visualization of the skin chromophore contents, in vivo experiments in the human skin were performed. A pressure cuff was applied to the upper arm of 5 subjects (all men, four Japanese and one Indonesian, mean age 27 ± 4 years). A cuff inflator was used to occlude the upper arm of the subjects as shown in Figure 1. After a rest of 300 s, acquisitions of RGB images and reflectance spectra were started and made for a total of 640 s at 5 s intervals. After 40 s of control measurements, the upper arm congesting cuff was inflated to 250 mmHg pressures for 300 s by a cuff inflator and then it was deflated for 300 s. Inflation of the cuff to 250 mmHg prevents blood flow from leaving the measurement site and also hinders arterial inflow. Analysis of both RGB images and reflectance spectra were made offline after measurements were completed.

4. Results and Discussion

Figure 4 compare the estimated and reference values of Cc,Ctb and StO2. Average relative errors of Cc,Ctb and StO2 were 9.1, 17.5, and 54.5%, respectively. The estimated values of StO2 above 80% agree well with reference values but large discrepancy below 40% increases the average relative error.

Figure 5 shows an example of spectral images obtained from finger area of human hand in the normal condition. Spectral images of fingers were successfully obtained by WEM. Average values of the diffuse reflectance spectra over the region of interest, or ROI (white square area), are comparable to the measured spectra by the spectrometer, as shown in Figure 6. Spectral characteristics of hemoglobin for the different oxygenation state are well estimated. The values of GFC obtained from 5 subjects summarized in Table 1 indicate the accurate spectral reconstruction by WEM.

Figure 7 shows an example of in vivo results during upper-arm occlusion. Time courses of Cm,Ctb and StO2 averaged over the ROIs (white squares are in Figure 7) for three subjects are shown in Figure 8. The average values of pre-occlusion Cm,Ctb and StO2 were 4.6 ± 3.7%, 0.8 ± 0.4%, and 44 ± 14%, respectively, which are close to typical normal values reported in the literature [8,14]. The average value of 44±14% for StO2 in pre-occlusion is lower than typical arterial oxygen saturation because the value of StO2 measured by this method represents oxygen saturation for the mixture of arterio-venous blood. After 300 s occlusion, Ctb increased slightly and StO2 decreased remarkably, due to blockage of both venous and arterial blood flow. The value of StO2 exhibited the well-known deoxygenation curve, in which the oxygen saturation falls exponentially. The slight increase in Ctb probably has a physiological cause. This is because, during occlusion, the venous outflow is reduced more than the arterial inflow. Immediately after the cuff was deflated, both Ctb and StO2 increased sharply. These increases are assumed to have been due to post occlusion reactive hyperemia. In spite of the remarkable changes in Ctb and StO2, Cm remained almost unchanged during the measurements. This tendency of the hemodynamic response is also demonstrated in the results obtained from the measured spectra by the spectrometer.

Deviations of Ctb from the reference values after cuff deflation are due to underestimations of reflectance at 540, 560, and 580 nm by WEM as shown in Figure 7. Considering noise in the camera response for W or using higher order terms of elements in vector v may improve the estimations of reflectance spectra [24,25]. In this study, we used the known spectral profiles of illuminant and camera. When the matrix F is unknown and experimentally determined, this method will be sensitive to small errors of measurement for determining the matrix F. Those issues should be investigated in future work.

This method should integrate all information along the depth direction because it relies on the steady-state diffuse reflectance. Therefore, the imaging system does not resolve the depth of the measurement. D’Alessandro et al. [34] have developed the technique separating melanin from oxygenated hemoglobin and deoxygenated hemoglobin through multispectral imaging combined with a voxel-based parallel processing Monte Carlo simulation under the condition of Nevoscope geometry and showed that subsurface oxygen saturation of localized region could be estimated with good implications for the reconstruction of three dimensional skin lesion volume. Such an approach based on the dependence of diffuse reflectance on the distance between the skin surface and localized chromophores will be useful for extending the method to depth-resolved imaging technique.

We used a single thickness for the epidermis and the dermis and only one typical wavelength-dependent scattering value and anisotropy for skin in the Monte Carlo simulation to derive the regression Equations (14) and (15) for the concentrations of melanin Cm and total blood Ctb. We also assumed a single thickness for the epidermis and the dermis in the Monte Carlo simulation. Diffusely reflected light from the skin will increase as the absorption of light in skin becomes small and will increase as the scattering coefficient μs (λ) becomes small. Thus, if the scattering coefficients μs (λ) of a sample are larger than the typical values used in the Monte Carlo simulation, the regression model will underestimate the chromophore concentrations. Diffusely reflected light from the skin will also increase as the anisotropy factors g(λ) decrease. Therefore, if the anisotropy factors g(λ) of a sample are larger than the typical values, the regression model will underestimate the chromophore concentrations. The probability that light is absorbed by melanin in the epidermis will be higher than the probability that light is absorbed by blood in the dermis as the epidermis becomes thicker. Therefore, if the thickness t of the epidermis is larger than the typical values, then the concentration of melanin in the epidermis or that of blood may be under- or overestimated, respectively. Hence, the measurements could be varied with the changes in the scattering coefficients μs (λ), the anisotropy factors g(λ), and the thickness t of each layer. Studies on the Monte Carlo simulation model with the variations in the scattering coefficients, the anisotropy factors, and the thickness of each layer would strength the method in the future. We will investigate the regression equations involving those variations further in future work. Although there were some artifacts due to the shade originating from the curved and irregular surface of fingers, lateral distributions of Cm,Ctb and StO2 and their responses to the occlusions were successfully visualized.

5. Conclusions

In summary, a method for estimating melanin concentration, blood concentration, and tissue oxygen saturation in human skin based on spectral reflectance images reconstructed from a single snap shot of an RGB image by WEM is demonstrated in the present report. Experiments with phantoms demonstrated the validity of the proposed imaging method for visualization of chromophore contents. In vivo experiments confirmed the ability of the method to monitor chromophore contents and physiological changes in human skin tissue. The results of the present study demonstrate the possibility of evaluating the hemodynamics of subsurface skin tissue. The great advantages of this method are its simplicity and applicability, because the only devices required are a digital RGB camera with a known color profile, a white light source, and a personal computer. The total cost of our system was approximately $4,000. We expect to further extend this method in order to investigate the physiological and clinical indices of blood flow, such as the arterial inflow rate, the venous capacitance, and the maximum venous outflow.

Acknowledgments

Part of this work was supported by the JGC-S Scholarship foundation, Japan and by a Grant-in-Aid for Scientific Research from the Japanese Society for the Promotion of Science.

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Dawson, J.B.; Barker, D.J.; Ellis, D.J.; Grassam, E.; Cotterill, J.A.; Fisher, G.W.; Feather, J.W. A theoretical and experimental study of light absorption and scattering by in vivo skin. Phys. Med. Biol. 1980, 25, 695–709. [Google Scholar]
  2. Feather, J.W.; Hajizadeh-Saffar, M.; Leslie, G.; Dawson, J.B. A portable scanning reflectance spectrophotometer using visible wavelengths for the rapid measurement of skin pigments. Phys. Med. Biol. 1989, 34, 807–820. [Google Scholar]
  3. Harrison, D.K.; Evans, S.D.; Abbot, N.C.; Beck, J.S.; McCollum, P.T. Spectrophotometric measurements of haemoglobin saturation and concentration in skin during the tuberculin reaction in normal human subjects. Clin. Phys. Physiol. Meas. 1992, 13, 349–363. [Google Scholar]
  4. Newton, D.J.; Harrison, D.K.; Delaney, C.J.; Beck, J.S.; McCollum, P.T. Comparison of macro- and maicro-lightguide spectrophotometric measurements of microvascular haemoglobin oxygenation in the tuberculin reaction in normal human skin. Physiol. Meas. 1994, 15, 115–128. [Google Scholar]
  5. Stratonnikov, A.A.; Loschenov, V.B. Evaluation of blood oxygen saturation in vivo from diffuse reflectance spectra. J. Biomed. Opt. 2001, 6, 457–467. [Google Scholar]
  6. Zonios, G.; Bykowski, J.; Kollias, N. Skin melanin, hemoglobin, and light scattering properties can be quantitatively assessed in vivo using diffuse reflectance spectroscopy. J. Invest. Dermatol. 2001, 117, 1452–1457. [Google Scholar]
  7. Stamatas, G.N.; Kollias, N. Blood stasis contributions to the perception of skin pigmentation. J. Biomed. Opt. 2004, 9, 315–322. [Google Scholar]
  8. Nishidate, I.; Aizu, Y.; Mishina, H. Estimation of melanin and hemoglobin in skin tissue using multiple regression analysis aided by Monte Carlo simulation. J. Biomed. Opt. 2004, 9, 700–710. [Google Scholar]
  9. Bargo, P.R.; Prahl, S.A.; Goodell, T.T.; Sleven, R.A.; Koval, G.; Blair, G.; Jacques, S.L. In vivo determination of optical properties of normal and tumor tissue with white light reflectance and empirical light transport model during endoscopy. J. Biomed. Opt. 2005, 10, 034018. [Google Scholar]
  10. Tseng, S.-H.; Bargo, P.; Durkin, A.; Kollias, N. Chromophore concentrations, absorption and scattering properties of human skin in vivo. Opt.Expess 2009, 17, 14599–14617. [Google Scholar]
  11. Sowa, M.G.; Payette, J.R.; Hewko, M.D.; Mantsch, H.H. Visible-near infrared multispectral imaging of the rat dorsal skin flap. J. Biomed. Opt. 1999, 4, 474–481. [Google Scholar]
  12. Dunn, A.K.; Devor, A.; Bolay, H.; Andermann, M.L.; Moskowitz, M.A.; Dale, A.M.; Boas, D.A. Simultaneous imaging of total cerebral hemoglobin concentration, oxygenation, and blood flow during functional activation. Opt. Lett. 2003, 28, 28–30. [Google Scholar]
  13. Kuzmina, I.; Diebele, I.; Jakovels, D.; Spigulis, J.; Valeine, L.; Kapostinsh, J.; Berzina, A. Towards noncontact skin melanoma selection by multispectral imaging analysis. J. Biomed. Opt. 2011, 16, 060502. [Google Scholar]
  14. Nishidate, I.; Wiswadarma, A.; Hase, Y.; Tanaka, N.; Maeda, T.; Niizeki, K.; Aizu, Y. Noninvasive spectral imaging of skin chromophores based on multiple regression analysis aided by Monte Carlo simulation. Opt. Lett. 2011, 36, 3239–3241. [Google Scholar]
  15. Arnold, T.; De Biasio, M.; Leitner, R. Hyper-spectral video endoscope for intra-surgery tissue classification using auto-fluorescence and reflectance spectroscopy. Proc. SPIE 2011, 8087, 808711. [Google Scholar]
  16. Basiri, A.; Nabili, M.; Mathews, S.; Libin, A.; Groah, S.; Noordmans, H.J.; Ramella-Roman, J.C. Use of a multi-spectral camera in the characterization of skin wounds. Opt. Express 2010, 18, 3244–3257. [Google Scholar]
  17. Hardeberg, J.Y. Acquisition and Reproduction of Color Images: Colorimetric and Multispectral Approaches. Ph.D. Thesis, Ecole Nationale Superieure des Telecommunications, Paris, France, 1999. [Google Scholar]
  18. Hardeberg, J.Y.; Schmitt, F.; Brettel, H. Multispectral color image capture using liquid crystal tunable filter. Opt. Eng. 2002, 41, 2532–2548. [Google Scholar]
  19. Cheung, V.; Westland, S.; Li, C.; Hardeberg, J.; Connah, D. Characterization of trichromatic color cameras by using a new multispectral imaging technique. J. Opt. Soc. Am. 2005, A22, 1231–1240. [Google Scholar]
  20. Shen, H.L.; Xin, J.H. Spectral characterization of a color scanner based on optimized adaptive estimation. J. Opt. Soc. Am. 2006, A23, 1566–1569. [Google Scholar]
  21. Shen, H.L.; Xin, J.H.; Shao, S.J. Improved reflectance reconstruction for multispectral imaging by combining different techniques. Opt. Express 2007, 15, 5531–s5536. [Google Scholar]
  22. König, F. Reconstruction of Natural Spectra from Color Sensor Using Nonlinear Estimation Methods. In Is and T Annual Conference; The Society for Imaging Science and Technology:: Cambridge, MA, USA, 1997; pp. 454–457. [Google Scholar]
  23. Stigell, P.; Miyata, K.; Kansari, M.H. Wiener estimation method in estimating of spectral reflectance from RGB image. Patt. Recogn. Image Anal. 2007, 17, 233–242. [Google Scholar]
  24. Murakami, Y.; Fukura, K.; Yamaguchi, M.; Ohyama, N. Color reproduction from low-SNR multispectral images using spatio-spectral Wiener estimation. Opt. Express 2008, 16, 4106–4120. [Google Scholar]
  25. Chen, S.; Liu, Q. Modified Wiener estimation of diffuse reflectance spectra from RGB values by the synthesis of new color for tissue measurements. J. Biomed. Opt. 2012, 17, 030501. [Google Scholar]
  26. Hernández-Andrés, J; Romero, J. Colorimetric and spectroradiometric characteristics of narrow-field-of-view clear skylight in Granada, Spain. J. Opt. Soc. Am. 2001, A18, 412–420. [Google Scholar]
  27. Wang, L.-H.; Jacques, S.L.; Zheng, L.-Q. MCML-Monte Carlo modeling of photon transport in multi-layered tissues. Comput. Meth. Progr. Biomed. 1995, 47, 131–146. [Google Scholar]
  28. Jacques, S.L.; Glickman, R.D.; Schwartz, J.A. Internal absorption coefficient and threshold for pulsed laser disruption of melanosomes isolated from retinal pigment epithelium. Proc.SPIE 1996, 2681, 468–477. [Google Scholar]
  29. Ninni, P.D.; Martelli, F.; Zaccanti, G. The use of India ink in tissue-simulating phantoms. Opt. Express 2010, 18, 26854–26865. [Google Scholar]
  30. Nishidate, I.; Tanaka, N.; Kawase, T.; Maeda, T.; Yuasa, T.; Aizu, Y.; Yuasa, T.; Niizeki, K. Noninvasive imaging of human skin hemodynamics using a digital red-green-blue camera. J. Biomed. Opt. 2011, 16, 086012. [Google Scholar]
  31. Gniechwitz, D.; Reichardt, N.; Ralph, J.; Blaut, M.; Steinhart, H.; Bunzel, M. Isolation and characterisation of a coffee melanoidin fraction. J. Sci. Food. Agric. 2008, 88, 2153–2160. [Google Scholar]
  32. Motai, H.; Inoue, S. Conversion of color components of melanoidin produced from the glycine-xylose system. Agric. Bio. Chem. 1974, 38, 233–239. [Google Scholar]
  33. Serban, A.; Nissenbaum, A. Light induced production of hydrogen from water by catalysis with ruthenium melanoidins. Int. J. Hydro.Energy. 2000, 25, 733–737. [Google Scholar]
  34. D’Alessandro, B.; Dhawan, A.P. Transillumination imaging for blood oxygen saturation estimation of skin lesions. IEEE Trans. Biomed. Eng. 2012, 59, 2660–2667. [Google Scholar]
Figure 1. Experimental configuration for the image acquisitions and the spectral reflectance measurements.
Figure 1. Experimental configuration for the image acquisitions and the spectral reflectance measurements.
Sensors 13 07902f1 1024
Figure 2. Spectral profiles for (a) the RGB-responses of camera and (b) the intensity of illuminant.
Figure 2. Spectral profiles for (a) the RGB-responses of camera and (b) the intensity of illuminant.
Sensors 13 07902f2 1024
Figure 3. Photographs of tissue-like agar gel phantom for (a) cross-sectional view and (b) top view.
Figure 3. Photographs of tissue-like agar gel phantom for (a) cross-sectional view and (b) top view.
Sensors 13 07902f3 1024
Figure 4. Comparison of the estimated values by the Wiener estimation and the reference values by spectrometer for (a) Cc, (b) Ctb, and (c) StO2 in the phantom experiments.
Figure 4. Comparison of the estimated values by the Wiener estimation and the reference values by spectrometer for (a) Cc, (b) Ctb, and (c) StO2 in the phantom experiments.
Sensors 13 07902f4 1024
Figure 5. In vivo results obtained from human fingers under the normal condition for (a) raw RGB image and (b) the estimated images of spectral diffuse reflectance by the Wiener estimation.
Figure 5. In vivo results obtained from human fingers under the normal condition for (a) raw RGB image and (b) the estimated images of spectral diffuse reflectance by the Wiener estimation.
Sensors 13 07902f5 1024
Figure 6. Comparisons of the estimated reflectance spectra averaged over the ROI (white square area in Figure 4) and the reference spectra measured by spectrometer for (a) pre-occlusion, (b) 300 s after occlusion, and (c) 90 s after deflation of pressure cuff.
Figure 6. Comparisons of the estimated reflectance spectra averaged over the ROI (white square area in Figure 4) and the reference spectra measured by spectrometer for (a) pre-occlusion, (b) 300 s after occlusion, and (c) 90 s after deflation of pressure cuff.
Sensors 13 07902f6 1024
Figure 7. Typical images of fingers (from top to bottom; Cm,Ctb, and StO2) for pre-occlusion, 300 s after occlusion, and 90 s after deflation of pressure cuff.
Figure 7. Typical images of fingers (from top to bottom; Cm,Ctb, and StO2) for pre-occlusion, 300 s after occlusion, and 90 s after deflation of pressure cuff.
Sensors 13 07902f7 1024
Figure 8. Time courses of (a) Cm, (b) Ctb, and (c) StO2 averaged over the ROIs (white squares in Figure 6) are compared with the reference values from the spectrometer recordings. The error bars show the standard deviations (n = 5).
Figure 8. Time courses of (a) Cm, (b) Ctb, and (c) StO2 averaged over the ROIs (white squares in Figure 6) are compared with the reference values from the spectrometer recordings. The error bars show the standard deviations (n = 5).
Sensors 13 07902f8 1024
Table 1. The goodness-of-fit coefficient (GFC) obtained from the 5 subjects.
Table 1. The goodness-of-fit coefficient (GFC) obtained from the 5 subjects.
Goodness-of-Fit Coefficient (GFC)
SubjectMean±SDMaxMinNumber of spectraAccuracy
#1099930.00050.99990.9983133Good
#20.99800.00170.99980.9930147Colorimetrically accurate
#30.99930.00060.99990.9970124Good
#40.99930.00070.99990.9965124Good
#50.99970.00040.99990.9986124Good

Share and Cite

MDPI and ACS Style

Nishidate, I.; Maeda, T.; Niizeki, K.; Aizu, Y. Estimation of Melanin and Hemoglobin Using Spectral Reflectance Images Reconstructed from a Digital RGB Image by the Wiener Estimation Method. Sensors 2013, 13, 7902-7915. https://doi.org/10.3390/s130607902

AMA Style

Nishidate I, Maeda T, Niizeki K, Aizu Y. Estimation of Melanin and Hemoglobin Using Spectral Reflectance Images Reconstructed from a Digital RGB Image by the Wiener Estimation Method. Sensors. 2013; 13(6):7902-7915. https://doi.org/10.3390/s130607902

Chicago/Turabian Style

Nishidate, Izumi, Takaaki Maeda, Kyuichi Niizeki, and Yoshihisa Aizu. 2013. "Estimation of Melanin and Hemoglobin Using Spectral Reflectance Images Reconstructed from a Digital RGB Image by the Wiener Estimation Method" Sensors 13, no. 6: 7902-7915. https://doi.org/10.3390/s130607902

Article Metrics

Back to TopTop