Next Article in Journal
Energy Efficient Routing Protocol in Novel Schemes for Performance Evaluation
Previous Article in Journal
Theoretical Analysis of a Biomass-Driven Single-Effect Absorption Heat Pump for Heating and Cooling Purposes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Analyzing the Electronics of Image Sensors and Their Functionality to Develop Low Light-Emitting Source Image

by
Rai Chiranjeevi
1,
Vairavasundaram Indragandhi
1,
Devarajan Gunapriya
2,
Vairavasundaram Subramaniyaswamy
3,
Michał Jasiński
4,*,
Vishnu Suresh
4 and
Zbigniew Leonowicz
4
1
Vellore Institute of Technology, School of Electrical Engineering, Vellore 632014, India
2
Department of Electrical and Electronics Engineering, Sri Eshwar College of Engineering, Coimbatore 641202, India
3
School of Computing, SASTRA Deemed University, Thanjavur 613402, India
4
Faculty of Electrical Engineering, Wroclaw University of Science and Technology, 50-370 Wroclaw, Poland
*
Author to whom correspondence should be addressed.
Appl. Syst. Innov. 2022, 5(5), 100; https://doi.org/10.3390/asi5050100
Submission received: 10 September 2022 / Revised: 3 October 2022 / Accepted: 8 October 2022 / Published: 12 October 2022

Abstract

:
Bioluminescence imaging has been used to visualize the biological effects of human beings and is a promising technique in a recent modality. In this study, the digital image technique is used to improve quality and recover images. The optical fluence that emerges from the source is generated using a camera, and a low resgolution is observed. In this paper, the diurnal change of ultra-weak photon emission was successfully imaged with an improved, highly sensitive imaging system using a charge-coupled device (CCD) camera. The changes in energy metabolism might be linked with diurnal changes in photon emission, and when observed, the body emits extremely weak light spontaneously without external photoexcitation. Therefore, to obtain accurate information, a combined Barn Door Star Tracker approach has been proposed to improve the accuracy of the method and has been implemented to test on celestial bodies. The ability to temporally assess the location of star movement can be monitored accurately with bioluminescence imaging.

1. Introduction

Digital image technology is a widely applied, ever-developing field with numerous applications in the current era. The elementary requirement to produce a digital image is a latent image to form on the image sensor. This latent image requires electromagnetic waves from the source object to focus on the sensor using a lens system made out of carefully designed glass elements. Hence, having some source of light becomes the basic requirement and the utmost necessity for an image to form. This light source may be strong or weak depending on the nature of the reaction producing the photons. Ideally, a highly luminous body is taken to capture an image with its illuminance value [1] ranging between 320–25,000 lux, the lowest value being office lighting and the highest value being full daylight. If above this range, the shutter speed of the camera will not be fast enough to stop the light source from flooding the image sensor. This issue can be tackled using various methods, such as using ND filters [2] or higher f-stop values on the lens.
On the other hand, it is the lower end of the spectrum on which we focus for our paper. The lower the intensity of the light, the lesser the information the sensor has to produce an image. As a result, we may require using more complex methods to produce a usable image, one of which is proposed here. It is possible to increase the ISO, which stands for International Standards Organization, that is, the sensitivity to light as it pertains to either film or a digital sensor of the camera sensor [3], i.e., the amplification of the information signal. Still, unfortunately, this procedure develops more and more noise in the image, resulting in a grainy image or increased exposure time. This method has some drawbacks and will be discussed later on in the paper; hence, we use a process called “stacking”. Both of these methods, i.e., long exposure and stacking, are tested, and the results are compared. The camera’s functioning and the image production are discussed, followed by a proposed design to obtain more efficient/better results. A technology called “Barn Door Star Tracker” has been implemented, which does not have any relation with the digital image technology but enormously helps to increase the reach of the work.
The existence of human bioluminescence [4] was proved by capturing an image showing the glow of five volunteers in the visible light spectrum by a Japanese researcher Masaki Kobayashi in the year 2009. This light was bright in the neck and cheek region, emitting a green color. The intensity of the light was only one-thousandth of that which an unaided human eye can perceive; hence, it could not be seen. Due to the lack of technology to capture such a low number of photons, achieving results was extremely difficult, and there was a lag in research. However, over time, digital image technology has advanced rapidly. Now, many middle-class members of society can afford DSLR and mirrorless cameras that truly pack wonders in them in terms of technology and pricing. This has proved to be a motivation to carry out this work and study the possibility of capturing similar images with that which is available. Until now, science has not been able to explain the reason why many mammals possess bioluminescence properly. There have been speculations and suggestions behind this phenomenon, but no concrete correlation has ever been found due to the lack of available data. The proposed work could help in understanding this phenomenon better.
The goal of this research is to present a convenient setup with an accessible gear, which will allow a larger number of researchers to capture images and collect data on low light-emitting sources such as the human body and faint nebulae. The biggest reason for which we have not been able to unveil the mysteries of human bioluminescence and the science behind it is the lack of data caused by the complex and expensive nature of the experiment. The paper has proven that by merely using the readily available CMOS DSLR/Mirrorless cameras, with the process of stacking and using a Barn Door Tracker, impressive results can be achieved. This will open a window to more research on human bioluminescence (the last research was performed in 2009), and we shall have more data to study and understand the behavior of the human body, thus bringing advances not only to the field of biology, but to essentially make it easier to study any low light-emitting source.

2. Experimental Setup and Technical Specifications

2.1. Experiment Setup

For the experiment, we studied the workings of various camera setups paired with lenses and decided upon a particular pair. Now, all the researchers may not have the exact same set of gear. For the same reason, we have shared the process through which we selected a particular camera body and lens, and any other researcher can refer to the study and similarly obtain their own apparatus and perform the experiment.
Multiple images were produced using this experiment, with the total exposure time ranging from 40 to 90 min (500–700 frames). The images had close to zero noise, which was possible only due to stacking. This is in contrast to the last experiment performed in 2009 by Kobayashi, in which a single exposure was taken that lasted 30 min. However, a 30 min exposure would produce too much thermal noise in a CMOS camera at room temperature. Therefore, we concluded that instead of taking single exposures, we can take multiple frames of the same subject and stack them using the process mentioned in this paper. In theory, this will allow us to image any low light-emitting source just by adjusting the number of frames taken (to obtain the desired signal-to-noise ratio). The apparatus, making of a Barn Door Tracker, the process of stacking, and the ultimate production of clear images of extremely dim objects as a result are shared in the paper.
This work aims to design a setup that allows for the efficient capture of low light-emitting sources by understanding how the technology for digital imaging works, how it has been used in past research, and how it can be optimized as per our requirements with the latest digital cameras. Multiple images were produced using this experiment, with the total exposure time ranging from 40 to 90 min (500–700 frames). The images had close to zero noise, which was possible only due to stacking. A specific set of camera bodies paired with the appropriate lens were used to obtain prototype values to mimic the results of the actual experiment as accurately as possible. The details of this equipment and the process of selecting the particular specification of the model are discussed. To obtain even more detailed results of particular celestial objects, a star tracker was created to negate the earth’s rotation and obtain sharper images in longer exposures.

2.2. Technical Specifications

The SONY a6100 specifications are given in Table 1. The digital camera schematic is presented in Figure 1, and the sigma lens specifications are provided in Table 2.
Figure 2 shows the schematic diagram of the lens used in work (Sigma 30 mm prime lens), and its specifications are listed in Table 2. In the figure, the accurate representation of all the class elements present inside the lens is depicted in the same order to produce a focused image on the APS-C sensor. Figure 3 and Figure 4 are two MTF (Modulation Transfer Function) [5] charts that are characteristic of the specific lens model. MTF is a measurement of the optical performance potential of a lens. These charts plot the resolution and contrast of all the glass elements combined from the center to the lens’s edges against an “ideal/perfect” lens that would theoretically pass 100% of the light that enters its front element. The contrast of a lens is relevant, as it is correlated to its resolution.
The purpose of using this chart is to measure and calculate the optical performance potential of a lens. Though it does not consider the diffraction of the incoming light, it normally shows greater values in the graph than the actual image produced by the lens. The graph lines at 10 Ip/mm (lines per millimeter) represent the glass’s contrast ability (red lines), and the consecutive fine parallel lines at 30 Ipm represent the glass’s sharpness ability (green lines) at the lowest f-stop values of the lens. The fine repeating lines are Sagittal lines, and the other lines are Meridional lines [6], which can be inferred from Table 3 to understand the graphs better. The MTF chart gives the result at the wide-open aperture.

3. Design Approach Details

Designing a setup that is capable of capturing human bioluminescence and the faintest of nebulae is a very complicated process, and the experimental setup is shown in Figure 5. By using a highly sensitive cryogenic CCD camera setup with the ability to detect light at the level of a single photon, Kobayashi succeeded in imaging the spontaneous photon emission of five subjects. The idea of the research was to provide a cost-efficient and simple alternative to the setup and process to perform the same experiments performed in past research that dealt with low light-emitting sources. Though SPADs are a great solution to do so, there were several drawbacks to our use case, which led us to discard them from our paper. First, the current commercial SPAD sensor modules alone retail for five to six times the price of the gear we used for our experiment. In addition, separately buying a lens for the experiment would add to the cost. DSLR and mirrorless cameras have become so common that almost anyone can get their hands on one if they need to carry out a similar study. This will allow for more research, and we shall have more data on human bioluminescence.
Moreover, SPAD detectors work on a single wavelength [7]. However, we are trying to register photons throughout the visible spectrum of light (not through one particular wavelength), as this gives us a more in-depth idea of the color of light emitted from various parts of the human body. The details are given below:
  • The CCD sensor camera was cooled to a temperature of −120 °C in slow-scanning mode to avoid overheating.
  • Before the exposure, the subject is kept awake in a 400 lux room.
  • The naked subject is placed in a dark room; cortisol samples are taken through saliva 10 min prior to the experiment.
  • The exposure is taken at 4 PM (peak), as shown in Figure 6 and Figure 7.
We have chosen a CMOS sensor for the study with sufficient dynamic range (included in the paper) to allow for enough sensitivity in low-light conditions to sense the entire spectrum of visible light (0.4–0.7 um). The expected photon emission at this time was 300 photon/s.cm2 from the cheeks of the subject. Saliva was taken in these experiments to measure the cortisol level as a biomarker of endogenous circadian rhythms [7]. The variations in photon emission (using the images produced) from the volunteer’s face were compared with the cortisol levels. A negative correlation diurnal rhythm of photon emission from the human body was found and is shown in Figure 8.
Data strongly suggested that the cortisol levels in the saliva (which is the biomarker of diurnal rhythm) and the photon emission intensity have a negative correlation. This suggests that the photon emission reflects the changes in the metabolic process, the latter of which is controlled by the circadian clock. The shaded region indicated the sleeping time of the subject. This is further illustrated by the daily changes in cortisol secretion and cortisol’s correlation to photon emission intensity in Figure 9 and Figure 10. A negative correlation was found: r = −0.3074, p < 0.002.

3.1. The Process of Creating a Digital Image

The fundamental basis of creating a digital image is light. Without light, an image can never be created. Light can synonymously be called “information” when it comes to photography. When light from a subject reaches a camera, it has to travel through the glass elements of the lens. These elements decide how much light will enter, the focal length of the frame, and where these rays will be focused. For a sharp image to be produced, a real image must be formed on the surface of the sensor. Image sensors consist of photo sites (pixels) that convert the incoming light into charge/electrons. This charge is accumulated in the pixel well before being transferred for further processing. Depending on the nature of the sensor (CMOS or CCD) [8], the charge is converted into voltage and then amplified using Op-Amps.
The voltage obtained here is ultimately the data we need. These data are further processed to become an image, but the image’s digital significance starts when a voltage value is assigned to it. When the exposure is concluded, all the electrons in the pixel well are boosted by an op-amp at a factor directly proportional to the ISO value set in the camera. The higher the ISO, the more the amplification occurs. ISO is a measure of the sensitivity of a camera’s sensor to light. The term ISO is an abbreviation for the International Organization for Standardization. The higher the number of the ISO, the more light is recorded by the camera’s sensor. This increases the brightness of the image. Then, the boosted signal is converted from analog to digital. CPU within the camera then processes this digital image and stores it in the memory card. This process is illustrated in Figure 11.
However, this does not conclude the process. When the light is being converted to voltage, various disturbances occur in the system; these disturbances are called “digital noise”. A small amount of current flows in the photosensitive pixel even when no incident photon is hitting it. This current is called a dark current, and it registers as unwanted noise. This noise is the reason to consider a dark frame for calibration in the stacking process. A dark current is the primary reason to have noise in the digital image [9], and it is by virtue of temperature (Figure 12).
The signal from dark current = DC * time, and the noise is (DC * time)0.5.
Photons are considered to be discrete. Due to the discrete nature of the electric charge, digital images also suffer from shot noise. The typical read noise in a CMOS is on the order of 6 to 16 electrons. During the process of analog-to-digital conversion, amplification, and imperfections in the electronics, there will be “readout noise”. CMOS-based cameras can provide a much lower noise floor when compared to CCD cameras. Vital information can be hidden due to the high noise profile, and hence lower noise is required to capture such images. There are two types of reading noise, upstream read noise and downstream read noise [10]. Upstream read noise is the noise that is induced during the hour before the analog amplification process; for example, the noise that is produced due to the sensor heating up during long exposure photography is upstream read noise. Downstream read noise is the noise that is induced after the amplification. Analog-to-digital conversion and image processing, for example, produce downstream read noise. Since upstream read noise is induced during the amplification using higher ISO, it will also increase the read noise and result in a grainy image. However, downstream read noise remains unaffected by ISO amplification. Therefore, it can be seen that if a camera has very low or zero downstream read noise, it would not really matter whether the ISO is increased for amplification while taking a photograph or whether the exposure is increased later during post-processing, since the same upstream read noise is being amplified in both cases. Otherwise, if the downstream read noise is strong, increased exposure in post-processing will also increase the downstream read noise and ruin the image. This concept is further illustrated in Figure 13. This property of some cameras that have low downstream read noise is called ‘ISO Invariance’. The Sony Alpha camera series is popularly known for having this feature, and hence they are an ideal choice for low-light imaging. Then, if the exposure values (EV) are balanced in post-production, it is observed that each image has the same amount of noise. Thus, boosting the exposure in post is the same as increasing the ISO in the camera due to the lack of downstream read noise. Therefore, this justifies our selection of the camera body for this work.
There are primarily two types of sensors, CMOS and CCD (charge-coupled device) sensors in camera bodies [11]. These have different methods for producing a digital image, and hence these two have different properties. In CCD sensors, each row of charge is individually converted to voltage first. After the conversion, the signal is amplified altogether. Timers and ADC converts are only integrated outside the chip, after the amplifier, as shown in Figure 14a. Since the charge in each pixel is converted individually, processing speed is low. The same amplifier is used for each pixel, as evident from the diagram. Therefore, the amplification is identical, and the noise pattern remains the same throughout the frame. CMOS cameras can have higher frame rates than their CCD counterparts. This is because the reading of the pixels can be performed faster than having to wait for a CCD’s charge transfer. This feature is essential for machine vision systems that often rely on real-time image processing for automation or image data analysis.
In the CMOS sensor, timers and ADC converters are integrated with each pixel, as shown in Figure 14b. The charge in each pixel is converted simultaneously using a pixel select switch; hence, the processing speed is high. Since a different amplifier is used for each pixel, the amplification and the noise pattern vary throughout the frame.

3.2. Dslr vs. Mirrorless Camera Bodies

Camera bodies have been an ever-evolving subject, starting from the first SLR cameras that used a chemical film that was photosensitive and when exposed to light would generate a “negative”. In either case, the same lenses were used to form the latent image. Electronic sensors replaced these films, and hence Digital-SLRs were invented. These bodies would allow light directly from the outside world to enter the lens, bounce through a mirror, travel through a prism, and enter the “eyepiece” or “viewfinder” of the DSLR. When the user presses the shutter button, the mirror flips, exposing the sensor to the latent image and forming a digital image. However, this made the camera bodies very bulky, and the event of taking a snap was significantly noisy. Therefore, these cameras were then followed by the invention of mirrorless cameras, in which the mirror and prism system were completely eliminated. This resulted in a much more compact and light camera body. Instead of the real image coming through the viewfinder, it was replaced with the “EVF/Electronic View Finder” [12], which would take the live feed from the sensor and display it on the back monitor and EVF. This advancement made the cameras more compact and shifted the cameras from mechanical to electronic systems, hence allowing for more reliable image processing. This resulted in better low-light performance and introduced ‘back-illuminated’ sensors. Figure 15 elaborates further on this.

3.3. Experiment Apparatus

The ISO of the camera at which the photo is being taken amplifies the noise and decreases the dynamic range of the image produced. To choose the right ISO for our work, we refer the reader to the graph in Figure 16 and Figure 17. Electron-multiplying CCD (EMCCD) cameras, with their precisely controlled thermoelectric cooling and EM gain, make them the ideal detector solutions for bioluminescent imaging in which photon fluxes from luciferase may be as low as 0.05 photons per µm2 of the sensor. The quantitative stability of EM gain across the entire range of camera readout speeds, pre-amplifiers, and temperature settings is a must to ensure reliable quantitative performance throughout a bioluminescent kinetic acquisition and repeatability between measurements.

3.4. Image Stacking

Taking a photo of a celestial object is essentially catching more and more photons using long exposure. Each pixel takes values in red, green, and blue colors only. These channels are divided into 256 discrete digital values from 0 to 255 for each color. A combination of these three values produces the color of the pixel [13]. Allowing a pixel to expose beyond this value will flood the value above 255 for at least one color and will result in a white pixel with no information.
Waiting for photons is like rolling a die to predict how many photons from a certain object will hit the sensor during a given period of time within a given interval of certainty. These incoming photons are from the target “signal”, and it has to be predicted that the number of photons from the object will be higher than the dark surrounding, but it cannot be predicted where the next photon will hit, since this is totally random. Therefore, the “Law of Large Numbers” has been followed by the rolling the dice method, as shown in Figure 18.
The first few trials will yield random, unusable information. However, after the experiment of rolling the dice has been performed several times, the bias in information in different pixels starts to appear. Allowing for more dice rolls is as effective as taking longer and longer exposures. Hence, exposures with short durations tend to be noisier than those with longer durations, since more photons have hit the right pixels. By taking more and more exposures, all the data are added by stacking; also, this number is divided by the total number of exposures taken; otherwise, the image will become brighter and brighter, resulting in an unusable white image. The division by ‘n’ only keeps the brightness level constant. This results in a better signal-to-noise ratio (SNR).
r e s u l t i n g   i m a g e = i m a g e 1 + ...... i m a g e n / n
The dark current suppression technology blocks the DC * time component, leaving only the random noise. In order to make dark current suppression technology effective, manufacturers have had to refine manufacturing methods so that the sensors are very uniform, reducing pattern noise (banding). The measurement of dark frames has the main purpose of subtracting an offset caused by the accumulation of the dark current level (DC * time) and pattern noise (including banding and amp glow) from the pixel-to-pixel variation in (DC * time), but dark current subtraction cannot remove random noise.
Dark current suppression technology does the same thing, but in the pixel with the hardware architecture of the pixel, and it does so during the exposure on the subject (while the camera is taking the picture). Therefore, there is no need for dark frame subtraction in cameras in which the on sensor dark current suppression technology is well-implemented (e.g., as in most recent camera models from the last few years). With such sensors, dark current is already subtracted during the light integration. There is no need to do it again in post-processing (this would result in more noise).
If the numbers of dark frames are subtracted, the equation for random noise at the darkest signal level in the image is given as:
T o t a l   N o i s e   i n   s t a c k = r 2 + D C * t / N + D C F * t + r 2 / M * 0.5
where r = read noise, DC = sensor dark current, t = time, DCF = dark frame dark current, N = number of light frames, and M = number of dark frames. To measure the dark frames at the same temperature as the light frames, with DCF = DC, the equation reduced to the noise is proportional to:
N o i s e = 1 / N + 1 / M 0.5 q

3.5. Barn Door Star Tracker

Taking longer exposures of celestial objects produces blurry images due to the rotation of the earth. The stars start to move out of the frame, resulting in motion blur or “start trails”, as shown in Figure 19. To avoid this, it is necessary to build a device that rotates against the motion of the earth and tracks the celestial object in order to keep it at one point in a frame. This will result in much sharper and more detailed images.
A synchronous electro-mechanical star tracker [14] was made for this purpose. The idea behind this is that if we point a rod toward the Polaris star and rotate it against the motion of the earth at 360 degrees per 24 h of angular speed, any camera firmly mounted on this rod, pointing to any star, will start tracking that star. The Polaris is a star situated right above the North Pole. Therefore, it remains at a relatively single point in the night sky while all the other stars make concentric circles around it, with Polaris as their center of rotation.
The axis of rotation or “tube” in Figure 20 points towards Polaris. When the gear turns clockwise, it pushes the camera away, resulting in a rotation, and here, the DSLR/mirrorless camera on the mount should track the star, and it is pointed out.
In this setup, a 2.2 rpm high-torque DC motor was used with a gear system to adjust the rotation of the axis at an angular speed of one degree per 4 min. The motor works with a variable voltage of 3 V–12 V with a potentiometer module and the image of a 20-teeth gear to slow down the RPMs, as shown in Figure 21.

4. Results and Discussion

The dark current noise of the sensor that came out was very high in the long exposure frame that was taken without the on-sensor dark current technology [15,16]. Dark current is a steady accumulation of charge with time due to heat that moves electrons in the pixel. Higher temperatures move more electrons, and dark current goes up. It is typically around one electron or less per second, so we do not see problems from dark current with short exposures. Subsequently, when the on-sensor dark current technology was used, a much cleaner image without the sensor heat noise was obtained, and the results are shown in Figure 22.
Samples taken with the process discussed are attached in Figure 23a–e. These photos were captured in the middle of the populated city of Ranchi, Jharkhand, with a light pollution of Bortle 5.5. The experiment was carried out during a rare, dark, starry night sky with no clouds in such high light pollution. These are a stack of 600 light frames, each of 5-s exposure, 30 dark frames, 30 bias frames, and 50 flat frames. The images of the Orion Nebula and Scorpius constellation were taken in the open air, in the light pollution of Bortle class 5, brightness = 1.27 mcd/m2, artif. brightness = 1100 ucd/m2, in an uncontrolled environment (in terms of wind speed and temperature). The artificial sky brightness levels are those used in the legend and indicate the following: up to 1% above the natural light (black); from 1 to 8% above the natural light (blue); from 8 to 50% above natural nighttime brightness (green); from 50% above natural to the level of light under which the Milky Way is no longer visible (yellow); from Milky Way loss to estimated cone stimulation (red); and very high nighttime light intensities, with no dark adaption for human eyes (white).
To avoid taking any exposures that would cause any significant change in the temperature of the camera body to avoid photon noise/shot noise, we limited our exposure time of individual frames to 6 s, as compared to the 30 min of single exposure performed in the previous study. The low amount of noise that still made it into the image was easily removed through the process of stacking. Hence, the influence of temperature was negligible. The temperature of the sensor, however, was maintained at 16 degrees Celsius at the time of recording via external cooling fans to minimize the thermal noise even further. A total of 500 lights, 50 darks, 30 bias, and 30 flat frames were recorded, all at the same temperature, at an ISO gain of 160. Even the dim Orion Nebula and Flame Nebula are visible through this process.
We attempted a study to quantitatively compare the brightness of astronomical objects in question to the glow of the human body. This way, we would get a better idea of how much longer the total exposure of the latter needs to be as compared to the astronomical objects. We attempted this by studying four different metrics for each application, namely: lumens, lux, candela, and luminance. However, this study had several practical constraints that pushed us to pursue a different route.
It was difficult to find the lumens value of the exact portion of the night sky in question. Even if we did manage to find the values for all the objects we were recording, it would be of close to no use for the following reason: the observable night sky is constantly changing. Depending upon the geo location of the study, the interference due to clouds, wind, moisture, temperature, and dust would highly influence the actual light that would reach the sensor. Hence, making a comparison based on the lumens of a celestial object became highly impractical. We could, however, measure the lux of the same during the time of recording, but a Bortle class 5 sky made it next to impossible to obtain accurate results.
Instead, we simply studied the exposure required to capture these images to make them comparable. The idea was that if we use a lens of the same aperture as a study in reference, we will just change the number of frames to change the total exposure time and stack the frames later in post-processing. In the experiment performed by Kobayashi, one exposure lasted for 30 min. We took 500 frames of 6 s each, equating to a total exposure time of 50 min, resulting in the same level of brightness of the image. This led us to conclude that the two applications are indeed similar in nature. The contributions of our proposed work are presented in the table. The table presents the differences between the existing work and our proposed work (Table 4).

5. Conclusions

In this work, a successful design for capturing bioluminescence was tested and compared on various celestial body images. To do this, we have defined a physical model of Barn Door Star Tracker. Then, we used an experimental approach to estimate low-light conditions of lens performance in recording. Multiple images were produced using this experiment, with the total exposure time ranging from 40 to 90 min (500–700 frames). The images had close to zero noise, which was possible only because of stacking. This is in contrast to the last experiment performed in 2009 by Kobayashi in which a single exposure was taken that lasted 30 min. However, a 30 min exposure would produce too much thermal noise in a CMOS camera at room temperature. Therefore, we concluded that instead of taking single exposures, we could take multiple frames of the same subject and stack them using the process mentioned in the paper. In theory, this allowed us to image any low light-emitting source just by adjusting the number of frames taken (to obtain the desired signal-to-noise ratio). The apparatus, making of a Barn Door Tracker, the process of stacking, and the ultimate production of clear images of extremely dim objects are shared in the paper. These conditions allowed us to simulate synthetic data with the help of digital signal-processing techniques. After defining and using comparison criteria, we conclude that the proposed methods are more appropriate for bioluminescence imaging. On real data, we have noticed that the Barn Door Star Tracker method has improved the contrast and resolution of these images. To confirm this study, the work can be further extended, and CCD cameras can be used with Starstax software instead of DSS to capture human bioluminescence much more easily. This could open the door to a much wider data set to look at software such as Tableau and Power BI to find patterns between different functions of the body. This will help us to understand human evolution in a much deeper sense. This work has attempted to understand what is inside the human body by looking outside into the universe.

Author Contributions

Conceptualization, R.C. and V.I.; methodology, D.G. and V.S. (Vishnu Suresh); software, R.C. and V.I.; validation, M.J. and V.S. (Vishnu Suresh); formal analysis, M.J. and V.S. (Vishnu Suresh); investigation, D.G. and V.S. (Vairavasundaram Subramaniyaswamy); resources, Z.L., R.C. and V.I.; data curation, D.G. and V.S. (Vairavasundaram Subramaniyaswamy); Writing—original draft preparation, R.C. and V.I.; writing—review and editing, D.G., V.S. (Vairavasundaram Subramaniyaswamy), M.J. and V.S. (Vishnu Suresh); visualization, supervision, Z.L. and V.I.; project administration, V.I.; funding acquisition, M.J. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Dupláková, D.; Hatala, M.; Duplak, J.; Knapaíkova, L.; Radchenko, S. Illumination simulation of working environment during the testing of cutting materials durability. Ain Shams Eng. J. 2019, 10, 161–169. [Google Scholar] [CrossRef]
  2. Schöberl, M.; Oberdörster, A.; Fößel, S.; Bloss, H.; Kaup, A. Digital neutral density filter for moving picture cameras. In Proceedings of the SPIE 7533, Computational Imaging VIII, San Jose, CA, USA, 18–19 January 2010; Volume 7533. [Google Scholar] [CrossRef]
  3. van Houten, W.; Geradt, Z. Using Anisotropic Diffusion for Efficient Extraction of Sensor Noise in Camera Identification. J. Forensic Sci. 2012, 5, 521–527. [Google Scholar] [CrossRef] [PubMed]
  4. Edwards, R.; Ibison, M.; Jessel-Kenyon, J.; Taylor, R. Measurements of human bioluminescence. Acupuncture & electro-therapeutics research. Acupunct. Electro-Ther. Res. 1990, 15, 85–94. [Google Scholar] [CrossRef]
  5. Othman, S.F.; Tamchek, N.; Muhammad, F.D.; Ithnin, M.H. Modulation Transfer Function Analysis in Myopic Model Eye. ASM Sci. J. 2021, 16, 1–8. [Google Scholar] [CrossRef]
  6. Koren, N. Compensating MTF Measurements for Chart Quality Limitations. IS&T Int. Symp. Electron. Imaging 2019, 31, 305-1. [Google Scholar] [CrossRef]
  7. Bruschini, C.; Homulle, H.; Antolovic, I.M.; Burri, S.; Charbon, E. Single-photon avalanche diode imagers in biophotonics: Review and outlook. Light. Sci. Appl. 2019, 8, 87. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Thosar, S.; Herzig, M.; Berman, A.; Roberts, S.; Clemons, N.; Morimoto, M.; Burchill, L.; Butler, M.; Emens, J.; McHill, A.; et al. 0679 Endogenous Circadian Rhythm in a Marker of Myocardial Oxygen Consumption. Sleep 2017, 40, A252. [Google Scholar] [CrossRef] [Green Version]
  9. Tian, X.; Liu, Z.; Guo, C.; Yang, J.; Chen, J.; Lyu, S.; Bi, H.; Qiao, F.; Wu, X.; Lu, Y. Pressure Sensor Array With Low-Power Near-Sensor CMOS Chip for Human Gait Monitoring. IEEE Sens. Lett. 2021, 5, 6000304. [Google Scholar] [CrossRef]
  10. Gupta, M.; Singh, N.; Shrivastava, K.; Mishra, P. Significance of digital imaging and communication in medicine in digital imaging. Digit. Med. 2015, 1, 63. [Google Scholar] [CrossRef]
  11. Starkey, D.A.; Fossum, E.R. Determining Conversion Gain and Read Noise Using a Photon-Counting Histogram Method for Deep Sub-Electron Read Noise Image Sensors. IEEE J. Electron Devices Soc. 2016, 4, 129–135. [Google Scholar] [CrossRef]
  12. Zaluzec, N.J. Two Dimensional CCD (Charged Coupled Device) Arrays as Parallel Detectors in Electron Energy Loss and X-ray Wavelength Dispersive Spectroscopy. United States. 1988. Available online: https://www.osti.gov/servlets/purl/6546403 (accessed on 9 September 2022).
  13. Kato, D.; Katsuura, T.; Koyama, H. Automatic control of a robot camera for broadcasting based on cameramen’s techniques and subjective evaluation and analysis of reproduced images. J. Physiol. Anthropol. Appl. Hum. Sci. 2000, 19, 61–71. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Duffy, T.; Zachary, F.; Hill, C.; Sharp, A.; Turner, S.; Williams, J.; Todd, J.; Gignac, P.; O’Brien, H. The Effect of Image Stack Resampling on Manual Segmentation of the Putamen from Magnetic Resonance Imaging. FASEB J. 2021, 35. [Google Scholar] [CrossRef]
  15. Chen, W.C.; Jan, S.S. Low-cost star tracker development with a laboratory simulation. In Proceedings of the 34th International Technical Meeting of the Satellite Division of the Institute of Navigation, ION GNSS+ 2021, St. Louis, MO, USA, 20–24 September 2021; pp. 2341–2352. [Google Scholar] [CrossRef]
  16. Yan, L.; Shi, F.; Cheng, H.; Yang, Y.; Ren, B.; Xiao, C.; Zhang, X. Research status of dark current in CMOS image sensor. Proc. SPIE 2021, 11763, 1085–1097. [Google Scholar] [CrossRef]
Figure 1. Diagram of a digital camera.
Figure 1. Diagram of a digital camera.
Asi 05 00100 g001
Figure 2. Sigma lens construction schematic.
Figure 2. Sigma lens construction schematic.
Asi 05 00100 g002
Figure 3. MTF chart 1.
Figure 3. MTF chart 1.
Asi 05 00100 g003
Figure 4. MTF chart 2.
Figure 4. MTF chart 2.
Asi 05 00100 g004
Figure 5. Schematic illustration of experiment setup.
Figure 5. Schematic illustration of experiment setup.
Asi 05 00100 g005
Figure 6. Illuminated vs. infrared images of the subject.
Figure 6. Illuminated vs. infrared images of the subject.
Asi 05 00100 g006
Figure 7. The glow of the human body.
Figure 7. The glow of the human body.
Asi 05 00100 g007
Figure 8. Temporal variation in biophoton intensity and cortisol over 3 days.
Figure 8. Temporal variation in biophoton intensity and cortisol over 3 days.
Asi 05 00100 g008
Figure 9. Correlation between cortisol and photon levels.
Figure 9. Correlation between cortisol and photon levels.
Asi 05 00100 g009
Figure 10. Daily rhythm of photon emission from 5 volunteers.
Figure 10. Daily rhythm of photon emission from 5 volunteers.
Asi 05 00100 g010
Figure 11. Illustration of a digital image with a Sony CMOS ISO invariant camera.
Figure 11. Illustration of a digital image with a Sony CMOS ISO invariant camera.
Asi 05 00100 g011
Figure 12. Sony CMOS dark current comparison with counterparts.
Figure 12. Sony CMOS dark current comparison with counterparts.
Asi 05 00100 g012
Figure 13. (a) ISO Invariant Sony Camera at different ISOs; (b) exposure compensated for in post-processing.
Figure 13. (a) ISO Invariant Sony Camera at different ISOs; (b) exposure compensated for in post-processing.
Asi 05 00100 g013
Figure 14. (a) CCD sensor schematic diagram; (b) CMOS sensor schematic diagram.
Figure 14. (a) CCD sensor schematic diagram; (b) CMOS sensor schematic diagram.
Asi 05 00100 g014
Figure 15. DSLR and mirrorless schematic diagram.
Figure 15. DSLR and mirrorless schematic diagram.
Asi 05 00100 g015
Figure 16. ISO vs. dynamic range comparison.
Figure 16. ISO vs. dynamic range comparison.
Asi 05 00100 g016
Figure 17. The low-light lens was used for the results.
Figure 17. The low-light lens was used for the results.
Asi 05 00100 g017
Figure 18. RGB values of a pixel.
Figure 18. RGB values of a pixel.
Asi 05 00100 g018
Figure 19. (a) Tracked (b) untracked Pleiades Cluster (motion blur).
Figure 19. (a) Tracked (b) untracked Pleiades Cluster (motion blur).
Asi 05 00100 g019
Figure 20. Working model of a Barn Door Tracker, a self-made tracker setup.
Figure 20. Working model of a Barn Door Tracker, a self-made tracker setup.
Asi 05 00100 g020
Figure 21. Teeth gear to slow down the RPM.
Figure 21. Teeth gear to slow down the RPM.
Asi 05 00100 g021
Figure 22. Technology samples (a6100) (a) without sensor and (b) with on-sensor.
Figure 22. Technology samples (a6100) (a) without sensor and (b) with on-sensor.
Asi 05 00100 g022
Figure 23. (a) Orion molecular complex 16-bit flat RGB image; (b) Orion molecular complex 8-bit enhanced color-graded image; (c) Orion Nebula flat 16-bit RGB image (d); Flame Nebula flat 16-bit RGB image; (e) Scorpius constellation down-sampled 8-bit RGB image.
Figure 23. (a) Orion molecular complex 16-bit flat RGB image; (b) Orion molecular complex 8-bit enhanced color-graded image; (c) Orion Nebula flat 16-bit RGB image (d); Flame Nebula flat 16-bit RGB image; (e) Scorpius constellation down-sampled 8-bit RGB image.
Asi 05 00100 g023
Table 1. SONY a6100 Specifications.
Table 1. SONY a6100 Specifications.
Full Model NameSony Alpha ILCE-A6100
Resolution24.20 Megapixels
Sensor SizeAPS-C (23.5 mm × 15.6 mm)
Kit Lens3.13× zoom 16–50 mm (24–75 mm eq.)
ViewfinderKVF/LCD
Native ISO100–32,000
Extended ISO100–51,200
Shutter1/4000–30 s
Max Aperture (Kit Lens)f/3.5
Dimensions4.7 × 2.6 × 2.3 in. (120 × 67 × 59 mm)
Weight512 g (includes battery and kit lens)
ManufacturerSony
Power Consumption19 mA
PCB Size18 × 45 mm
Weight7 g
Sensor TypeCMOS
Approx. Pixel Pitch3.92 microns
Focal Length Multiplier1.5×
Aspect Ratio3:2
Colour Filter TypeRGBG
Image File FormatRAW (14-bit compressed ARW 2.3)
Rear Display Resolution921,600 dots (307,200 px)
Exposure Compensation±5.0 EV in 0.3 EV steps
Table 2. Sigma Lens Specifications.
Table 2. Sigma Lens Specifications.
Lens Construction9 elements in 7 groups
Angle of View50.7 degrees (Sony E-Mount)
Number of Diaphragm Blades9 (Rounded Diaphragm)
Minimum Aperturef/16
Minimum Focusing Distance30 cm/11.8 in.
Maximum Magnification Ratio1:7
Filter Sizeϕ52 mm
Dimensions (Diameter × Length)ϕ64.8 mm × 73.3 mm (Sony E-Mount)
Weight265 g (Sony E-Mount)
Edition NumberC016
Table 3. MTF chart lines.
Table 3. MTF chart lines.
Spatial FrequencyS:Sagittal LineM:Meridional Line
10 Ip/mm----------------------------- ------ ------
30 Ip/mm----------------------------- ------ ------
Table 4. Comparison of existing work vs. proposed work.
Table 4. Comparison of existing work vs. proposed work.
Existing WorkContribution towards Novelty
Current work exists as separate concepts about shot noise, read noise, tracker, long-exposure images, lens type, sensor type, and image stacking.This is a one-stop paper that combines all of these concepts to achieve better results in the fields of human bioluminescence and astro-photography.
Existing work only involves the use of CCD-based camera setups, which tend to be more expensive.This paper uses a CMOS-based camera sensor to do the same task at a much lower cost, which will make this field of study more accessible to researchers across the globe.
Existing work uses an exposure time of 20–30 min per image, which heats the camera sensor and leads to many complications. This requires a much more sophisticated setup and a higher cost.Current setup proposes a method to reduce the exposure time to 2–3 min per image, taking multiple images, and then stacking them to improve the SNR.
No previous work has used a mechanical star tracker (which brings down the cost from Rs. 20,000 to >Rs. 2500).The paper has shared the details of a new design for a star tracker that is completely mechanical, called a “Barn Door Tracker”, producing similar results.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Chiranjeevi, R.; Indragandhi, V.; Gunapriya, D.; Subramaniyaswamy, V.; Jasiński, M.; Suresh, V.; Leonowicz, Z. Analyzing the Electronics of Image Sensors and Their Functionality to Develop Low Light-Emitting Source Image. Appl. Syst. Innov. 2022, 5, 100. https://doi.org/10.3390/asi5050100

AMA Style

Chiranjeevi R, Indragandhi V, Gunapriya D, Subramaniyaswamy V, Jasiński M, Suresh V, Leonowicz Z. Analyzing the Electronics of Image Sensors and Their Functionality to Develop Low Light-Emitting Source Image. Applied System Innovation. 2022; 5(5):100. https://doi.org/10.3390/asi5050100

Chicago/Turabian Style

Chiranjeevi, Rai, Vairavasundaram Indragandhi, Devarajan Gunapriya, Vairavasundaram Subramaniyaswamy, Michał Jasiński, Vishnu Suresh, and Zbigniew Leonowicz. 2022. "Analyzing the Electronics of Image Sensors and Their Functionality to Develop Low Light-Emitting Source Image" Applied System Innovation 5, no. 5: 100. https://doi.org/10.3390/asi5050100

Article Metrics

Back to TopTop