1. Introduction
During the last decades, image capturing and processing have evolved from scarce technology, used by professionals for niche applications, to a rapidly advancing research field with application in low-cost and complexity data acquisition of long duration physical and/or biological phenomena [
1]. To this end, a great amount of research effort has been spent on designing image processing and machine learning-based approaches that not only quantify the population growth for image sequences, but also provide accurate predictions concerning its evolution.
Scanning the open technical literature, there are several published papers that report the use of images and logistic functions (LFs) for predicting a specific-cell type population growth [
2,
3,
4,
5,
6,
7,
8,
9,
10]. In more detail, in [
2], the use of eight consecutive images, which were acquired by a single reflex (SLR) camera, was presented, in conjunction with the probability of survival of hamster stem cells, which was modeled according to the LF approach. Additionally, in [
3], the authors showed that the in-vitro cellular growth rate may be used as survival probability of the fetus in case of hamsters, while, in [
4], a multi-camera approach for modeling larva population by means of LF was presented. Another example of timelapse application in population behavior is delivered in [
5], where the insect
Costelytra zealandica was infected with the bacteria Yersinia entomophaga and its behavior was observed and recorded by acquiring 1 image per
, using a digital SLR camera. Fluorescence substances were used on the insects to facilitate analysis of the resulting image sequence. More recently, in [
6], the construction of a special incubation chamber was described that uses two petri dishes to control humidity for a long duration. Images were acquired every
for 40 days and used to record and study the morphology of bacterial colonies, such as streptomycin, bacillus subtillis E42, serratia marcescens, arthrobacter agilis, and nestekonia SP. The timelapse technique has also been applied to agriculture [
7], embryo moprhokinetics [
8] and microbial interaction [
9,
10].
From the data processing point of view, a number of LF-based functions have been employed for modeling and/or predicting the population evolution based on the birth and death rates [
11,
12]. In this direction, in [
13,
14], the bi-LF was introduced to model population evolution that show two overlapping or sequential phases of logistic growth. The two LFs were summed and fitted to rice crop evolution data to handle an initial growth increase followed by a decrease. The combined curve provided a good fit to the data under investigation. Of note, non-linear least squares are used to estimate the parameter values of the function. Meanwhile, in [
15], the LF is augmented by using an additive constant to accommodate varying capacity. This method was applied to two actual cases of human population growth. Moreover, in [
16], the bi-phasic LF was used for modeling the sudden changes in the evolution of research papers and patents. The combination of two LFs was treated in a systematic way, using the following categories: (i) Sequential (sum of two time translated curves), (ii) superposed simultaneous curves, (iii) converging (first logistic growth combined with a second logistic function, reaching the maximum at about the same time) and (iv) diverging (different growth rates and carrying capacities). In all aforementioned cases, the resulting curves were unable to accommodate data decreasing trends. Additionally, in [
17], a number of different extensions of the LF were discussed including the generalized logistic regression, the Von Bertalanffy, and the Blumberg expressions. Again, these expressions were unable to model decreasing phases of the data. Finally, in [
18], the combertzian population growth model, which is a double exponential model, with parameters that control the time shift, the maximum asymptotic population and the maximum growth rate, was applied to investigate the evolution of breast cancer cells.
To the best of the authors’ knowledge, the problems of modeling the decreasing phase of the data have not been adequately addressed in the technical literature. Motivated by this, the current contribution presents an appropriate growth approach that is able to model both the increasing and decreasing phases and verifies its efficiency by means of experiment-driven microbial population modeling. In particular, we propose an experimental setup for periodic snapshot recording of the evolution of a fungus on a petri dish. The selected fungus is the Candida species, which is the most common cause of fungal infections [
19,
20,
21,
22]. The acquired images are processed in the red–green–blue (RGB) color system to quantify the number of microbes in each pixel of the plate. A novel mathematical model of the time evolution of the fungus for individual pixel/regions of the plate is presented, which introduces an LF with second degree polynomial time exponent capable of modeling population curves that may eventually become decreasing. Finally, we apply parametric imaging to depict the spatial distribution of a quantity proportional to the growth rate of the microbial population. The proposed approach is expected to open a new road to automatic data acquisition, modeling, and prediction of different evolution processes. The results are further validated and the robustness of the proposed method assessed using two more publicly available timelapse videos with a different acquisition method and microbial colonies of different species.
The rest of this paper is organized as follows:
Section 2 is focused on presenting the methodology that we follow. In more detail, the experimental setups accompanied by the developed theoretical framework are reported in this section. Next, in
Section 3 experimental results that verify the proposed analysis and the accuracy of the proposed modeling function are presented. Finally, useful remarks and conclusions summarizing this work are provided in
Section 4.
Notations: Unless otherwise stated, in what follows, lower and upper case bold letters denote vectors and matrices, respectively. Moreover, stand for the union of the sets and , while ⊕ and •, respectively, represent the morphological dilation and erosion. Additionally, and , respectively, stand for the transpose and inverse operator. Finally, and , respectively, denote the exponential and the natural logarithm.
3. Results
This section is devoted to presenting experimental results that evaluate the effectiveness and accuracy of the proposed approach. In this direction, in
Figure 7, an indicative example is depicted, where, in the final acquired frame, two regions of the plate, which contain several colonies, are selected. The extracted population curves are also presented in
Figure 7d,e. It is evident that the curve of the smaller blue area, which is depicted in
Figure 7b,d, shows a decreasing trend. Finally, as illustrated in
Figure 7c,e, the evolution curve of the yellow area has a monotonically increasing trend.
Next, the influence of the selected area size is explored. First, a pixel is selected and the experimental population curve is calculated for different sizes of the square region centered at the selected pixel. As depicted in
Figure 8, for each experimental curve, the modeling is performed using both the LF and LFSD approaches. Moreover, the LFSD approach is observed to be more accurate compared to the LF. Interestingly, it becomes obvios that as the value of
r decreases, the population curve becomes more noisy.
For each
r parameter, the coefficients of the exponential polynomial in the case of LF and LFSD are, respectively, reported in
Table 1 and
Table 2. Notice that
in the case of LF and
,
of LFSD are population growth rate metrics. The consistency of the curve extraction and proposed modeling is shown in
Figure 9, where
is calculated using Equation (
22). It can be observed that
does not vary substantially even for drastically
r changes.
To highlight the superiority of LFSD against the conventional LF, in
Figure 10a, we present a population evolution, which after a specific frame is decreasing.
Figure 10b illustrates the estimated population against the LF-based model. From this figure, it becomes evident that the conventional LF is incapable of modeling this behavior. This highlights the importance of LFSD for modeling such trends. The number of pixels with negative
in the conventional LF in the whole petri dish is also reported in
Table 3. We notice that the number of pixels having negative exponent
decreases as the radius of the ROI area increases (
Figure 11). However, the proposed LFSD does not suffer from this shortcoming.
The extracted population curves exhibit noticeable fluctuation, which appears to increase as the local mean value of the curve increases.
Figure 9 plots the instantaneous signal-to-noise ratio (SNR) for the population curve shown in
Figure 8. The parameter
is set to 80. The logarithmic definition of SNR was used. It becomes apparent that as the population increases with time, both the amplitude of signal and noise increases, however the signal amplitude increases faster than the noise (curve’s local standard deviation); thus, the SNR overall increases. Furthermore, as expected, the noise decreases as the size of the ROI used for the calculation increases.
The time
of the first appearance of non-zero experimental data for each pixel is shown as a parametric image in
Figure 12.
Similarly,
is shown in
Figure 13a and also superimposed on the petri dish in
Figure 13b, using shades of green.
Finally,
Figure 14 shows parametric images of
of LF, with their color scale, for two different radii
and 8 pixels, respectively. Visual inspection of the parametric images
and considering the influence of the
factor on the population curve, suggests that areas with a high parameter values exhibit a low population density.
In
Figure 15, four locations are shown on different colonies of petri dish 2 in the final frame. The population curves that were extracted and modeled using the LF and the proposed LFSD, are shown in
Figure 16. Again, it can be observed that the LFSD achieves more accurate population modeling in the cases of populations reaching their maximum during the acquisition, as well as in the case of population’s continuous grow.
The parametric image of petri dish 2 that depicts the time in which the population is maximized, is shown in
Figure 17. Blue color represents pixels with continuously increasing population that did not exhibit maximum value during the acquisition, yellow color marks pixels whose
cannot be determined because the curve is too noisy to be modeled (or pixels outside the dish) and finally shades of green color (from black to light green) encode the determined value of
for the remaining pixels, in the range
frame. Note that even the yellow pixels inside the petri dish appear in areas where no visible colony growth could be detected
In
Figure 18, four locations are shown on different colonies of petri dish 3. The extracted population curves and the extracted LF and LFSD-based models are depicted in
Figure 19. It can be observed that the LFSD achieves more accurate population modeling.
4. Conclusions
In this paper, a low-complexity approach for petri dish image acquisition, automatic measure and mathematically modeling fungus evolution was presented. The images were acquired using an inexpensive web camera. An image-based heuristic method for microbial number estimation was described and applied for the generation of experimental population curves. A novel modeling approach based on the LFSD was presented for the population evolution and compared with the conventional LF. Our results highlighted that the the proposed approach outperforms the commonly-used LF one, in terms of accuracy, since it can also capture decreasing trends of the population evolution. The concept of parametric imaging was studied in order to further improve the visualization of the LFSD model parameters. Finally, the different origins of the three petri dishes, the variety of image acquisition process, image quality and resolution and the different species of growing microorganisms, show the robustness of the proposed population measurement and modeling method.
Future work may include comparison between the growth measures identified in this work, such as the rate of growth and the time of maximum population, between different cultures of the same or different micro-organisms. Such comparisons also require identical image acquisition conditions and equipment and possibly color histogram normalization of the images, adapted to the background color of each individual dish.