Scaling Relations of Lognormal Type Growth Process with an Extremal Principle of Entropy

The scale, inflexion point and maximum point are important scaling parameters for studying growth phenomena with a size following the lognormal function. The width of the size function and its entropy depend on the scale parameter (or the standard deviation) and measure the relative importance of production and dissipation involved in the growth process. The Shannon entropy increases monotonically with the scale parameter, but the slope has a minimum at √ 6/6. This value has been used previously to study spreading of spray and epidemical cases. In this paper, this approach of minimizing this entropy slope is discussed in a broader sense and applied to obtain the relationship between the inflexion point and maximum point. It is shown that this relationship is determined by the base of natural logarithm e ' 2.718 and exhibits some geometrical similarity to the minimal surface energy principle. The known data from a number of problems, including the swirling rate of the bathtub vortex, more data of droplet splashing, population growth, distribution of strokes in Chinese language characters and velocity profile of a turbulent jet, are used to assess to what extent the approach of minimizing the entropy slope can be regarded as useful.


Introduction
Growth phenomena or equivalent growth phenomena exist in many natural and technological processes and most often involve competitive production and dissipation mechanisms to make the size grow initially and finally decay.Examples are growth of the size of living issues such as the height of human body [1], expansion of firms and industries [2], spreading of communicable epidemics [3], production of kinetic energy during transition from laminar flow to turbulent flow [4], generation of droplets during spray process [5], population and pollution growth [6], etc.
The growth rate for such phenomena is generally proportional to the current size.According to Gibrat law, the size for such a growth process may follow a lognormal function [2] The lognormal function is very popular and important in science and technology [7,8].
There are apparently two free parameters: t D and σ.The maximum of f (t) is at t = t D while σ is the scale parameter (a measure of the geometrical standard deviation) that characterizes the width of the distribution f (t).
Here, t is simply called time, though sometimes it may refer to distance or other variables over which f is distributed or with which f varies.For instance, in droplet splashing, t is the diameter of droplets produced during splashing and f (t) is the probability for a droplet to have size t.
For the specific problem of droplet splashing, the use of Shannon entropy determines the free parameter σ to be [9] σ = √ 6 6 0.41, (2) and the way of obtaining this was attributed to the principle of maximal rate of entropy production [10,11].Martyushev and Seleznev [12] outlined the restrictions for correct use of this principle, and commented on recent achievements as reported in [13][14][15][16][17]. Though the way of reference [9] to work with Shannon entropy production may not be linked to the principle of maximal rate of entropy production in its strict sense, the value (2) was supported by a large amount of data from droplet splashing by Wu [9] and Moreira et al. [18] using the experimental data of several publications [5,19,20].Moreover, with this theoretical value of σ, Wang et al. [21] successfully modelled the number of hospitalized cases during the epidemics of SARS in 2003.
The lognormal function has an inflexion point (denoted t L ) and a maximum point (denoted t D ), as can be seen from Figure 1.For application to epidemic spreading [21], the value (2) is used in (1) to give and it is found that Equation ( The spray process studied in [9,18] and the epidemics studies in [21] are two quite different problems, while the values of σ for these cases are all closely equal to that given by (2).This would mean that the method should have some broader sense.Thus, we try to explore in this paper more properties of the approach used in [9,21], and to test more cases in order to assess whether this approach can be applied in various problems.
It was claimed in [9,21] that the principle of maximum rate of entropy production is used while obtaining (2).It is necessary to verify here whether it is a maximization or minimization of some entropy property.Sensitivity analysis is also required to show whether the results are sensitive or insensitive to the choice of σ.It is also desired here that the ratios of the locations and sizes between the maximum point and inflexion point should have some form more exquisite than given by (3).Moreover, we wish that the results, such as the values of the ratios t D t L and , should have some relationship similar to a more understandable principle such as a minimal surface energy principle.These issues will be discussed in Section 2 of this paper.
In Section 3, we provide a selective number of cases to test if the theoretical values of the ratios t D t L and f (t D ) f (t L ) are useful in more situations other than those considered in [9,21].These cases include the swirling rate of the bathtub vortex, more data of droplet splashing, population growth, distribution of strokes in Chinese language characters and the velocity profile of a turbulent jet.Some discussion will also be provided to open a question about the value of the Karman constant in turbulence flow.

The Method of Minimal Slope of Shannon Entropy
In this section, we first study the variation of Shannon entropy with respect to the scale parameter σ and establish some relations between the locations and sizes of the inflexion point and maximum point of (1).Then, we make some sensitivity analysis.The method for application will be provided in Section 3.

Shannon Entropy Property and Some Useful Relations
For (1), it follows that and The inflexion point t = t L is given by This equation can be solved for t D t L to give Furthermore, The use of these two relations and of expression (7) for t L t D gives Recall that expressions (7) and ( 8) have already been obtained in [21] for epidemic spreading.The Shannon entropy for Equation (1) is defined here as See Section 2.2 for more details of the choice of the power t 3 and Dumouchel [22] for discussions and more references.The explicit form for Equation (9) is For convenience, we put S(σ) = S V (σ) + 9ln t D , where S V (σ) = 3 ln √ 2πσ + 3σ 2 + 1 2 is solely dependent on σ.If t D is regarded as constant independent of σ, then Figure 2 shows the variation of S V (σ) (S(σ) with t D = 1) and S (σ) with respect to σ.It is seen that the entropy slope S (σ) has a minimum.Setting S (σ) = 0 gives Equation ( 2).This means that σ =  7) and ( 8), we get where e is the base of natural logarithm.In this paper, we do not make any attempt to discuss whether the present approach of fixing σ by minimizing the entropy slope does or does not have any relation with the usual maximum principle of the entropy production rate of Ziegler or the minimum principle of entropy production rate of Prigogine (see [23] for a review of these principles).Now, we show that fixing σ by minimizing the entropy slope exhibits some geometrical similarity to the minimal surface area principle, and the latter is related to the minimal surface energy principle (see the droplet example below).In fact, the two relations in Equation (11) mean that The volume (V) and total surface area (A) of a cube exactly satisfy the scaling relation For a hexahedron other than a cube, the scaling relation ( 13) does not hold.Since the volume to surface area ratio (V/A) of cube is the maximal for all hexahedron, the similarity between Equations ( 12) and ( 13) would mean that minimizing the slope of the Shannon entropy with respect to σ has some geometrical reason.The volume and surface area of a sphere also exhibits scaling relation ( 13) while an ellipsoid does not.Recall that the minimal surface area principle may be related to the minimal surface energy principle by considering the surface energy of a droplet.A droplet displays minimal surface energy if it is in spherical shape.If the environment is gravity-free, then a droplet is in spherical shape.When gravity is present, the droplet is near spherical shape if it is small enough.

Sensitivity Analysis
There are several sensitivity issues that need to be considered.The first is the sensitivity of φ (σ) and ψ (σ) when σ is slightly different from σ = √ 6 6 .The sensitivity may be measured by σ φ(σ) Figure 3 displays φ (σ) (see Equation ( 7)) and ψ (σ) (see Equation ( 8)) for various σ other than but including σ = √ 6 6 .Hence, both φ (σ) and ψ (σ) vary smoothly around σ = √ 6 6 .Hence, a slight difference of σ from  Following [22], the Shannon entropy may be defined as follows Here, F(t) = t 1−η f (t) with η = 1, 2 or 3.In [9,21], the value η = 3 is used.In [22], both η = 1 and η = 3 are considered.The value η = 3 is the choice adopted in Equation (9).For the spray problem, F(t) is the so-called volumique distribution function if η = 3.For more general problems, we want to see, as for the second issue of sensitivity analysis, how the results are related to the choice of the value of η.
Vanishing the second derivative of ( 14) gives If we take η = 1 (t scales to length), then the use of Equations ( 7), ( 8) and ( 15) yields This means that if the growth and dissipation process are such that the entropy is defined by Equation ( 14) with η = 1, then which are much larger than given by Equation (11).However, Equation ( 17) does not have a geometrical sense like that between Equations ( 12) and ( 13).
The third issue lies in taking t D as a constant while considering t L as a variable.If we consider t L to be constant and rewrite Equation (10) as Then, with Equation (7) for t D t L , we may write With t L assuming to be a constant, we get S (σ) = 0 at σ = 0.348, which is slightly slower than Equation (2).Taking σ = 0.348 yields φ (σ) ≈ 1. 51 and ψ (σ) ≈ 2. 027, which are also slightly slower than the values given by Equation (11).The final issue is whether we still have similar results if the size function is not the lognormal one.For Gaussian function, for which the Shannon entropy is S(σ) = 1 2 1 + ln(2πσ 2 ) .Luchko [24] studied the entropy growth in time for process described by such a function.
Obviously, there is no minimal or maximal value for the slope S (σ).Hence, the minimal entropy slope method does not apply to Gaussian function.For Gaussian function, it is easily shown that independently of the value σ.

Examples and Assessment
The references [9,21] have used two specific examples that justify the usefulness of the value σ given by Equation ( 2) and the ratios t D t L and given by Equation (11).First, we recall how to use the method given in Section 2.

Method
Suppose that for a natural or artificial growing process, the size (or growing rate in some cases) follows the lognormal function (1), at least approximately.The preliminary purpose is to use the data t L and f (t L ) at the inflexion point to anticipate t D and f (t D ) through Equation (11).Note again that t may not just mean time.Therefore, we will use L for t L and D for t D in the following.
In some problems, possible ambiguity exists for determining the initial point for counting L. This is extremely important for epidemic spreading since it is hard to identify the initial date.Wang et al. [21] resolved this issue by applying Equation (4) at L to give When σ = √ 6 6 and D L = √ e are used in Equation ( 18), it follows For problems, it is difficult to identify the initial point for counting L, and Equation ( 19) may be used for L since it is relatively easy to identify the inflexion point and to measure the values of f (L) and d f (L) dt .In some applications, the measured size may not follow the lognormal function ( 1), but the size rate g(t) = d f (t) dt or accumulated size I(t) = t 0 f (t)dt may follow approximately the lognormal function.In these cases, the relations between the inflexion point and maximal point of g(t) or I(t) are supposed to satisfy Equation (11).

Bathtub Vortex
The bathtub vortex is a familiar fluid dynamic phenomenon, with swirling due to either initial disturbance with residue circulation and asymmetry of geometry and water supply [25], or due to the Coriolis effect [26], or when the tank containing the liquid is rotating [27].When the condition of perfect symmetry and initial stillness is met, then water draining from a tank would rotate counter-clockwise in the Northern Hemisphere and clockwise in the Southern Hemisphere [26].Due to conservation of angular momentum, the radius of the rotating core decreases as liquid approaches the plug hole so that the rate of rotation increases.
Interestingly, for relatively quiescent initial conditions and independent of the initial direction of rotation, the direction of rotation might reverse as the liquid surface approached the bottom of the vessel.This reversal was attributed by Sibulkin [25] to the conservation of vorticity during the draining of vorticity contained in the boundary layer on the bottom of the tank.The vorticity on the boundary layer has a radial component, which becomes vertical when the fluid element containing this vorticity is drained into the plug hole.The direction of rotation for this boundary layer induced vertical vorticity component is opposed to the original direction of the bathtub vortex.When the latter becomes weak in the final stage of draining, the boundary layer induced vorticity component dominates and the direction reverses.
To demonstrate, Sibulkin [25] built a tank with 12 inches in diameter and four inches in height.The initial level of water is Z s = 0.9 inches.A thin cork disk having a diameter of four minimeters and a weight of 0.8 minigramme and floating at the center of the surface of water was used to record its motion pictures and its angular displacement (θ) and angular velocity (ω) are measured.It is interesting to note that both the angular displacement and the angular velocity follow approximately the lognormal function, as displayed in Figures 4 and 5 (data from Figure 2 of Sibulkin [25]).For the angular displacement, the inflexion point occurs when the liquid surface drops to a level at a distance of L = 0.342 inches to the initial level Z s , and the maximum point occurs when the surface is at a level of a distance D = 0.575 inches to the initial level Z s .Hence, which is very close to the value given by Equation (11).For the angular velocity, it is the right branch of the curve that is close to the lognormal distribution according to Figure 5, and the ratio between the maximum point and the inflexion point, counted from the zero height level of the liquid surface, is which is still close to the value given by Equation (11).Water draining provides the production mechanism and the viscous effect in the boundary layer provides the dissipation mechanism for this problem.

Further Data from Droplet Size Distribution for Droplet Splashing
A droplet impinging on a solid wall may splash and produces a large number of secondary droplets with a size distribution following approximately the lognormal function [18].The theoretical value σ = √ 6/6 was originally derived for this problem by Wu [9] where a large set of experimental data was used to assess this theoretical value.Moreira et al. [18] recently analyzed the experimental data of several publications [5,19,20] and showed that σ can be related closely to the theoretical value σ = √ 6/6 given by Wu.According to Moreira et al. [18], the data from references [5,19,20] can be fitted as 6 for the data from [5], σ = (1.009, 1.065) for the data from [19], for the data from [20].
However, in the studies of droplet splashing, there was no consideration for D/L.Now, we the data of Stow and Stainer [5] to make a comparison.Stow and Stainer [5] used a droplet of diameter 2 mm with an impact velocity varying from 2.0 to 8.4 m/s.The size distribution for one set of data is displayed in Figure 6.The inflexion point is at L = 72.5 µm and the maximum is at D = 118 µm.Thus, which is very close to the value given by Equation ( 11).Comparison with another set of data yields similar conclusions.

Population Growth
Though the population of the world does not itself follow the lognormal function, the growth rate nearly follows it, as can be seen from Figure 7 based on the data from Raymond [28].The population of the world started to grow at an increasing rate since 1650.We see that, for the growth rate, there is an inflexion point (near 1773) and a local maximum point (near 1844).We have thus D = 194 and L = 123, and, therefore, D/L = 1.58, which is close to the theoretical value.

Stroke Distribution in Language
Each Chinese word is composed of a number of strokes (while each word of Western languages is composed of a number of letters).The number of words (n w ) with a specific number (t = n s ) of strokes first increases, reaches a maximum at around n s = 10 and decays when n s further increases.
The function f w (n s ) = n w (n s ) (number of words) or f s (n s ) = n s × n w (n s ) (total number of strokes for all words with a given n s ) approximately follow the lognormal function, as shown in Figure 8, which are obtained using the data from Reference [29].It is seen that the change of the number of strokes f s from n s = 7 to 8 is the largest, meaning that this is the inflexion point and hence L = 7.5.The maximum number of f s occurs at n s = 12, hence D = 12.As a result, D/L = 1.6.Moreover, f s (7.5) = (910 + 1312)/2 = 1111 and f s (12) = 2304 so that f s (D)/ f s (L) = 2.08.Both D/L and f s (D)/ f s (L) are close to the ratios shown in Equation (11).

Possible Significance for Turbulent Flow
First, consider the turbulent free jet.Using a number of experimental data, Rodi [30] gave a fitted curve for the mean axial velocity profile U/U 0 = f (y/y 0 ), where U 0 is the velocity on the center line of the jet and y is the radial distance to the center of the jet (y 0 is the radial position at which U = 1 2 U 0 ). Figure 9 displays this velocity profile and its derivative with respect to y.We remark that this velocity profile also follows lognormal distribution approximately, and, counting from the outer edge of the jet, which is just y = 2.26y 0 according to Rodi, the inflexion point is at L = 1.477, and the maximum (center of the jet) is at D ≈ 2.26.Hence, D L = 1.53, which is close to the ratio shown in Equation (11).Consider now the gradient of the velocity, as displayed in Figure 10.We observe that the gradient also has an inflexion point (L = 0.28, counting from the center of the jet) and a maximum point (D = 0.77, also counting from the center of the jet) and D/L ≈ 2.75.This means that, for the velocity gradient, the dissipation is weak so that σ is large and the ratio D/L cannot be predicted.
In turbulent flow, kinetic energy is produced and dissipated so that this is also a typical problem of growth with production and decay.Hence, it would be expected that there be some intrinsic relations between the turbulent properties and the minimal slope of Shannon entropy.We thus attempt to raise some open questions.We know that for turbulent boundary layer flow, the velocity profile in the logarithm regime is described by where u * is the friction velocity and ν is the viscosity.Here, κ is the Karman constant.Though the specific value of this constant may be problem dependent [31], it is generally accepted that κ ≈ 0.41, which is remarkably close to the constant σ = √ 6/6 ≈ 0.408.Since the logarithm regime is the regime where turbulence production and dissipation is at equilibrium, the Karman constant κ and the constant σ would be physically related or it would be just the same constant.The justification of this in a more rigorous way is left as an open question.Again for turbulence, the energy spectrum, E(k) defined such that ∞ 0 Edk = k where k is the wavenumber and k is the turbulent kinetic energy, looked at the wavenumber space nearly follows lognormal distribution, especially for isotropic turbulence of large Reynolds number flow [32].Lower wavenumber corresponds to large eddies coming from production and high wavenumber corresponds to small eddies that are going to be quickly dissipated.Between the energy-containing (for which E has its peak value) and dissipation range, there is a subrange in which E(k) ∼ k −p , where p = 5/3 is the famous Kolmogorov scaling parameter [33].Whether the two numbers 5/3 1. 666 7 and √ e 1. 648 7 are intrinsically related is the second question open to further studies.

Conclusions
We consider in this paper the growth process with a size described by the lognormal function.This size function contains a scale parameter (σ, some measure of the standard deviation) which is normally considered as a free parameter.The slope of the Shannon entropy, obtained by taking the derivative of this entropy to σ, is shown here to have a minimal value at σ = √ 6/6.With this free parameter thus uniquely defined, the relations between the inflexion point and maximum point of the lognormal function are also uniquely defined, notably by the base of natural logarithm (e 2.718).In these relations, the location (D) of the maximum is connected to the location (L) of the inflexion point by D/L = e 1 2 and the sizes are connected by f D / f L = e 3 4 .These relations are useful if the data at the inflexion point are known in advance and the data at the maximum require being predicted.The test using a number of quite different examples shows that these relations have some acceptable accuracy.Thus, the present method of minimizing the Shannon entropy slope is applicable to problems when no other means actually exist for determining the free parameter σ.
The value σ = 0.408, or σ = √ 6/6, has been previously used in References [9,21] for droplet size spreading and epidemic spreading.However, in References [9,21], it was assumed that this follows from the principle of maximum entropy production.Here, we have shown that this value of σ corresponds to minimization of the slope of the Shannon entropy with respect to σ.It is not clear whether this slope minimization is connected to the well-known principle of maximum or minimum entropy production rate [11,12,15,16,34].Moreover, we have shown in this paper that the relations obtained by the definition of Shannon entropy with η = 3 and the use of the minimization of the Shannon entropy slope have some geometric connection with the minimal surface area or energy principle.

Figure 4 .Figure 5 .
Figure 4. Angular displacement of the floating disk for a bathtub vortex with reserval, original data from Figure 2 of Sibulkin [17].

Figure 6 .
Figure 6.Droplet size distribution for one set of data of Stow and Stainer [5].

Figure 7 .
Figure 7. Population growth in the world.

Figure 8 .
Figure 8. Traditional Chinese words and total strokes.

Figure 9 .
Figure 9. Velocity profile in a turbulent jet.

Figure 10 .
Figure 10.Velocity gradient profile in a turbulent jet.

t)/dt t f(t) t R MP t D t L S ec ond IP IP Figure 1. The
lognormal function and its derivative.The inflexion point (IP) is at t = t L and the maximum point (MP) is at t = t D .
3) predicts the date and number of maximum hospitalized cases with a reasonable accuracy for SARS in the year 2003.df(