Abstract
The generalized cumulative residual entropy is a recently defined dispersion measure. In this paper, we obtain some further results for such a measure, in relation to the generalized cumulative residual entropy and the variance of random lifetimes. We show that it has an intimate connection with the non-homogeneous Poisson process. We also get new expressions, bounds and stochastic comparisons involving such measures. Moreover, the dynamic version of the mentioned notions is studied through the residual lifetimes and suitable aging notions. In this framework we achieve some findings of interest in reliability theory, such as a characterization for the exponential distribution, various results on k-out-of-n systems, and a connection to the excess wealth order. We also obtain similar results for the generalized cumulative entropy, which is a dual measure to the generalized cumulative residual entropy.
Keywords:
generalized cumulative entropy; generalized cumulative residual entropy; variance; mean residual life; stochastic orders MSC:
60E05; 62B10; 62N05; 94A17
1. Introduction and Background
The notions of uncertainty and information are relative and involve comparisons of distributions in terms of a probabilistic point of view. In information theory a relevant role is played by the concept of entropy; see Shannon [1]. We recall that an absolutely continuous nonnegative random variable X with probability density function (pdf) the (differential) entropy of X is defined as
where denotes expectation and “log” is the natural logarithm, with the convention
Despite the many advantages, the Shannon entropy has some limitations; see, e.g., Rao et al. [2] and Schroeder [3]. We recall the following concerns about the differential entropy. (i) cannot be used when X is a mixed random variable. (ii) The differential entropy of an absolutely continuous random variable may take any value on the extended real line, wheres in the discrete case the entropy is always positive. (iii) is inconsistent, in the sense that for a uniform distribution it may be zero, or negative, or positive. (iv) The differential entropy is decreased by conditioning. Moreover, the vanishing of the conditional differential entropy of X given Y does not imply that X is a function of Y, whereas in the discrete case the conditional entropy of X given Y is equal to zero if and only if X is a function of Y. (v) In general, the entropy of the empirical distribution does not provide a proper approximation of the differential entropy of an absolutely continuous random variable. (vi) The differential entropy, as the Shannon entropy, is location independent. To overcome these drawbacks, various new alternative measures of uncertainty have been proposed in the recent literature. Here we recall some basic concepts which are involved in their definitions.
Let X be a random variable with support , having cumulative distribution function (cdf) and survival function . As customary, we denote by
the cumulative hazard function and by
the hazard rate function of X. Let X describe the lifetime of a system. Under the condition that the system has survived up to age the survival function and the cumulative hazard function of the residual lifetime , , are respectively given by
where refers to a random variable having the same distribution of X conditioned on The mean residual lifetime (MRL) function of X is defined as
Similarly, one can also introduce the reversed hazard rate function of X, given by , , and the cumulative reversed hazard function
Under the condition that the system has been found failed at age the inactivity time is defined as , The mean inactivity time (MIT) function of X is
It is also known as the mean past lifetime and the mean waiting time function of X.
Let us now recall various useful information measures that have been defined recently in terms of the functions reported above. For clarity and brevity, we report them in Table 1. The cumulative residual entropy (CRE) has been proposed and studied by Rao et al. [2] and Rao [4] as an alternative measure of uncertainty; see case (i) of Table 1. This measure is obtained by replacing the pdf with the survival function in (1). The CRE can be expressed as (see, e.g., Mitra [5] and Asadi and Zohrevand [6])
Table 1.
Information measures of interest, for a given random lifetime X, with for cases (iii) and (v), for cases (iv) and (vi), and for cases (v) and (vi).
The CRE has been used by Leser [7] in order to measure the elasticity of life expectancy with respect to a proportional change of mortality in life tables. Recently, it has been extended in Psarrakos and Navarro [8] to the generalized cumulative residual entropy (GCRE) of for , as given in (iii) of Table 1. It is worth noting that the GCRE is a dispersion measure related to the (upper) record values of a sequence of independent and identically distributed random variables and to the relevation transform. We recall that the relevation transform of X, denoted by , is defined through the survival function
where is an independent copy of the lifetime X. Specifically, the GCRE refers to a relevation process with underlying distribution function . This process describes the occurrence of failures of items, where a failed item is replaced (or repaired) by another item with the same age. Hence, after denoting by the lifetime of the nth items, has distribution function . Moreover, conditional on has the same distribution of , that is, the residual lifetime of , for all (see Psarrakos and Navarro [8] and Kapodistria and Psarrakos [9] for details). According to the above notation, we note that the GCRE satisfies the following probabilistic relation (see Corollary 4.1 of [9], and Equation (11) below):
Hence, the GCRE provides a measure on the effectiveness of a relevation process, in the sense of the mean. Moreover, it is appropriate to describe useful information on stochastic models connected with the non-homogeneous Poisson process, shock models, preventive maintenance, repairable systems, and standby systems.
For , one has whereas for the GCRE identifies with the CRE (see Table 1). In order to capture the effect of the age of a system on the information of the residual distribution, according to Equation (8) of Psarrakos and Navarro [8], the dynamic version of GCRE, denoted DGCRE for short, is defined by substituting with in the definition (see cases (iii) and (v) of Table 1). It is evident that . Moreover, for we have
i.e., the mean residual life function (4). Some properties of and its dynamic version are widely discussed in Asadi and Zohrevand [6] and Navarro et al. [10], among others. An application of the CRE in reliability engineering systems is given by Toomaj et al. [11]. Several properties of the GCRE and the DGCRE, such as bounds, stochastic ordering, aging classes properties, relationships with other entropy concepts, and characterization results, were investigated by Navarro and Psarrakos [12], Psarrakos and Navarro [8], and Psarrakos and Toomaj [13]. Specifically, in the latter paper the GCRE was studied as a risk measure, compared to the standard deviation and the right-tail risk measure, the latter being introduced by Wang [14].
Various dual measures can be introduced by analogy, as can be seen on the right-hand-side of Table 1, by replacing with , and with . Indeed, Di Crescenzo and Longobardi [15] defined the cumulative entropy (CE) as an alternative measure of uncertainty for the inactivity time by replacing the survival function with the distribution function; see (ii) of Table 1. We also recall that . A suitable extension of the CE, in analogy with the GCRE, was defined by Kayal [16] as the generalized cumulative entropy (GCE); see case (iv) of Table 1. Furthermore, Kayal [16] considered the corresponding dynamic version, named dynamic generalized cumulative entropy (DGCE), as given in case (vi) of Table 1. Note that , which coincides with the GCE of X. Various results on GCE and DGCE, related to bounds, stochastic ordering, aging classes properties, relationships with other entropy concepts, and characterizations, were obtained by Kayal [16] and Di Crescenzo and Toomaj [17].
The aim of the present paper is to investigate further results on GCRE and GCE. Specifically, we first illustrate an intimate connection between the GCRE and the non-homogeneous Poisson process. Moreover, we perform various stochastic comparisons, and provide various inequalities, including an upper bound for the GCRE in terms of the standard deviation. Some of our results are based on the fact that the GCRE is related to the record values of a sequence of independent and identically distributed (i.i.d.) random variables and the relevation transform, and that its dual, i.e., the GCE, is related to the lower record values and the reversed relevation transform. We recall that, in analogy with the relevation transform, the reversed relevation transform of X, denoted by , is defined through the distribution function
with an independent copy of the lifetime X.
In this paper we also focus on certain connections with the excess wealth order, based on the result that the GCRE can be expressed in terms of the excess wealth transform. Our investigation also deals with classical coherent systems of interest in reliability theory, i.e., k-out-of-n systems, by focusing on monotonicity properties and comparison results for their residual variance and GCRE.
The rest of this paper is organized as follows: In Section 2 we investigate a connection of the GCRE with the non-homogeneous Poisson processes (NHPP). Further, an expression for the variance of a random variable based the its mean residual lifetime is obtained and the connection of the GCRE with the standard deviation is considered. The connection of the GCRE with the excess wealth order is obtained in Section 3. Dynamic properties of GCRE and of the residual variance are given in Section 4. A characterization of the exponential distribution in terms of the variance residual life function and the dynamic GCE is also provided in Section 4. In Section 5, we discuss applications of the dynamic GCRE and of the residual variance in reliability, also with reference to k-out-of-n systems. In Section 6, similar results for the GCE are studied, whereas the dynamic GCE and inactivity variance are investigated in Section 7. Finally, Section 8 concludes the paper with some closing remarks.
For simplicity, in the rest of the paper we write instead of for any given function . Moreover, denotes the derivative of . Note that the terms increasing and decreasing are used in a non-strict sense.
2. Connection of Variance and GCRE
An intimate connection of the GCRE with the expected interepochs (or successive times) of a non-homogeneous Poisson process and the relevation transform has been pointed out by Psarrakos and Navarro [8]. These notions arise naturally in preventive maintenance, repairable systems, cold standby systems, and shock models. In fact, such connection shows that the known results on the GCRE can be used in various applied contexts thanks to the large usefulness of the Poisson process. In particular, there is an intimate connection among non-homogeneous Poisson processes (NHPPs), record values, and minimal repair processes. For an excellent review, we refer the readers to, e.g., Gupta and Kirmani [18] and Kirmani and Gupta [19].
Let X be an absolutely continuous nonnegative random variable with pdf and survival function . Assume that denote the epoch times of a NHPP with intensity function (2), where has the same distribution as X. In this case, describes the duration of the interepoch intervals or the interoccurrence times. Denoting by the survival function of it follows that (see Baxter [20])
so that the pdf of is given by
Thus, for the GCRE of order n corresponds to the expected interepoch interval in a non-homogeneous Poisson process, with .
As mentioned by Psarrakos and Toomaj [13], there is a close relationship between the GCRE and the standard deviation . Indeed, can be used for measuring the closeness of X to a degenerate distribution; i.e., it is a dispersion measure.
Proposition 1.
Let , where is a strictly increasing function such that for all Then, for all .
Proof.
From (iii) of Table 1, denoting by the inverse of , one has
Therefore, the proof immediately follows. □
This result is similar to that shown in Theorem 1 of Ebrahimi et al. [21] for the differential entropy. It should be noted that one advantage of the GCRE is that it exists for heavy tailed distributions with mean and , while in this case is not finite; see Psarrakos and Toomaj [13] and Yang [22]. Similar results also hold for the generalized entropy.
Hereafter, we provide a connection between the variance and the generalized cumulative residual entropy. First, we obtain an expression for the variance, , in terms of the mean residual life function. It is based on the results in Hall and Wellner [23] (see also, Fernandez-Ponce et al. [24]).
Theorem 1.
Let X be an absolutely continuous nonnegative random variable with pdf distribution function and mean residual life function where the second moment is finite. Then
Hereafter we show that Theorem 1 does not hold for a discrete random variable.
Remark 1.
Let X be an integer-valued random variable with probability mass function and survival function respectively. The discrete mean residual life is defined as (see Roy and Gupta [25])
For example, we consider a three-point discrete distribution with the probability mass function and Then from (13), we obtain and while It is obvious that However, we get
Applying Theorem 1, one can get variance inequalities under suitable sufficient conditions. First, we recall that X is said to have increasing (decreasing) mean residual life, IMRL (DMRL) for short, if is increasing (decreasing) in
Moreover, for absolutely continuous nonnegative random variables X and Y with CDFs F and G, PDFs f and and mean residual lifetime functions and respectively, we say that X is smaller than Y in the
- Usual stochastic order, denoted by if
- Mean residual lifetime order, denoted by if for all
For further information and properties about these concepts and on the stochastic orders that will be used in this paper (i.e., , , , ), we refer the reader to Shaked and Shanthikumar [26]. In view of the following theorem, we recall that neither of the orders and implies the other (see Section 2.A.2 of [26]).
Theorem 2.
Let X and Y be nonnegative random variables with mean residual life functions and respectively. Then
- (i)
- Let and . If either X or Y is IMRL; then
- (ii)
- Let and . If either X or Y is DMRL; then
Proof.
The first inequality is obtained from the assumption while the last inequality is obtained by the fact that implies that for all increasing functions Now, let X be IMRL. Then, we similarly have
and hence the result stated in (i) follows. The proof of (ii) is similar. □
Example 1.
Let have generalized Pareto distribution, with survival function
for , , (see Arriaza et al. [27] for a recent characterization of the generalized Pareto distribution). It is well known that X has linear mean residual life function , , . Clearly, X is DMRL if , is exponential if , and is IMRL if . Assume that , with analogous constraints on the parameters. It is clear that if and , then and . If, in addition, , then both X and Y are IMRL. Indeed, in this case the result stated in point (i) of Theorem 2 is confirmed, being for and .
In the sequel, we give an upper bound for the generalized CRE in terms of the standard deviation. First, as extension of Theorem 2.1 of Asadi and Zohrevand [6] we provide an expression for the GCRE in terms of the mean residual life function.
Theorem 3.
Let X be an absolutely continuous nonnegative random variable with survival function and mean residual life function , and let be the nth epoch time of a NHPP with intensity function (2). Then, for all
The identity (14) is a special case of Equation (34), which is proved in Section 4 below. As application of the representations (12) and (14), consider the following results.
Example 2.
(i) Assume that X is exponentially distributed with mean Then, it is known that the MRL function of X is Hence, we have and for any due to (14).
(ii) If X is distributed uniformly on then From this, it can be shown that Moreover, for any we have
where the last equality is obtained by noting that
(iii) Let X have a Pareto (Lomax) distribution with parameters and , with survival function and mean residual life given respectively by
Hence, we get
Furthermore, it holds that
where the last equality is obtained by , for .
Remark 2.
A class of distributions of interest in maintenance policies and shock models is the class of new better (worse) than used in expectation (NBUE) (NWUE) distributions. A random lifetime X is said to have a new better (worse) than used in expectation (NBUE) (NWUE) distribution if for all . For a greater detail on these concepts, we refer the reader to, e.g., Barlow and Proschan [28]. If X is NBUE (NWUE), then under the assumptions of Theorem 3 we have
Moreover, from (12) one can see that , or equivalently
Thanks to (14), an iterative formula for the GCRE is proved in the following theorem.
Theorem 4.
Under the assumption of Theorem 3, for all we have
where
Proof.
By virtue of (14) and , it holds that
for all . Using Fubini’s theorem, we have
this giving the desired result. □
Hereafter we provide an alternative iterative formula for the GCRE.
Theorem 5.
Under the assumption of Theorem 3, for all we have
where Z is an absolutely continuous nonnegative random variable having pdf
Proof.
Remark 3.
Hereafter, we obtain an upper bound for the GCRE of X in terms of its standard deviation, thereby providing a suitable relation between two concepts of dispersion measure.
Theorem 6.
Let X be an absolutely continuous nonnegative random variable with standard deviation and GCRE function Then, for all ,
Proof.
By the Cauchy–Schwarz inequality, for all we obtain
On the other hand, it holds that
Therefore, use of Theorems 1 and 3 completes the proof. □
In the special case , from Theorem 6 one can obtain a close relationship between the standard deviation and CRE; i.e.,
where, for , the first inequality is obtained from Rao et al. [2]. It is worth pointing out that the inequalities given in (21) involve three uncertainty measures. Moreover, the related inequality between the differential entropy and the standard deviation is similar to relation (2) of Ebrahimi et al. [21]. They also pointed out that the first inequality in (21) becomes an equality if and only if X is normal. Moreover, if X is exponential then the second inequality is satisfied as equality. As well known, the entropy is a measure of disparity of the density function from the uniform distribution. On the other hand, the variance measures an average of distances of outcomes of the probability distribution from the mean. Additionally, as mentioned by Psarrakos and Toomaj [13] (see also Toomaj et al. [11]), the CRE acts like the standard deviation, i.e., it is a dispersion measure in spite of the similarity shape with the Shannon entropy. Although all of three measures, i.e., entropy, standard deviation, and CRE, are measures of dispersion and uncertainty, the lack of a simple relationship between orderings of a distribution by the three measures derives from their quite substantial and subtle differences. All such measures reflect “concentration”, but their respective metrics for concentration are different.
We remark also that the Stirling formula allows one to obtain the following asymptotic result for the term given in the right-hand-side of (20):
For the last theorem of this section, we provide suitable bounds for the GCRE. These are useful in reliability applications, since in a typical situation the only fact known a priori, for example, is that the component has an increasing (decreasing) failure rate due to wear (reverse ageing). We recall that if X is an absolutely continuous nonnegative random variable with hazard rate function then X is said to have an increasing (decreasing) failure rate, say IFR (DFR), if is increasing (decreasing) in
Theorem 7.
Let X be an absolutely continuous nonnegative random variable with hazard rate function and GCRE function . If X is IFR (DFR), then for all
Proof.
Since X is IFR (DFR), for all we have
Hence, recalling that X has survival function and pdf , from (iii) of Table 1 we have
this giving the proof. □
It is not hard to verify that if X is IFR, then
We recall that the condition that X is IFR implies that X is IFRA, i.e., is increasing in t, so that the above relation indicates that the upper bound in Proposition 3.1 of Psarrakos and Toomaj [13] is a sharper bound. On the other hand, if X is DFR, then it is also DFRA. In this case, the inequality in (23) is reversed. This shows also that the lower bound in Proposition 3.1 of [13] improves the bound given in Theorem 7 when X is DFR.
3. Connection with the Excess Wealth Order
One of the most important issues in statistics, probability, actuarial science, risk theory, and other related areas is the concept of variability. The simplest way of comparing the variabilities of two distributions involves the associated standard deviations. However, the comparison of numerical measures is not always sufficiently informative. Several transforms and stochastic orders for comparing their variabilities have been introduced and widely studied (see Shaked and Shanthikumar [26]). One of said orders for the measure of spread is the excess wealth order. For a nonnegative random variable X with probability distribution function we recall that the quantile function is defined by
The excess wealth transform (or right spread function) is, for ,
This function is also related to the mean residual life function (4) by the following relation
For an absolutely continuous nonnegative random variable X with strictly increasing distribution function F, Fernández-Ponce et al. [24] obtained the following representation for the variance of X in terms of excess wealth
Analogously, in the following theorem we show that the GCRE can be expressed in terms of the excess wealth transform by means of (14). The proof is straightforward and thus is omitted.
Theorem 8.
For an absolutely continuous nonnegative random variable X, for any one has
Example 3.
(ii) Let us consider the Pareto distribution given in case (iii) of Example 2. It is easily seen that . Thus, from (26), for any we have
Let X and Y be random variables with distribution functions F and respectively. Then X is said to be smaller than Y in the excess wealth order, denoted as when for all . It is known that implies ; see Shaked and Shanthikumar [26]. From (26) we thus obtain the following result, whose proof is straightforward.
Theorem 9.
Let X and Y be absolutely continuous nonnegative random variables. If then for any .
Consequently, we have the following implications:
for any We recall that X is smaller than Y in the dispersive order (denoted by ) if , (for more details, see, e.g., Shaked and Shanthikumar [26]).
4. Results on Dynamic GCRE and Residual Variance
In this section, we extend the previous results from GCRE to the DGCRE, cf. Table 1, as well as to the variance residual life function. The mean residual life function at age t has been employed in life lengths studies by various authors; see, e.g., Hollander and Proschan [30], Bhattacharjee [31], Hall and Wellner [23], Gupta [32], and the references therein. Another quantity which has generated interest in recent years is the variance of the residual life function defined by
It is involved in the formula for where is an estimator of the mean residual life function; see Hall and Wellner [23]. Several properties of the variance residual life function are studied in Gupta [32], Gupta et al. [33], and Gupta and Kirmani [18], among others. In this section, we will study some further results of this quantity and the GCRE. Similarly to (12), one can obtain an analogue representation for the variance residual life function in terms of the mean residual life function as follows:
for all Furthermore, its derivative is expressed as (see also Gupta [32])
If X is an absolutely continuous nonnegative random variable, it is shown in Psarrakos and Navarro [8] and Navarro and Psarrakos [12] that, for and , the DGCRE satisfies the following equalities:
and
Hereafter we specify the dynamic version of identity (14). To this aim we point out that
is the pdf of , . Recalling the correspondence between the structure of upper record values and the occurrence times of non-homogeneous Poisson processes under minimal repair (see Gupta and Kirmani [18]), we note that can be viewed also as the pdf of the nth epoch time of a (delayed) NHPP Poisson process whose intensity function is .
Theorem 10.
Under the assumptions of Theorem 1, for all and we have
Proof.
Recalling (3), since , it is not hard to see that for all one has
From the above relation, from the definition given in (iii) of Table 1, and using Fubini’s theorem, we obtain
Clearly, for , Equation (34) yields identity (14). We remark that the dynamic version of Theorem 6 provides the following upper bound:
In the next theorem, through two suitable expressions we provide different probabilistic meanings for the DGCRE. The first is given in terms of a conditional expectation involving the cumulative hazard function and the hazard rate function. The second involves the conditional covariance of the n-th epoch time and the random variable .
Theorem 11.
For any and for all it holds that
- (i)
- (ii)
Proof.
(i) Recalling (33) we have
this giving the desired result due to the definition of DGCRE given in (v) of Table 1.
(ii) By the definition, we have
Therefore, the result follows by means of (32). □
For Theorem 11 immediately yields the following result.
Corollary 1.
For all it holds that
- (i)
- (ii)
We remark also that , and thus Moreover, the special case of Corollary 1 yields the relation , which is given in, e.g., [9].
Let us now provide a result for the variance residual life functions of two random variables satisfying the proportional mean residual life model (see Zahedi [34] and Nanda et al. [35] for some contributions on this topic).
Theorem 12.
Let X and Y be absolutely continuous nonnegative random variables with survival functions and hazard functions and , and residual variances and respectively. Assume that X and Y satisfy the proportional mean residual life model, so that
where c is constant. If and if is an increasing function of t, then is also increasing in provided that
Proof.
From differentiation of (35), after some calculations and making use of Equations (2) and (4), we first obtain that the hazard functions are related to the mean residual life of X by the following relation:
Since is increasing in t by assumption, from (29) we have
for all We need to show that
or, due to (37), the stronger condition
To that aim, we define the function
Since is increasing, this implies that and the desired result then follows. □
The next theorem generalizes Theorem 4.5 of Asadi and Zohrevand [6] for the GCRE and the variance residual life function. We first recall the following result, which is stated in Navarro and Psarrakos [12].
Lemma 1.
If X is IMRL (DMRL), then is increasing (decreasing) in , for all .
Theorem 13.
Let X and Y be absolutely continuous nonnegative random variables with survival functions and variance residual life functions and , and DGCRE functions and respectively, such that and for fixed Let , and let either X or Y be IMRL. Then
- (i)
- for all and for all ;
- (ii)
- for all
Proof.
(i) We prove it by induction, when X is IMRL. Assumption gives for all Moreover, implies that for all increasing functions , and in particular for since X is IMRL. Hence, from these conditions, recalling (31) one can obtain, for all ,
Assume now that for all , and for a fixed . We recall that if X is IMRL, then is increasing in , for all (see Lemma 1). Thus, using similar arguments of from (31) we obtain, for all ,
for . Thus, in this case the proof is completed. The case when Y is IMRL can be treated similarly.
(ii) By using similar arguments of part (i), and due to (28), the result is obtained. □
In the sequel, we compare the GCRE and variance residual life functions of two random variables under weaker conditions.
Theorem 14.
Let X and Y be absolutely continuous nonnegative random variables with survival functions and mean residual life functions and , and DCRE functions and respectively. If , and if X is DMRL and Y is IMRL, then
- (i)
- , for all and for all
- (ii)
- , for all
Proof.
(i) The proof proceeds by induction. For we have
The first inequality in (38) is obtained by noting that Y is IMRL and X is DMRL, while the last inequality is obtained from the assumption . This gives the stated result for . Now we assume that for all , and for a given . Since X is DMRL and Y is IMRL, from Lemma 1 we have that and are decreasing and increasing, respectively. Hence, recalling (31) we get
where the last inequality is due to the inductive hypothesis. This completes the proof.
(ii) The proof of , , can be obtained similarly, starting from (28), making use of the assumption that and are decreasing and increasing, respectively, and finally, using . □
Finally, we conclude this section with a characterization of the exponential distribution in terms of variance residual life function and DCRE.
Theorem 15.
Let X be a nonnegative, absolutely continuous random variable having support , with survival function , residual variance , and DCRE . Then
if and only if X is exponentially distributed.
Proof.
The necessity is obvious. To prove the sufficiency, let Equation (39) hold so that
By differentiating both sides of such identity with respect to recalling (29) and (30) for , and (8), we obtain
Hence, from (40) we get
This reduces to , which yields
The proof is thus complete; recal that the latter identity is fulfilled if and only if X is exponentially distributed (see Theorem 4.8 of Asadi and Zohrevand [6]). □
5. Applications in Reliability Theory
In the study of reliability of redundant systems, parallel systems play an important role. A parallel system consisting of m components, is a system which functions if and only if at least one of its m components functions. Let be i.i.d. random variables with common absolutely continuous distribution function F and survival function and assume that , , is the time up to the failure of the ith component of a coherent system. We denote by , , the lifetime of the component having the kth smallest lifetime among m i.i.d. system components. The random lifetime may represent the lifetime of an -out-of-m system, which consists of m components and functions if and only if at least out of m components functions. For the analysis of an -out-of-m system, we can define for all The conditional random variable denotes the residual lifetime of the system under the condition that at least components of the system are working at time t. The survival function of this lifetime is expressed as
for all We denote the corresponding mean residual lifetime by
Asadi and Goliforushani [36] provided the following expression
where
and where is the odds function. This measure has been studied by several authors in the reliability literature. Applying (42) and recalling (12), the residual variance of , for will be denoted
for all where
is the pdf of . Recalling (31), one can obtain the GCRE of as
for all and for all
Asadi and Goliforushani [36] have shown that, when the components of an -out-of-m system are IFR, then the mean residual life function of is a decreasing function of time t. In the following theorem, we prove similar results for the variance residual life function and the GCRE. We just prove it for the variance since the proof for the other measure is similar.
Theorem 16.
Let denote the i.i.d. lifetimes of an -out-of-m system. If X is IFR, then and are decreasing functions of
Proof.
The results simply follow from Theorem 2.4 of Asadi and Goliforushani [36], Theorem 3.3 of Gupta [32] and making use of Lemma 1. □
Other comparisons of -out-of-m systems are given in the next two theorems.
Theorem 17.
Let denote the lifetimes of an -out-of-m system. If X is DFR, then
- (i)
- for all
- (ii)
- for all
Proof.
The first inequality is obtained due to Remark 3 of Asadi and Bayramoglu [37] by noting that for all while the second inequality follows by the fact that when X is DFR, then is an increasing function of x due to Theorem 2 of Asadi and Bayramoglu [37] and by noting that which implies for all The latter relation can be obtained from the following remarks: from Remark 1 of Asadi and Bayramoglu [37], we derive that the distribution of is identical to the distribution of the k-th order statistics of the sample taken from the conditional distribution of Therefore, from Corollary 1.C.38 of Shaked and Shanthikumar [26] it holds that , which implies for all
(ii) The proof is similar to that of (i) and thus is omitted. □
The following theorem gives sufficient conditions for comparison of two -out-of-m systems based on their variance residual life functions and dynamic GCREs.
Theorem 18.
Let us consider two -out-of-m systems with i.i.d. component lifetimes distributed as X and Y, and having distribution functions F and respectively. If and X is DFR, then
- (i)
- for all
- (ii)
- for all
Proof.
For , from (43) we have
Since X is DFR, then is an increasing function of t due to Theorem 2 of Asadi and Bayramoglu [37]. Moreover, implies and hence the first inequality is obtained. The second inequality follows from Theorem 3 of Asadi and Bayramoglu [37]. Finally, the proof of part (ii) is similar to the proof of part (i) and thus is omitted. □
6. Results on the GCE
As pointed out by Kayal [16], there is an intimate connection with GCE and lower record values. Let be a sequence of i.i.d. nonnegative random variables with a common absolutely continuous cdf F, and with pdf . An observation is said to be a lower record if for all Assume that if occurs at time then the record time sequence is defined as
The random variables , , are said to be the lower records, such that Denoting by the cumulative distribution function of it follows that
so that the pdf of is given by
where is the cumulative reversed hazard function defined in (5). Recalling the definition of GCE given in case (iv) of Table 1, from (44) we obtain
Thus, the GCE of order n corresponds to the expected spacings of lower record values. Note that for which may be divergent. With reference to the GCE, in the following theorem we obtain a result analogous to (14). The proof is omitted, being similar to that of Theorem 3 since
Theorem 19.
Let X be an absolutely continuous nonnegative random variable with mean inactivity time function . Then, for all one has
In the following theorem, we determine equivalent expressions for the GCE analogous to those given in Theorems 4 and 5, and thus the proof is omitted.
Theorem 20.
Under the assumption of Theorem 19, for all we have
- (i)
- where
- (ii)
- where is an absolutely continuous nonnegative random variable having pdf
For an absolutely continuous nonnegative random variable for all such that the mean inactivity time (6) can be written as
where
denotes the mean failure time of a system conditioned by a failure before time also named “mean past lifetime”. The derivative of this function is given by
for all In the next theorem, we prove that the variance of a random variable can also be written in terms of the mean inactivity time function.
Theorem 21.
Let X be an absolutely continuous nonnegative random variable with pdf cdf and mean inactivity time where the second moment is finite. Then
Proof.
Let us set
Using (47), we obtain
Recalling (48), it holds that
Integration by parts gives
which implies
In analogy with the result given in Theorem 2, on the ground of identity (49) we can now state the following theorem. First we remark that for two absolutely continuous nonnegative random variables X and Y with cdf’s F and G, pdf’s f and and mean inactivity time functions and respectively, we say that X is smaller than Y in the mean inactivity time order, denoted by if for all Moreover, we recall that X is said to have increasing mean inactivity time (IMIT) if is increasing in The proof of the following theorem is omitted, being similar to that of Theorem 2.
Theorem 22.
Let X and Y be nonnegative random variables with mean inactivity time functions and respectively. Let and . If either X or Y is IMIT, then
Analogously to (19), hereafter we obtain an upper bound for the GCE in terms of the expected value of the squared mean inactivity time. The proof is omitted being similar to that of Theorem 6.
Theorem 23.
Let X be an absolutely continuous nonnegative random variable with mean inactivity time . Then, for all ,
In the special case , from Theorem 23, one can obtain a close relationship between the standard deviation and the cumulative entropy; i.e.,
similarly as in (21).
7. Results on Past Variance and DGCE
In analogy with the variance of the residual life function defined in (27), we can introduce the variance of inactivity time (VIT) as (see, e.g., Mahdy [38])
It should be noted that it is of interest to compare the dispersion of inactivity time distributions in some situations, especially when the mean inactivity times of these distributions are non-ordered. For example, suppose that the random variable X represents the failure time (or time of death) of a component or a living organism. Assume that the a component or a patient with lifetime fails (dies) at time t or sometimes before t, and consequently the component can be considered as a black box in the sense that the exact failure time or drying time of X is unknown. In this case, one wishes to estimate the time that has elapsed since the failure and to study the dispersion of this elapsed interval of time. Therefore, several authors have considered properties and stochastic orders of the variance inactivity time function; see Mahdy [38,39] and Kayid and Izadkhah [40] and the references therein. Similarly as (49), one can obtain an analogue representation for the variance inactivity time function in terms of the mean inactivity time function as follows:
In analogy with (46) we have:
Hereafter, we provide a result that is dual to Theorem 10, and hence its proof is omitted. To that end, we note that
is the pdf of , .
Theorem 24.
Under the assumptions of Theorem 19, for all and , we have
We remark that the dynamic version of Theorem 23 provides the following upper bound:
Now, with reference to Theorem 11, we obtain the dual results for the past time. In fact, through two suitable expressions we provide different probabilistic meanings for the DGCE where the first is given in terms of a conditional expectation involving the cumulative reversed hazard function as well as the reversed hazard rate function.
Theorem 25.
For any and for all it holds that
- (i)
- (ii)
The analogies between Equations (27) and (52) allow us to provide various results for the VIT that are similar to those for the variance of the residual life. The following theorem is an analogue to Theorem 12; the proof is similar and thus is omitted. In this case we consider random variables having proportional mean inactivity time functions.
Theorem 26.
Let X and Y be absolutely continuous nonnegative random variables with survival functions and mean inactivity time functions and , and variances of inactivity time and respectively. Assume that
where c is constant. If and if is an increasing function of t, then is also increasing in t.
We conclude with a result for the generalized cumulative entropy and the variance of inactivity time that is analogous to Theorem 13. Again, the proof is similar and thus is omitted. We have seen already that X is IMIT means that is increasing in Moreover, consider the following lemma, which is stated in Di Crescenzo and Toomaj [17].
Lemma 2.
If X is IMIT, then is increasing in , for all .
Theorem 27.
Let X and Y be absolutely continuous nonnegative random variables with variances of inactivity time and , and DGCE functions and respectively, such that and for fixed Let , and let either X or Y be IMIT. Then
- (i)
- for all and for all ;
- (ii)
- , for all
8. Conclusions
Besides that the GCRE is related to the upper record values of a sequence of independent and identically distributed random variables, and the relevation transform, there is also an intimate connection of the GCRE with the non-homogeneous poisson process, so we are assured that several findings in the literature on the GCRE can be used in shock models, preventive maintenance, repairable systems, and standby systems. It is known that the GCRE has some important variability properties, such as location invariance and positive homogeneity (i.e., for all and ) and standardization (i.e., for all one has ). These properties suggest that the GCRE can also be considered as a dispersion measure. In this case, a connection of the GCRE with the standard deviation is derived. We have shown that when a random variable is absolutely continuous, then its variance can be represented in terms of either mean residual lifetime and mean inactivity time. Based on these expressions, several preservation properties with some well-known stochastic orders have been investigated. Moreover, the connection of the GCRE with the excess wealth order has been studied, together with some properties of the dynamic version of GCRE. Similar results have been obtained also for the GCE, being the dual measure of GCRE.
Future developments based on the ideas considered in this paper will be oriented to the case of weighted measures involving cumulative weighted random variables (see Toomaj and Di Crescenzo [41]). Other related research lines may involve (i) the information-based measures of statistical dispersion based on entropy and Fisher information treated by Kostal et al. [42], and (ii) the variance of typical information measures, such as the differential entropy and the Tsallis entropy (see, e.g., Di Crescenzo and Paolillo [43], and Wei [44]).
Finally, we note that a new kind of entropy that combines the concepts of CRE and CE is the cumulative paired -entropy. The construction of such a notion is based on both the distribution function and the survival function of X, through the functional
See Klein et al. [45] and Klein and Doll [46] for detailed investigations on , also dealing with relationships of the cumulative paired entropy to the variance. This entropy has the properties of a measure of scale (or dispersion). Suitable choices of allow one to introduce suitable generalized measures. This approach can be adopted also to construct paired combinations of the CGRE and GCE, and of their dynamic counterparts. This reveals new research ideas for future developments.
Author Contributions
The authors contributed equally to this work. All authors have read and agreed to the published version of the manuscript.
Funding
A.T. is partially supported by a grant from Gonbad Kavous University. A.D.C. is a member of the GNCS of INdAM. This research is partially supported by MIUR (PRIN 2017, project “Stochastic Models for Complex Systems”, number 2017JFFHSH).
Acknowledgments
We thank the referees for useful comments.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Shannon, C.E. A mathematical theory of communication. Bell. Syst. Tech. J. 1948, 27, 379–423, 623–656. [Google Scholar] [CrossRef]
- Rao, M.; Chen, Y.; Vemuri, B.; Fei, W. Cumulative residual entropy: A new measure of information. IEEE Trans. Inf. Theory 2004, 50, 1220–1228. [Google Scholar] [CrossRef]
- Schroeder, M.J. An alternative to entropy in the measurement of information. Entropy 2004, 6, 388–412. [Google Scholar] [CrossRef]
- Rao, M. More on a new concept of entropy and information. J. Theoret. Probab. 2005, 18, 967–981. [Google Scholar] [CrossRef]
- Mitra, S. A short note on the Taeuber paradox. Demography 1978, 15, 621–623. [Google Scholar] [CrossRef] [PubMed]
- Asadi, M.; Zohrevand, Y. On the dynamic cumulative residual entropy. J. Stat. Plan. Inference 2007, 137, 1931–1941. [Google Scholar] [CrossRef]
- Leser, C.E.V. Variations in mortality and life-expectation. Popul. Stud. 1955, 9, 67–71. [Google Scholar] [CrossRef]
- Psarrakos, G.; Navarro, J. Generalized cumulative residual entropy and record values. Metrika 2013, 27, 623–640. [Google Scholar] [CrossRef]
- Kapodistria, S.; Psarrakos, G. Some extensions of the residual lifetime and its connection to the cumulative residual entropy. Probab. Eng. Inform. Sci. 2012, 26, 129–146. [Google Scholar] [CrossRef]
- Navarro, J.; del Aguila, Y.; Asadi, M. Some new results on the cumulative residual entropy. J. Stat. Plan. Inference 2010, 140, 310–322. [Google Scholar] [CrossRef]
- Toomaj, A.; Sunoj, S.; Navarro, J. Some properties of the cumulative residual entropy of coherent and mixed systems. J. Appl. Probab. 2017, 54, 379–393. [Google Scholar] [CrossRef]
- Navarro, J.; Psarrakos, G. Characterizations based on generalized cumulative residual entropy functions. Commun. Stat. Theory Methods 2017, 46, 1247–1260. [Google Scholar] [CrossRef]
- Psarrakos, G.; Toomaj, A. On the generalized cumulative residual entropy with applications in actuarial science. J. Comput. Appl. Math. 2017, 309, 186–199. [Google Scholar] [CrossRef]
- Wang, S. An actuarial index of the right-tail risk. N. Am. Actuar. J. 1998, 2, 88–101. [Google Scholar] [CrossRef]
- Di Crescenzo, A.; Longobardi, M. On cumulative entropies. J. Stat. Plan. Inferfaces 2009, 139, 4072–4087. [Google Scholar] [CrossRef]
- Kayal, S. On generalized cumulative entropies. Probab. Eng. Inform. Sci. 2016, 30, 640–662. [Google Scholar] [CrossRef]
- Di Crescenzo, A.; Toomaj, A. Further results on the generalized cumulative entropy. Kybernetika 2017, 53, 959–982. [Google Scholar] [CrossRef]
- Gupta, R.C.; Kirmani, S.N.U.A. Closure and monotonicity properties of non-homogeneous Poisson processes and record values. Probab. Eng. Inform. Sci. 1988, 2, 475–484. [Google Scholar] [CrossRef]
- Kirmani, S.N.U.A.; Gupta, R.C. On repair age and residual repair life in the minimal repair process. Probab. Eng. Inform. Sci. 1989, 3, 381–391. [Google Scholar] [CrossRef]
- Baxter, L. Reliability applications of the relevation transform. Naval Res. Logist. Quart. 1982, 29, 323–329. [Google Scholar] [CrossRef]
- Ebrahimi, N.; Maasoumi, E.; Soofi, E.S. Ordering univariate distributions by entropy and variance. J. Econom. 1999, 90, 317–336. [Google Scholar] [CrossRef]
- Yang, L. Study on cumulative residual entropy and variance as risk measure. In Proceedings of the 2012 Fifth International Conference on Business Intelligence and Financial Engineering, Lanzhou, Gansu, China, 18–21 August 2012; pp. 210–213. [Google Scholar]
- Hall, W.J.; Wellner, J.A. Mean residual life. In Statistics and Related Topics; Csörgö, M., Dawson, D.A., Rao, J.N.K., Saleh, A.K.M.E., Eds.; North-Holland: Amsterdam, The Netherlands, 1981; pp. 169–184. [Google Scholar]
- Fernández-Ponce, J.M.; Kochar, S.C.; MuÑoz-Perez, J. Partial orderings of distributions based on right spread functions. J. Appl. Probab. 1998, 35, 221–228. [Google Scholar] [CrossRef]
- Roy, D.; Gupta, R.P. Characterizations and model selections through reliability measures in the discrete case. Stat. Probab. Lett. 1999, 43, 197–206. [Google Scholar] [CrossRef]
- Shaked, M.; Shanthikumar, J.G. Stochastic Orders and Their Applications; Academic Press: San Diego, CA, USA, 2007. [Google Scholar]
- Arriaza, A.; Di Crescenzo, A.; Sordo, M.A.; Suárez-Llorens, A. Shape measures based on the convex transform order. Metrika 2019, 82, 99–124. [Google Scholar] [CrossRef]
- Barlow, R.E.; Proschan, F. Statistical Theory of Reliability and Life Testing; Holt, Rinehart and Winston: New York, NY, USA, 1975. [Google Scholar]
- Di Crescenzo, A. A probabilistic analogue of the mean value theorem and its applications to reliability theory. J. Appl. Probab. 1999, 36, 706–719. [Google Scholar] [CrossRef]
- Hollander, W.; Proschan, F. Tests for mean residual life. Biometrika 1975, 62, 585–593. [Google Scholar] [CrossRef]
- Bhattacharjee, M.C. The class of mean residual lives and some consequences. Siam J. Algebraic Discrete Methods 1982, 3, 56–65. [Google Scholar] [CrossRef]
- Gupta, R.C. On the monotonic properties of residual variance and their applications in reliability. J. Stat. Plan. Infer. 1987, 16, 329–335. [Google Scholar] [CrossRef]
- Gupta, R.C.; Kirmani, S.N.U.A.; Launer, R.L. On life distributions having monotone residual variance. Probab. Eng. Inform. Sci. 1987, 1, 299–307. [Google Scholar] [CrossRef]
- Zahedi, H. Proportional mean remaining life model. J. Stat. Plan. Inference 1991, 29, 221–228. [Google Scholar] [CrossRef]
- Nanda, A.K.; Bhattacharjee, S.; Alam, S.S. Properties of proportional mean residual life model. Stat. Probab. Lett. 2006, 76, 880–890. [Google Scholar] [CrossRef]
- Asadi, M.; Goliforushani, S. On the mean residual life function of coherent systems. IEEE Trans. Inf. Theory 2008, 57, 314–318. [Google Scholar] [CrossRef]
- Asadi, M.; Bairamoglu, I. The mean residual life function of the k-out-of-n systems at system level. IEEE Trans. Inf. Theory 2006, 55, 314–318. [Google Scholar]
- Mahdy, M. Characterization and preservations of the variance inactivity time ordering and the increasing variance inactivity time class. J. Adv. Res. 2012, 3, 29–34. [Google Scholar] [CrossRef][Green Version]
- Mahdy, M. Further results involving variance past lifetime class and associated orderings, and its properties. Phys. A Stat. Mech. Its Appl. 2016, 462, 1148–1160. [Google Scholar] [CrossRef]
- Kayid, M.; Izadkhah, S. Some new results about the variance inactivity time ordering with applications. Appl. Math. Model. 2016, 40, 3832–3842. [Google Scholar] [CrossRef]
- Toomaj, A.; Di Crescenzo, A. Connections between weighted generalized cumulative residual entropy and variance. Mathematics 2020. submitted. [Google Scholar]
- Kostal, L.; Lansky, P.; Pokora, O. Measures of statistical dispersion based on Shannon and Fisher information concepts. Inf. Sci. 2013, 235, 214–223. [Google Scholar] [CrossRef]
- Di Crescenzo, A.; Paolillo, L. Analysis and applications of the residual varentropy of random lifetimes Probab. Eng. Inform. Sci. 2020. to appear. [Google Scholar] [CrossRef]
- Wei, L. On the exact variance of Tsallis entanglement entropy in a random pure state. Entropy 2019, 21, 539. [Google Scholar] [CrossRef]
- Klein, I.; Mangold, B.; Doll, M. Cumulative paired ϕ-entropy. Entropy 2016, 18, 248. [Google Scholar] [CrossRef]
- Klein, I.; Doll, M. (Generalized) maximum cumulative direct, residual, and paired Φ entropy approach. Entropy 2020, 22, 91. [Google Scholar] [CrossRef]
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).