1. Introduction
Numerous disciplines, including the science of information, physics, statistical analysis, probability, theory of communications, and economics, have made extensive use of the entropy measure that Shannon [
1] introduced. Assume that
Y is the lifespan of a unit with a probability density function (pdf)
, a survival function
, and a cumulative distribution function (cdf)
. If the expected quantity is present, the Shannon differential entropy of
Y, which measures the uncertainty of a random phenomenon, is defined by
The literature has presented a number of entropy measurements, each of which are appropriate for a particular set of circumstances. The uncertainty measure, known as the residual cumulative entropy, was proposed by Rao et al. [
2] and is dependent on the cdf. The residual cumulative entropy for a non-negative continuously random variable
Y with survival function
is shown as
As noted by Asadi and Ebrahimi [
3],
is no longer relevant for evaluating the uncertainty over the unit’s remaining lifespan if
Y is taken to be the lifetime of a new unit. In these cases, the residual entropy measure of a component or system’s lifespan
Y should be taken into account provided that the system has lived to an age
l. The dynamical or dependent on time random variable
with a survival function is what we are interested in examining in these situations:
where
, and both
y and
l are positive. Then the function of mean life residual (
) is defined as
. Asadi and Zohrevand [
4] have adjusted the concept of residual cumulative entropy to account for the system’s present age by using the survival function of
as
The measure
is known as the dynamic residual cumulative entropy measure.
is evident. Address Rao et al. [
2], Asadi and Zohrevand [
4], Navarro et al. [
5], and the articles cited therein for more characteristics and uses of (2) and (3).
Another alternative form of the dynamic residual cumulative entropy measure can be obtained by considering the pdf of
, symbolized as
, in which
y and
l are both positive. Ebrahimi [
6] proposed this measure of
as
In addition to other studies cited in their work, several academics, including Asadi et al. [
7], Nanda and Paul [
8], and Zhang [
9], have conducted extensive research on the properties, extensions, and applications of
.
Another interesting measure of uncertainty is the Sharma–Taneja–Mittal entropy, independently introduced by Sharma and Taneja [
10] and by Mittal [
11] and defined as follows:
with the condition that
, and
,
stands for the quantile function. Moreover, the Sharma–Taneja–Mittal entropy measure provided in (5) could be considered a further development of negative Tsallis entropy if
, see Tsallis [
12].
More recently, Kattumannil et al. [
13] proposed definitions for the Sharma–Taneja–Mittal residual cumulative entropy and cumulative entropy, given by
again under the restriction that
. Subsequently, Sudheesh et al. [
14] reformulated the measures in the above expressions in terms of probability-weighted moments, thereby paving the way for the development of inferential techniques based on the established properties of these moments. Moreover, Sakr and Mohamed [
15] discussed the Sharma–Taneja–Mittal entropy measure in estimation and goodness-of-fit test. In addition, several works have explored the Sharma–Mittal framework and its related extensions in diverse situations. For instance, Ghaffari et al. [
16] examined thermodynamic characteristics of Schwarzschild black holes within the Sharma–Mittal entropy formalism. Koltcov et al. [
17] employed the Sharma–Mittal entropy to assess the performance of topic modeling techniques. In the setting of record values, Paul and Thomas [
18] investigated key properties associated with the Sharma–Mittal entropy. More recently, Sfetcu et al. [
19] introduced an alternative form of the cumulative residual Sharma–Taneja–Mittal entropy and established corresponding upper and lower bounds.
This paper discusses the properties of Sharma–Taneja–Mittal entropy and its extensions. The organization of the rest of the article is as follows:
Section 2 presents the proportional hazard framework of the residual cumulative Sharma–Taneja–Mittal entropy and its non-parametric estimation using a U-statistic.
Section 3 explores the properties of the dynamic residual cumulative Sharma–Taneja–Mittal entropy, including stochastic comparisons and their connections to hazard rate functions, mean residual functions, and equilibrium random variables.
Section 4 introduces an alternative dynamic form of the residual cumulative Sharma–Taneja–Mittal entropy and examines its properties with ordered variables. Finally,
Section 5 presents the Sharma–Taneja–Mittal entropy and its properties for coherent and mixed structures in independent and identically distributed situations.
2. Properties of Residual Cumulative Sharma–Taneja–Mittal Entropy
In this section, we will discuss some further properties of the residual cumulative Sharma–Taneja–Mittal entropy introduced in (6). We demonstrate that is shifting as an independent measure in the following property.
Theorem 1. Let , and let Y be a continuous non-negative random variable. Next, Proof. The conclusion is that for every , . □
Theorem 2. Assume that two random variables, Y and , admit a proportional hazard framework, provided byThen the following claims are true: - (i)
,
- (ii)
.
Corollary 1. Suppose X becomes a random variable that is not negative and has a cdf of K that is absolutely continuous. Using a random sample of K, let be the first-order statistic based on . We know , and so .
Example 1. Suppose the random variable Y follows an exponential distribution with parameter θ, , then , , and . So, we have .
We now derive an estimator for
. Let
, and assume that
represents the smallest order statistic from a random sample
drawn from the distribution
F. For a non-negative random variable
Y, its expectation is given by
. Thus, we can express
This motivates the construction of a U-statistic–based estimator for
as
where the summations extend over the set
containing all combinations of
distinct elements
selected from
for
.
Next, we simplify the expression for
. Denote by
the
j-th order statistic based on the sample
drawn from
K. In terms of these order statistics, the following equivalent formulations hold:
and
Thus, the estimator in (8) can be alternatively written as
We now examine the asymptotic properties of
. It is evident that this estimator is both unbiased and consistent for
(see Lehmann [
20]). The following theorem characterizes its asymptotic distribution.
Theorem 3. As , the scaled differenceconverges in distribution to a normal random variable with mean zero and variance Proof. By employing the central limit theorem for U-statistics, the asymptotic normality of
follows. The asymptotic variance, denoted
, is provided by Lee [
21] as
Define
; then, its survival function is
for
. Notice that
Substituting this result into (11) yields the variance expression shown in (10), which completes the proof. □
Finally, the finite-sample performance of the estimator in (9) is assessed via Monte Carlo simulations, with the results detailed in the next subsection.
2.1. Simulation Studies
Using the exponential distribution with rate
and the gamma distribution with shape parameter equal 2 and scale parameter equal 2 (
), we perform a comprehensive Monte Carlo simulation research to evaluate the estimator performance of the suggested measure. Using R software (version 4.4.1), the simulation is run ten thousand times with varying sample sizes.
Table 1 and
Table 2 present the theoretical value of the residual cumulative Sharma–Taneja–Mittal entropy as well as the variance and the mean square error root (MSER) of the estimator
with different values of
and
. The results in
Table 1 and
Table 2 indicate that for a fixed pair
, increasing the dimension
p significantly reduces both the variance and the MSER of the residual cumulative Sharma–Taneja–Mittal entropy estimator, demonstrating enhanced estimation accuracy with larger
p. Moreover, as the difference between
and
increases—reflected by the
index becoming less negative—the estimator exhibits further improvements, with lower variance and MSER observed. This suggests that a larger disparity between the tuning parameters, in addition to an increased
p, contributes to a more robust and efficient estimation by better balancing bias and variance in the estimation procedure.
Under
,
, and
,
Figure 1 and
Figure 2 show the performance of the residual cumulative Sharma–Taneja–Mittal entropy estimator computed from 10,000 simulations using an exponential distribution with rate
and
distribution, respectively. The top left (TL) panel displays the histogram with a kernel density overlay and the theoretical value marked by a dashed line. The top right (TR) panel shows the QQ-plot for assessing normality. The bottom left (BL) panel illustrates the running cumulative average, demonstrating convergence to the theoretical value, while the bottom right (BR) panel presents a boxplot summarizing the estimator’s dispersion.
2.2. Real Data Application
In this subsection, a real dataset is analyzed to illustrate the practical applicability of the proposed methodology. The dataset comprises records of malignant tumor cases collected from King Faisal Specialist Hospital and Research Centre, classified by tumor site and gender for the year 2023 in Saudi Arabia. The analysis is restricted to female patients from the Jeddah region. This dataset is publicly accessible via the Saudi Open Data Portal at
https://open.data.gov.sa/ar/datasets/view/190d7539-ba90-47f2-a162-f2b64b3c41d1 (accessed on 5 November 2025).
The observations were modeled using an exponential distribution whose cdf is expressed as . Parameter estimation was carried out using the maximum likelihood estimation method, resulting in an estimated rate parameter of . The goodness-of-fit of the model was assessed through two statistical tests:
Kolmogorov–Smirnov test: statistic = 0.29587, with p-value = 0.1168;
Anderson–Darling test: statistic = 2.471, with p-value = 0.05213.
Both tests support the adequacy of the exponential model in describing the observed data. Additionally,
Figure 3 presents the histogram of the data along with the fitted pdf and a comparison between the empirical and fitted cdfs.
We run 10,000 bootstrap samples to examine the estimate for the real set of data.
Table 3 shows the bootstrap estimates of the proposed estimator for several combinations of
based on 10,000 resamples from the observed data. The results indicate that the bootstrap mean values are very close to the original estimates across all combinations, suggesting that the estimator is stable and exhibits only minor bias. The standard deviations and the associated
confidence intervals confirm that the variability of the estimator decreases as the values of
increase, reflecting improved precision for larger order parameters. Overall, the bootstrap analysis supports the consistency and robustness of the proposed estimator under repeated sampling.
3. Dynamic Residual Cumulative Sharma–Taneja–Mittal Entropy
In this section, we will define the dynamic residual cumulative Sharma–Taneja–Mittal entropy. In analogue to (3), we can define the dynamic residual cumulative Sharma–Taneja–Mittal entropy as
with the condition that
, and we readily recognize that
, at
.
Proposition 1. is always non-positive.
Proof. For , we have , , which proves the result. □
Lemma 1. In the event when is an increasing differentiated function, the random variable Z’s dynamic residual cumulative Sharma–Taneja–Mittal entropy can be found using Example 2. Let for a non-negative randomly selected variable Y, where and . Next, we haveMoreover, we can see that - 1.
.
- 2.
.
Let and represent the dynamic residual cumulative Sharma–Taneja–Mittal entropy of the random variables and , where . We now confirm the conditions under which the transformations raise or lower the cumulative Sharma–Taneja–Mittal entropy of the dynamic residual. We specify the dispersion ordered of and to demonstrate this.
Definition 1. A random variable is said to possess a higher degree of dispersion than , denoted by , if and only if there exists a dilation function such that . This means that the function ψ satisfies .
Theorem 4. If it holds that (or equivalently, ), then the relationship is valid.
Proof. Since the dilation function satisfies for all y, and using the non-positivity property established earlier, the required inequality follows immediately from the application of Equation (13). Hence, the result is proved. □
Theorem 5. Let Y be a random variable that is continuous with hazard rate function and the survival function . The connection between the dynamic residual cumulative Sharma–Taneja–Mittal entropy and hazard rate function is provided bywhere . Proof. From (12), we have
When we differentiate both sides of the equation above with regard to
l, we obtain
which is equivalent to
Then,
which proves the theorem. □
Proposition 2. Assume that Y is a non-negative variable that is random with a hazardous rate function and the survival function . The survival function is therefore uniquely determined by .
In the following theorem, we demonstrate that the Sharma–Taneja–Mittal entropy’s dynamic residual cumulative can possibly be represented as an expectation of the mean residual function .
Theorem 6. The dynamic residual cumulative Sharma–Taneja–Mittal entropy can be expressed as Proof. We can write (12) as
By noting that
where
, then the result follows. □
The equilibrium random and the initial random variables are related by the following theorem.
Theorem 7. Assume that the cdf K has the decreasing mean residual life property. Then the equilibrium random variable obeys the inequality Proof. The survival function for the equilibrium’s randomly selected variable
is provided by
Moreover, for the non-positivity property, the equation above now simplifies to (16) when the decreasing mean residual life property is applied. □
4. Alternative Dynamic Residual Cumulative Sharma–Taneja–Mittal Entropy
In this section, we will discuss an alternative version of the dynamic residual cumulative Sharma–Taneja–Mittal entropy. In analogy with (4), we can define the alternative dynamic residual cumulative Sharma–Taneja–Mittal entropy as follows:
with the condition that
, and
is the quantile function of
,
. We readily recognize that
at
.
The resultant value of the expression under affine translation is provided by the following lemma. The proof is left out.
Lemma 2. Define for every absolutely continuous random variable Y, where and are the constants. Subsequently, Proof. Using the transformation for the pdf,
, so
Then, the result follows. □
Ebrahimi [
6] introduced two non-parametric distribution classes characterized by the function
.
Definition 2. A random variable Y is said to exhibit a decreasing (or increasing) life residual property—denoted as DLR (or ILR)—if the function is monotonically decreasing (or increasing) for every .
Similarly, using the measure , we define another set of nonparametric classes.
Definition 3. A non-negative random variable Y is classified as having a decreasing (or increasing) life residual—referred to as DLR (or ILR)—if the function decreases (or increases) continuously for all .
We give a counter-example below to demonstrate that not every distribution is monotonous with regard to .
Example 3. (Illustrative Counterexample) Consider a nonnegative random variable Y whose survival function is defined asAccordingly, the probability density function of Y is given by Now, set and . Then, the expressionis obtained. As illustrated in Figure 4, this function is not monotonic. Remark 1. Unlike Proposition 1, we find that is not always non-positive, as shown in Figure 4. This can be explained by the fact that the ratio is not always less than or equal to one (not necessarily bounded above by one). 4.1. Record Values
Let us look at a technical mechanism that experiences shocks like spikes in voltage. Given a common continual cdf
, pdf
, and survival function
, the shocks may then be treated as a series of independently and equally distributed random variables
. The stresses placed on the mechanism at various points in time are represented by the shocks. The record statistics of this sequence, or the values of the greatest stresses recorded thus far, are of interest to us. Let us represent the
j-th ordering statistic from the first
p occurrences by
. Next, we establish the sequences of upper record values
and upper record timings
, as follows:
noting that
Knowing the incomplete gamma function,
we can see that the survival function and the pdf of
, represented by
and
, correspondingly, are known to be provided by (see, e.g., [
22])
and
In this part, our focus is on analyzing an alternative formulation of the dynamic residual cumulative Sharma–Taneja–Mittal entropy associated with the random variable . This measure serves to assess the level of uncertainty arising from the density function of , which characterizes the remaining lifetime of the system and its predictability. To simplify the computational process, we present a lemma establishing the connection between this alternative formulation of dynamic residual cumulative Sharma–Taneja–Mittal entropy for record value from a uniform distribution and the incomplete gamma function. This link is practically significant as it facilitates a more efficient computation of the proposed entropy measure.
Lemma 3. Consider a sequence of independent and identically distributed random variables following a uniform distribution. Define as the p-th upper record value within this sequence. Then, the following holds:for all and . Proof. For the given sequence
, the random variables are uniformly distributed on
, so the survival function is
Using (18) and (19), we have
Changing the variable,
Rewriting the integral in terms of
v, where
, so when
, we obtain
:
Recognizing this integral as an incomplete gamma function,
□
Practitioners and researchers may easily use the well-known incomplete gamma function to calculate the alternative formulation of the dynamic residual cumulative Sharma–Taneja–Mittal entropy of recording values from a distribution that is uniform by utilizing this lemma. The measure’s applicability and usability in a variety of scenarios are improved by this computational reduction. For the amounts of
and
together with the value of
, we show the plot of
in
Figure 5.
We denote
to signify that the random variable
V follows a truncated Gamma distribution, characterized by the pdf
where
and
are both positive parameters. The following theorem establishes a connection between the alternative expression of the dynamic residual cumulative Sharma–Taneja–Mittal entropy for record values
and this entropy measure for record values derived from a distribution of uniform.
Theorem 8. A series of independently and equally distributed variables that are random, having cdf K and pdf k, is represented as . For the sequence , let represent the p-th higher record value. Then, for any , the alternative expression of the dynamic residual cumulative Sharma–Taneja–Mittal entropy of is constructed as follows:where , . Proof. Using (18) and (19), we have
where
. Then, by applying Lemma 3, the proof is completed. □
The following example shows the application of the previous theorem.
Example 4. We assume a series of randomly distributed variables with equal and independent distributions that have a similar Weibull distribution. This distribution’s cdf is provided byThe inverse cdf of Y may be found asAfter that, we may computeThus, utilizing (21), we obtain. 4.2. Conditional Entropy of Record Values
Given that all units have voltages greater than
, we are now interested in assessing the remaining recordings
,
. Thus,
may express its survival function as follows, see [
23],
In the following part, we will examine the Sharma–Taneja–Mittal entropy of the random variable
, which quantifies the degree of uncertainty regarding the predicted duration of the framework’s residual lifetime with regard to the Sharma–Taneja–Mittal entropy contained in the density of
. A key component of our goal is the probability of the integral substitution
.
obviously has the following pdf:
In the next proposal, we use the previously described transformations to give an expression for the alternative formulation of the dynamic residual cumulative Sharma–Taneja–Mittal entropy of .
Theorem 9. A series of independently and equally distributed variables that are random, having cdf K and pdf k, is represented as . The alternative expression of the dynamic residual cumulative Sharma–Taneja–Mittal entropy of is able to be stated as follows:for every , . Proof. From (17) and (22), we use the changed value of the variable
to obtain
The final equality completes the proof since
represents the pdf of
V stated in (23). □
5. Entropy of Sharma–Taneja–Mittal of a Combination of Systems That Are Coherent
Based on the definition of continuous Sharma–Taneja–Mittal entropy given in Equation (5), we can express the continuous Sharma–Taneja–Mittal entropy of a random variable Y as follows:
Proposition 3. Consider Y as a continuous random variable characterized by a probability density function (pdf) . Then, an alternative formulation of Sharma–Taneja–Mittal entropy using the hazard rate function, defined as , is presented below:where the pdf of the transformed random variable , for , is given by Following the approach of Shaked and Shanthikumar [
24], with the addition of Definition 1, we make use of specific stochastic order relations, including the stochastic order (
), the hazard rate order (
), and the dispersive order (
). Furthermore, the relationships among these orders can be summarized as
;
.
Definition 4. Let and be two non-negative continuous random variables with pdfs and , respectively. Then, we say that is smaller than in the sense of Sharma–Taneja–Mittal entropy, denoted as , ifwhere . Remark 2. The following results will be discussed under the conditions and for all . Moreover, these conditions hold for any other form of the pdf.
Theorem 10. Suppose that and are non-negative continuous random variables, with pdfs , and cdfs , , respectively. From (24), if , then , noting that the conditions in Remark 2 hold.
Proof. From (24) with
. If
, then
Then, the result follows. □
Aspects of the Sharma–Taneja–Mittal entropy of coherence (and mixing) structures are presented in this section. A system is said to be coherent if its structure–function is monotonic and all of its parts are pertinent. One specific example of a coherence structure is the r-out-of-p system. Additionally, according to Samaniego [
25], a collection of coherent frameworks is regarded as a mixed system. In the independent and identical situation, the reliable functional of the mixing system lifespan
L is reflected by
where the survival function of
is
,
. The mixing system lifespan
L’s pdf is provided by
where
is defined as,
,
The vector
represents the mechanism’s signature, and
,
,
. The pdf of the order of the statistical process
,
, is
Consequently,
’s pdf is
The Sharma–Taneja–Mittal entropy of
L is discussed in the following formula utilizing the above transformations.
Theorem 11. The mixed system lifespan L’s Sharma–Taneja–Mittal entropy isnoting that is specified in Equation (26). Proof. After applying the transformation
to (24), we obtain
□
Theorem 12. Assume that two mixed systems with p equally and independent component lives have lifetimes of and under the same signature. Next up is the following:
- 1.
If , then .
- 2.
Consider the sets and . If the relation holds, then it follows that , provided that either or the inequality is satisfied.
Note that the conditions in Remark 2 hold.
Proof. 1. Given that
, we may infer from Equation (24)
where
, which leads to the desired result.
2. Given that
, it follows from Equation (24) that when
, we obtain
Therefore, by utilizing (29) along with the condition
for
, we arrive at
□
The following theorem shows that the shortest lifetime in the equal and independent case has a lower or equal Sharma–Taneja–Mittal entropy order than for all of the mixed systems in the setting of the decreasing failure rate of each lifetime component.
Theorem 13. Assume that the lifespan component has a declining failure rate and that the cases are equal and independent. Then, for the mixed lifetime mechanism denoted by L, we have . Note that the conditions in Remark 2 hold.
Proof. As stated by Bagai and Kochar [
26], when the lifetime has a decreasing failure rate, it holds that
implies
. From Theorem 10, we then conclude that
. □
Theorem 14. Given the assumption that , we obtain from Equation (27)where is the Sharma–Taneja–Mittal entropy of the r-th order statistic. Note that the conditions in Remark 2 hold. Proof. Referring back to Equation (28), we obtain
When we apply Jensen’s inequality, we obtain
where
exhibits convexity when
and
, with
. Therefore,
by multiplying both sides of Equation (30) by
and observing that
, the following holds:
□