Abstract
In this paper, we refined the concept of past extropy measure for concomitants of order statistics from Farlie-Gumbel-Morgenstern family. In addition, cumulative past extropy measure and dynamic cumulative past extropy measure for concomitant of rth order statistic are also conferred and their properties are studied. The problem of estimating the cumulative past extropy is investigated using empirical technique. The validity of the proposed estimator has been emphasized using simulation study.
Keywords:
concomitants of order statistics; Farlie-Gumbel-Morgenstern family; past extropy; cumulative past extropy; dynamic cumulative past extropy MSC:
62B10; 62G30
1. Introduction
Let , be independent and identically distributed (iid) random variables (rvs) from a continuous bivariate distribution with cumulative distribution function (cdf) and joint probability density function (pdf) . Let and be the marginal pdf of X and Y respectively, and be the marginal cdf, respectively. We define as the quantile function of . If we arrange in the order , then the associated with these order statistics (OS) are called concomitants of order statistics (COS). We denote and for the rth order statistic and concomitant of rth order statistic.
If the members of a random sample are sorted according to corresponding values of an other random sample, then the COS arise. The concept of COS has been introduced by [1]. It has important applications in various areas such as in selection problems, inference problems etc. One may refer [2] for more details and applications of COS.
The common approach in the problems of modeling is that to select a family of distributions and then choose the one from the family that is more appropriate to describe the observation. The desirable feature of selecting a family is that it should be flexible. That is, it should accommodate several models that could represent any data situations. The most well-known parametric family from all the available parametric families is the Farlie-Gumbel-Morgenstern (FGM) family, that is mannered by [3]. The FGM family of distributions is constructed in such a way that it includes a joint distribution function along with its marginals, which makes it easier for the analyst to make several assumptions about marginals. Ref. [4] studied about the new generalized FGM distributions and COS. A multi-parameter Generalized FGM bivariate copula family via Bernstein polynomial has been introduced by [5].
One of the most widely used measure of uncertainty is the entropy measure introduced by [6], which is used to quantify the amount of uncertainty involved in a rv and has several applications in various areas. The Shannon entropy is given by
Interested readers can refer the work by [7] for the characterizations of OS and records of entropy. Ref. [8] introduced new measure of sample entropy of continuous rv. Ref. [9] suggested some estimators of entropy using random sampling. The idea of varentropy is proposed by [10] as a great replacement for the kurtosis measure.
The differential extropy proposed by [11] is considered as the complementary dual of Shannon entropy. It is appeared from a critical analysis to score the forecasting distribution. For a non-negative rv X with pdf , differential extropy is given as follows
In the application perspective, one can refer to [12] for the application of extropy in thermodynamics and [13] for the application of extropy in automatic speech recognition. Ref. [14] analysed the characterization results of extropy using OS and record values. Ref. [15] developed some results related to extropy properties of mixed systems. Ref. [16] provided general weighted extropy of ranked set sampling (RSS). They studied some characterization results, stochastic comparison and monotone properties of general weighted extropy.
In order to deal with the situations where uncertainty may be confined to the past life of an event, ref. [17] introduced past entropy for a rv . The past extropy is offered by [18,19] to measure the uncertainty in a past lifetime distribution based on extropy. It is given as
From Equation (2), it is clear that and , for . It has several applications in information theory, reliability theory, survival analysis etc.
Ref. [20] introduced the concept of varextropy which is a dispersion measure of extropy for residual and past lifetimes of rvs. Ref. [21] explored RSS properties of past extropy and negative cumulative extropy. Ref. [22] made a comparison study between past entropy and past extropy and showed that there are situations where uncertainty related to past life is approximately lower for past extropy measure than past entropy. Thus, it is evident that in some situations of uncertainty, information content is more while using past extropy measure than past entropy for rvs representing past life time.
If the properties of the residual and past lifetime depend on time, they are considered as dynamic. This means that these characteristics vary over time and are not constant. Ref. [23] considered dynamic weighted extropy. Ref. [24] introduced the concept of dynamic survival extropy in the literature. Ref. [25] introduced another uncertainty measure called Dynamic survival past extropy (DSPE) for past lifetime of a system. It is defined for a non-negative rv X with absolutely continuous cdf as
It is always less than zero and for , it became the cumulative past extropy (CPE) which is given by [25], as
Some properties of Fisher information in OS and its concomitants are inspected by [26]. Ref. [27] explored information properties for COS in FGM family. [28] explored properties of extropy for concomitants of generalized OS in FGM family. Ref. [29] explained the concept of ordered variables and their concomitants under extropy via COVID-19 data application. Ref. [30] developed the approach of the extropy of concomitants of generalized OS from Huang–Kotz–Morgenstern bivariate distribution.
The concomitants are mostly used in selection problems where the individuals are chosen according to the X values and associated characteristic is shown using the corresponding the Y values. The flexible nature of the FGM family is built in such a way that once the prior information in the form of marginals is available the bivariate distribution can be constructed with the help of those marginals and correlation between the variables directly. Its flexibility encouraged us to cope up the work in COS from FGM family. Ref. [31] studied residual and past entropy for concomitants of ordered rvs from FGM family. But not any work is available on the literature based on the COS from FGM family in the case of past life time rvs. This motivated us to present the information content and properties of COS for the rvs representing past lifetime.
The structure of the paper is organized as: In Section 2, we obtain the expression for based on past extropy measure as well as some results related to past extropy of concomitant of rth order statistic are derived. In Section 3 and Section 4, the properties of COS in CPE and DSPE measures are studied. Section 5 deals with the estimation of CPE for concomitant of rth order statistic using empirical estimators. And in Section 6, simulation study is exhibited to support the potency of the estimator. Finally, Section 7 provides a conclusion of main findings.
2. Past Extropy for Concomitants of Order Statistics in FGM Family
In this section, we derive measures of past extropy for COS in FGM family.
The cdf and pdf of the FGM family are given by [32] as
and
where , and are the marginal pdf of X and Y, respectively. and are the marginal cdf of X and Y, respectively.
The pdf and cdf of concomitant of th order statistic given by [33], respectively are
and
where .
Proposition 1.
Let , be a bivariate random sample from FGM family and denotes the concomitant of the rth order statistic arising from FGM family, the past extropy of denoted as is given by
where is the past extropy of rv Y, and is a uniformly distributed rv on with pdf .
Proof.
Then,
Expanding and rearranging, we get
Using Equation (8) it will be
Hence, the theorem is proved. □
Remark 1.
When in Equation (9), then , which implies .
Remark 2.
If and , we get the concomitants of the 1st and nth OS of a random sample of size n. Then, the past extropy measure for COS and , respectively are given by
and
where is a rv distributed uniformly on and .
Example 1.
Let , be a bivariate random sample arising from FGM bivariate exponential distribution with cdf
where , . Then,
Figure 1 shows some plots of for a sample of size and the first order statistic with various selections of for FGM bivariate exponential distribution.
Figure 1.
The plots of for with various values of for FGM bivariate exponential distribution.
It is clear that values are negative for all cases considered in this figure. Using Equation (14), the difference between concomitants of nth and 1st OS for past extropy measure denoted as is given by
which is positive when , is negative when , and is zero for .
Example 2.
Figure 2 presents plots of the for a sample of size to the first order statistic with FGM bivariate logistic distribution.
Figure 2.
Plots of for for the FGM bivariate logistic distribution.
Figure 2 indicates that the values of are negative and its value depends on the parameter .
Corollary 1.
Let be a bivariate sample of size n coming from FGM family. Then, the past extropy for concomitant of rth order statistic for is same as past extropy for concomitant of th order statistic with .
Proof.
Let us denote as and be the past extropy of concomitant of rth order statistic for any . From the definition of it is clear that
Thus, = . Hence the corollary is attained. □
Corollary 2.
Let be a bivariate sample of size n coming from FGM family. If n is odd, then the concomitant of median of X observations in the case of past extropy measure is same as past extropy of Y.
Proof.
In the case, if n is odd the concomitant of median of X observations is . Again, we can say that for and n is odd. Thus, . The corollary is thus obtained. □
Theorem 1.
Let be the concomitant of rth order statistic arising from FGM family, then the upper bound for past extropy of is given by
where .
Proof.
Since , the inequality can be obtained directly from Proposition 1. □
Theorem 2.
Let . If is the concomitant of rth order statistic obtained from FGM family, the lower bound for is
3. Cumulative Past Extropy of Concomitants of Order Statistics in FGM Family
In this section, we introduce the concept of CPE for concomitant of rth order statistic. The CPE can be defined only for the rvs that have bounded range of possible values since it gives negative infinity for any rv with unbounded support. So, we limit the definition of CPE to bounded rvs. For a non-negative rv X with bounded range of values , the CPE is given by
Proposition 2.
Let , be a bivariate random sample from FGM family. Then, the concomitant of in the case of CPE is given by
where U is a rv uniformly distributed on , is the CPE of rv Y, and .
Proof.
For a rv Y bounded on and from the definition of one may have
Hence, attained the result. □
Remark 3.
In Equation (19), when then , which implies that .
Remark 4.
The CPE of concomitants of the 1st and nth OS, respectively, are given by
and
where U∈ and .
Example 3.
For FGM bivariate uniform distribution with cdf given by
where , and , the expression for with parameters is
Figure 3 presents plots of for sample sizes selected from FGM bivariate uniform distribution to different OS , 5, 10, 15, 25, 30, 40, 50.
Figure 3.
Plots of for various selections of r based on the FGM bivariate uniform distribution.
Again, from Figure 3 it is obvious that the values of are negative and the shape of the depends on the sample size and the rth order statistic. Let be the difference between concomitant of nth order statistic and concomitant of 1st order statistic. Then,
which is positive, negative or zero whenever and , and or and , respectively.
Corollary 3.
For a bivariate sample from FGM family, if n is odd then the CPE for concomitant of median of X observations is same as CPE of rv Y.
Corollary 4.
For a bivariate sample obtained from FGM family, the CPE for concomitant of rth order statistic for is same as CPE of th order statistic for .
Theorem 3.
For a bivariate sample , , lower bound for is given by
where U∈.
Proof.
By using Cauchy-Schwartz inequality, we get
Hence the proof is attained. □
4. Dynamic Survival Past Extropy for Concomitants of Order Statistics in FGM Family
Here, we derive the expression for measures of DSPE for concomitant of rth order statistic.
Proposition 3.
Let be a bivariate sample of size n from FGM family. The concomitant of rth order statistic for DSPE measure, is
where is DSPE of rv Y, ∈ and .
Proof.
Remark 5.
When in Equation (20), then , which implies .
Remark 6.
The concomitants of 1st and nth OS of a random sample of size n are obtained using . Then, the DSPE measure for concomitants of the corresponding OS, respectively are
and
where is a rv distributed uniformly on and .
Example 4.
If is a bivariate sample from FGM bivariate exponential distribution with the cdf given in Equation (13), then
Figure 4 presents some plots of for a sample of size selected from FGM bivariate exponential distribution with .
Figure 4.
Plots of for based on the FGM bivariate exponential distribution.
From Figure 4 it is obvious that the values of are negative and its shape depends on the parameter values . Let be the difference between DSPE of concomitants of nth and 1st OS. It is given by
Hence, is positive when and , is negative when and , is zero when and .
Example 5.
Let the bivariate sample is selected from FGM bivariate logistic distribution with cdf given in Equation (16), the DSPE of is given by
Next,
is positive for when , negative in the range for and zero when with .
Corollary 5.
For a bivariate sample obtained from FGM family, the DSPE for concomitant of rth order statistic for is same as DSPE of th order statistic for .
Proof.
The proof is similar to the proof of Corollary (1). Hence, . □
Corollary 6.
For a bivariate sample from FGM family, if n is odd then the for concomitant of median of X observations is same as DSPE of rv Y.
Proof.
The proof is similar to the proof of Corollary (2) and hence omitted. □
Theorem 4.
The upper bound for DSPE of is given by
where and is the concomitant of rth order statistic arising from FGM family.
Proof.
Since the DSPE ≤ 0, by using Proposition (3) we can obtain the inequality straightly. Hence, the theorem is attained. □
Theorem 5.
If denotes the concomitant of rth order statistic arising from FGM family, then the lower bound of DSPE is
where .
Proof.
Based on Equation (3), we have
Using Cauchy-Schwartz inequality to get
Hence, the theorem is proved. □
5. Estimation of CPE for Concomitant of rth Order Statistic
Here, the problem of estimating the CPE of rth order statistic using the empirical CPE is considered. Let be a sequence obtained from the FGM family. Using Equation (19), the empirical CPE of is derived as
where , are the sample spacings based on rv Y.
Example 6.
For FGM bivariate uniform distribution, the spacings are independent beta distributed with parameters 1 and n. Then,
and
We figured the values of and for different sample sizes for in the case of FGM bivariate uniform distribution, and the results are given in Table 1 and Table 2.
Table 1.
Values of for FGM bivariate uniform distribution with = = 1.
Table 2.
Values of for FGM bivariate uniform distribution with = = 1.
- For a fixed value of n, the values of are decreasing as the values of increases, whereas the values of are increasing with .
- For a fixed , both the values of and are decreasing with the increasing value of n.
- As n tends to infinity, the value of tends to zero.
6. Simulation
A Monte Carlo simulation study is conducted to validate the above proposed empirical estimator of CPE. Data is obtained through random generation following the FGM bivariate uniform distribution with parameter values of and set to 1. The study involves varying values of to analyze and explore different scenarios using the generated data. Empirical CPE, theoretical CPE, bias, and mean squared error (MSE) for are calculated for different values of sample size n and specific . These computations are performed at various OS, allowing for an analysis between empirical and theoretical values while also assessing bias and accuracy for different scenarios, which are showed in Table 3 and Figure 5.
Table 3.
Theoretical value, Estimated value, bias and MSE of CPE of for different values of r, and n.
Figure 5.
CPE of (red) and empirical CPE of (blue) in the case of FGM bivariate uniform distribution for .
From Table 3, it is clear that as the sample size n increases, both the bias and MSE decrease, and in the case of the MSE, it approaches zero. This trend indicates that the estimator is performing well in this scenario. The decreasing bias implies that the estimator tends to be more accurate as the sample size becomes larger. The diminishing MSE suggests that the estimator’s predictions are closer to the true values with increasing sample size, signifying improved estimation accuracy and efficiency.
The following conclusions can be obtained from the Figure 5. They are,
- In all the cases discussed in the figure, both and behaves alike. Both the values are almost similar for various values of OS.
- For , both the theoretical and empirical CPE of show a decreasing trend as the value of r increases.
- On the other hand, for , both the functions and exhibit an increasing pattern as r falls within this range.
7. Conclusions and Future Works
In this work, we have considered the properties of past extropy, CPE, DSPE for concomitant of rth order statistic in FGM family. Several properties and bounds related to the above three measures for COS are developed. Estimation of CPE has been done using empirical estimation. The validity of the proposed estimators has been backed through numerical calculations on FGM uniform distribution and simulation study. From the simulation study, it can be concluded that the empirical CPE of exhibits a behavior similar to the theoretical CPE of . When , as r increases, both the theoretical and empirical CPE of decrease, whereas for , both the theoretical and empirical CPE of increase with decreasing r in this range. The proposed estimator is considered good based on its MSE performance. This suggests that the estimator is capable of providing reliable and satisfactory estimates, making it a favorable choice for the given scenario.
COS play a crucial role in diverse selection processes. One significant application of COS lies in sampling procedures, including RSS, double sampling, and others. Investigating the information content of different information measures using these sampling designs in terms of COS could be a valuable addition to existing literature. To conduct such a study, COS can be derived from various bivariate families like FGM and Sarmanov.
Author Contributions
Conceptualization, M.R.I., K.A., R.M., A.I.A.-O. and G.A.; methodology, M.R.I., K.A., R.M., A.I.A.-O. and G.A.; software, M.R.I., K.A., R.M., A.I.A.-O. and G.A.; validation, M.R.I., K.A., R.M., A.I.A.-O. and G.A.; writing—original draft preparation, M.R.I., K.A., R.M., A.I.A.-O. and G.A.; writing—review and editing, M.R.I., K.A., R.M., A.I.A.-O. and G.A.; visualization, M.R.I., K.A., R.M., A.I.A.-O. and G.A.; funding acquisition, G.A. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2023R226), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia on the financial support for this project.
Data Availability Statement
Not applicable.
Acknowledgments
Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2023R226), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.
Conflicts of Interest
There is no conflict of interest with the publication of this work.
References
- David, H.A. Concomitants of order statistics. Bull. Int. Stat. Inst. 1973, 45, 295–300. [Google Scholar]
- David, H.A.; Nagaraja, H.N. Concomitants of order statistics. In Handbook of Statistics; Balakrishnan, N., Rao, C.R., Eds.; Elsevier: Amsterdam, The Netherlands, 1998; pp. 487–513. [Google Scholar]
- Morgenstern, D. Einfache beispiele zweidimensionaler verteilungen. Mitteilungsblatt Math. Stat. 1956, 8, 234–235. [Google Scholar]
- Bairamov, I.; Kotz, S.; Bekci, M. New generalized Farlie-Gumbel-Morgenstern distributions and concomitants of order statistics. J. Appl. Stat. 2001, 28, 521–536. [Google Scholar] [CrossRef]
- Susam, S.O. A multi-parameter Generalized Farlie-Gumbel-Morgenstern bivariate copula family via Bernstein polynomial. Hacet. J. Math. Stat. 2022, 51, 618–631. [Google Scholar] [CrossRef]
- Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379–432. [Google Scholar] [CrossRef]
- Baratpour, S.; Ahmadi, J.; Arghami, N.R. Some characterizations based on entropy of order statistics and record values. Commun. Stat.-Theory Methods 2007, 36, 47–57. [Google Scholar] [CrossRef]
- Al-Omari, A.I. A new measure of sample entropy of continuous random variable. J. Stat. Theory Pract. 2015, 10, 721–735. [Google Scholar] [CrossRef]
- Al-Omari, A.I. Estimation of entropy using random sampling. J. Comput. Appl. Math. 2014, 261, 95–102. [Google Scholar] [CrossRef]
- Song, K.S. A mathematical theory of communication. J. Stat. Plan. Inference 2001, 93, 51–69. [Google Scholar] [CrossRef]
- Frank, L.; Sanfilippo, G.; Agro, G. Extropy: Complementary dual of entropy. Stat. Sci. 2015, 30, 40–58. [Google Scholar]
- Martinas, K.; Frankowicz, M. Extropy-reformulation of the Entropy Principle. Period. Polytech. Chem. Eng. 2000, 44, 29–38. [Google Scholar]
- Becerra, A.; de la Rosa, J.I.; Gonzalez, E.; Pedroza, A.D.; Escalante, N.I. Training deep neural networks with non-uniform frame-level cost function for automatic speech recognition. Multimed. Tools Appl. 2018, 77, 27231–27267. [Google Scholar] [CrossRef]
- Qiu, G. Extropy of order statistics and record values. Stat. Probab. Lett. 2017, 120, 52–60. [Google Scholar] [CrossRef]
- Qiu, G.; Wang, L.; Wang, X. On extropy properties of mixed systems. Probab. Eng. Inf. Sci. 2019, 33, 471–486. [Google Scholar] [CrossRef]
- Gupta, N.; Chaudhary, S.K. On general weighted extropy of ranked set sampling. Commun. Stat.-Theory Methods 2023. [Google Scholar] [CrossRef]
- Di Crescenzo, A.; Longobardi, M. Entropy-based measure of uncertainity in past lifetime distributions. J. Appl. Probab. 2002, 39, 434–440. [Google Scholar] [CrossRef]
- Krishnan, A.S.; Sunoj, S.M.; Nair, N.U. Some reliability properties of extropy for residual and past lifetime random variables. J. Korean Stat. Soc. 2020, 49, 457–474. [Google Scholar] [CrossRef]
- Kamari, O.; Buono, F. On extropy of past lifetime distribution. Ric. Mat. 2021, 70, 505–515. [Google Scholar] [CrossRef]
- Vaselabadi, N.M.; Tahmasebi, S.; Kazemi, M.R.; Buono, F. Results on varextropy measure of random variables. Entropy 2021, 23, 356. [Google Scholar] [CrossRef]
- Irshad, M.R.; Maya, R.; Archana, K.; Tahmasebi, S. On Past Extropy and Negative Cumulative Extropy Properties of Ranked Set Sampling and Maximum Ranked Set Sampling with Unequal Samples. Stat. Optim. Inf. Comput. 2023, 11, 740–754. [Google Scholar]
- Jose, J.; Abdul Sathar, E.I. Extropy for past life based on classical records. Extropy Past Life Based Class. Rec. 2021, 22, 27–46. [Google Scholar] [CrossRef]
- Sathar, E.A.; Nair, R.D. On dynamic weighted extropy. J. Comput. Appl. Math. 2021, 393, 113507. [Google Scholar] [CrossRef]
- Abdul Sathar, E.I.; Nair, R.D. On dynamic survival extropy. Commun. Stat.-Theory Methods 2020, 50, 1295–1313. [Google Scholar] [CrossRef]
- Pakdaman, Z.; Hashempour, M. On dynamic survival past extropy properties. J. Stat. Res. Iran 2019, 16, 229–244. [Google Scholar]
- Abo-Eleneen, Z.A.; Nagaraja, H.N. Fisher information in an order statistic and its concomitant. Ann. Inst. Stat. Math. 2002, 54, 667–680. [Google Scholar] [CrossRef]
- Tahmasebi, S.; Behboodian, J. Information properties for concomitants of order statistics in Farlie–Gumbel–Morgenstern (FGM) Family. Commun. Stat.-Theory Methods 2012, 41, 1954–1968. [Google Scholar] [CrossRef]
- Almaspoor, Z.; Jafari, A.A.; Tahmasebi, S. Measures of extropy for concomitants of generalized order statistics in Morgenstern Family. J. Stat. Theory Appl. 2022, 21, 1–20. [Google Scholar] [CrossRef]
- Mohamed, M.S.; Abdulrahman, A.T.; Almaspoor, Z.; Yusuf, M. Ordered variables and their concomitants under extropy via COVID-19 data application. Complexity 2021, 2021, 6491817. [Google Scholar] [CrossRef]
- Hussiney, I.A.; Shyam, A.H. The extropy of concomitants of generalized order statistics from Huang–Kotz–Morgenstern bivariate distribution. Hindawi J. Math. 2022, 2022, 6385998. [Google Scholar] [CrossRef]
- Mohie EL-Din, M.M.; Amein, M.M.; Ali, N.S.A.; Mohamed, M.S. Residual and past entropy for concomitants of ordered random variables of Morgenstern Family. Hindawi J. Math. 2015, 2015, 159710. [Google Scholar] [CrossRef][Green Version]
- Johnson, N.L.; Kotz, S. On some generalized Farlie–Gumbel–Morgenstern distributions. Commun. Stat.-Theory Methods 1975, 4, 415–427. [Google Scholar]
- Scaria, J.; Nair, U. On concomitants of order statistics from Morgenstern family. Biom. J. 1999, 41, 483–489. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).