Abstract
We obtain explicit expressions for single and product moments of the order statistics of an omega distribution. We also discuss seven methods to estimate the omega parameters. Various simulation results are performed to compare the performance of the proposed estimators. Furthermore, the maximum likelihood method is adopted to estimate the omega parameters under the type II censoring scheme. The usefulness of the omega distribution is proven using a real data set.
1. Introduction
Dombi et al. [1] pioneered the three-parameter omega distribution and obtained some of its mathematical properties. It allows for modeling bathtub-shaped hazard function (). This model has two characteristics: simplicity and flexibility. The simplicity is because its cumulative distribution function () and include only power functions and lack exponential terms. The flexibility follows from the fact that it has bounded support, while the exponential function tends to infinity over an unbounded support. Furthermore, Dombi et al. [1] proposed two statistical estimation methods for the omega parameters: the first one depends on the log-likelihood function, the so-called global optimization method to maximize it, and the second depends on fitting its to an empirical .
The probability density function () and of the omega distribution, say Omg(), are
and
respectively, where , and . The parameter is the scale, and the maximum density function increases with it. The parameter is the shape, and the density function is strictly monotonously decreasing when and unimodal when . Clearly, the parameter d specifies the support.
Henceforth, we denote by X a random variable with density (1). Notice that
Okorie and Nadarajah [2] derived closed-form expressions for the raw moments and quantile function of the omega distribution. The applications of moments of order statistics are well-known in the statistical literature; see [3,4,5]. Explicit expressions for order statistics moments were determined by [6]. For more results in this context, one may also refer to [7,8,9,10] and the references therein.
In recent years, the importance of order statistics has increased because of the more frequent use of nonparametric inferences and robust procedures. The aim in this paper is to complete the works of Dombi et al. [1] and of Okorie and Nadarajah [2] by deriving explicit expressions for single and product moments of the order statistics of the omega distribution. The L-moments are also obtained. These results can be adopted to derive the best linear unbiased (BLU) and best linear invariant (BLI) estimators of the scale and location-scale parameters of the omega distribution as well as the BLU predictors and BLI predictors of future unobserved order statistic; see, for example [11].
The characterizations of distributions based on the moments of order statistics have also been of great interest to researchers for the past several decades. Therefore, it is important to mention that the findings of this paper can also be useful in the characterization of the omega distribution; see, for example [12,13].
We also consider different methods for estimating the omega parameters and provide numerical simulations to examine the mean square errors (MSEs) of the proposed estimators. Furthermore, the method of maximum likelihood is adopted to estimate the distribution parameters under type II censored samples. It is proven empirically that the omega distribution provides a better fit than ten extensions of the Weibull distribution (with three and four parameters), namely the modified Weibull [14], transmuted complementary Weibull-geometric [15], Lindley Weibull [16], power generalized Weibull [17], alpha power Weibull [18], alpha power exponentiated-Weibull [19], exponentiated-Weibull [20], extended odd Weibull exponential [21], logarithmic transformed Weibull [22], and Weibull distributions.
This paper is organized as follows. In Section 2, we derive explicit expressions for single and product moments of the order statistics from the omega distribution. Some of its statistical properties are obtained in Section 3. Seven estimation methods are presented in Section 4. A simulation study is done in Section 5, and some conclusions are offered in Section 6.
2. Single and Product Moments of Order Statistics
Let be a random sample of size n from the omega distribution with and , given in (1) and (2), respectively, and let be the associated order statistics. The of the rth-order statistic is given (for ) by [23,24]
and the joint of the rth () and sth () order statistics is (for )
where
Next, the kth single moment of takes the form
and the th product moment of and reduces to
Furthermore, we use the integral [25]
to prove some results of this paper, where
are the beta and Gauss hypergeometric functions, respectively, and .
2.1. Single Moments
The results are now presented in the form of theorems.
Theorem 1.
For the omega distribution (1) (, ), we have
Proof.
In view of (6) and the result given by [23] (Page 45), we can write
where
or, equivalently, from Equation (3),
Setting , Equation (12) can be rewritten as
Using the integral Formula (8), we obtain
Inserting in Equation (10), it follows (9).
An alternative equation for follows. □
Theorem 2.
Proof.
Applying similar steps from Theorem 1 leads to (13). □
Remark 1.
(a) Setting in (9) or (13), we obtain
which is the kth moment of X reported by [2].
Setting and in Equation (15), one can obtain simple expressions for the first four moments of X [2].
(b) Setting in (13),
and setting in (13),
which are moments of the extremum order statistics.
Recurrence relations for single moments of order statistics from the (2) are given below.
Theorem 3.
For and ,
and, consequently,
Proof.
Khan et al. [26] proved that (for )
or, equivalently, from (3),
which leads to (18). Using the relation for moments ([23], p. 44)
in Equation (18), we obtain (19). This completes the proof. □
Remark 2.
We obtain the negative moments in Theorem 3 when . For applications, see [27,28].
Corollary 1.
For and ,
and
Proof.
Equations (21) and (22) follow by setting and , respectively, in (19) with for and . □
2.2. Product Moments
The product moment of order statistics from the omega distribution are reported below.
Theorem 4.
For and , we can write
Proof.
Khan et al. [29] showed that (for )
where
Substituting (26) in Equation (24) and simplifying lead to (23). □
Remark 3.
The negative moments follow in Theorem 4 when .
Corollary 2.
For the omega distribution, we obtain ()
and
Proof.
Furthermore, setting and in Equation (23), the recurrence relation (28) follows as
□
Corollary 3.
For in Theorem 4, Theorem 3 follows.
Remark 4.
Setting in (13), we calculate the means and second moments of the order statistics for the omega distribution (for ) for various parameters, reported in Table 1. It can be noted that the condition holds [23].
Table 1.
Moments of order statistics from the omega distribution for several parametric values.
The variance in () is , where and follow from Equation (13) when and , respectively. We compute the moments using theRsoftware [30].
3. Some Statistical Properties
3.1. L-Moments
The L-moments are expectations of certain linear combinations of order statistics [31]. The mth L-moment of a distribution can be defined as
where
The properties and applications of L-moments were explored by [31]. L-moments can also be used in model specification to characterize distributions, parameter estimation, and hypothesis testing.
Setting and 4 in Equation (29), the first four L-moments easily follow. The L-moments for the omega distribution can be written as and , where
The L-moments of the omega distribution computed to six decimal places for selected parameters are reported in Table 2.
Table 2.
L-moments of the omega distribution for several parametric values.
3.2. Incomplete Moments
Okorie and Nadarajah [2] derived closed-form non-central moments of X, say , which can be obtained from (16) with . The rth incomplete moment of X is
and substituting from (1) gives
It can be easily shown that
The first incomplete moment of X comes from Equation (30) when , which also gives the mean deviations and the Bonferroni and Lorenz curves.
4. Methods of Estimation
Dombi et al. [1] proposed two approaches for practical statistical estimation of the omega parameters: the first one is the global optimization method to maximize the log-likelihood function, and the second depends on fitting its cdf to an empirical cdf. Here, we discuss seven methods to estimate these parameters.
4.1. Maximum Likelihood Estimation
Let be a random sample from the omega distribution with corresponding observations , and let () be their first r-order statistics under type II right censored mechanism. The statistical literature contains many papers for estimation under different censoring types, and all the derivations in these papers are based on the maximum likelihood method.
The complete data follow when . The maximum likelihood estimate (MLE) of d follows by noting that . Therefore, the MLE of d is .
The likelihood function for the parameters under type II right censored mechanism follows from (1) and (2):
Then, the log-likelihood function is
The first partial derivatives of ℓ with respect to and are
The MLEs and can be found from these nonlinear equations using the MLE of d therein.
4.2. Ordinary and Weighted Least-Squares
It is well-known that and .
The least squares estimates (LSEs) , and can be determined by minimizing
in relation to , , and d.
The weighted least squares estimates (WLSEs) follow by minimizing
inn relation to these parameters, where the weight function at the jth point is .
4.3. Maximum Product of Spacing
An alternative method to estimate the parameters of a continuous distribution is the maximum product of spacing (MPS) discussed by [32,33].
Let be the observed order statistics. Then, for the omega cdf (2), the uniform spacing (for ) is
where and . Note that . The MPS estimates (MPSEs) of the parameters (for a fixed value of d) are found by maximizing
in relation to and . This can be done equivalently by maximizing
The MPSEs of the unknown parameters can be determined by solving the nonlinear equations
where
4.4. Percentiles
The percentile method is defined by equating the sample percentile points to the population percentiles. If denotes an estimate of , then the percentile estimates (PCEs) , and can be obtained by minimizing
where
and is the unbiased estimator of .
4.5. Anderson–Darling and Right-Tail Anderson–Darling
The Anderson–Darling estimates (ADEs) can be found by minimizing
in relation to , , and d. The ADEs follow by solving the equations
where
and
The right-tail Anderson–Darling estimates (RADEs) are obtained by minimizing
in relation to these parameters. The RADEs can also be found by solving the equations
5. Simulations
Samples of sizes are simulated from the Omg() model, where d has two values , whereas samples of sizes are simulated from the Omg() model for different values of , , and d. The previous estimation methods are compared under two scenarios:
- (i)
- Two unknown parameters: we use the true values , and . The estimates of the parameters and from the seven previous methods and their MSEs are listed in Table 3, Table 4 and Table 5.
Table 3. The maximum likelihood estimates (MLEs), least square estimates (LSEs), weighted least squares estimates (WLSEs), maximum product of spacing estimates (MPSEs), percentile estimates (PCEs), Anderson–Darling estimates (ADEs), right-tail Anderson–Darling estimates (RADEs), and their mean square errors (MSEs).
Table 4. The MLEs, LSEs, WLSEs, MPSEs, PCEs, ADEs, RADEs and their MSEs.
Table 5. The MLEs, LSEs, WLSEs, MPSEs, PCEs, ADEs, RADEs and their MSEs. - (ii)
- Three unknown parameters: we use true values ; ; and . The estimates of the three parameters from the seven estimation methods and their MSEs are reported in Table 6 and Table 7.
Table 6. The MLEs, LSEs, WLSEs, MPSEs, PCEs, ADEs, RADEs and their MSEs.
Table 7. The MLEs, LSEs, WLSEs, MPSEs, PCEs, ADEs, RADEs and their MSEs.
Based on the figures in Table 6 and Table 7, we note that decreasing the actual value improves the estimates while increasing the actual value improves the estimates. Furthermore, we note that increasing d gives good estimates of and . The MLEs, MPSEs, ADEs, RADEs, WLSEs, LSEs, and PCEs are evaluated based on the following quantities including the average estimates and the MSEs for each sample size. The figures in Table 3, Table 4, Table 5, Table 6 and Table 7 reveal that the estimates of the omega parameters are precise and small MSEs for all cases, i.e., these estimates are quite reliable and close to the true parameters. Moreover, the MSEs decay when n increases, thus showing that these estimators are consistent. On the other hand, the performance ordering of the estimators, from best to worst, in terms of their MSEs is MLE, MPSE, ADE, RADE, WLSE, LSE, and PCE in most of these cases.
6. Real Data Illustration
This section compares the omega distribution with the other ten competing distributions in terms of fitting a real data set, which was analyzed by [34]. The data set consists of 72 exceedances of flood peaks (in m/s) of the Wheaton river (Canada) for the years 1958–1984: 0.4, 0.7, 1.7, 1.1, 1.9, 1.1, 2.2, 2.2, 14.4, 20.6, 5.3, 12.0, 13.0, 9.3, 1.4, 18.7, 8.5, 22.9, 1.7, 0.1, 25.5, 2.5, 14.4, 1.7, 37.6, 0.6, 11.6, 14.1, 22.1, 39.0, 0.3, 15.0, 36.4, 2.7, 64.0, 1.5, 11.0, 7.3, 1.1, 0.6, 9.0, 1.7, 7.0, 14.1, 3.6, 5.6, 30.8, 13.3, 9.9, 10.4, 10.7, 20.1, 0.4, 2.8, 30.0, 4.2, 25.5, 3.4, 11.9, 21.5, 27.6, 2.5, 27.4, 1.0, 27.1, 5.3, 9.7, 20.2, 16.8, 27.5, 2.5, and 27.0. Each observation is divided by 65 for computational stability, and hence, the estimate of the parameter d is . The comparison is based on the Kolmogorov–Smirnov (K-S) statistic with its associated p-value.
The selected models are the modified Weibull (MW), transmuted complementary Weibull-geometric (TCWG), Lindley Weibull (LiW), power generalized Weibull (PGW), alpha power Weibull (APW), alpha power exponentiated-Weibull (APEW), exponentiated-Weibull (EW), extended odd Weibull exponential (EOWE), logarithmic transformed Weibull (LTW), and Weibull (W) distributions.
Table 8 reports the MLEs and their corresponding standard errors (SEs), and the K-S statistic (K-S (stat)) with its associated p-value (K-S (p-value)) for all models fitted to the Wheaton river data. The figures in this table indicate that the omega model gives the closest fit to these data compared to the competing distributions.
Table 8.
Results from the fitted distributions.
The fitted , , survival function, and probability–probability (PP) plots of the omega distribution are displayed in Figure 1. The PP plots for all fitted models are displayed in Figure 2. The parameters of the omega distribution are estimated using several estimation methods, as listed in Table 9. The PP plots of the omega model using different estimation methods are given in Figure 3.
Figure 1.
The fitted , , survival function, and probability–probability (PP) plots of the omega distribution.
Figure 2.
The PP plots of the fitted distributions.
Table 9.
Estimates of the omega parameters and Kolmogorov–Smirnov (K-S) (stat) with its associated p-value from seven methods of estimation.
Figure 3.
The PP plots of the omega distribution based on seven methods of estimation.
7. Conclusions
The omega distribution was pioneered by [1] to model reliability data, and its basic properties were studied by [2]. We obtained explicit expressions for single and product moments of order statistics of this distribution along with L-moments, which may be useful for practitioners. This will encourage researchers to conduct further works about the omega distribution and order statistics. We present seven methods to determine estimates of the parameters of the omega distribution and provide a simulation study to illustrate the performance of the different estimators. We show empirically that the maximum likelihood method gives consistent estimates of the omega parameters. An application to real data illustrates the importance of the omega distribution, which gives a superior fit compared to ten other distributions.
It is worth mentioning that this article can be extended in many ways. For example, an exponentiated version of the omega distribution can be established, among other extensions; some properties of the order statistics from this distribution can be investigated and their relations to well-known stochastic orders; and a bivariate or multivariate omega distribution can also be proposed. Furthermore, the parameters of the omega distribution can be estimated in the Bayesian approach under different losses functions.
Author Contributions
Conceptualization, Z.A., H.A., M.A. and A.E.-B.A.A.; methodology, Z.A., H.A., M.A., A.E.-B.A.A. and G.M.C.; software, Z.A., M.A., A.E.-B.A.A. and A.Z.A.; formal analysis, Z.A., A.E.-B.A.A. and A.Z.A.; writing—original draft preparation, Z.A., G.M.C. and A.Z.A.; writing-review and editing, A.A., Z.A., G.M.C. and A.Z.A.; project administration, A.Z.A.; funding acquisition, A.A. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Dombi, J.; Jónás, T.; Tóth, E.Z.; Árva, G. The omega probability distribution and its applications in reliability theory. Qual. Reliab. Eng. Int. 2019, 35, 600–626. [Google Scholar] [CrossRef]
- Okorie, I.E.; Nadarajah, S. On the omega probability distribution. Qual. Reliab. Eng. Int. 2019, 35, 2045–2050. [Google Scholar] [CrossRef]
- Malik, H.J.; Balakrishnan, N.; Ahmed, S.E. Recurrence relations and identities for moments of order statistics I: Arbitrary continuous distribution. Commun. Stat.-Theory Methods 1988, 17, 2632–2655. [Google Scholar]
- Balakrishnan, N.; Malik, H.J.; Ahmed, S.E. Recurrence relations and identities for moments of order statistics II: Specific continuous distributions. Commun. Stat.-Theory Methods 1988, 17, 2657–2694. [Google Scholar] [CrossRef]
- Balakrishnan, N.; Sultan, K.S. Recurrence relations and identities for moments of order statistics. In Handbook of Statistics; Balakrishnan, N., Rao, C.R., Eds.; Order Statistics: Theory and Methods; North-Holland: Amsterdam, The Netherlands, 1998; Volume 16, pp. 149–228. [Google Scholar]
- Nadarajah, S. Explicit Expressions for Moments of Order Statistics. Stat. Probab. Lett. 2008, 78, 196–205. [Google Scholar] [CrossRef]
- Nagaraja, H.N. Moments of order statistics and L-moments for the symmetric triangular distribution. Stat. Probab. Lett. 2013, 83, 2357–2363. [Google Scholar] [CrossRef]
- Çetinkaya, Ç.; Genç, A.ŀ. Moments of order statistics of the standard two-sided power distribution. Commun. Stat.-Theory Methods 2018, 47, 4311–4328. [Google Scholar] [CrossRef]
- Akhter, Z.; MirMostafaee, S.M.T.K.; Athar, H. On the moments of order statistics from the standard two-sided power distribution. J. Math. Model. 2019, 7, 381–398. [Google Scholar]
- Akhter, Z.; Saran, J.; Verma, K.; Pushkarna, N. Moments of order statistics from length-biased exponential distribution and associated inference. Ann. Data Sci. 2020. [Google Scholar] [CrossRef]
- Balakrishnan, N.; Cohen, A.C. Order Statistics and Inference: Estimation Methods; Academic Press: San Diego, CA, USA, 1991. [Google Scholar]
- Lin, G.D. Characterizations of distributions via moments of order statistics: A survey and comparison of methods. In Statistical Data Analysis and Inference; Dodge, Y., Ed.; North-Holland: Amsterdam, The Netherlands, 1989; pp. 297–307. [Google Scholar]
- Kamps, U. Characterizations of Distributions by Recurrence Relations and Identities for Moments of Order Statistics. In Handbook of Statistics; Balakrishnan, N., Rao, C.R., Eds.; Order Statistics: Theory and Methods; North-Holland: Amsterdam, The Netherlands, 1998; Volume 16, pp. 291–311. [Google Scholar]
- Sarhan, A.; Zaindin, M. Modified Weibull distribution. Appl. Sci. 2009, 11, 123–136. [Google Scholar]
- Afify, A.Z.; Nofal, Z.M.; Butt, N.S. Transmuted complementary Weibull geometric distribution. Pak. J. Stat. Oper. Res. 2014, 10, 435–454. [Google Scholar] [CrossRef]
- Cordeiro, G.M.; Afify, A.Z.; Yousof, H.M.; Cakmakyapan, S.; Ozel, G. The Lindley Weibull distribution: Properties and applications. An. Acad. Bras. CiêNcias 2018, 90, 2579–2598. [Google Scholar] [CrossRef]
- Bagdonovacius, V.; Nikulin, M. Accelerated Life Models: Modeling and Statistical Analysis; Chapman and Hall/CRC: Boca Raton, FL, USA, 2002. [Google Scholar]
- Nassar, M.; Alzaatreh, A.; Mead, M.; Abo-Kasem, O. Alpha power Weibull distribution: Properties and applications. Commun. Stat.-Theory Methods 2017, 46, 10236–10252. [Google Scholar] [CrossRef]
- Mead, M.E.; Cordeiro, G.M.; Afify, A.Z.; Al Mofleh, H. The alpha power transformation family: Properties and applications. Pak. J. Stat. Oper. Res. 2019, 15, 525–545. [Google Scholar] [CrossRef]
- Mudholkar, G.; Srivastava, D. Exponentiated Weibull family for analyzing bathtub failure-real data. IEEE Trans. Reliab. 1993, 42, 299–302. [Google Scholar] [CrossRef]
- Afify, A.Z.; Mohamed, O.A. A new three-parameter exponential distribution with variable shapes for the hazard rate: Estimation and applications. Mathematics 2020, 8, 135. [Google Scholar] [CrossRef]
- Nassar, M.; Afify, A.Z.; Shakhatreh, M.K.; Dey, S. On a new extension of Weibull distribution: Properties, estimation, and applications to one and two causes of failures. Qual. Reliab. Eng. Int. 2020, 36, 2019–2043. [Google Scholar] [CrossRef]
- David, H.A.; Nagaraja, H.N. Order Statistics, 3rd ed.; John Wiley: New York, NY, USA, 2003. [Google Scholar]
- Arnold, B.C.; Balakrishnan, N.; Nagaraja, H.N. A First Course in Order Statistics; SIAM Publishers: Philadelphia, PA, USA, 2008. [Google Scholar]
- Gradshteyn, I.S.; Ryzhik, I.M. Tables of Integrals, Series and Products, 7th ed.; Jeffrey, A., Zwillinger, D., Eds.; Academic Press: San Diego, CA, USA, 2007. [Google Scholar]
- Khan, A.H.; Yaqub, M.; Parvez, S. Recurrence relations between moments of order statistics. Nav. Res. Logist. Q. 1983, 30, 419–441, Corrections in 1985, 32, 693. [Google Scholar] [CrossRef]
- Khan, A.H.; Khan, R.U.; Parvez, S. Inverse moments of order statistics from Weibull distribution. Scand. Actuar. J. 1984, 1984, 91–94. [Google Scholar] [CrossRef]
- Ali, M.M.; Khan, A.H. On order statistics from the log-logistic distribution. J. Stat. Plan. Inference 1987, 17, 103–108. [Google Scholar]
- Khan, A.H.; Parvez, S.; Yaqub, M. Recurrence relations between product moments of order statistics. J. Stat. Plan. Inference 1983, 95, 175–183. [Google Scholar] [CrossRef]
- R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2020; Available online: https://www.R-project.org/ (accessed on 22 June 2020).
- Hosking, J.R.M. L-moments: Analysis and estimation of distributions using linear combinations of order statistics. J. R. Stat. Soc. B 1990, 52, 105–124. [Google Scholar] [CrossRef]
- Cheng, R.C.H.; Amin, N.A.K. Estimating parameters in continuous univariate distributions with a shifted origin. J. R. Stat. Soc. 1983, 45, 394–403. [Google Scholar] [CrossRef]
- Ranneby, B. The maximum spacing method: An estimation method related to the maximum likelihood method. Scand. J. Stat. 1984, 11, 93–112. [Google Scholar]
- Choulakian, V.; Stephens, M.A. Goodness-of-fit tests for the generalized Pareto distribution. Technometrics 2001, 43, 478–484. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).