Abstract
In this paper, the problem of predicting future failure times based on a jointly type-II censored sample from k exponential populations is considered. The Bayesian prediction intervals and point predictors were then obtained. Generalized Bayes is a Bayesian study based on a learning rate parameter. This study investigated the effects of the learning rate parameters on the prediction results. The loss functions of squared error, Linex, and general entropy were used as point predictors. Monte Carlo simulations were performed to show the effectiveness of the learning rate parameter in improving the results of prediction intervals and point predictors.
Keywords:
learning rate parameter; exponential distribution; joint type-II censoring; point predictor; prediction intervals; squared-error loss; Linex loss; general entropy loss MSC:
62F10; 62F15
1. Introduction and Motivations
Generalized Bayes is a Bayesian study based on a learning rate parameter () as a power of the likelihood function . The traditional Bayes framework is obtained for , and we demonstrate the effect of the learning rate parameter on the prediction results. That is, if the prior distribution of the parameter is then the generalized Bayes posterior distribution for is
For more details on the generalized Bayes method and the choice of the value of the rate parameter, we refer the reader to [1,2,3,4,5,6,7,8,9,10,11]. In a special way, the choice of the learning rate was studied in [3,4,5,6] by a so-called safe Bayes algorithm based on the minimization of a sequential risk measure. Another learning rate selection method considers the two different information-matching strategies proposed in [7,8]. In addition, a generalized Bayes estimation based on a joint censored sample of type II from k exponential populations using different values of the learning rate parameter was studied in [11]. An exact inference method based on maximum likelihood estimates (MLEs) was developed in [12], and its performance was compared with that of approximate, Bayesian, and bootstrap methods. The joint progressive censoring type II and the expected number of failures for two populations under the joint progressive censoring type II were introduced and studied by [13]. In contrast, the exact likelihood inference for two exponential populations under joint progressive censoring of type II was studied in [14], and some precise results were obtained based on the maximum likelihood estimates developed by [15]. Exact likelihood inference for two populations of two-parameter exponential distributions under type II joint censoring was studied by [16].
One might be interested in predicting future failures using a joint type II censored sample. To accomplish this, prediction points or intervals should be determined. Bayesian prediction bounds for future observations based on certain distributions were discussed by several authors. A study of Bayesian estimation and prediction based on a joint censored sample of type II from two exponential populations was presented by [17]. Prediction (various classical and Bayesian point predictors) for future failures in the Weibull distribution under hybrid censoring was studied by [18]. A Bayesian prediction based on generalized order statistics with multiple censoring of type II was developed by [19].
The main objective of this study is to predict future failures based on a joint type-II censoring scheme for k-exponential populations when censoring is performed on k-samples in a combined manner. Suppose that products from different lines are produced in the same factory, and independent samples of size are selected from these lines and simultaneously placed in a lifetime experiment. To reduce the cost and time of the experiment, the experimenter may decide to stop the lifetime test when a certain number () of failures occurs. The nature of the problem and the distributions used in our study are presented below.
Suppose are -samples, where are the lifetimes of samples of product line and are assumed to be independent and identically distributed (iid) random variables from a population with a probability density function (pdf) and a cumulative distribution function (cdf) .
Furthermore, let be the total sample size, and let be the total number of observed failures. Let denote the order statistics of N random variables . Under the joint type-II censoring scheme for the -samples, the observable data then consist of , where , with being a pre-fixed integer and associated to is defined by
Letting denote the number of -failures in and , the joint density function of is given by
where is the survival functions of hth population and .
For any continuous variables , the joint density function of is given by.
Here, linked with the discrete variables .
Then the joint density function of is given by
where
The conditional density function of given , is given by
where
In addition, when the populations are exponential, the pdf is given by
where .
Then, the likelihood function in (3) becomes
where and .
Substituting (6) into (5), we obtain the conditional density function of , given ,
where , and .
Some special cases of the conditional density function are described as follows:
- Case 1:
Suppose that is the number of samples satisfy , but only one sample from the samples say satisfies or .
Under Case 1, the conditional density function of given becomes
where , , .
- Case 2:
Suppose that is the number of samples satisfy for and is the number of samples satisfy for , equivalently, but .
Under Case 2, let us just consider the samples, where , then the conditional density function of given becomes
where , and .
The remainder of this article is organized as follows: Section 2 presents the generalized Bayesian and Bayesian prediction points and intervals using squared error, Linex, and general entropy loss functions in the point predictor. A numerical study of the results from Section 2 is presented in Section 3. Finally, we conclude the paper in Section 4.
2. Generalized Bayes Prediction
In this section, we introduce the concept of generalized Bayesian prediction, which is an investigation of Bayesian prediction under the influence of a learning rate parameter . To apply the concept of generalized Bayesian prediction to a prediction study, we give a brief description of generalized Bayesian prediction based on a learning rate parameter . A scheme for predicting a sample based on joint censoring of type II samples from k exponential distributions is presented. The main goal is to obtain the point predictors and prediction intervals given at the end of this section.
2.1. Generalized Bayes
The parameters are assumed to be unknown, we may consider the conjugate prior distributions of as independent gamma prior distributions, i.e., . Hence, the joint prior distribution of is given by
where
and denotes the complete gamma function.
Combining (7) and (11) after raising (7) to the power , the posterior joint density function of is then
where .
Since is a conjugate prior, where , then it follows that the posterior density function of is .
2.2. One Sample Prediction
A sample prediction scheme for the case of the joint censoring of samples from two exponential distributions was studied in [17], and then three cases for the future failures were derived; where in the first case, the future predicted failure surly belongs to failures if , in the second case, the future predicted failure surly belongs to failures if , and in the third case, it is unknown to which sample the future predicted failure belongs. Here, we generalize the results reported in [17] and examine two special cases in addition to the general case.
In the general case, the size of any sample is greater than the number of observed failures; that is, for The first special case arises when all future values (predictors) belong to only one sample and the observations of the remaining samples are less than . The second special case arises when all future values (predictors) belong to some samples and all observations of the other samples are less than . The forms of all functions related to the second special case are similar to those related to the general case; therefore, we will introduce only the general case and the first special case.
For the general case, to predict for based on the observed data , we use the conditional density function . Let us define the following integral:
Since ,
Using (8), (13), and (14), the Bayesian predictive density function of given becomes
where
Under Case 1, the Bayesian predictive density function of given becomes
where , .
2.3. Bayesian Point Predictors
For the point predictor, we considered three types of loss functions:
- (i).
- The squared error loss function (SE), which is classified as a symmetric function, is given bywhere is an estimate of
- (ii).
- The Linex loss function, which is asymmetric, is given by
- (iii).
- The generalization of the entropy (GE) loss function is
It is worth noting that the Bayes estimates under the GE loss function coincide with those under the SE loss function when However, when the Bayes estimates under GE become those under the weighted squared error loss function and the precautionary loss function, respectively.
Now, the Bayesian point predictors , under different loss functions (SE, Linex, and GE) can be obtained using the predictive density function (15), which are denoted, respectively, by and given as follows:
Under Case 1, are, respectively, given by
The above equations are solved numerically to obtain the predictors .
2.4. Prediction Interval
The predictive survival function of is given by
Numerical integration is required to obtain the predictive survival function in Equation (23).
In Case 1, the predictive survival function of is given by
The Bayesian predictive bounds of a two-sided equi-tailed interval for , can be obtained by solving the following two equations numerically,
3. Numerical Study
In this section, the results of the Monte Carlo simulation study are conducted to evaluate the performance of the prediction study derived in the previous section, and an example is presented to illustrate the prediction methods discussed here.
3.1. Simulation Study
We considered three samples from three populations with for choices and . In Case 1, we choose the exponential parameters as (2, 1, 0.1) based on the hyperparameters represented by , where .
In the general case, we choose the exponential parameters as (2, 2.5, 3) based on the hyperparameters .
For the generalized Bayesian study, three values are chosen for the learning rate parameter , and 10,000 repetitions are used for the Monte Carlo simulations.
The mean observations values of the three generated samples and their joint sample , using 10,000 repetitions, are presented in Table 1, Table 2, Table 3 and Table 4, where the underlined values are greater than .
Table 1.
The mean observations values for , (Case 1).
Table 2.
The mean observations values for , (Case 1).
Table 3.
The mean observations values for , , (general case).
Table 4.
The mean observations values for , , (general case).
For , under Case 1, we use (20), (21), and (22) to calculate the mean squared prediction errors (MSPEs) of the point predictors () for , where ; , and the results are presented in Table 5.
Table 5.
MSPE of point predictions for in Case 1.
The results of the MSPEs in the general case are calculated using (17), (18), and (19), and shown in Table 6.
Table 6.
MSPEs of point predictions for .
For and , the results of the prediction bounds of and , respectively, are calculated using (24) and (25) in Case 1, then are presented in Table 7.
Table 7.
Lower and upper 95 prediction bounds for in Case 1, for different choices of and .
Table 8 presents the prediction bounds using (23), and (25) to show the results of the general case.
Table 8.
Lower and upper 95 prediction bounds for , for different choices of and .
3.2. Illustrative Example
To illustrate the usefulness of the results developed in the previous sections, we consider three samples of size from Nelson’s data (groups 1, 4, and 5) corresponding to the breakdown of an insulating fluid subjected to a high-stress load (see [20] p. 462). These breakdown times, referred to here as samples , are jointly type-II censored data in the form of obtained from these three samples with and are shown in Table 9.
Table 9.
The failure time data for , and , and their order , where .
Using (17), (18), (19), (23), and (25), the MSPEs of the point predictors and prediction intervals of are calculated and presented in Table 10 using and ; and and .
Table 10.
The values of point predictors and 95 prediction interval of , for .
4. Conclusions
In this study, we examined the effects of learning rate parameters on prediction results. We used Monte Carlo simulations to show the effectiveness of the learning rate parameter in improving the results of prediction intervals and point predictors. Formally, we considered a joint type-II censoring scheme in which the lifetimes of the three populations have exponential distributions. We determined the MSPEs of the point predictors and prediction intervals using different values for the learning rate parameter and different values for the parameters of the losses in both the simulation study and the illustrative example. From all tables in this prediction study, it can be seen that the results improve with increasing the loss parameters c, , and learning rate parameter . In the simulation study, a comparison of the results in Table 5 and Table 6 shows that the results in Table 5 are better, and the length of the prediction intervals in Table 8 is smaller than those in Table 7 because the observed values used in Table 7 are larger than those used in Table 8. The results of the illustrative example improve with larger values of loss parameters and learning rate parameter. So we conclude that the results of the prediction study became better as learning rate parameter increased. However, in both studies, the lengths of the prediction intervals increased for the larger future lifetimes. It may be interesting to examine this work using a different type of censoring.
Author Contributions
Conceptualization, Y.A.-A.; methodology, Y.A.-A. and M.K.; software, G.A.; validation, G.A.; formal analysis, M.K.; resources, Y.A.-A.; writing—original draft, Y.A.-A. and M.K.; writing—review & editing, G.A.; supervision, M.K.; project administration, Y.A.-A. and G.A. All authors have read and agreed to the published version of the manuscript.
Funding
Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2023R226), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.
Data Availability Statement
The data used to support the findings of this study are included in the article.
Acknowledgments
The authors thank the three anonymous reviewers and the editor for their constructive criticism and valuable suggestions, which have greatly improved the presentation and explanations in this article. The authors extend their sincere appreciation to Princess Nourah bint Abdulrahman University Researchers Supporting Project Number (PNURSP2023R226), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Bissiri, P.G.; Holmes, C.C.; Walker, S.G. General framework for updating belief distributions. J. R. Stat. Soc. Ser. B Stat. Methodol. 2016, 78, 1103–1130. [Google Scholar] [CrossRef] [PubMed]
- Miller, J.W.; Dunson, D.B. Robust Bayesian inference via coarsening. J. Am. Stat. Assoc. 2019, 114, 1113–1125. [Google Scholar] [CrossRef] [PubMed]
- Grünwald, P. The safe Bayesian: Learning the learning rate via the mixability gap. In Algorithmic Learning Theory; MR3042889; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2012; Volume 7568, pp. 169–183. [Google Scholar]
- Grünwald, P.; van Ommen, T. Inconsistency of Bayesian inference for misspecified linear models, and a proposal for repairing it. Bayesian Anal. 2017, 12, 1069–1103. [Google Scholar] [CrossRef]
- Grünwald, P. Safe probability. J. Stat. Plan. Inference 2018, 195, 47–63. [Google Scholar] [CrossRef]
- De Heide, R.; Kirichenko, A.; Grünwald, P.; Mehta, N. Safe-Bayesian generalized linear regression. Proc. Mach. Learn. Res. 2020, 106, 2623–2633. [Google Scholar]
- Holmes, C.C.; Walker, S.G. Assigning a value to a power likelihood in a general Bayesian model. Biometrika 2017, 104, 497–503. [Google Scholar]
- Lyddon, S.P.; Holmes, C.C.; Walker, S.G. General Bayesian updating and the loss-likelihood bootstrap. Biometrika 2019, 106, 465–478. [Google Scholar] [CrossRef]
- Martin, R. Invited comment on the article by van der Pas, Szabó, and van der Vaart. Bayesian Anal. 2017, 12, 1254–1258. [Google Scholar]
- Martin, R.; Ning, B. Empirical priors and coverage of posterior credible sets in a sparse normal mean model. Sankhya Ser. A 2020, 82, 477–498. [Google Scholar] [CrossRef]
- Abdel-Aty, Y.; Kayid, M.; Alomani, G. Generalized Bayes estimation based on a joint type-II censored sample from k-exponential populations. Mathematics 2023, 11, 2190. [Google Scholar] [CrossRef]
- Balakrishnana, N.; Rasouli, A. Exact likelihood inference for two exponential populations under joint Type-II censoring. Comput. Stat. Data Anal. 2008, 52, 2725–2738. [Google Scholar] [CrossRef]
- Parsi, S.; Bairamov, I. Expected values of the number of failures for two populations under joint Type-II progressive censoring. Comput. Stat. Data Anal. 2009, 53, 3560–3570. [Google Scholar] [CrossRef]
- Rasouli, A.; Balakrishnan, N. Exact likelihood inference for two exponential populations under joint progressive type-II censoring. Commun. Stat. Theory Methods 2010, 39, 2172–2191. [Google Scholar] [CrossRef]
- Su, F. Exact Likelihood Inference for Multiple Exponential Populations under Joint Censoring. Ph.D. Thesis, McMaster University, Hamilton, ON, Canada, 2013. [Google Scholar]
- Abdel-Aty, Y. Exact likelihood inference for two populations from two-parameter exponential distributions under joint Type-II censoring. Commun. Stat. Theory Methods 2017, 46, 9026–9041. [Google Scholar] [CrossRef]
- Shafay, A.R.; Balakrishnan, N.Y.; Abdel-Aty, Y. Bayesian inference based on a jointly type-II censored sample from two exponential populations. J. Stat. Comput. Simul. 2014, 84, 2427–2440. [Google Scholar] [CrossRef]
- Asgharzadeh, A.; Valiollahi, R.; Kundu, D. Prediction for future failures in Weibull distribution under hybrid censoring. J. Stat. Comput. Simul. 2013, 85, 824–838. [Google Scholar] [CrossRef]
- Abdel-Aty, Y.; Franz, J.; Mahmoud, M.A.W. Bayesian prediction based on generalized order statistics using multiply type-II censoring. Statistics 2007, 41, 495–504. [Google Scholar] [CrossRef]
- Nelson, W. Applied Life Data Analysis; Wiley: New York, NY, USA, 1982. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).