Next Article in Journal
Symmetries of Magnetic Fields Driven by Spherical Dynamos of Exoplanets and Their Host Stars
Next Article in Special Issue
Asymptotic Distributions for Power Variations of the Solutions to Linearized Kuramoto–Sivashinsky SPDEs in One-to-Three Dimensions
Previous Article in Journal
The Brain’s Asymmetric Frequency Tuning: Asymmetric Behavior Originates from Asymmetric Perception
Previous Article in Special Issue
Multistage Estimation of the Scale Parameter of Rayleigh Distribution with Simulation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multistage Estimation of the Rayleigh Distribution Variance

1
Department of Mathematics, Kuwait College of Science and Technology, KuwaitCity 27235, Kuwait
2
Faculty of Commerce, Menoufia University, Menoufia 32952, Egypt
3
Faculty of Management Sciences, October University for Modern Sciences and Arts, Cairo 11435, Egypt
*
Author to whom correspondence should be addressed.
Symmetry 2020, 12(12), 2084; https://doi.org/10.3390/sym12122084
Submission received: 28 November 2020 / Revised: 14 December 2020 / Accepted: 14 December 2020 / Published: 15 December 2020

Abstract

:
In this paper we discuss the multistage sequential estimation of the variance of the Rayleigh distribution using the three-stage procedure that was presented by Hall (Ann. Stat. 9(6):1229–1238, 1981). Since the Rayleigh distribution variance is a linear function of the distribution scale parameter’s square, it suffices to estimate the Rayleigh distribution’s scale parameter’s square. We tackle two estimation problems: first, the minimum risk point estimation problem under a squared-error loss function plus linear sampling cost, and the second is a fixed-width confidence interval estimation, using a unified optimal stopping rule. Such an estimation cannot be performed using fixed-width classical procedures due to the non-existence of a fixed sample size that simultaneously achieves both estimation problems. We find all the asymptotic results that enhanced finding the three-stage regret as well as the three-stage fixed-width confidence interval for the desired parameter. The procedure attains asymptotic second-order efficiency and asymptotic consistency. A series of Monte Carlo simulations were conducted to study the procedure’s performance as the optimal sample size increases. We found that the simulation results agree with the asymptotic results.

1. Introduction

Rayleigh distribution was presented by Rayleigh [1] in 1880 and primarily proposed in the context of a problem in acoustics and optics. As a useful reference for the history of the distribution, see Johnson et al. [2]. The distribution is extensively used in communication theory to describe the hourly median and immediate peak power of received radio signals. It plays a crucial role in survival analysis, reliability analysis, physical sciences, engineering, medical imaging science, applied statistics, and clinical studies. For more details related to its application, see Palovko [3], Gross and Clark [4], Lee and Wang [5], Rosen et al. [6], and Siddiqui [7]; for more information about the distribution and its statistical parameter inference, see Siddiqui [7], Hirano [8], Dyer and Whisenand [9], Howlader and Hossian [10], and Johnson et al. [2].
There have been many forms for the Rayleigh distribution to provide flexibility for modeling data. Vod [11,12] proposed a generalized form of the Rayleigh distribution and discussed its statistical and inferential properties. The probability density function of the generalized form with scale parameter σ and shape parameter λ is given by:
f x ; σ , λ = σ 2 λ 2 x 2 λ + 1 Γ λ + 1 e x / σ 2 , x > 0 ,   σ > 0 ,   λ > 1
where Γ a = 0 t a 1 e t   d t is the gamma function.
At λ = 0 we obtain the standard Rayleigh distribution. The probability density function of the standard Rayleigh distribution with scale parameter σ is:
f x ; σ = x σ 2 e x / σ 2 , x > 0 ,   σ > 0 .
Now, let X 1 , X 2 , be independent and identically distributed random variables following a standard Rayleigh distribution with unknown scale parameter σ . It can be shown from Johnson et al. [2] that the population mean and population variance of the distribution are, respectively, E X = π / 2 σ and V a r X = 2 π 2 σ 2 .
Recently, Yousef et al. [13] discussed the Rayleigh distribution scale parameter’s multistage estimation using Hall’s [14] three-stage procedure. They tackled two estimation problems, point and confidence interval estimation, under a unified optimal stopping rule. They obtained the three-stage regret while they discussed the coverage probability through Monte Carlo simulation. They proved that the procedure attains asymptotic second-order efficiency and asymptotic consistency in the sense of Chow and Robbins [15] and Ghosh and Mukhopadhyay [16]. Tahir [17] proposed a purely sequential procedure to tackle the point estimation problem for the square of the scale parameter of the Rayleigh distribution, using a weighted squared-error loss function plus the cost of sampling. He found a second-order asymptotic expansion for the incurred regret and proved that the asymptotic regret is negative for a range of parameter values.
In this paper, the aim is to estimate the population variance V a r X = 2 π 2 σ 2 or the population second moment E X 2 = 2 σ 2 of the Rayleigh distribution through estimating the scale parameter’s square of the Rayleigh distribution. We do so because both the variance and the second moment are linear functions of σ 2 . We use Hall’s [14] procedure to carry out the study. Using sequential estimation goes back to the non-existence of a fixed-sample-size procedure that solves the problem analytically. For more details, see Mukhopadhyay and de Silva [18] (chapters 6–13 and 16) and Ghosh et al. [19] (Theorem 3.7.1). Since our focus is on the sequential estimation of the scale parameter’s square, we use the following transformation to ease the subsequent sections’ calculations. Let W = X 2 / 2 , and θ =   σ 2 . Then the Jacobian transformation yields that:
f w ; θ = 1 θ e   w / θ ,   0 w < , θ > 0 ,
which is the probability density function of the exponential distribution with mean θ . It is readily known that 2 W / θ is distributed according to the chi-squared distribution with two degrees of freedom χ 2 2 . Let W 1 , W 2 , , W n be a sequence of independent and identically distributed random variables following the exponential distribution in (1), then the r t h raw moment is given by:
E W r = θ r Γ r + 1 .
Hence, for any W i and i = 1 ,   2 ,   3 ,   , n we have:
E W i θ = 0 ,     E ( W i θ ) 2 =   θ 2 ,     E ( W i θ ) 3 = 2 θ 3 ,     E ( W i θ ) 4 = 9 θ 4 .
Moreover, let W ¯ n = i = 1 n W i n   be the sample average of a random sample of size n 2 , then:
E W ¯ n θ = 0 ,     E ( W ¯ n θ ) 2 = θ 2 n   ,   E ( W ¯ n θ ) 3 = 2 θ 3 n 2   , E ( W ¯ n θ ) 4 = 9 θ 4 n 3 .

2. Estimation Problems

2.1. Minimum Risk Point Estimation for the Parameter θ

It is a common practice in optimal decision structures to assume that the cost incurred in estimating θ by the corresponding sample measure W ¯ n takes the form of a squared-error loss function with linear sampling cost. For more details, see Degroot [20], Chow and Yu [21], and Martinsek [22].
L n A = A 2 ( W ¯ n   θ ) 2 + c   n .
The first term in (2) is known as the cost of estimation and the second term is the cost of sampling. The constant c is the cost per unit sample, and A is the estimation unit’s cost. Details regarding the interpretation of A are given in the following sections. The risk associated with (2) is:
R n A   = E L n A = A 2   θ 2 n + c n .
Considering n as a continuous variable, we differentiate (3) concerning n   , and equate the result by zero to get the optimal sample size as:
n * p o i n t =   A θ   / c .
Note that (4) is the optimal fixed-sample size required to minimize the risk had θ been known.

2.2. Fixed-Width Confidence Interval Estimation for the Parameter θ

Assume further that for a fixed-width 2 d > 0 a confidence interval for θ is required, whose coverage probability is at least the nominal value 100 1 α % . We use the central limit theorem and the normal approximation of the distribution of the sample average W ¯ n to propose the interval I n = W ¯ n d θ W ¯ n + d for θ . It follows that for large   n , the central limit theorem states that the quantitate Q = n W ¯ n θ θ is distributed as a standard normal distribution. Therefore,
P |   Q   ) | d n θ 1 α = 2 Φ a 1 ,
where Φ u = 2 π 1 u e t 2 / 2 d t . Moreover, a is the upper α / 2   percentage, the cutoff point of the standard normal distribution. It follows that the optimal sample size required to satisfy the above objectives takes the form:
n * c o n f =   a 2 θ 2 d 2 .
Since θ is numerically unknown, then n * c o n f is unknown. It was shown by Dantzig [23] that there exists no fixed sample size that can achieve the above objectives uniformly for all θ > 0 except sequentially.
In the following, we combine both the point estimation and the confidence interval estimation in one decision framework to make maximum use of the available sample to achieve several objectives in performing inference.

2.3. A Unified Decision Framework for Point and Interval Estimation

To determine the optimal sample size required to achieve both types of estimation, we equate both Equations (4) and (5) to obtain a 2 θ 2 d 2 =   A θ   / c   , which results in A =   a 2 θ c d 2 and A 2 = a 2 d 2 c n * , contrary to what has been said about   A 2 , being a known constant in the literature. In fact,   A 2 is partially known. The term a 2 d 2 is a Fisher information and c n * represents the optimal cost of sampling, which depends on the unknown n * . Therefore,   A 2 represents the cost of estimation measured relative to the optimal cost of sampling. Clearly, A 2 as d 0 . However, we continue to use the optimal sample size in a general form as n * = λ 2 g θ to define the three-stage sampling procedure in the following section. The function g   > 0 is a real-valued and continuously differentiable bounded function in a neighborhood around the parameter θ such that S u p n > m g n = O g n * .

3. Three-Stage Sequential Procedure for Inference

Hall [14] introduced the three-stage sampling procedure. The objective was to obtain a fixed-width confidence interval for the mean of a normal distribution when the variance is finite but unknown. It was designed to overcome several technical problems in both one-by-one purely sequential schemes that were introduced by Anscombe [24], Robbins [25], and Chow and Robbins [15] and the two-stage bulk sample that was introduced by Stein [26,27] and Cox [28]. The procedure showed asymptotic second-order efficiency and asymptotic consistency in the sense of Chow and Robbins [15]. Mukhopadhyay [29] developed a unified framework for the three-stage procedure and laid out the theory associated with asymptotic second-order properties. As suggested by the name, the procedure is carried out in three consecutive sampling phases, the pilot phase, the main-study phase, and the fine-tuning phase.
The pilot-study phase: We start the process by observing a random pilot sample of size m ( > 2 )   W 1 , W 2 , , W m   to initiate the sampling procedure and calculate the sample estimate W ¯ m = i = 1 m W i m .
The main-study phase: In this phase, only a portion 0 < δ < 1 of the optimal sample size n *   is estimated to avoid the early stopping and the possibility of oversampling. Let x be the integer-valued function. Then the procedure is terminated in this stage according to the following stopping rule:
N 1 = m a x {   m   ,   δ λ 2 g W ¯ m + 1 } .
If m   δ λ 2 g W ¯ m + 1 , we terminate the process at this phase; otherwise, we continue to observe an additional sample of size δ λ 2 g W ¯ m + 1   m   , say   W m + 1 , W m + 2 , , W N 1   augment the two samples and update the estimate W ¯ N 1 = i = 1 N 1 W i N 1 .
The fine-tuning phase: We define the fine-tuning stopping rule as:
N = m a x N 1   ,   λ 2 g W ¯ N 1 + 1 .
If N 1 λ 2 g W ¯ N 1 + 1 , sampling is terminated, else we continue to sample a sample of size λ 2 g W ¯ N 1 + 1 N 1 , say   W N 1 + 1 , W N 1 + 2 , W N 1 + 3 , , W N   , then we terminate the sampling course. Hence, we propose the point estimate W ¯ N and the confidence interval I N = W ¯ N ± d for the unknown parameter θ . As a result, the three-stage point estimate for the variance of the Rayleigh distribution is 2 π 2 θ ^ .
The asymptotic characteristics of each phase are given in the following section.
The following asymptotic results were developed under the general regularity assumptions set forward by Hall [14] to develop a theory for the three-stage sampling procedure, which states:
Assumption A.
Let 0 < δ < 1 , k > 1   and   λ 2 = λ 2 m , m 1   be constants, with λ 2 m , l i m S u p m m λ 2 m < δ θ and λ 2 m = O m k ,   k > 1 .

3.1. Asymptotic Characteristics for the Main Study Phase

Theorem 1.
Under assumption (A), for the stopping rules (6) and (7), we have as d   0 ,
(i)  E W ¯ N 1 = θ θ 2 δ n * d l n g θ d θ + o d 2
(ii)  E W ¯ N 1 2 = θ 2 + θ 2 δ n * 1 2 θ   d l n g θ d θ + o d 2
(iii)  E W ¯ N 1 θ 2 = θ 2 δ n *   + o d 2
Proof.
To prove i , we consider E   W ¯ N 1 = θ + E N 1 1 i = 1 N 1 ( W i θ )   .
Conditioning on the σ f i e l d generated by   W 1 , W 2 ,   W 3 , …, W m   we get
E   W ¯ N 1 = θ + E N 1 1 i = 1 m ( W i θ ) + i = m + 1 N 1 ( W i θ ) |   W 1 , W 2 , , W m   .
E   W ¯ N 1 = θ + E   N 1 1   i = 1 m ( W i θ + N 1 m E W i θ , by Wald’s [30] first equation. Therefore, E   W ¯ N 1 = θ + E N 1 1 i = 1 m W i θ   . We then expand   N 1 1 in a Taylor series expansion around g θ to obtain:
  N 1 1 = ( δ n * ) 1 δ λ 2 g W ¯ m g θ   ( δ n * ) 2 + ( δ λ 2 ) 2 (   g W ¯ m g θ ) 2 ν 3 ,
where ν is a random variable that lies between N 1 and   δ n * .
E   W ¯ N 1 = θ   δ λ 2   m E ( W ¯ m θ ) 2 g θ ( δ n * ) 2 + δ λ 2 (   m E ( W ¯ m θ ) 3 g ( ν ) δ n * 2       + ( δ λ 2 ) 2 m E ( W ¯ m θ g W ¯ m   g θ 2 ν 3   = I I I + I I I + V I .
where we expand   g W ¯ m in a Taylor series to the second-order around θ and the fact that g   > 0 at its derivative is bounded gives:
  E I I = θ 2 δ n * d l n g θ d θ ,     E I I I =   δ λ 2 ( m E ( W ¯ m θ ) 3 g ( ν ) δ n * 2 M δ λ 2 m ( δ n * ) 2 2 θ 3 m 2 = o d 2 .  
as m , by the regularity condition in Assumption (A) and M is a constant independent of   both   ν ,   and   N 1 .
Next,
E I V = ( δ λ 2 ) 2 m E W ¯ m θ g W ¯ m     g θ 2 ν 3 ;
consider the following two cases:
  • If m N 1 < ν < δ n * , we have:
    E I V = ( δ λ 2 ) 2 m E W ¯ m θ g W ¯ m g θ 2 ν 3   M δ λ 2 m E W ¯ m θ m 3 = 0 .
We have used the assumption that g · and its derivatives are bounded and the fact that E W ¯ m θ = 0 .
  • If δ n * < ν < N 1 , E I V = ( δ λ 2 ) 2 m E ( W ¯ m θ g W ¯ m     g θ 2 ν 3   M ( δ λ 2 ) 2 m E W ¯ m θ / δ n * 3 = 0 .
Therefore,
  E   W ¯ N 1 = θ θ 2 δ n *   d l n g θ d θ + o d 2 . This proves   i   of Theorem 1. □
To prove   i i , we write E W ¯ N 1 2 = E N 1 2 i = 1 N 1 ( W i θ + θ ) 2 . E W ¯ N 1 2 = θ 2 + E N 1 2 i = 1 N 1 W i θ 2 + 2 θ   E N 1 1 i = 1 N 1 W i θ and by i of Theorem 1, we get E W ¯ N 1 2 = θ 2 2 θ 3 δ n *   d l n g θ d θ + E N 1 2 i = 1 N 1 W i θ 2 . Arguments similar to those used above provide E N 1 2 i = 1 N 1 W i θ 2 = θ 2 δ n * + o d 2 . Combining terms, the statement of the part i i of Theorem 1 is immediate. The proof of (ii) is complete. □
Part ( i i i ) of Theorem 1 is the direct application of parts i and   i i of Theorem 1. □
The following Theorem 2 provides second-order asymptotic expansion of a real-valued, continuously differentiable and bounded function g   > 0   of W ¯ N 1 .
Theorem 2.
Under assumption (A), for the three-stage stopping rule (6) and (7) and as d 0 , we have:
E g W ¯ N 1 = g θ + θ 2   2 δ n * g θ 2 g θ d l n ( g θ d θ + o d 2 .
Proof.
The proof is prompt if we consider the second-order Taylor expansion of g W ¯ N 1 around θ and make use of i and i i of Theorem 1, and the assumption that the real-valued continuously differentiable function g > 0 and its derivatives are bounded. The proof of (iii) is complete. □
In the following section, we present the asymptotic theory for the stopping variable N .

3.2. Asymptotic Characteristics for the Fine-Tuning Phase

Theorem 3.
Under assumption (A), for the stopping variable N , and as d 0 , we have:
(i)  E N = n * + θ 2 δ 1 2   g θ g θ 2 g θ g θ 2 + 1 2 + o 1
(ii)  E N 2 = ( n * ) 2 + θ 2 n * δ g θ g θ g θ g θ 2 + n * + o d 2
(iii)  E N n * 2 = θ 2 n * δ g θ g θ 2 + o d 2
Proof.
First, write the random variable N as N = λ 2 g W ¯ N 1 + φ N 1 ,   a . s . (almost surely) except possibly on a set ζ = N 1 < m λ 2 g W ¯ N 1 < δ λ 2 g W ¯ N 1 + 1 , of measure zero such that   ζ d P = o 1 , and where the random variable φ N 1 = 1 λ 2 g   W ¯ N 1 λ 2 g   W ¯ N 1 is distributed uniformly over 0 ,   1 ; see Hall [14] for details. Therefore, E N = λ 2 E g W ¯ N 1 + E ( φ N 1 ) + o 1 . By using Theorem 2 and E ( φ N 1 ) = 1 / 2 the proof is complete. □
Part ( i i ) . N 2 = λ 4 g 2 W ¯ N 1 + 2   φ N 1 λ 2 g W ¯ N 1 + φ N 1 2 + o 1 . By taking the expectation we have
E N 2 = λ 4 E g 2 W ¯ N 1 + 2 λ 2   E   φ N 1 g W ¯ N 1 + E φ N 1 2 + o 1 .
It can be shown that as d 0 , φ N 1 and g W ¯ N 1 are asymptotically uncorrelated.
Hence, E N 2 = λ 4 E g 2 W ¯ N 1 + λ 2   E   g W ¯ N 1 + o 1 . By using Taylor expansion for g 2 W ¯ N 1 and utilizing Theorem 2, we have:
E λ 4 g 2 W ¯ N 1 = n * 2 + θ 2 n *   δ g 2 θ g θ g θ g θ 2 + o d 2 .
By using part (i), we obtain the proof. The proof is complete. □
Part i i i follows directly from i and i i   of Theorem 3. □
The first part of Theorem 3 shows that lim d 0 E N / n * = 1 (first-order asymptotic efficiency) and lim d 0 E N n * < is bounded by a finite number that is unrelated to n * . Such a property is called second-order asymptotic efficiency in the sense of Chow and Robbins [15]. Part (iii) shows that the variance increases as n * increases.
Theorem 4 below provides a second-order asymptotic expansion of the moments of a real-valued function h > 0 that is a continuously differentiable and bounded function of N .
Theorem 4.
Let assumption (A) hold, and let h (> 0) be a real-valued continuously differentiable function in a neighborhood around n * such that lim Sup n   > m h n = O | h ( n * )|. Then as m ,
E h N = h n * +   θ 2 δ 1 2   g θ g θ 2 g θ g θ 2   + 1 2 h n * + 1 2 θ 2 n * δ   g θ g θ 2 h n * + o d 2 h n * .
Proof.
The proof is a direct substitution of i and i i i of Theorem 3 in the Taylor series expansion of the function   h N . We omit any further details for brevity. The proof is complete. □
Lemma 1.
As d 0 , N is an asymptotically standard normal distribution.
Proof.
According to Anscombe [31], the central limit theorem d 0 , Q = δ n * N n * θ g θ g θ has an asymptotically standard normal distribution. By computing the moment generating function of Q , E e t Q and using Theorem 4 we get the result. The proof is complete. □
Theorem 5.
Under assumption (A), for the stopping variable N , and as d 0 , we have:
(i)  E W ¯ N = θ   θ 2 δ n *   g θ g θ + o d 2
(ii)  E ( W ¯ N ) 2 = θ 2 θ 3 δ n *   1   2 θ   d l n ( g θ d θ + o d 2
(iii)  E W ¯ N θ 2 = θ 2 δ n * + o d 2
Proof.
To prove (i) write E W ¯ N = θ   + E N 1 i = 1 N W i     θ .   Then, condition on the σ f i e l d   generated by   W 1 ,   W 2 , W 3 , , W N 1   to get:
E W ¯ N = θ + E N 1 E i = 1 N 1 W i θ + i = N 1 + 1 N W i θ |   W 1 , W 2 , , W N 1     .
Given   W 1 , W 2 , , W N 1   the term E ( i = 1 N 1 W i     θ ) is constant. Moreover, by Wald’s first equation [30] we get:
E i = N 1 + 1 N W i θ |   W 1 ,   W 2 ,   , W N 1 = N N 1 E W i     θ = 0 .
Therefore,
E W ¯ N = θ   + E N 1 i = 1 N 1 W i     θ .
Consider the second-order expansion of   N 1   in the Taylor series around   n * ; we have:
N 1 =   ( n * ) 1 λ 2 ( g W ¯ N 1 g θ ( n * ) 2 + λ 4 ( g W ¯ N 1 g θ 2 ( ν ) 3 ,
where random variable ν is between N and   n * . The assumption that g > 0 and its derivatives are bounded can be used to prove that λ 4 E i = 1 N 1 W i     θ g W ¯ N 1 g θ 2 v 3 = 0 .
E W ¯ N = θ + E i = 1 N 1 W i θ ( n * ) 1   λ 2 ( g W ¯ N 1 g θ ( n * ) 2 + o d 2 .  
E W ¯ N = θ   λ 2 E i = 1 N 1 W i θ ( g W ¯ N 1 g θ ( n * ) 2 + o d 2 .  
Consider that the first-order Taylor expansion of g ( W ¯ N 1 ) gives
E W ¯ N = θ   λ 2 E N 1 i = 1 N 1 W i θ 2 g θ ( n * ) 2 . Again, we condition on the σ f i e l d generated by   W 1 , W 2 , , W m   . We get:
E W ¯ N   = θ λ 2 g θ ( n * ) 2 E { N 1 E { ( i = 1 m 1 W i θ + i = m + 1 N 1 ( W i θ ) ) 2   } |   W 1 ,   W 2 ,   W 3 , , W m   } .  
Arguments similar to those used above and the fact that N 1 1   ( n * ) 1 yield statement of ( i i ) of Theorem 5. The proof is complete. □
Part i i i of Theorem 5 is the direct use of i   a n d   i i of Theorem 5; we omit details. The proof is complete. □
Part (i) of Theorem 4 shows that W ¯ N is an asymptotically unbiased estimator of θ whereas the variance decreases as n * increases.

3.3. The Asymptotic Regret

The regret associated with the quadratic loss function with linear sampling cost given by (2) is:
ω d = E L N d ) L n * d ,
where L N d is the loss associated with the three-stage sampling estimation procedure, and L n * d is the optimal loss had the parameter θ been known.
E L N d ) = a 2 d 2 c n * E ( W ¯ N θ ) 2 + c   E N
and by i i i of Theorem 5 and i of Theorem 3, we get:
E L N d = c   a 2 δ θ 2 d 2 + c n * +   θ 2 δ 1 2   g θ g θ     2 g θ g θ 2 + 1 2 + o 1 . = c n * 1 + δ + c θ 2 δ 1 2   g θ g θ     2 g θ g θ 2 + c 2 + o 1 .
and the optimal risk L n * d = 2 c n * . Therefore, the asymptotic regret is given as:
ω d = c n * δ 1 + c θ 2 δ 1 2   g θ g θ     2 g θ g θ 2 + c 2 + o 1 .
As shown above, negative regret is expected, since   c   n * δ 1 < 0 . The issue of negative regret was addressed also by Martinsek [22], Yousef [32], and Hamdy [33]. This phenomenon deserves an in-depth investigation shortly.

3.4. Three-Stage Asymptotic Coverage Probability for the Parameter θ

The three-stage coverage probability is defined as:
P θ I N = n = m P W ¯ N θ d ,   N = n = n = m P ( W ¯ N θ d | N = n ) P N = n .
Meanwhile, the two events P W ¯ N θ d and the event N = n are dependent for n = m ,   m + 1 , . Therefore, we cannot obtain a mathematical expression of the coverage probability like those of Hall [14], Hamdy et al. [34], and Hamdy [35]. Therefore, we conducted a Monte Carlo simulation using Microsoft Developer Studio software to study the performance of the three-stage fixed-width confidence interval for θ when the optimal sample size varies from small to moderate and to large.

4. Simulation Study

We conducted a Monte Carlo simulation [36] to study the performance of the fixed-width confidence interval for the parameter θ . A series of 5 0 , 000 replications was generated from the exponential distribution with mean θ = 5 using Microsoft Developer Studio software with the IMSL (International Mathematical and Statistical Library). The optimal sample sizes were chosen as recommended by Hall [15]: n * = 24 ,   43 ,   61 ,   76 ,   96 ,   125 ,   171 ,   246 , and 500. We took the design factor γ = 0.5 and the pilot sample m = 10 . For brevity, we will consider   α = 5 % , which gives   a = 1.96 . Let N ¯ be the simulated estimate of the optimal sample size n * with standard error S N ¯ . Let θ ^ be the simulated estimate of the scale parameter’s square of the Rayleigh distribution with standard error S ( θ ^ ) . v a r ^ x is the simulated estimate for the variance of the Rayleigh distribution and 1 α ^ is the simulated estimate of the coverage probability. Table 1 below demonstrates the simulation results as the optimal sample size increases. We noticed that the simulation results agree with our findings while the coverage probability improves as the optimal sample size increases. It is evident from the simulation that the procedure provides coverage probabilities that are less than the prescribed nominal value, that is, P θ I N < 1 α . At the same time, as d 0 , P θ I N 1 α . Collectively, all estimates improve as the optimal sample size increases. For the simulation methodology, see Yousef [37].

5. Conclusions

We have proposed a three-stage sequential procedure for estimating the Rayleigh distribution variance by estimating the Rayleigh distribution scale parameter’s square. We proposed a unified decision framework for estimation and found all asymptotic results that led to asymptotic regret. The procedure attained negative regret, which shows that the three-stage procedure provides estimates better than the classical fixed-sample size procedures. Monte Carlo simulation agreed with our findings and revealed that the procedure provides coverage probabilities that are always less than the desired nominal value.

Author Contributions

Conceptualization, A.Y., and H.I.H.; methodology, A.Y.; A.A.A.; software, A.Y.; validation, A.Y., A.A.A., E.E.H.; investigation, A.Y., and H.I.H.; resources, A.Y.; data curation, A.Y., A.A.A., E.E.H. and H.I.H.; writing—original draft preparation, A.Y.; writing—review and editing, A.Y., A.A.A.; visualization, A.Y. and H.I.H.; supervision, A.Y. and H.I.H.; project administration, A.Y.; funding acquisition, A.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Rayleigh, L. On the stability or instability of certain fluid motions. Proc. Lond. Math. Soc. 1880, 1, 57–70. [Google Scholar] [CrossRef]
  2. Johnson, N.L.; Kotz, S.; Balakrishnan, N. Continuous Univariate Distributions, 2nd ed.; John Wiley & Sons: New York, NY, USA, 1994. [Google Scholar]
  3. Palovko, A.M. Fundamentals of Reliability Theory; Academic Press: New York, NY, USA, 1968. [Google Scholar]
  4. Gross, A.J.; Clark, V.A. Survival Distributions, Reliability Application in Biomedical Science; John Wiley & Sons: New York, NY, USA, 1975. [Google Scholar]
  5. Lee, E.T.; Wang, J.W. Statistical Methods for Survival Data Analysis, 3rd ed.; John Wiley & Sons Inc.: Hoboken, NJ, USA, 2003. [Google Scholar]
  6. Rosen, K.; Buskirk Van, R.; Garbesi, K. Wind energy potential of coastal Eritrea: An Analysis of sparse wind data. Sol. Energy 1999, 66, 201–213. [Google Scholar] [CrossRef]
  7. Siddiqui, M.M. Some problems connected with Rayleigh distributions. J. Res. Nat. Bur. Stand. D 1962, 66, 167–174. [Google Scholar] [CrossRef]
  8. Hirano, K. Rayleigh Distributions; John Wiley & Sons: New York, NY, USA, 1986. [Google Scholar]
  9. Dyer, D.D.; Whisenand, C.W. Best Linear Unbiased estimator of the parameter of the Rayleigh distribution: Part-II optimum theory for selected order statistics. IEEE Trans. Reliab. 1965, 60, 229–231. [Google Scholar] [CrossRef]
  10. Howlader, H.A.; Hossain, A. On Bayesian estimation and prediction from Rayleigh distribution based on type-II censored data. Commun. Stat. Theory Methods 1995, 24, 2249–2259. [Google Scholar] [CrossRef]
  11. Vode, V.G. Inferential procedures on a generalized Rayleigh variate (I). Apl. Mat. 1976, 21, 395–412. [Google Scholar] [CrossRef]
  12. Vode, V.G. Inferential procedures on a generalized Rayleigh variate (II). Apl. Mat. 1976, 21, 413–419. [Google Scholar] [CrossRef]
  13. Yousef, A.; Hassan, E.E.H.; Amin, A.A.; Hamdy, H.I. Multistage Estimation of the Scale Parameter of Rayleigh Distribution with Simulation. Symmetry 2020, 12, 1925. [Google Scholar] [CrossRef]
  14. Hall, P. Asymptotic theory and triple sampling of sequential estimation of a mean. Ann. Stat. 1981, 9, 1229–1238. [Google Scholar] [CrossRef]
  15. Chow, Y.S.; Robbins, H. On the asymptotic theory of fixed-width sequential confidence intervals for the mean. Ann. Math. Stat. 1965, 36, 1203–1212. [Google Scholar] [CrossRef]
  16. Ghosh, M.; Mukhopadhyay, N. Consistency and asymptotic efficiency of two-stage and sequential estimation procedures. Sankhya Indian J. Stat. Ser. A 1981, 43, 220–227. [Google Scholar]
  17. Tahir, M. Sequential estimation of the square of the Rayleigh parameter. J. Math. Stat. 2014, 10, 275–280. [Google Scholar] [CrossRef]
  18. Mukhopadhyay, N.; de Silva, B.M. Sequential Methods and Their Applications; CRC Press: Boca Raton, FL, USA, 2009. [Google Scholar]
  19. Ghosh, M.; Mukhopadhyay, N.; Sen, P.K. Sequential Estimation; John Wiley & Sons: New York, NY, USA, 1997. [Google Scholar]
  20. Degroot, M.H. Optimal Statistical Decisions; McGraw-Hill: New York, NY, USA, 1970. [Google Scholar]
  21. Chow, Y.S.; Yu, K.F. The performance of a sequential procedure for the estimation of the mean. Ann. Stat. 1981, 9, 189–198. [Google Scholar] [CrossRef]
  22. Martinsek, A.T. Negative regret, optional stopping and the elimination of outliers. J. Am. Stat. Assoc. 1988, 83, 160–163. [Google Scholar] [CrossRef]
  23. Dantzig, G.B. On the Non-existence of tests of student’s hypothesis having power function independent of σ. Ann. Math. Stat. 1940, 11, 186–192. [Google Scholar] [CrossRef]
  24. Anscombe, F.J. Sequential estimation. J. R. Stat. Soc. Ser. B 1953, 15, 1–21. [Google Scholar] [CrossRef]
  25. Robbins, H. Sequential Estimation of the Mean of a Normal Population; Probability and Statistics (Harald Cramer Volume); Almquist and Wiksell: Uppsala, Sweden, 1959; pp. 235–245. [Google Scholar]
  26. Stein, C. A two-sample test for a linear hypothesis whose power is independent of the variance. Ann. Math. Stat. 1945, 16, 243–258. [Google Scholar] [CrossRef]
  27. Stein, C. Some problems in sequential estimation (abstract). Econometrica 1949, 17, 77–78. [Google Scholar]
  28. Cox, D.R. Estimation by double sampling. Biometrika 1952, 39, 217–227. [Google Scholar] [CrossRef]
  29. Mukhopadhyay, N. A note on three-stage and sequential point estimation procedures for a normal mean. Seq. Anal. 1985, 4, 311–319. [Google Scholar] [CrossRef]
  30. Wald, A. Sequential Analysis; John Wiley & Sons: New York, NY, USA, 1947. [Google Scholar]
  31. Anscombe, F.J. Large sample theory of sequential estimation. In Mathematical Proceedings of the Cambridge Philosophical Society; Cambridge University Press: Cambridge, UK, 1952; Volume 48, pp. 600–607. [Google Scholar]
  32. Yousef, A.; Hamdy, H. Three-stage estimation for the mean and variance of the normal distribution with application to inverse coefficient of variation. Mathematics 2019, 7, 831. [Google Scholar] [CrossRef] [Green Version]
  33. Yousef, A.; Hamdy, H. Three-Stage Sequential Estimation of the Inverse Coefficient of Variation of the Normal Distribution. Computation 2019, 7, 69. [Google Scholar] [CrossRef] [Green Version]
  34. Hamdy, H.I.; Mukhopadhyay, N.; Costanza, M.C.; Son, M.S. Triple stage point estimation for the exponential location parameter. Ann. Inst. Stat. Math. 1988, 40, 785–797. [Google Scholar] [CrossRef]
  35. Hamdy, H.I. Performance of fixed width confidence intervals under Type II errors: The exponential case. S. Afr. Stat. J. 1997, 31, 259–269. [Google Scholar]
  36. Dunn, W.; Shultis, J.K. Exploring Monte Carlo Methods, 1st ed.; Elsevier Science: Amsterdam, The Netherlands, 2011. [Google Scholar]
  37. Yousef, A. Performance of three-stage sequential estimation of the inverse coefficient of variation under type II error probability: A Monte Carlo simulation study. Front. Phys. 2020, 8, 71. [Google Scholar] [CrossRef]
Table 1. Three-stage simulation results at m = 10 , δ = 0.5 , and α = 5 %
Table 1. Three-stage simulation results at m = 10 , δ = 0.5 , and α = 5 %
n * N ¯ S N ¯ θ ^ S θ ^ v a r ^ x 1 α ^
2421.420.0554.52200.00481.940860.9096
4339.260.0884.59090.00461.970430.8066
6157.140.1134.69700.00402.015970.8618
7672.360.1304.76390.00362.044680.8830
9692.660.1544.81960.00312.068590.8977
125122.500.1834.87490.00262.092320.9138
171169.570.2234.91970.00212.111550.9241
246246.550.2844.95030.00162.124690.9324
500509.360.4684.97900.00102.137010.9428
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yousef, A.; Amin, A.A.; Hassan, E.E.; Hamdy, H.I. Multistage Estimation of the Rayleigh Distribution Variance. Symmetry 2020, 12, 2084. https://doi.org/10.3390/sym12122084

AMA Style

Yousef A, Amin AA, Hassan EE, Hamdy HI. Multistage Estimation of the Rayleigh Distribution Variance. Symmetry. 2020; 12(12):2084. https://doi.org/10.3390/sym12122084

Chicago/Turabian Style

Yousef, Ali, Ayman A. Amin, Emad E. Hassan, and Hosny I. Hamdy. 2020. "Multistage Estimation of the Rayleigh Distribution Variance" Symmetry 12, no. 12: 2084. https://doi.org/10.3390/sym12122084

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop