Chebyshev–Edgeworth-Type Approximations for Statistics Based on Samples with Random Sizes

Abstract

Second-order Chebyshev–Edgeworth expansions are derived for various statistics from samples with random sample sizes, where the asymptotic laws are scale mixtures of the standard normal or chi-square distributions with scale mixing gamma or inverse exponential distributions. A formal construction of asymptotic expansions is developed. Therefore, the results can be applied to a whole family of asymptotically normal or chi-square statistics. The random mean, the normalized Student t-distribution and the Student t-statistic under non-normality with the normal limit law are considered. With the chi-square limit distribution, Hotelling’s generalized $T_0^2$ statistics and scale mixture of chi-square distributions are used. We present the first Chebyshev–Edgeworth expansions for asymptotically chi-square statistics based on samples with random sample sizes. The statistics allow non-random, random, and mixed normalization factors. Depending on the type of normalization, we can find three different limit distributions for each of the statistics considered. Limit laws are Student t-, standard normal, inverse Pareto, generalized gamma, Laplace and generalized Laplace as well as weighted sums of generalized gamma distributions. The paper continues the authors’ studies on the approximation of statistics for randomly sized samples.

1. Introduction

In classical statistical inference, the number of observations is usually known. If observations are collected in a fixed time span or we lack observations the sample size may be a realization of a random variable. The number of failed devices in the warranty period, the number of new infections each week in a flu season, the number of daily customers in a supermarket or the number of traffic accidents per year are all random numbers.

Interest in studying samples with a random number of observations has grown steadily over the past few years. In medical research, the authors of [1,2,3] examines ANOVA models with unknown sample sizes for the analysis of fixed one-way effects in order to avoid false rejection. Applications of orthogonal mixed models to situations with samples of a random number of observations of a Poisson or binomial distributed random variable are presented. Based a random number of observations [4], Al-Mutairi and Raqab [5] and Barakat et al. [6] examined the mean with known and unknown variances and the variance in the normal model, confidence intervals for quantiles and prediction intervals for the future observations for generalized order statistics. An overview on statistical inference of samples with random sample sizes and some applications are given in [4], see also the references therein.

When the non-random sample size is replaced by a random variable, the asymptotic features of statistics can change radically, as shown by Gnedenko [7]. The monograph by Gnedenko and Korolev [8] deals with below limit distributions for randomly indexed sequences and their applications.

General transfer theorems for asymptotic expansions of the distribution function of statistics based on samples with non-random sample sizes to their analogues for samples of random sizes are proven in [9,10]. In these papers, rates of convergence and first-order expansion are proved for asymptotically normal statistics. The results depend on the rates of convergence with which the distributions of the normalized random sample sizes approach the corresponding limit distribution.

The difficulty of obtaining second-order expansions for the normalized random sample sizes beyond the rates of convergences was overcome by Christoph et al. [11]. Second-order expansions were proved by the authors of [11,12] for the random mean and the median of samples with random sample sizes and the authors of [13,14] for the three geometric statistics of Gaussian vectors, the length of a vector, the distance between two vectors and the angle between two vectors associated with their correlation coefficient when the dimension of the vectors is random.

The classical Chebyshev–Edgeworth expansions strongly influenced the development of asymptotic statistics. The fruitful interactions between Chebyshev Edgeworth expansions and Bootstrap methods are demonstrated in [15]. Detailed reviews of applications of Chebyshev–Edgeworth expansions in statistics were given by, e.g., Bickel [16] and Kolassa [17]. If the arithmetic mean of independent random variables is considered as the statistic, only the expected value and the dispersion are taken into account in the central limit theorem or in the Berry–Esseen inequalities. The two important characteristics of random variables, skewness and kurtosis, have great influence on second order expansions, provided that the corresponding moments exist. The Cornish–Fisher inversion of the Chebyshev–Edgeworth expansion allows the approximation of the quantiles of the test statistics used, for example, in many hypothesis tests. In [11], Theorems 3 and 6, and [12], Corollaries 6.2 and 6.3, Cornish–Fisher expansions for the random mean and median from samples with random sample sizes are obtained. In the same way, Cornish–Fisher expansions for the quantiles of the statistics considered in present paper can be derived from the corresponding Chebyshev–Edgeworth expansions.

In the present paper, we continue our research on approximations if the sample sizes are random. To the best of our knowledge, Chebyshev–Edgeworth-type expansions with asymptotically chi-square statistics have not yet been proven in the literature when the sample sizes are random.

The article is structured as follows. Section 2 describes statistical models with random numbers of observations, the assumptions about statistics and random sample sizes and transfer propositions from samples with non-random to random sample sizes. Section 3 presents statistics with non-random sample sizes with Chebyshev–Edgeworth expansions based on standard normal or chi-square distributions. Corresponding expansions of the negative binomial or discrete Pareto distributions as random sample sizes are considered in Section 4. Section 5 describes the influence of non-random, random or mixed normalization factors on the limit distributions of the examined statistics that are based on samples with random sample sizes. Besides the common Student’s t, normal and Laplace distributions, inverse Pareto, generalized gamma and generalized Laplace as well as weighted sums of generalized gamma distributions also occur as limit laws. The main results for statistic families with different normalization factors and examples are given in Section 6. To prove statements about a family of statistics, formal constructions for the expansions are worked out in Section 7, which are used in Section 8 to prove the theorems. Conclusions are drawn in Section 9. We leave four auxiliary lemmas to Appendix A.

2. Statistical Models with a Random Number of Observations

Let $X_1,X_2,\dots \in \mathbb{R}=(-\infty \infty )$ and $N_1,N_2,\dots \in {\mathbb{N}}_{+}=\{1,2,\dots \}$ be random variables defined on a common probability space $\left(\mathsf{\Omega },\mathbb{A},\mathbb{P}\right)$. The random variables $X_1,\dots ,X_m$ denote the observations and form the random sample with a non-random sample size $m\in {\mathbb{N}}_{+}$. Let

$$T_m:=T_m\left(X_1,\dots ,X_m\right)\mathrm{with}m\in {\mathbb{N}}_{+}$$

be some statistic obtained from the sample $\{X_1,X_2,\dots ,X_m\}$. Consider now the sample $X_1,\dots ,X_{N_n}$. The random variable $N_n\in {\mathbb{N}}_{+}$ denotes the random size of the underlying sample, that is the random number of observations, depending on a parameter $n\in {\mathbb{N}}_{+}$. We suppose for each $n\in {\mathbb{N}}_{+}$ that $N_n\in {\mathbb{N}}_{+}$ is independent of random variables $X_1,X_2,\dots$ and $N_n\to \infty$ in probability as $n\to \infty$.

Let $T_{N_n}$ be a statistic obtained from a random sample $X_1,X_2,\dots ,X_{N_n}$ defined as

$$T_{N_n}\left(\omega \right):=T_{N_n\left(\omega \right)}\left(X_1\left(\omega \right),\dots ,X_{N_n\left(\omega \right)}\left(\omega \right)\right)\mathrm{for}\mathrm{all}\omega \in \mathsf{\Omega }\mathrm{and}\mathrm{every}n\in {\mathbb{N}}_{+}.$$

2.1. Assumptions on Statistics $T_m$ and Random Sample Sizes $N_n$

In further consideration, we restrict ourselves to only those terms in the expansions that are used below.

We assume that the following condition for the statistic $T_m$ with $\mathbb{E}{T}_m=0$ from a sample with non-random sample size $m\in {\mathbb{N}}_{+}$ is fulfilled:

Assumption 1.

There are differentiable functions for all $x\ne 0$ distribution function $F\left(x\right)$ and bounded functions $f_1\left(x\right)$, $f_2\left(x\right)$ and real numbers $\gamma \in \{0,\pm 1/2,\pm 1\}$, $a>1$ and $0<C_1<\infty$ so that for all integers $m\ge 1$

$${sup}_x|\mathbb{P}\left(m^{\gamma }{T}_m\le x\right)-F\left(x\right)-m^{-1/2}{f}_1\left(x\right)-m^{-1}{f}_2\left(x\right)|\le C_1{m}^{-a}.$$

(1)

Remark 1.

In contrast to Bening et al. [10], the differentiability of $F\left(x\right)$, $f_1\left(x\right)$ and $f_2\left(x\right)$ is only required for $x\ne 0$. In the present article, in addition to the normal distribution, the chi-square distribution with p degrees of freedom is used as $F\left(x\right)$, which is not differentiable in $x=0$ if $p=1$ or $p=2$.

The distribution functions of the normalized random variables $N_n\in {\mathbb{N}}_{+}$ satisfy the following condition:

Assumption 2.

A distribution function $H\left(y\right)$ with $H(0+)=0$, a function of bounded variation $h_2\left(y\right)$, a sequence $0<g_n\uparrow \infty$ and real numbers $b>0$ and $C_2>0$ exist so that for all integers $n\ge 1$

$$\left.\begin{array}{ccc}{sup}_{y\ge 0}\left|\mathbb{P}\left(g_n^{-1}{N}_n\le y\right)-H\left(y\right)\right|\le C_2{n}^{-b},\hfill & for\hfill & 0<b\le 1,\hfill \\ {sup}_{y\ge 0}\left|\mathbb{P}\left(g_n^{-1}{N}_n\le y\right)-H\left(y\right)-n^{-1}{h}_2\left(y\right)\right|\le C_2{n}^{-b},\hfill & for\hfill & b>1.\hfill \end{array}\right\}$$

(2)

2.2. Transfer Proposition from Samples with Non-Random to Random Sample Sizes

Assumptions 1 and 2 allow the construction of expansions for distributions of normalized random-size statistics $T_{N_n}$ based on approximate results for fixed-size normalized statistics $T_m$ in (1) and for the random size $N_n$ in (2).

Proposition 1.

Suppose $\gamma \in \{0,\pm 1/2,\pm 1\}$ and the statistic $T_m$ and the sample size $N_n$ satisfy Assumptions 1 and 2. Then, for all $n\in {\mathbb{N}}_{+}$, the following inequality applies:

$${sup}_{x\in \mathbb{R}}|\mathbb{P}\left(g_n^{\gamma }{T}_{N_n}\le x\right)-G_n(x,1/g_n)|\le C_1\mathbb{E}\left(N_n^{-a}\right)+(C_3{D}_n+C_4)n^{-b},$$

(3)

where

$$G_n(x,1/g_n)={\int }_{1/g_n}^{\infty }\left(F\left(x{y}^{\gamma }\right)+\frac{f_1\left(x{y}^{\gamma }\right)}{\sqrt{g_{n}y}}+\frac{f_2\left(x{y}^{\gamma }\right)}{g_{n}y}\right)d\left(H\left(y\right)+\frac{h_2\left(y\right)}{n}\right),$$

(4)

$$D_n=\underset{x}{sup}{\int }_{1/g_n}^{\infty }\left|\frac{{\displaystyle \partial }}{{\displaystyle \partial y}}\left(F\left(x{y}^{\gamma }\right)+\frac{f_1\left(x{y}^{\gamma }\right)}{\sqrt{g_{n}y}}+\frac{f_2\left(x{y}^{\gamma }\right)}{y{g}_n}\right)\right|dy,$$

(5)

$a>1,b>0$ and $f_1\left(z\right),f_2\left(z\right),h_2\left(y\right)$ are given in (1) and (2). The constants $C_1,C_3,C_4$ do not depend on n.

General transfer theorems with more terms are proved in [9,10] for $\gamma \ge 0$.

Remark 2.

The approximation function $G_n(x,1/g_n)$ is not a polynomial in $g_n^{-1/2}$ and $n^{-1/2}$. The domain $[1/g_n,\infty )$ of integration in (4) depends on $g_n$. Some of the integrals in (4) could tend to infinity with $1/g_n\to 0$ as $n\to \infty$.

The following statement clarifies the problem.

Proposition 2.

In addition to the conditions of Proposition 1, let the following conditions be satisfied on the functions $H(.)$ and $h_2(.)$, depending on the rate of convergence $b>0$ in (2):

$$\begin{array}{ccc}\hfill H(1/g_n)\le c_1{g}_n^{-b},& for& b>0,\hfill \end{array}$$

(6)

$$\begin{array}{ccc}\hfill {\int }_0^{1/g_n}{y}^{-1/2}dH\left(y\right)\le c_2{g}_n^{-b+1/2},& for& b>1/2,\hfill \end{array}$$

(7)

$$\begin{array}{ccc}\hfill \left.\begin{array}{cc}i:\hfill & {\int }_0^{1/g_n}{y}^{-1}dH\left(y\right)\le c_3{g}_n^{-b+1},\hfill \\ ii:\hfill & h_2\left(0\right)=0and\left|h_2(1/g_n)\right|\le c_{4}n{g}_n^{-b},\hfill \\ iii:\hfill & {\int }_0^{1/g_n}{y}^{-1}\left|h_2\left(y\right)\right|dy\le c_{5}n{g}_n^{-b},\hfill \end{array}\right\}& for& b>1.\hfill \end{array}$$

(8)

Then, for the function $G_n(x,1/g_n)$ defined in (4), one has

$${sup}_x|G_n(x,1/g_n)-G_{n,2}\left(x\right)-I_1(x,n)-I_2(x,n)-I_3(x,n)-I_4(x,n)|\le C{g}_n^{-b}$$

with

$$G_{n,2}\left(x\right)=\left\{\begin{array}{cc}\underset{0}{\overset{\infty }{\int }}F\left(x{y}^{\gamma }\right)dH\left(y\right),\hfill & \hfill for0<b\le 1/2,\\ \underset{0}{\overset{\infty }{\int }}\left(F\left(x{y}^{\gamma }\right)+\frac{{\displaystyle f_1\left(x{y}^{\gamma }\right)}}{{\displaystyle \sqrt{g_{n}y}}}\right)dH\left(y\right)=:G_{n,1}\left(x\right),\hfill & \hfill for1/2<b\le 1,\\ G_{n,1}\left(x\right)+\underset{0}{\overset{\infty }{\int }}\frac{{\displaystyle f_2\left(x{y}^{\gamma }\right)}}{{\displaystyle g_{n}y}}dH\left(y\right)+\underset{0}{\overset{\infty }{\int }}\frac{{\displaystyle F\left(x{y}^{\gamma }\right)}}{{\displaystyle n}}d{h}_2\left(y\right),\hfill & \hfill forb>1,\end{array}\right\}$$

(9)

$$\begin{array}{ccc}\hfill I_1(x,n)& =& {\int }_{1/g_n}^{\infty }\frac{f_1\left(x{y}^{\gamma }\right)}{\sqrt{g_{n}y}}dH\left(y\right)forb\le 1/2,I_2(x,n)={\int }_{1/g_n}^{\infty }\frac{f_2\left(x{y}^{\gamma }\right)}{g_{n}y}dH\left(y\right)forb\le 1,\hfill \end{array}$$

(10)

$$\begin{array}{ccc}\hfill I_3(x,n)& =& {\int }_{1/g_n}^{\infty }\frac{f_1\left(x{y}^{\gamma }\right)}{n\sqrt{g_{n}y}}d{h}_2\left(y\right)and{I}_4(x,n)={\int }_{1/g_n}^{\infty }\frac{f_2\left(x{y}^{\gamma }\right)}{n{g}_{n}y}d{h}_2\left(y\right)forb>1.\hfill \end{array}$$

(11)

Remark 3.

The lower limit of integration in $I_1(x,n)$ to $I_4(x,n)$ in (10) and (11) depends on $g_n$. If the sample size $N_n=N_n\left(r\right)$ is negative binomial distributed with, e.g., $0<r<1/2$ or $1<r<2$ and $g_n=r(n-1)+1$ (see (28) below), then both $I_1(x,n)$ and $I_4(x,n)$ have order $n^{-r}$ and not $n^{1/2}$ or $n^{-2}$, as it seems at first glance.

Remark 4.

The additional conditions (6)–(8) guarantee to extend the integration range of the integrals in (9) from $[1/g_n,\infty )$ to $(0,\infty )$.

Proof of Propositions 1 and 2:

Evidence of Proposition 1 follows along the similar arguments of the more general Transfer Theorem 3.1 in [10] for $\gamma \ge 0$. The proof was adapted by Christoph and Ulyanov [13] to negative $\gamma <0$, too. Therefore, the Proposition 1 applies to $\gamma \in \{0,\pm 1/2,\pm 1\}$.

The present Propositions 1 and 2 differ from Theorems 1 and 2 in [13] only by the additional term $f_1\left(x{y}^{\gamma }\right){\left(g_{n}y\right)}^{-1/2}$ and the added condition (7) to estimate this additional term. Therefore, the details are omitted her. □

Remark 5.

In Appendix 2 of the monograph by Gnedenko and Korolev [8], asymptotic expansions for generalized Cox processes are proved (see Theorems A2.6.1–A2.6.3). As random sample size, the authors considered a Cox process $N\left(t\right)$ controlled by a Poisson process $\mathsf{\Lambda }\left(t\right)$ (also known as a doubly stochastic Poisson process) and proved asymptotic expansions for the random sum $S\left(t\right)={\sum }_{k=1}^{N\left(t\right)}{X}_k$, where $X_1,X_2,\dots$ are independent identically distributed random variables. For each $t\ge 0$, the random variables $N\left(t\right),X_1,X_2,\dots$ are independent. The above-mentioned theorems are close to Proposition 1. The structure of the functions $G_{2;n}(.)$ in (4) and the bounds on the right-hand side of inequality (3) in Proposition 1 differ from the corresponding terms in Theorems A2.6.1–A2.6.3. Thus, the bounds contain little o-terms.

3. Chebyshev–Edgeworth Expansions Based on Standard Normal and Chi-Square Distributions

We consider two classes of statistics which are asymptotically normal or chi-square distributed.

3.1. Examples for Asymptotically Normally Distributed Statistics

Let $X,X_1,X_2,\dots$ be independent identically distributed random variables with

$$\left.\begin{array}{c}\mathbb{E}{\left|X\right|}^5<\infty ,\mathbb{E}\left(X\right)=\mu ,0<\mathrm{Var}\left(X\right)={\sigma }^2,\\ \mathrm{skewness}{\lambda }_3={\sigma }^{-3}\mathbb{E}{\left(X-\mu \right)}^3\mathrm{and}\mathrm{kurtosis}{\lambda }_4={\sigma }^{-4}\mathbb{E}{\left(X-\mu \right)}^4.\end{array}\right\}$$

(12)

The random variable X is assumed to satisfy Cramér’s condition

$${lim\; sup}_{\left|t\right|\to \infty }\left|\mathbb{E}{e}^{itX}\right|<1.$$

(13)

Consider the asymptotically normal sample mean:

$${\overline{X}}_m=\left(X_1+\cdots +X_m\right)/mm=1,2,\dots ,$$

(14)

It follows from Petrov [18], Theorem 5.18 with $k=5$, that

$${sup}_x\left|\mathbb{P}({\sigma }^{-1}\sqrt{m}({\overline{X}}_m-\mu )\le x)-{\mathsf{\Phi }}_{2;m}\left(x\right)\right|\le C{m}^{-3/2},$$

(15)

with C being independent of m and second order expansion

$${\mathsf{\Phi }}_{2;m}\left(x\right)=\mathsf{\Phi }\left(x\right)-\left(\frac{{\lambda }_3}{6\sqrt{m}}{H}_2\left(x\right)+\frac{1}{m}\left(\frac{{\lambda }_4}{24}{H}_3\left(x\right)+\frac{{\lambda }_3^2}{72}{H}_5\left(x\right)\right)\right)\phi \left(x\right),$$

(16)

where $\mathsf{\Phi }\left(x\right)$ and $\phi \left(x\right)$ are standard normal distribution function and its density and $H_k\left(x\right)$ are the Chebyshev–Hermite polynomials

$$H_2\left(x\right)=x^2-1H_3\left(x\right)=x^3-3xand{H}_5\left(x\right)=x^5-10x^3+15x.$$

Let the random variable ${\chi }_d^2$ be chi-square distributed with d degrees of freedom having distribution function $G_d\left(x\right)$ and density function $g_d\left(x\right)$:

$$G_d\left(x\right)=\mathbb{P}({\chi }_d^2\le x)={\int }_0^x{g}_d\left(y\right)dyand{g}_d\left(y\right)=\frac{1}{2^{d/2}\mathsf{\Gamma }(d/2)}{y}^{(d-2)/2}{e}^{-y/2},y>0.$$

(17)

Next, we examine the scale-mixed normalized statistic $T_m=\sqrt{m}Z/\sqrt{{\chi }_m^2}$, where Z and ${\chi }_m^2$ are independent random variables with the standard normal distribution $\mathsf{\Phi }\left(x\right)$ and the chi-square distribution $G_m\left(x\right)$, respectively. Then, the statistic $T_m=\sqrt{m}Z/\sqrt{{\chi }_m^2}$ follows the Student’s t-distribution with m degrees of freedom. Example 2.1 in [19] indicates

$$\left|\mathbb{P}\left(\frac{\sqrt{m}Z}{\sqrt{{\chi }_m^2}}\le x\right)-\mathsf{\Phi }\left(x\right)-\frac{(x^3+x)\phi \left(x\right)}{4m}\right|\le \frac{{sup}_x\left\{\right|x^5+2x^3+3x\left|\phi \left(x\right)\right\}}{6m^2}+\frac{6(m+4)}{m^3}\le \frac{30.5}{m^2}.$$

(18)

Chebyshev–Edgeworth expansions of Student’s t-statistic under non-normality are well investigated, but only Hall [20] proved these under minimal moment condition. Let conditions (12) and (13) are satisfied for independent identically distributed random variables $X_1,X_2,\dots$ Define $T_m^{*}=m^{1/2}({\overline{X}}_m-\mu )/{\widehat{\sigma }}_m$ with sample mean ${\overline{X}}_n$ and biased sample variance ${\widehat{\sigma }}_m^2=m^{-1}{\sum }_{i=1}^m{(X_i-{\overline{X}}_m)}^2$. It follows from Hall [20] that for Student’s t-statistic $T_m^{*}$:

$$R_m\left(x\right)=\left|\mathbb{P}\left(m^{1/2}\frac{{\overline{X}}_m-\mu }{{\widehat{\sigma }}_m}\le x\right)-\mathsf{\Phi }\left(x\right)-\phi \left(x\right)\left(\frac{P_1\left(x\right)}{\sqrt{m}}+\frac{P_2\left(x\right)}{m}\right)\right|\le C{m}^{-3/2}(1+u\left(m\right))$$

(19)

uniformly in x, where $u\left(m\right)\to 0$ as $m\to \infty$,

$$P_1\left(x\right)={\lambda }_3(2x^2+1)/6\mathrm{and}{P}_2\left(x\right)=x\left\{\frac{{\lambda }_4}{12}(x^2-3)-\frac{{\lambda }_3^2}{18}(x^4+2x^2-3)-\frac{1}{4}(x^2+3)\right\}.$$

(20)

Remark 6.

The estimate (19) does not satisfy (1) in Assumption 1 because we do not have a computable error bound U with $\left|u\right(m\left)\right|\le U<\infty$ for all $m\in {\mathbb{N}}_{+}$. The estimate (19) does not satisfy (1) in Assumption 1 because we do not have a computable constant C with $\left|u\right(m\left)\right|\le C<\infty$ for all $m\in {\mathbb{N}}_{+}$, if all parameter are given. The remainder in (19) meets order condition $R_m\left(x\right)=\mathcal{O}\left(m^{-3/2}\right)$ as $m\to \infty$, but in the equivalent condition $su{p}_x{R}_m\left(x\right)\le C{m}^{-3/2}$ for all $m\ge M$ the values $C>0$ and $M>0$ are unknown. About non-asymptotic bounds and order conditions, see the work of Fujikoshi and Ulyanov [19] (Section 1.1).

In [21], an inequality for a first order approximation is proved:

$${sup}_x\left|\mathbb{P}\left(m^{1/2}\frac{{\overline{X}}_m-\mu }{{\widehat{\sigma }}_m}\le x\right)-\mathsf{\Phi }\left(x\right)-\frac{P_1\left(x\right)\phi \left(x\right)}{\sqrt{m}}\right|\le C{m}^{-1},$$

(21)

where ${\mathbb{E}\left|X\right|}^{4+\epsilon }<\infty$ is required for arbitrary $\epsilon >0$ and $P_1\left(x\right)$ is defined in (20).

3.2. Examples for Asymptotically Chi-Square Distributed Statistics

The baseline distribution of the second order expansions is now the chi-square distribution $G_d\left(x\right)$ occurring as limit distribution in different multivariate tests (see [22], Chapters 5 and 8–10, [19,23]).

At first, we consider statistic $T_m=T_0^2=m\mathrm{tr}{\mathbf{S}}_q{\mathbf{S}}_m^{-1}$, where ${\mathbf{S}}_q$ and ${\mathbf{S}}_m$ are random matrices independently distributed as Wishart distributions $W_p(q,{\mathbf{I}}_p)$ and $W_p(m,{\mathbf{I}}_p)$, respectively, with identity operator ${\mathbf{I}}_p$ in ${\mathbb{R}}_p$. Note that $\mathbf{W}$ has Wishart distribution $W_p(q,\Sigma )$ if $q\ge p$ and its density is

$$\frac{1}{2^{pq/2}{\mathsf{\Gamma }}_p(q/2){|\Sigma |}^{q/2}}exp\left\{-\frac{1}{2}\mathrm{tr}\left({\Sigma }^{-1}\mathbf{W}\right)\right\}{\left|\mathbf{W}\right|}^{(q-p-1)/2},$$

where ${\mathsf{\Gamma }}_p(q/2)={\pi }^{p(p-1)/4}{\Pi }_{k=1}^p\mathsf{\Gamma }\left((q-k+1)/2\right)$ (see [23], Chapter 2, for some basic properties).

Hotelling’s generalized $T_0^2$ distribution allows approximation

$${sup}_x\left|\mathbb{P}\left(m\mathrm{tr}\left({\mathbf{S}}_q{\mathbf{S}}_m^{-1}\right)\le x\right)-G_d\left(x\right)-\frac{d}{4m}\left(a_0{G}_d\left(x\right)+a_1{G}_{d+2}\left(x\right)+a_2{G}_{d+4}\left(x\right)\right)\right|\le C{m}^{-2}$$

(22)

(see [24], Theorem 4.1), where

$$d=pq,a_0=q-p-1,a_1=-2q\mathrm{and}{a}_2=q+p+1\mathrm{with}{a}_0+a_1+a_2=0.$$

(23)

If $T_m={\chi }_d^2/{\chi }_m^2$ is a scale mixture, where ${\chi }_d^2$ and ${\chi }_m^2$ are independent, $T_m$ allows asymptotic expansion

$${sup}_x\left|\mathbb{P}\left(m{\chi }_d^2/{\chi }_m^2\le x\right)-G_d\left(x\right)-\frac{d}{4m}\left(a_0{G}_d\left(x\right)+a_1{G}_{d+2}\left(x\right)+a_2{G}_{d+4}\left(x\right)\right)\right|\le C{m}^{-2}$$

(24)

(see [25], Section 5), where now

$$a_0=2-d,a_1=2d\mathrm{and}{a}_2=-(2+d)\mathrm{with}{a}_0+a_1+a_2=0.$$

(25)

Integration by parts gives $G_{k+2}\left(x\right)=-2g_{k+2}\left(x\right)+G_k\left(x\right)$. Moreover, $g_{k+2}\left(x\right)=(x/k)g_k\left(x\right)$ for $k=d$ and $k=d+2$. Then, it follows for both statistics $Z_m=\mathrm{tr}\left({\mathbf{S}}_q{\mathbf{S}}_m^{-1}\right)$ in (22) and $Z_m={\chi }_d^2/{\chi }_m^2$ in (24) that

$${sup}_x\left|\mathbb{P}\left(m{Z}_m\le x\right)-G_d\left(x\right)+\frac{g_d\left(x\right)}{m}\left(\frac{(a_1+a_2)x}{2}+\frac{a_2{x}^2}{2(d+2)}\right)\right|\le C{m}^{-2}$$

(26)

where the coefficients $a_1$ and $a_2$ are defined in (23) and (25).

The scaled mixture $T_m=m{\chi }_4^2/{\chi }_m^2$ is considered in the works by Fujikoshi et al. [23] (Example 13.2.2) and Fujikoshi and Ulyanov [19] (Example 2.2). The estimation given there leads to a computable error bound:

$${sup}_x|\mathbb{P}\left(m\frac{{\chi }_4^2}{{\chi }_m^2}\le x\right)-G_4\left(x\right)+\frac{(2x-x^2)g_4\left(x\right)}{2m}|\le \frac{x^2|x^2-4|e^{-x/2}}{12m^2}+\frac{12(m+4)}{m^3}\le \frac{65.9}{m^2}.$$

(27)

Remark 7.

The statistics $T_m$ in (15), (18) and (21) satisfy Assumption 1 with the normal limit distribution $\mathsf{\Phi }\left(x\right)$ and in (26) and (27) with chi-square distributions $G_d\left(x\right)$ and $G_4\left(x\right)$, respectively.

4. Chebyshev–Edgeworth Expansions for Distributions of Normalized Random Sample Sizes

As in the articles by, e.g., Bening et al. [9,10], Christoph et al. [11,12] and Christoph and Ulyanov [13] and Christoph and Ulyanov [14], we consider as random sample sizes $N_n$ the negative binomial random variable $N_n\left(r\right)$ and the maximum of n independent discrete Pareto random variables $N_n\left(s\right)$ where $r>0$ and $s>0$ are parameters.

“The negative binomial distribution is one of the two leading cases for count models, it accommodates the overdispersion typically observed in count data (which the Poisson model cannot)” [26]. Moreover, $\mathbb{E}{N}_n\left(r\right)<\infty$ and $\mathbb{P}(N_n\left(r\right)/\mathbb{E}{N}_n\left(r\right)$$\le y)$ tends to the gamma distribution $G_{rr}\left(y\right)$ with identical shape and rate parameters $r>0$.

On the other hand, the mean for the discrete Pareto-like variable $N_n\left(s\right)$ does not exist, yet $\mathbb{P}(N_n\left(s\right)/n\le x)$ tends to the inverse exponential distribution $W_s\left(y\right)=e^{-s/y}$ with scale parameter $s>0$.

Remark 8.

The authors of [1,2,3,4,27], among others, considered the binomial or Poisson distributions as random number N of observations. If $N=N_n$ is binomial (with parameters n and $0<p<1$) or Poisson (with rate $\lambda n,0<\lambda <\infty$) distributed, then $\mathbb{P}(N_n\le \mathbb{E}{N}_{n}x)$ tends to the degenerated in 1 distribution as $n\to \infty$. Therefore, Assumption 2 for the Transfer Proposition 1 is not fulfilled. On the other hand, since binomial or Poisson sample sizes are asymptotically normally distributed and if the statistic $T_m$ is also asymptotically normally distributed, so is the statistic $T_{N_n}$, too (see [28]). Chebyshev–Edgeworth expansions for lattice distributed random variables exist so far only with bounds of small-o or large-$\mathcal{O}$ order (see [29]). For (2) in Assumption 2, computable error bounds $C_2$ are required because the constant $C_3$ in (3) depends on $C_2$ (see also Remark 6 on large-$\mathcal{O}$-bounds and computable error bounds).

4.1. The Random Sample Size $N_n=N_n\left(r\right)$ Has Negative Binomial Distribution with Success Probability $1/n$

The sample size $N_n\left(r\right)$ has a negative binomial distribution shifted by 1 with the parameters $1/n$ and $r>0$, the probability mass function

$$\mathbb{P}(N_n\left(r\right)=k)=\frac{\mathsf{\Gamma }(k+r-1)}{\mathsf{\Gamma }\left(k\right)\mathsf{\Gamma }\left(r\right)}{\left(\frac{1}{n}\right)}^r{\left(1-\frac{1}{n}\right)}^{k-1},k=1,2,\dots$$

(28)

and $g_n=\mathbb{E}\left(N_n\left(r\right)\right)=r(n-1)+1$. Bening and Korolev [30] and Schluter and Trede [26] showed

$${lim}_{n\to \infty }{sup}_y\left|\mathbb{P}(N_n\left(r\right)/g_n\le y)-G_{r,r}\left(y\right)\right|=0,$$

(29)

where $G_{r,r}\left(y\right)$ is the gamma distribution function with its density

$$g_{r,r}\left(y\right)=\frac{r^r}{\mathsf{\Gamma }\left(r\right)}{y}^{r-1}{e}^{-ry}{\mathbb{I}}_{(0\infty )}\left(y\right),y\in \mathbb{R}.$$

(30)

In addition to the expansion of $N_n\left(r\right)$, a bound of the negative moment $\mathbb{E}{\left(N_n\left(r\right)\right)}^{-a}$ in (3) is required, where $m^{-a}$ is rate of convergence of the Chebyshev–Edgeworth expansion for $T_m$ in (1).

Proposition 3.

Suppose that $r>0$ and the discrete random variables $N_n\left(r\right)$ have probability mass function (28) with $g_n:=\mathbb{E}{N}_n\left(r\right)=r(n-1)+1$. Then,

$${sup}_{y\ge 0}\left|\mathbb{P}\left(\frac{N_n\left(r\right)}{g_n}\le y\right)-G_{r,r}\left(y\right)-\frac{h_{2;r}\left(y\right)}{n}\right|\le C_2\left(r\right)n^{-min\{r,2\}},$$

(31)

for all $n\in {\mathbb{N}}_{+}$, where the constant $C_2\left(r\right)>0$ does not depent on n and

$$h_{2;r}\left(y\right)=\left\{\begin{array}{cc}0,\hfill & forr<1,\hfill \\ {\left(2r\right)}^{-1}{g}_{r,r}\left(y\right)\left((y-1)(2-r)+2Q_1\left(g_{n}y\right)\right),\hfill & forr\ge 1.\hfill \end{array}\right.$$

(32)

$$Q_1\left(y\right)=1/2-(y-\left[y\right])and[.]denotestheintegerpartofanumber.$$

(33)

Moreover, negative moments$\mathbb{E}{\left(N_n\left(r\right)\right)}^{-a}$fulfill the estimate for all$r>0$, $\alpha >0$

$$\mathbb{E}{\left(N_n\left(r\right)\right)}^{-\alpha }\le C\left(r\right)\left\{\begin{array}{c}{n}^{-min\{r,\alpha \}},r\ne \alpha \hfill \\ ln\left(n\right)n^{-\alpha },r=\alpha \hfill \end{array}\right.$$

(34)

and the convergence rate in case$r=\alpha$cannot be improved.

Proof. 

In [10] (Formula (21)) and in [31] (Formula (11)), the convergence rate is reported for the case $r<1$. In [11] (Theorem 1), the Chebyshev–Edgeworth expansion for $r>1$ is proved. In the case $r=1$, for geometric distributed random variable $N_n\left(1\right)\in {\mathbb{N}}_{+}$ with success probability $1/n$ the proof is straightforward:

$$\mathbb{P}\left(N_n\le ny\right)=1-\mathbb{P}(N_n\ge \left[ny\right]+1)=1-{\left(1-\frac{1}{n}\right)}^{ny-\tau }=\left(1-e^{-y}+\frac{e^{-y}}{n}\left(\frac{y}{2}-\tau \right)\right)+r_n\left(y\right),$$

where ${sup}_y\left|r_n\left(y\right)\right|\le C{n}^{-2}$ and $\tau =ny-\left[ny\right]=1/2-Q_1\left(ny\right)\in \left[01\right)$. Hence, (31) holds for $r=1$.

In [12] (Corollary 4.2), leading terms for the negative moments of $\mathbb{E}{\left(N_n\left(r\right)\right)}^{-p}$ are derived, which lead to (34). □

Remark 9.

The negative binomial random variables $N_n\left(r\right)$ satisfy (2) in Assumption 2 and the additional conditions (6), (7) and (8) in Proposition 2 with $H\left(y\right)=G_{r,r}\left(y\right)$, $h_2\left(y\right)=h_{2;r}\left(y\right)$, $g_n=\mathbb{E}{N}_n\left(r\right)=r(n-1)+1$ and $b=min\left\{r2\right\}$. The jumps of the distribution function $\mathbb{P}(N_n\left(r\right)\le g_{n}y)$ only affect the function $Q_1(.)$ in the term $h_{2;r}(.)$.

4.2. The Random Sample Size $N_n=N_n\left(s\right)$ Is the Maximum of n Independent Discrete Pareto Variables

We consider the continuous Pareto Type II (Lomax) distribution function

$$F_{Y^{*}}\left(x\right)=1-{\left(1+(x-1)/s\right)}^{-1}forx\ge 1.$$

The discrete Pareto II distribution $F_{Y\left(s\right)}$ is obtained by discretizing the continuous Pareto distribution $F_{Y^{*}}\left(x\right)$, : $\mathbb{P}(Y\left(s\right)=k)=F_{Y^{*}}\left(k\right)-F_{Y^{*}}(k-1),k\in {\mathbb{N}}_{+}$. The random variable $Y\left(s\right)$ is the discrete counterpart on the positive integers to the continuous random variable $Y^{*}$. Both random variables $Y^{*}$ and $Y\left(s\right)$ have shape parameter 1 and scale parameter $s>0$ (see [32]). The discrete Pareto distributed $Y\left(s\right)$ has probability mass and distribution functions:

$$\mathbb{P}(Y\left(s\right)=k)=\frac{s}{s+k-1}-\frac{s}{s+k}and\mathbb{P}\left(Y\left(s\right)\le k\right)=\frac{k}{s+k},fork\in {\mathbb{N}}_{+}.$$

(35)

Let $Y_1\left(s\right),Y_2\left(s\right),\dots$ be a sequence of independent random variables with the common distribution function (35). Define

$$N_n\left(s\right)={max}_{1\le j\le n}{Y}_j\left(s\right)with\mathbb{P}(N_n\left(s\right)\le k)={\left(\frac{k}{s+k}\right)}^n,n\in {\mathbb{N}}_{+},k\in {\mathbb{N}}_{+}s>0.$$

(36)

The random variable $N_n\left(s\right)$ is extremely spread over the positive integers.

Proposition 4.

Consider the discrete random variable $N_n\left(s\right)$ with distribution function (36). Then,

$${sup}_{y>0}\left|\mathbb{P}\left(\frac{N_n\left(s\right)}{n}\le y\right)-W_s\left(y\right)-\frac{h_{2;s}\left(y\right)}{n}\right|\le \frac{C_3\left(s\right)}{n^2}foralln\in {\mathbb{N}}_{+}andfixeds>0,$$

(37)

$$W_s\left(y\right)={\mathrm{e}}^{-s/y}and{h}_{2;s}\left(y\right)=s{\mathrm{e}}^{-s/y}\left(s-1+2Q_1\left(ny\right)\right)/\left(2y^2\right),y>0$$

(38)

where $C_3\left(s\right)>0$ does not depend on n and $Q_1\left(y\right)$ is defined in (33). Moreover,

$$\mathbb{E}{\left(N_n\left(s\right)\right)}^{-p}\le C\left(p\right)n^{-min\{p,2\}},$$

(39)

where for $0<p\le 2$ the order of the bound is optimal.

The Chebyshev–Edgeworth expansion (37) is proved in [11] (Theorem 4). In [12] (Corollary 5.2), leading terms for the negative moments $\mathbb{E}{\left(N_n\left(s\right)\right)}^{-p}$ are derived for the negative moments that lead to (39).

Remark 10.

Let the random variable $V\left(s\right)$ is exponentially distributed with rate parameter $s>0$. Then, $W\left(s\right)=1/V\left(s\right)$ is an inverse exponentially distributed random variable with the continuous distribution function $W_s\left(y\right)=e^{-s/y}{\mathbb{I}}_{(0\infty )}\left(y\right)$. Both $W_s\left(y\right)$ and $\mathbb{P}(N_n\left(s\right)\le y)$ are heavy tailed with shape parameter 1.

Remark 11.

Since $\mathbb{E}\left(W\left(s\right)\right)=\infty$ and $\mathbb{E}\left(N_n\left(s\right)\right)=\infty$ for all $n\in {\mathbb{N}}_{+}$, we choose $g_n=n$ as normalizing factor for $N_n\left(s\right)$ in (37).

Remark 12.

The random sample sizes $N_n\left(s\right)$ satisfy (2) in Assumption 2 and the additional conditions (6)–(8) in Proposition 2 with $W_s\left(y\right)={\mathrm{e}}^{-s/y}$, $h_2\left(y\right)=h_{2;s}\left(y\right)$, $g_n=n$ and $b=2$. The jumps of the distribution function $\mathbb{P}(N_n\left(s\right)\le ny)$ only affects the function $Q_1(.)$ in the term $h_{2;s}(.)$.

Remark 13.

Lyamin [33] proved a bound $|\mathbb{P}(N_n\left(s\right)\le ny)-W_s\left(y\right)|\le 0.37n^{-1}$ for integers $s\ge 1$.

5. Limit Distributions of Statistics with Random Sample Sizes Using Different Scaling Factors

The statistic $T_m$ from a sample with non-random sample size $m\in {\mathbb{N}}_{+}$ fulfills condition (1) in Assumption 1. Instead of the non-random sample size m, we consider a random sample size $N_n\in {\mathbb{N}}_{+}$ satisfying condition (2) in Assumption 2. Let $g_n$ be a sequence with $g_n\uparrow \infty$ as $n\to \infty$. Consider the scaling factor $g_n^{\gamma }{N}_n^{{\gamma }^{*}-\gamma }$ by the statistics $T_{N_n}$ with $\gamma \in \{0,\pm 1/2\}$ if $F\left(x\right)=\mathsf{\Phi }\left(x\right)$ and ${\gamma }^{*}=1/2$ or $\gamma \in \{0,\pm 1\}$ if $F\left(x\right)=G_u\left(x\right)$ and ${\gamma }^{*}=1$. Then, conditioning on $N_n$ and using (1) and (2), we have

$$\begin{array}{ccc}\hfill \mathbb{P}\left(g_n^{\gamma }{N}_n^{{\gamma }^{*}-\gamma }{T}_{N_n}\le x\right)& =& \mathbb{P}\left(N_n^{\gamma }{T}_{N_n}\le x{(N_n/g_n)}^{\gamma }\right)=\sum _{m=1}^{\infty }\mathbb{P}\left(m^{\gamma }{T}_m\le x{(m/g_n)}^{\gamma }\right)\mathbb{P}(N_n=m)\hfill \\ & & \stackrel{\left(1\right)}{\approx }\mathbb{E}\left(F\left(x{(N_n/g_n)}^{\gamma }\right)\right)={\int }_{1/g_n}^{\infty }F\left(x{y}^{\gamma }\right)d\mathbb{P}(N_n/g_n\le y)\stackrel{\left(2\right)}{\approx }{\int }_{1/g_n}^{\infty }F\left(x{y}^{\gamma }\right)dH\left(y\right).\hfill \end{array}$$

(40)

If there exists a limit distribution of $\mathbb{P}\left(g_n^{\gamma }{N}_n^{{\gamma }^{*}-\gamma }{T}_{N_n}\le x\right)$ as $n\to \infty$, then it has to be a scale mixture of parent distribution $F\left(x\right)$ and positive mixing parameter $H\left(y\right)$: ${\int }_0^{\infty }F\left(x{y}^{\gamma }\right)dH\left(y\right)$ (see, e.g., [23,34], Chapter 13, and [19] and the references therein).

Remark 14.

Formula (40) shows that different normalization factors at $T_{N_n}$ lead to different scale mixtures of the limit distribution of the normalized statistics $T_{N_n}$.

5.1. The Case $F\left(x\right)=\mathsf{\Phi }\left(x\right)$ and $H\left(y\right)=G_{r,r}\left(y\right)$

The statistics (15), (18) and (21) considered in Section 3.1 have normal approximations $\mathsf{\Phi }\left(x\right)$. The limit distribution for the normalized random sample size $N_n\left(r\right)/\mathbb{E}{N}_n\left(r\right)$ is the gamma distribution $G_{r,r}\left(y\right)$ with density (30). We investigate the dependence of the limit distributions in $\mathbb{P}\left(g_n^{\gamma }{N}_n{\left(r\right)}^{1/2-\gamma }{T}_{N_n\left(r\right)}\le x\right)\to {\int }_0^{\infty }\mathsf{\Phi }\left(x{y}^{\gamma }\right)d{G}_{r,r}\left(y\right)$ as $n\to \infty$ for $\gamma \in \{1/2,0,-1/2\}$.

(i) If $\gamma =1/2$, then the limit distribution is Student-s t distribution $S_{2r}\left(x\right)$ having density

$$s_{2r}\left(x\right)=\frac{\mathsf{\Gamma }\left(\right(r+1/2)}{\sqrt{2r\pi }\mathsf{\Gamma }\left(r\right)}{\left(1+\frac{x^2}{2r}\right)}^{-r+1/2},r>0,x\in \mathbb{R}.$$

(41)

(ii) If $\gamma =0$, the standard normal law $\mathsf{\Phi }\left(x\right)$ is the limit one with density $\phi \left(x\right)$.

(iii) For $\gamma =-1/2$, the generalized Laplace distributions $L_r\left(x\right)$ occur with density (see [13], Section 5.1.3):

$$l_r\left(x\right)=\frac{r^r}{\mathsf{\Gamma }\left(r\right)}{\int }_0^{\infty }\phi \left(x{y}^{-1/2}\right)y^{r-3/2}{e}^{-ry}dy=\frac{2r^r}{\mathsf{\Gamma }\left(r\right)\sqrt{2\pi }}{\left(\frac{\left|x\right|}{\sqrt{2r}}\right)}^{r-1/2}{K}_{r-1/2}(\sqrt{2r}\left|x\right|).$$

(42)

where $K_{\alpha }\left(u\right)$ is the Macconald function of order α or modified Bessel function of the third kind with index $\alpha$. The function $K_{\alpha }\left(u\right)$ is also sometimes called a modified Bessel function of the second kind of order $\alpha$. For properties of these functions, see, e.g., Chapter 51 in [35] or the Appendix on Bessel functions in [36].

If $r\in N_{+}$, the so-called Sargan densities$l_1\left(x\right),l_2\left(x\right),\dots$ and their distribution functions are computable in closed forms (see Formulas (63)–(65) below in Section 7):

$$\left.\begin{array}{ccc}{l}_1\left(x\right)=\frac{{\displaystyle 1}}{{\displaystyle \sqrt{2}}}{e}^{-\sqrt{2}\left|x\right|}\hfill & and\hfill & L_1\left(x\right)=1-\frac{{\displaystyle 1}}{{\displaystyle 2}}{e}^{-\sqrt{2}\left|x\right|},x>0\hfill \\ l_2\left(x\right)=\left(\frac{{\displaystyle 1}}{{\displaystyle 2}}+\left|x\right|\right)e^{-2\left|x\right|}\hfill & and\hfill & L_2\left(x\right)=1-\frac{{\displaystyle 1}}{{\displaystyle 2}}(1+x)e^{-2\left|x\right|},x>0\hfill \\ l_3\left(x\right)=\frac{{\displaystyle 3\sqrt{6}}}{{\displaystyle 16}}\left(1+\sqrt{6}\left|x\right|+2x^2\right)e^{-\sqrt{6}\left|x\right|}\hfill & and\hfill & L_3\left(x\right)=1-\left(\frac{{\displaystyle 1}}{{\displaystyle 2}}+\frac{{\displaystyle 5\sqrt{6}x}}{{\displaystyle 16}}+\frac{{\displaystyle 3x^2}}{{\displaystyle 8}}\right)e^{-\sqrt{6}\left|x\right|},\hfill \end{array}\right\}$$

(43)

where $L_r(-x)=1-L_r\left(x\right)$ for $x\ge 0$.

The double exponential or standard Laplace density is $l_1\left(x\right)$ with variance 1 and distribution function $L_1\left(x\right)$ given in (43). The Sargan distributions are therefore a generalisation of the standard Laplace distribution.

5.2. The Case $F\left(x\right)=G_d\left(x\right)$ and $H\left(y\right)=W_s\left(y\right)=e^{-s/y}$

The statistics considered in Section 3.2 asymptotically approach chi-square distribution $G_d\left(x\right)$. The limit distribution for the normalized random sample size $N_n\left(s\right)/n$ is the inverse exponential distribution $W_s\left(y\right)=e^{-s/y}{\mathbb{I}}_{(0,\infty )}\left(y\right)$.

(i) If $\gamma =1$, then the generalized gamma distribution $W_d(x;2s)$ occurs with density $w_d(x;2s)$:

$$w_d(x;2s)=s{\left(\frac{sx}{2}\right)}^{d/4-1/2}{K}_{d/2-1}\left(\sqrt{2sx}\right){\mathbb{I}}_{(0,\infty )}\left(x\right)$$

(44)

where the Macconald function $K_{\alpha }\left(u\right)$ already appears in Formula (42) with different $\alpha$ and argument. For $\alpha =m+1/2$, where m is an integer, the Macconald function $K_{m+1/2}\left(u\right)$ has a closed form (see Formulas (63)–(65) below in Section 7). Therefore, if $d=1,3,5\dots$ is an odd number, then the density $w_d(x;2s)$ may be calculated in closed form. The distribution functions $W_d(x;2s)$ with density functions $w_d(x;2s)$ for $d=1,3,5$ and $x>0$ are

$$\begin{array}{ccc}\hfill w_1(x;2s)& =& s{\left(2sx\right)}^{-1/2}{e}^{-\sqrt{2sx}}\mathrm{and}{W}_1(x;2s)=1-e^{-\sqrt{2sx}},\hfill \end{array}$$

(45)

$$\begin{array}{ccc}\hfill w_3(x;2s)& =& s{e}^{-\sqrt{2sx}}\mathrm{and}{W}_3(x;2s)=1-e^{-\sqrt{2sx}}(\sqrt{2sx}+1),\hfill \end{array}$$

(46)

$$\begin{array}{ccc}\hfill w_5(x;2s)& =& \frac{s}{3}\left(1+2\sqrt{2sx}\right)e^{-\sqrt{2sx}}\mathrm{and}{W}_5(x;2s)=1-e^{-\sqrt{2sx}}\left(\sqrt{2sx}+\frac{2sx}{3}\right).\hfill \end{array}$$

(47)

Remark 15.

Functions in (45) are Weibull density and distribution functions, in (46) there are density and distribution functions of a generalized gamma distribution, but $w_5\left(x\right)$ and $W_5\left(x\right)$ are even more general.

The family of generalized gamma distributions contains many absolutely continuous distributions concentrated on the non-negative half-line.

Remark 16.

The generalized gamma distribution $G^{*}(x;r,\alpha ,\lambda )$ corresponds to the density

$$g^{*}(x;r,\alpha ,\lambda )=\frac{\left|\alpha \right|{\lambda }^r}{\mathsf{\Gamma }\left(r\right)}{x}^{\alpha r-1}{e}^{-\lambda x^{\alpha }},x\ge 0,\left|\alpha \right|>0,r>0,\lambda >0,$$

(48)

where α and r are the two shape parameters and λ the scale parameter. The density representation (48) is suggested in the work of Korolev and Zeifman [37] or Korolev and Gorshenin [38], and many special cases are listed therein. In addition to, e.g., Gamma and Weibull distributions (with a > 0), inverse Gamma, Lévy and Fréche distributions (with a < 0) also belong to that family of generalized gamma distributions.

Remark 17.

The Weibull density in (45) is $w_1(x;2s)=g^{*}(x;1,1/2,\sqrt{2s})$. Moreover, $w_3(x;2s)$$=g^{*}(x;2,1/2,\sqrt{2s})$. The densities $w_5\left(x\right)$, $w_7\left(x\right),w_9\left(x\right),\dots$ are weighted sums of generalized gamma distribution with different shape parameters r, e.g.,

$$\begin{array}{ccc}\hfill w_5(x;2s)& =& \frac{1}{3}{g}^{*}(x;2,\frac{1}{2},\sqrt{2s})+\frac{2}{3}{g}^{*}(x;3,\frac{1}{2},\sqrt{2s})\hfill \\ \hfill w_9(x;2s)& =& \frac{5}{35}{g}^{*}(x;2,\frac{1}{2},\sqrt{2s})+\frac{10}{35}{g}^{*}(x;3,\frac{1}{2},\sqrt{2s})+\frac{12}{35}{g}^{*}(x;4,\frac{1}{2},\sqrt{2s})+\frac{8}{35}{g}^{*}(x;5,\frac{1}{2},\sqrt{2s}).\hfill \end{array}$$

(i) If $\gamma =1$. For better readability I have introduced for (i) and after (ii).

(ii) If $\gamma =0$, the standard normal law $\mathsf{\Phi }\left(x\right)$ is the limit distribution with density $\phi \left(x\right)$.

(iii) If $\gamma =-1,$ as limit distribution the inverse Pareto distribution occurs $V_{d/2}(x;2s)$ with shape parameter $d/2$, scale parameter $2s$ and density $v_{d/2}(x;2s)$:

$$V_{d/2}(x;2s)={\left(\frac{{\displaystyle x}}{{\displaystyle 2s+x}}\right)}^{d/2}\mathrm{and}{v}_{d/2}(x;2s)=\frac{{\displaystyle sd{x}^{d/2-1}}}{{\displaystyle {(x+2s)}^{d/2+1}}}\mathrm{for}x\ge 0$$

(49)

In [39], a robust and efficient estimator for the shape parameter of the inverse Pareto distribution and applications are given.

6. Main Results

We examine asymptotic approximations of $\mathbb{P}\left(g_n^{\gamma }{N}_n^{{\gamma }^{*}-\gamma }{T}_{N_n}\le x\right)$ depending on the scaling factor $g_n^{\gamma }{N}_n^{{\gamma }^{*}-\gamma }$ for $\gamma \in \{0,\pm 1/2,\pm 1\}$, for ${\gamma }^{*}=1/2$ if the statistic $T_m$ is asymptotically normal or ${\gamma }^{*}=1$ if $T_m$ is asymptotically chi-square distributed.

6.1. Asymptotically Normal Distributed Statistics with Negative Binomial Distributed Sample Sizes

Consider first the statistics estimated in (15), (18) and (21) with the normal limiting distribution $\mathsf{\Phi }\left(x\right)$. They have the form

$$\left|\mathbb{P}(\sqrt{m}{Z}_m\le x)-\mathsf{\Phi }\left(x\right)-\left(m^{-1/2}(p_0+p_2{x}^2)+m^{-1}(p_{1}x+p_3{x}^3+p_5{x}^5){\mathbb{I}}_{a>1}\left(a\right)\right)\phi \left(x\right)\right|\le m^{-a}.$$

(50)

The sample size is negative binomial $N_n=N_n\left(r\right)$ with probability mass function (28).

Theorem 1.

Let $r>0$. If inequality (50) for the statistic $Z_m$ and inequality (31) for random sample size $N_n\left(r\right)$ with $g_n=\mathbb{E}{N}_n\left(r\right)=r(n-1)+1$ hold, then, for all $n\in {\mathbb{N}}_{+}$, the following expansions apply:

i: 

The non-random scaling factor $\sqrt{g_n}$ by statistic $Z_{N_n\left(r\right)}$ leads to Student’s t-approximation.

$${sup}_x\left|\mathbb{P}\left(\sqrt{g_n}{Z}_{N_n\left(r\right)}\le x\right)-S_{2r;n}\left(x\right)\right|\le C_r\left\{\begin{array}{cc}{n}^{-r}ln\left(n\right),\hfill & r\in \{1/2,3/2,2\},\hfill \\ n^{-min\{r,2\}},\hfill & r\notin \{1/2,3/2,2\}\hfill \end{array}\right.$$

where

$$\begin{array}{ccc}\hfill S_{2r;n}\left(x\right)& =& S_{2r}\left(x\right)+\frac{s_{2r}\left(x\right)}{\sqrt{g_n}}\left(p_0\frac{{\displaystyle x^2+2r}}{{\displaystyle 2r-1}}+p_2{x}^2\right){\mathbb{I}}_{\{r>1/2\}}\left(r\right)\hfill \\ & & +\frac{s_{2r}\left(x\right)}{g_n}\left(p_1\frac{{\displaystyle x(x^2+2r)}}{{\displaystyle (2r-1)}}+p_3{x}^3+p_5\frac{x^5(2r+1)}{x^2+2r}+\frac{(2-r)x(x^2+1)}{4(2r-1)}\right){\mathbb{I}}_{\{r>1\}}\left(r\right),\hfill \end{array}$$

(51)

$S_{2r}\left(x\right)$ is Student’s t-distribution having density $s_{2r}\left(x\right)$, defined in (41), and $p_k$ are the coefficients in (50).

ii: 

The standard normal approximation occurs at random scaling factor $\sqrt{N_n\left(r\right)}$ by statistic $Z_{N_n\left(r\right)}$:

$${sup}_x\left|\mathbb{P}(\sqrt{N_n\left(r\right)}{Z}_{N_n\left(r\right)}\le x)-{\mathsf{\Phi }}_{n2}\left(x\right)\right|\le C_r\left\{\begin{array}{cc}{n}^{-min\{r,2\}},\hfill & r\ne 2,\hfill \\ ln\left(n\right)n^{-2},\hfill & r=2,\hfill \end{array}\right.$$

(52)

where

$$\begin{array}{ccc}\hfill {\mathsf{\Phi }}_{n2}\left(x\right)& =& \mathsf{\Phi }\left(x\right)+\frac{\sqrt{r}\mathsf{\Gamma }(r-1/2)}{\mathsf{\Gamma }\left(r\right)\sqrt{g_n}}(p_0+p_2{x}^2)\phi \left(x\right){\mathbb{I}}_{\{r>1/2\}}\left(r\right)\hfill \\ & & +\frac{(p_{1}x+p_3{x}^3+p_5{x}^5)\phi \left(x\right)}{g_n}\left(lnn{\mathbb{I}}_{\{r=1\}}\left(r\right)+\frac{r}{r-1}{\mathbb{I}}_{\{r>1\}}\left(r\right)\right),\hfill \end{array}$$

(53)

iii: 

If $r=2$, the mixed scaling factor $g_n^{-1/2}{N}_n\left(2\right)$ by statistic $Z_{N_n\left(2\right)}$ leads to generalized Laplace approximation:

$${sup}_x\left|\mathbb{P}\left(g_n^{-1/2}{N}_n\left(2\right)Z_{N_n\left(2\right)}\le x\right)-L_2\left(x\right)-l_{n;2}\left(x\right)\right|\le C_{2}ln\left(n\right)n^{-2}$$

(54)

where $L_2\left(x\right)=1-\frac{{\displaystyle 1}}{{\displaystyle 2}}(1+x)e^{-2\left|x\right|}$, $L_2(-x)=1-L_2\left(x\right)$ for $x\ge 0$ and

$$l_{n;2}\left(x\right)=\frac{e^{-2\left|x\right|}}{\sqrt{g_n}}\left(p_0\left(\right|x|+1/2)+2p_2{x}^2)\right)-\frac{e^{-2\left|x\right|}}{g_n}\left(p_{1}x+4p_3\left|x\right|x+4p_5(2x^3+\left|x\right|x)\right).$$

(55)

Remark 18.

Analogous to (54) and (55), expansions for all $r>0$ can be derived from Formulas (42) and (63)–(66) below in Section 7, whereby closed forms can be presented only for $r\in \{1,2,3,\dots \}$.

The statistics from Section 3.1 are considered with different normalization factors as applications of Theorem 1:

Corollary 1.

Let the conditions of Theorem 1 be satisfied:

i: 

In the case of the Student’s t-statistic $Z/\sqrt{{\chi }_m^2}$ estimated in (18), one has (51) with $p_0=p_2=p_5=0$ and $p_1=p_3=1/4$ using non-random scaling factor $\sqrt{g_n}$:

$${sup}_x\left|\mathbb{P}\left(\frac{\sqrt{g_n}Z}{\sqrt{{\chi }_{N_n\left(r\right)}^2}}\le x\right)-S_{2r}(x;n)\right|\le C_r\left\{\begin{array}{cc}{n}^{-min\{r,2\}},\hfill & r\ne 2,\hfill \\ ln\left(n\right)n^{-2},\hfill & r=2,\hfill \end{array}\right.$$

where

$$S_{2r}(x;n)=S_{2r}\left(x\right)-s_{2r}\left(x\right)\frac{{\displaystyle 2r(x+x^3)-(2-r)x(x^2+1)}}{{\displaystyle 4(2r-1)g_n}}{\mathbb{I}}_{\{r>1\}}\left(r\right)$$

ii: 

In the case of Student’s one-sample t-test statistic under non-normality $T_m=({\overline{X}}_m-\mu )/{\widehat{\sigma }}_m$ estimated in (21) with $a=1$, the first-order approximation defined in (52) for $0<r\le 1$ and (53) with $p_0={\lambda }_3/6$ and $p_2={\lambda }_3/3$ using random scaling factor $\sqrt{N_n\left(r\right)}$ leads uniformly in x to:

$$\left|\mathbb{P}(\sqrt{N_n\left(r\right)}{T}_{N_n\left(r\right)}\le x)-\mathsf{\Phi }\left(x\right)+\frac{\sqrt{r}\mathsf{\Gamma }(r-1/2){\lambda }_3(2x^2+1)}{6\mathsf{\Gamma }\left(r\right)\sqrt{g_n}}\phi \left(x\right)\right|\le C_r\left\{\begin{array}{cc}{n}^{-min\{r,1\}},\hfill & r\ne 1,\hfill \\ ln\left(n\right)n^{-1},\hfill & r=1.\hfill \end{array}\right.$$

iii: 

Considering sample mean ${\overline{X}}_m$ estimated in (15), one has (55) with $p_0=-p_2={\lambda }_3/6$, $p_1={\lambda }_4/8-5{\lambda }_3^2/24$, $p_3=-{\lambda }_4/24+5{\lambda }_3^2/36$, and $p_5=-{\lambda }_3^2/72$ using mixed scaling factor $g_n^{-1/2}{N}_n\left(2\right)$:

$${sup}_x\left|\mathbb{P}\left(g_n^{-1/2}{N}_n\left(2\right){\overline{X}}_{N_n\left(2\right)}\le x\right)-L_2\left(x\right)-l_{2;n}\left(x\right)\right|\le C_{2}ln\left(n\right)n^{-2},$$

where the generalized Laplace distributions $L_2\left(x\right)$ is defined in (43) and

$$l_{2;n}\left(x\right)=\frac{{\lambda }_3{e}^{-2\left|x\right|}}{6\sqrt{g_n}}\left(2x^2-\left|x\right|-1/2\right)+\frac{e^{-2\left|x\right|}}{36g_n}\left({\lambda }_4(9x-6x|x\left|\right)+12{\lambda }_3^2(4x^3+18x\left|x\right|-15x)\right).$$

Remark 19.

The approximating functions in the expansions for $\mathbb{P}\left(g_n^{\gamma }{N}_n{\left(r\right)}^{1/2-\gamma }{T}_{N_n\left(r\right)}\le x\right)$ with the statistics estimated in (15), (18) and (21) can only be given in closed form for all $r>0$ in the case of non-random ($\gamma =1/2$) or random ($\gamma =0$) normalization factors. In the case of the mixed ($\gamma =-1/2$) normalization factor, only for positive integer r closed forms are available, while in the other cases Macconald functions are involved.

6.2. Asymptotically Chi-Square Distributed Statistics with Pareto-Like Distributed Sample Sizes

Consider now the statistics, estimated in (26) and (27) with limit chi-square distributions. They have the form

$$\left|\mathbb{P}(m{T}_m\le x)-G_d\left(x\right)-m^{-1}(q_{1}x+q_2{x}^2)g_d\left(x\right)\right|\le C\left(s\right)m^{-2}.$$

(56)

The sample size is the Pareto-like random variable $N_n=N_n\left(s\right)$ with probability mass function (35).

Theorem 2.

Let $s>0$ and (36) be the distribution function of the random sample size $N_n=N_n\left(s\right)$. If for the statistic $T_m$ the inequality (56) with limiting chi-square distribution $G_d\left(x\right)$ and the inequality (37) with $g_n=n$ for the random sample size $N_n\left(s\right)$ hold, then for all $n\in {\mathbb{N}}_{+}$ one has the following approximation:

i: 

The non-random scaling factor n by $T_{N_n\left(s\right)}$ leads to the limiting generalized gamma distributions.

$${sup}_{x>0}\left|\mathbb{P}\left(n{T}_{N_n\left(s\right)}\le x\right)-W_{d;n}(x;2s)\right|\le C\left(s\right)n^{-2}lnnford=1andd=3,$$

(57)

$$W_{1;n}(x;2s)=W_1(x;2s)+n^{-1}{w}_1(x;2s)\left(q_{1}x\left(1+\sqrt{2sx}\right)+q_2{x}^2-\frac{(s-1)x(\sqrt{2sx}+1)}{4s}\right)$$

(58)

and

$$W_{3;n}(x;2s)=W_3(x;2s)+n^{-1}{w}_3(x;2s)\left(q_1\frac{x\sqrt{2sx}}{2s}+q_2{x}^2-\frac{(s-1)x^2}{2\sqrt{2sx}}\right).$$

(59)

where the limit law $W_d(x;2s)$ with density $w_d(x;2s)$ for $d=1$ and $d=3$ are given in (45) and (46).

ii: 

The random scaling factor $N_n\left(s\right)$ by $T_{N_n\left(s\right)}$ induces the limiting chi-square distribution.

$${sup}_x\left|\mathbb{P}(N_n\left(s\right)T_{N_n\left(s\right)}\le x)-G_d\left(x\right)-\frac{g_d\left(x\right)}{sn}\left(q_{1}x+q_2{x}^2\right)\right|\le C\left(s\right)\frac{lnn}{n^2},$$

(60)

iii: 

Limiting inverse Pareto distributions occur at mixed scaling factor $n^{-1}{N}_n^2\left(s\right)$ by $T_{N_n\left(s\right)}$.

$${sup}_{x>0}\left|\mathbb{P}\left(\frac{N_n^2\left(s\right)}{n}{T}_{N_n\left(s\right)}\le x\right)-V_{d/2}(x;2s)-\frac{1}{n}{v}_{d/2;n}(x;2s)\right|\le C\left(s\right)\frac{lnn}{n^2},$$

where

$$v_{d/2;n}(x;2s)=v_{d/2}(x;2s)\left(q_1\frac{{\displaystyle x(d+2)}}{{\displaystyle x+2s}}+q_2\frac{{\displaystyle x^2(d+4)(d+2)}}{{\displaystyle {(x+2s)}^2}}+\frac{(s-1)x(2+d)}{2(x+2s)}\right)$$

(61)

with inverse Pareto distribution $V_{d/2}(x;2s)$ having shape parameter $d/2$, scale parameter $2s$ and density $v_{d/2}(x;2s)$ defined in (49).

Remark 20.

Analogous to (57), expansions for all $d\in {\mathbb{N}}_{+}$ can be derived from Formulas (44), (63)–(65) and (69) below in Section 7, whereby closed forms can be given for $d\in \{1,3,5,\dots \}$.

The statistics from Section 3.2 are considered with different normalization factors as applications of Theorem 2.

Corollary 2.

Let the conditions of Theorem 2 be satisfied.

i: 

Let ${\chi }_d^2/{\chi }_m^2$ be scale mixture, estimated in (24), where ${\chi }_d^2$ and ${\chi }_m^2$ are independent. Then, using non-random scaling factor, n limiting generalized gamma distributions occur with $q_1=(d-2)/2$ and $q_2=-1/2$ in (58) and (59):

$${sup}_{x>0}\left|\mathbb{P}\left(n\mathrm{tr}\left({\chi }_d^2/{\chi }_{N_n\left(s\right)}^2\right)\le x\right)-W_{d;n}(x;2s)\right|\le C\left(s\right)n^{-2}lnn,ford=1andd=3,$$

$$W_{1;n}(x;2s)=W_1(x;2s)+n^{-1}{w}_1(x;2s)\left(-x\left(1+\sqrt{2sx}\right)-\frac{x^2}{2}-\frac{(s-1)x(\sqrt{2sx}+1)}{4s}\right)$$

$x>0$ and

$$W_{3;n}(x;2s)=W_3(x;2s)+n^{-1}{w}_3(x;2s)\left(\frac{x}{4s}\sqrt{2sx}-\frac{x^2}{2}-\frac{(s-1)x^2}{2\sqrt{2sx}}\right),x>0,$$

where the limit law $W_d(x;2s)$ with density $w_d(x;2s)$ for $d=1$ and $d=3$ are given in (45) and (46).

ii: 

For the scaled mixture ${\chi }_4^2/{\chi }_m^2$ estimated in (27), one gets the limiting chi-square distribution with a random scaling factor $N_n\left(s\right)$ in (60) with $q_1=1$ and $q_2=1/2$:

$${sup}_x\left|\mathbb{P}(N_n\left(s\right){\chi }_4^2/{\chi }_{N_n\left(s\right)}^2\le x)-G_d\left(x\right)-\frac{g_d\left(x\right)}{sn}\left(x-x^2/2)\right)\right|\le C\left(s\right)\frac{lnn}{n^2},$$

iii: 

In the case of the Hotelling’s generalized $T_0^2$ statistic $T_0^2=m\mathrm{tr}\left({\mathbf{S}}_q{\mathbf{S}}_m^{-1}\right)$ estimated in (22), one has the limiting inverse Pareto distributions with mixed scaling factor $n^{-1}{N}_n^2\left(s\right)$ by $\mathrm{tr}\left({\mathbf{S}}_q{\mathbf{S}}_{N_n\left(s\right)}^{-1}\right)$. Here, (61) holds with $q_1=(p+1-q)/2$ and $q_2=(p+1+q)/(2d+4)$.

$${sup}_{x>0}\left|\mathbb{P}\left(\frac{N_n^2\left(s\right)}{n}\mathrm{tr}\left({\mathbf{S}}_q{\mathbf{S}}_{N_n\left(s\right)}^{-1}\right)\le x\right)-V_{d/2}(x;2s)-\frac{1}{n}{v}_{d/2;n}(x;2s)\right|\le C\left(s\right)\frac{lnn}{n^2},$$

and

$$v_{d/2;n}(x;2s)=v_{d/2}(x;2s)\left(\frac{{\displaystyle (p+1-q)x(d+2)}}{{\displaystyle 2(x+2s)}}+\frac{{\displaystyle (p+1+q)x^2(d+4)}}{{\displaystyle 2{(x+2s)}^2}}+\frac{(s-1)x(2+d)}{2(x+2s)}\right)$$

where the inverse Pareto distribution$V_{d/2}(x;2s)$with shape parameter$d/2$, scale parameter$2s$ and density$v_{d/2}(x;2s)$is defined in (49).

Remark 21.

For the statistics estimated in (26) and (27), the approximating functions in the expansions for $\mathbb{P}\left(g_n^{\gamma }{N}_n{\left(s\right)}^{1-\gamma }{T}_{N_n\left(s\right)}\le x\right)$ can only be given in closed form for all integer d in the case of non-random ($\gamma =1$) or random ($\gamma =0$) normalization factors. In the case of the mixed ($\gamma =-1$) normalization factor, only for odd integer d in closed form can be presented; for even integer d, the Macconald functions are involved.

7. Formal Construction of the Expansions

Expansions of the statistics considered in (15), (18), (21), (26) and (27) have the structure:

$$G\left(x\right)+g\left(x\right)\left(m^{-1/2}{P}_1(x;j_1^{*})+m^{-1}{P}_2(x;j_2^{*})\right)$$

with $g\left(x\right)=G^{\prime }\left(x\right)$ and polynomials $P_1(x;j_1^{*}),P_2(x;j_2^{*})$ of degrees $j_1^{*}$ and $j_2^{*}$, respectively. Here, $G\left(x\right)=\mathsf{\Phi }\left(x\right)$ or $G\left(x\right)=\mathbb{P}({\chi }_d^2\le x)$.

We calculate the integrals with $k=1,2$ and $j=0,1,\dots ,j_k^{*}$:

$$J_1(x;\gamma )={\int }_0^{\infty }G\left(x{y}^{\gamma }\right)dH\left(y\right)\mathrm{and}{J}_2(x;\gamma ,k,j)=x^j{\int }_0^{\infty }{y}^{\gamma j-k/2}g\left(x{y}^{\gamma }\right)dH\left(y\right).$$

The limit distributions of the random sizes $N_n$ are $H\left(y\right)=G_{r,r}\left(y\right)$ and $H\left(y\right)=W_s\left(y\right)=e^{-s/y}$ with corresponding second approximation $h_2\left(y\right)$.

We use the following formulas several times: Formula 2.3.3.1 in [40]

$$M_{\alpha }\left(p\right)=\underset{0}{\overset{\infty }{\int }}{y}^{\alpha -1}{\mathrm{e}}^{-py}dy\stackrel{y=1/z}{=}\underset{0}{\overset{\infty }{\int }}{z}^{-\alpha -1}{\mathrm{e}}^{-p/z}dz=\mathsf{\Gamma }\left(\alpha \right)p^{-\alpha }\alpha >0,p>0.$$

(62)

and Formula 2.3.16.1 in [40] with real $\alpha$ and $p,q>0$:

$$K_{\alpha }^{*}(p,q)={\int }_0^{\infty }{y}^{\alpha -1}{e}^{-py-q/y}dy=2{\left(\frac{q}{p}\right)}^{\alpha /2}{K}_{\alpha }\left(2\sqrt{pq}\right),$$

(63)

where the Macconald function $K_{\alpha }\left(u\right)$ already appears in Formula (42) with different $\alpha$ and argument.

For $\alpha =m+1/2$, where m is an integer, the Macdonald function $K_{m+1/2}\left(u\right)$ has a closed form (see Formulas 2.3.16.2 and 2.3.16.3 in [40] with $p,q>0$):

$$K_{m+1/2}^{*}(p,q)=K_m^{**}(p,q)\mathrm{if}m\mathrm{is}\mathrm{an}\mathrm{integer},$$

(64)

where

$$K_m^{**}(p,q)={\int }_0^{\infty }{y}^{m-1/2}{e}^{-py-q/y}dy=\left\{\begin{array}{c}{(-1)}^m\sqrt{\pi }\frac{{\displaystyle {\partial }^m}}{{\displaystyle \partial p^m}}\left(p^{-1/2}{e}^{-2\sqrt{pq}}\right),m=0,1,2,\dots ,\hfill \\ {(-1)}^{-m}\sqrt{\frac{{\displaystyle \pi }}{{\displaystyle p}}}\frac{{\displaystyle {\partial }^{-m}}}{{\displaystyle \partial q^{-m}}}{e}^{-2\sqrt{pq}},m=0,-1,-2,\dots \hfill \end{array}\right.$$

(65)

7.1. The Case $G\left(x\right)=\mathsf{\Phi }\left(x\right)$ and $H\left(y\right)=G_{r,r}\left(y\right)$

Consider statistics that meet the condition (50).

Let $J_1(x;\gamma )={\int }_0^{\infty }\mathsf{\Phi }\left(x{y}^{\gamma }\right)d{G}_{r,r}\left(y\right)$ with $\gamma \in \{0,\pm 1/2\}$. Then, $J_1(x;\gamma )=\mathsf{\Phi }\left(x\right)$ for $\gamma =0$ and

$$\begin{array}{ccc}\hfill \frac{\partial }{\partial x}{J}_1(x;\gamma )& =& \frac{r^r}{\mathsf{\Gamma }\left(r\right)\sqrt{2\pi }}\underset{0}{\overset{\infty }{\int }}{y}^{r+\gamma -1}{e}^{-(x^2{y}^{2\gamma }/2+ry)}dy\hfill \\ & & =\frac{r^r}{\mathsf{\Gamma }\left(r\right)\sqrt{2\pi }}\left\{\begin{array}{cc}{M}_{r+1/2}\left(r\left(1+x^2/\left(2r\right)\right)\right),\hfill & \mathrm{for}\gamma =1/2,\hfill \\ K_{r-1/2}^{*}(r,x^2/2)=2{\left(\frac{{\displaystyle x^2}}{{\displaystyle 2r}}\right)}^{r/2-1/4}{K}_{r-1/2}\left(\sqrt{2r}x\right),\hfill & \mathrm{for}\gamma =-1/2.\hfill \end{array}\right.\hfill \end{array}$$

(66)

If $r>0$ is an integer number then using (64) with $m=r-1$, the density of $J_1(x;-1/2)$ can be calculated with (65) in a closed form.

Let $\gamma \in \{0,\pm 1/2\}$. Let $k=1,2$ and $j=0,1,\dots ,5$ be the exponents at $m^{-k/2}$ and $x^j$ in (50), respectively.

$$\begin{array}{ccc}\hfill J_2(x;\gamma ,k,j)& =& \frac{r^r{x}^j}{\mathsf{\Gamma }\left(r\right)\sqrt{2\pi }}{\int }_0^{\infty }{y}^{j\gamma +r-1-k/2}{e}^{-(x^2{y}^{2\gamma }/2+ry)}dy\hfill \\ & =& \frac{{\displaystyle r^r{x}^j}}{{\displaystyle \mathsf{\Gamma }\left(r\right)\sqrt{2\pi }}}\left\{\begin{array}{cc}{M}_{j/2+r-k/2}\left(r\left(1+x^2/\left(2r\right)\right)\right),\hfill & \mathrm{for}\gamma =1/2,\hfill \\ e^{-x^2/2}{M}_{r-k/2}\left(r\right),\hfill & \mathrm{for}\gamma =0,\hfill \\ K_{r-(j+k)/2}^{*}(r,x^2/2),\hfill & \mathrm{for}\gamma =-1/2.\hfill \end{array}\right.\hfill \end{array}$$

(67)

In (50) $k+j$ are odd integers. If $r>0$ is an integer, then $K_{r-(j+k)/2}^{*}(r,x^2/2)=$$K_{r-(j+k+1)/2}^{**}(r,x^2/2)$.

Define $p_j^{*}=p_j{I}_2(x;\gamma ,k,j)$ with coefficient $p_j$ from (50) and calculate the terms in (67):

$$\left.\begin{array}{cc}\gamma =1/2,\hfill & k=1:p_0^{*}=\frac{{\displaystyle p_0(2r+x^2)}}{{\displaystyle 2r-1}}{s}_{2r}\left(x\right),p_2^{*}=p_2{x}^2{s}_{2r}\left(x\right),\hfill \\ \hfill & k=2:p_1^{*}=\frac{{\displaystyle p_{1}x(x^2+2r)}}{{\displaystyle 2r-1}}{s}_{2r}\left(x\right),p_3^{*}=p_3{x}^3{s}_{2r}\left(x\right),p_5^{*}=p_5\frac{{\displaystyle x^5(2r+1)}}{{\displaystyle x^2+2r}}{s}_{2r}\left(x\right),\hfill \\ \gamma =-1/2,\hfill & k=1,r=2:p_0^{*}=p_0\left(\right|x|+1/2)e^{-2\left|x\right|},p_2^{*}=p_{2}2x^2{e}^{-2\left|x\right|},\hfill \\ \hfill & k=2,r=2:p_1^{*}=p_{1}2x{e}^{-2\left|x\right|},p_3^{*}=p_{3}4\left|x\right|x{e}^{-2\left|x\right|},p_5^{*}=p_{5}4(2x^3+x\left|x\right|)e^{-2\left|x\right|},\hfill \\ \gamma =0,\hfill & k=1,2,j=0,1,2,3,5:p_j^{*}=p_j{x}^j\phi \left(x\right)r^{k/2}\mathsf{\Gamma }(r-k/2)/\mathsf{\Gamma }\left(r\right),\hfill \end{array}\right\}$$

(68)

7.2. The Case $G\left(x\right)=G_d\left(x\right)$ and $H\left(y\right)=W_s\left(y\right)=e^{-s/y}$

Consider statistics that meet the condition (56). Let $J_1(x;\gamma )={\int }_0^{\infty }{G}_u\left(x{y}^{\gamma }\right)s{y}^{-2}{e}^{-s/y}dy$, $\gamma \in \{0,\pm 1\}$. Then, $J_1(x;0)=G_u\left(x\right)$ and

$$\frac{\partial }{\partial x}{J}_1(x;\gamma )=s{\int }_0^{\infty }{y}^{\gamma -2}{g}_u\left(x{y}^{\gamma }\right)e^{-s/y}dy=\frac{s{x}^{d/2-1}}{2^{d/2}\mathsf{\Gamma }(d/2)}{\int }_0^{\infty }{y}^{\gamma d/2-2}{e}^{-x{y}^{\gamma }/2-s/y}dy,\gamma =\pm 1.$$

Let $\gamma =1$. Using (63) with $\alpha =d/2-1$, $p=x/2$ and $q=s$, we find

$$\begin{array}{ccc}\hfill \frac{\partial }{\partial x}{J}_1(x;1)& =& s\underset{0}{\overset{\infty }{\int }}y{g}_u\left(xy\right)e^{-s/y}dy=\frac{s{x}^{d/2-1}}{2^{d/2}\mathsf{\Gamma }(d/2)}\underset{0}{\overset{\infty }{\int }}{y}^{d/2-2}{e}^{-xy/2-s/y}dy\hfill \\ & =& \frac{s{x}^{d/2}}{2^{d/2}\mathsf{\Gamma }(d/2)}{K}_{d/2-1}^{*}(x/2,s)=s{\left(\frac{sx}{2}\right)}^{d/4-1/2}{K}_{d/2-1}\left(\sqrt{2sx}\right).\hfill \end{array}$$

If $d=1,3,5,\dots$ is an odd number, using the closed form $K_m^{**}(p,q)$ in (65) with $m=(d-3)/2$, $p=x/2$ and $q=s$, then $J_1(x;1)=W_d(x,2s)$ and its density $w_d(x;2s)$ may be calculated in closed form:

$$w_d(x;2s)=\frac{\partial }{\partial x}{J}_1(x;1)=\frac{s{x}^{d/2-1}}{2^{d/2-1}\mathsf{\Gamma }(d/2)}{K}_{(d-3)/2}^{**}(x/2,s)\mathrm{for}d=1,3,5,\dots$$

(69)

The distribution functions $W_d(x;2s)$ and their densities $w_d(x;2s)$ for $d=1,3,5$ are given in (45)–(47).

If $\gamma =-1$, we use (62) with $\alpha =d/2+1$, $p=(x+2s)/2$, $q=s$ and the substitution $y=1/z$:

$$\begin{array}{ccc}\hfill \frac{\partial }{\partial x}{J}_1(x;-1)=\frac{s{x}^{d/2-1}}{2^{d/2}\mathsf{\Gamma }(d/2)}{\int }_0^{\infty }{y}^{-d/2-2}{e}^{-(x/2+s)/y}dy\stackrel{y=1/z}{=}\frac{s{x}^{d/2-1}}{2^{d/2}\mathsf{\Gamma }(d/2)}\underset{0}{\overset{\infty }{\int }}{z}^{d/2}{e}^{-(x+2s)z/2}dz& & \hfill \\ \hfill =\frac{s{x}^{d/2-1}\mathsf{\Gamma }(d/2+1)2^{d/2+1}}{2^{d/2}\mathsf{\Gamma }(d/2){(x+2s)}^{d/2+1}}=\frac{sd{x}^{d/2-1}}{{(x+2s)}^{d/2+1}}=\frac{sd}{x^2}{\left(1+\frac{2s}{x}\right)}^{-d/2-1}=v_{d/2}(x;2s).& \end{array}$$

(70)

where $v_{d/2}(x;2s)$ is the density of the inverse Pareto distribution defined in (49).

Suppose $\gamma \in \{0,\pm 1\}$. Let $j=1,2$ be the exponent at $x^j$ in (56). Then, by (65) for positive odd numbers d with $\alpha =j+(d-7)/2$, $p=x/2$, $q=s$ if $\gamma =1$, by (62) with $\alpha =2$, $p=s$ for $\gamma =0$ and with $\alpha =j+d/2-1$, $p=(x+2s)/2$ for $\gamma =-1$:

$$\begin{array}{ccc}\hfill & & J_2(x;\gamma ,2,j)=\frac{s{x}^j}{2^{d/2}\mathsf{\Gamma }(d/2)}{\int }_0^{\infty }{y}^{j\gamma -3}{\left(x{y}^{\gamma }\right)}^{d/2-1}{e}^{-(x{y}^{\gamma }/2+s/y)}dy\hfill \\ & & =\frac{s{x}^{j+d/2-1}}{2^{d/2}\mathsf{\Gamma }(d/2)}{\int }_0^{\infty }\frac{y^{\gamma (j+d/2-1)-3}}{e^{x{y}^{\gamma }/2+s/y}}dy=\frac{s{x}^{j+d/2-1}}{2^{d/2}\mathsf{\Gamma }(d/2)}\left\{\begin{array}{cc}{K}_{j+(d-7)/2}^{**}(x/2,s),\hfill & \gamma =1,\hfill \\ e^{-x/2}{M}_2\left(s\right),\hfill & \gamma =0,\hfill \\ M_{j+1+d/2}\left((x+2s)/2\right),\hfill & \gamma =-1.\hfill \end{array}\right.\hfill \end{array}$$

(71)

If d is not an odd number, $K_{j+(d-7)/2}^{**}(x/2,s)$ in (71) has to be replaced by $K_{j+d/2-3}^{*}(x/2,s)$, which may be calculated with (63) where the Macdonald functions $K_{j+d/2-3}\left(\sqrt{2sx}\right)$ are involved.

Define $q_j^{*}=q_j{I}_2(x;\gamma ,2,j)$ for $j=1,2$ with the coefficient $q_j$ from (56). Calculating the corresponding terms in (71) we find

$$\left.\begin{array}{ccc}\gamma =1,d=1:\hfill & q_1^{*}=q_{1}x{\left(2s\right)}^{-1}\left(1+\sqrt{2sx}\right)w_1\left(x\right),\hfill & q_2^{*}=q_2{x}^2{w}_1\left(x\right),\hfill \\ \gamma =1,d=3:\hfill & q_1^{*}=q_1{\left(2s\right)}^{-1}x\sqrt{2sx}{w}_3\left(x\right),\hfill & q_2^{*}=q_2{x}^2{w}_3\left(x\right),\hfill \\ \gamma =-1:\hfill & q_1^{*}=q_1\frac{{\displaystyle x(d+2)}}{{\displaystyle x+2s}}{v}_{d/2}(x;2s),\hfill & q_2^{*}=q_2\frac{{\displaystyle x^2(d+4)(d+2)}}{{\displaystyle {(x+2s)}^2}}{v}_{d/2}(x;2s),\hfill \\ \gamma =0:\hfill & q_1^{*}=q_{1}x{s}^{-1}{g}_{d/2}\left(x\right)\hfill & q^{*}21=q_2{x}^2{s}^{-1}{g}_{d/2}\left(x\right)\hfill \end{array}\right\}$$

(72)

8. Proof of Theorems

We find from Lemmas A1 and A2 that $D_n$ in (5) in Proposition 1 is bounded and the integrals in (10) and (11) in Proposition 2 have the necessary convergence rates. It remains to calculate the integrals in (9).

Proof of Theorem 1.

Let $F\left(x\right)=\mathsf{\Phi }\left(x\right)$, $H\left(y\right)=G_{r,r}\left(y\right)$ and $h_2\left(y\right)=h_{2;r}\left(y\right)$ defined in (32).

Suppose $J_1(x;\gamma )={\int }_0^{\infty }\mathsf{\Phi }\left(x{y}^{\gamma }\right)d{G}_{r,r}\left(y\right)$ with $\gamma \in \{0,\pm 1/2\}$, which are the limit distributions in (9) for $\mathbb{P}\left(g_n^{\gamma }{N}_n{\left(r\right)}^{1/2-\gamma }{Z}_{N_n\left(r\right)}\le x\right)$ under the condition of Theorem 1. Then, $J_1(x;\gamma )=\mathsf{\Phi }\left(x\right)$ for $\gamma =0$. It follows from (66), (62) for $\gamma =1/2$ and (65) for $\gamma =-1/2$ that

$$\frac{\partial }{\partial x}{J}_1(x;\gamma )=\left\{\begin{array}{ccc}{s}_{2r}\left(x\right)=\frac{{\displaystyle \mathsf{\Gamma }(r+1/2)}}{{\displaystyle \sqrt{2r\pi }\mathsf{\Gamma }\left(r\right)}}{\left(1+\frac{{\displaystyle x^2}}{{\displaystyle 2r}}\right)}^{-(r+1/2)},\hfill & \gamma =1/2\hfill & \mathrm{with}{J}_1(x;1/2)=S_{2r}\left(x\right),\hfill \\ \phi \left(x\right)=\frac{{\displaystyle 1}}{{\displaystyle \sqrt{2\pi }}}{e}^{-x^2/2},\hfill & \gamma =0\hfill & \mathrm{with}{J}_1(x;0)=\mathsf{\Phi }\left(x\right),\hfill \\ l_2\left(x\right)=\left(\frac{{\displaystyle 1}}{{\displaystyle 2}}+\left|x\right|\right)e^{-2\left|x\right|},r=2,\hfill & \gamma =-1/2,\hfill & \mathrm{with}{J}_1(x;-1/2)=L_2\left(x\right),\hfill \end{array}\right.$$

(73)

where $s_{2r}\left(x\right)$ is the density of Student’s t-distribution with $2r$ degrees of freedom and $l_2\left(x\right)$ is the density of a generalized Laplace distribution.

Integral $J_2(x;\gamma )={\int }_0^{\infty }{y}^{-1/2}\left(p_0+p_2{x}^2{y}^{2\gamma }\right)\phi \left(x{y}^{\gamma }\right)d{G}_{r,r}\left(y\right)$ is the integral by $g_n^{-1/2}$ in the expansion (9). Then, using (67) and (68) with $k=1$, we obtain

$$J_2(x;\gamma )=p_0{J}_2(x;\gamma ,1,0)+p_2{J}_2(x;\gamma ,1,2)=p_0^{*}+p_2^{*},$$

(74)

Integral $J_3(x;\gamma )={\int }_0^{\infty }{y}^{-1}\left(p_{1}x{y}^{\gamma }+p_3{x}^3{y}^{3\gamma }+p_5{x}^5{y}^{5\gamma }\right)\phi \left(x{y}^{\gamma }\right)d{G}_{r,r}\left(y\right)$ is the integral by $g_n^{-1}$ in the expansion (9). Then, using again (67) and (68) with $k=2$, we obtain

$$J_3(x;\gamma )=p_1{J}_2(x;\gamma ,2,1)+p_3{J}_2(x;\gamma ,2,3)+p_5{J}_2(x;\gamma ,2,5)=p_1^{*}+p_3^{*}+p_5^{*}$$

(75)

Integration by parts in the last integral by $n^{-1}$ in (9) for $\gamma =\pm 1/2$ and $r>1$ leads to

$$J_4(x;\gamma )={\int }_0^{\infty }\mathsf{\Phi }\left(x{y}^{\gamma }\right)d{h}_{2,r}\left(y\right)=-\frac{\gamma x{r}^r}{2r\sqrt{2\pi }\mathsf{\Gamma }\left(r\right)}{\int }_0^{\infty }\frac{y^{\gamma +r-2}}{e^{x^2{y}^{2\gamma }/2+ry}}\left((y-1)(2-r)+2Q_1\left(g_{n}y\right)\right)dy.$$

Suppose $\gamma =1/2$. We find from (62)

$$\begin{array}{ccc}\hfill J_4(x;1/2)& =& \frac{x{r}^r(2-r)}{4r\sqrt{2\pi }\mathsf{\Gamma }\left(r\right)}\left(M_{r-1/2}(r+x^2/2)-M_{r+1/2}(r+x^2/2)\right)-J_4^{*}(x;1/2)\hfill \\ & =& \frac{(2-r)x(x^2+1)}{4r(2r-1)}{s}_{2r}\left(x\right)-J_4^{*}(x;1/2).\hfill \end{array}$$

with

$$J_4^{*}(x;1/2)=\frac{x{r}^{r-1}}{2\sqrt{2\pi }\mathsf{\Gamma }\left(r\right)}{\int }_0^{\infty }{y}^{r-3/2}{e}^{-(r+x^2/2)y}{Q}_1\left(g_{n}y\right)dy,$$

(76)

where $Q_1\left(y\right)$ is defined in (33). It follows from Lemma A3 that for $r>1$

$${sup}_x{n}^{-1}\left|J_4^{*}(x;1/2)\right|\le c\left(r\right)n^{-r}.$$

Hence, because of $0\le g_n^{-1}-{\left(rn\right)}^{-1}\le {\left(n{g}_n\right)}^{-1}$ for $r\ge 1$, we obtain

$$\left|\frac{1}{n}{\int }_0^{\infty }\mathsf{\Phi }\left(x\sqrt{y}\right)d{h}_2\left(y\right)-\frac{(2-r)x(x^2+1)}{4(2r-1)g_n}{s}_{2r}\left(x\right)\right|\le \frac{1}{n}\left|J_4^{*}\right|+\frac{C\left(r\right)}{n{g}_n}\le c_1\left(r\right)n^{-min\left\{r2\right\}}.$$

(77)

For $\gamma =-1/2$, we only consider the case $r=2$, which results in $J_4(x;-1/2)=0$ and

$$J_4^{*}(x;-1/2)=\frac{x}{2\sqrt{2\pi }}{\int }_0^{\infty }{y}^{-1/2}{Q}_1\left(g_{n}y\right)e^{-(2y+x^2/\left(2y\right))}dy,$$

(78)

where ${sup}_x{n}^{-1}{J}_4^{*}(x;-1/2)\le C{n}^{-2}$ is proved in Lemma A3.

If $\gamma =0$, then $J_4(x;0)=\mathsf{\Phi }\left(x\right)(h_{2;r}(\infty )-h_{2;r}\left(0\right))=0$ since $Q_1\left(0\right)=1/2$.

The proof of Theorem 1 follows from (73)–(75) and (77) and Lemma A3. □

Proof of Theorem 2.

Let $F\left(x\right)=G_d\left(x\right)$, $H\left(y\right)=W_s\left(y\right)=e^{-s/y}$ and $h_2\left(y\right)=h_{2;s}\left(y\right)$ defined in (32).

Suppose $J_1(x;\gamma )={\int }_0^{\infty }{G}_d\left(x{y}^{\gamma }\right)s{y}^{-2}{e}^{-s/y}dy$ with $\gamma \in \{0,\pm 1\}$ which are the limit distributions in (9) for $\mathbb{P}\left(g_n^{\gamma }{N}_n{\left(s\right)}^{1/2-\gamma }{Z}_{N_n\left(s\right)}\le x\right)$ under the condition of Theorem 2.

Then, $J_1(x;\gamma )=G_d\left(x\right)$ for $\gamma =0$. It follows from (69) and (65) for $\gamma =1$ and (70) for $\gamma =-1$ that

$$\frac{\partial }{\partial x}{J}_1(x;\gamma )=\left\{\begin{array}{ccc}{w}_1(x;2s)=s{\left(2sx\right)}^{-1/2}{e}^{-\sqrt{2sx}}\hfill & \gamma =1\hfill & \mathrm{with}{J}_1(x;1)=W_1\left(x\right),\hfill \\ w_3(x;2s)=s{e}^{-\sqrt{2sx}}\hfill & \gamma =1\hfill & \mathrm{with}{J}_1(x;1)=W_3\left(x\right),\hfill \\ \phi \left(x\right)=\frac{{\displaystyle 1}}{{\displaystyle \sqrt{2\pi }}}{e}^{-x^2/2},\hfill & \gamma =0\hfill & \mathrm{with}{J}_1(x;0)=\mathsf{\Phi }\left(x\right),\hfill \\ v_{d/2}(x;2s)=\frac{{\displaystyle sd{x}^{d/2-1}}}{{\displaystyle {(x+2s)}^{d/2+1}}}\hfill & \gamma =-1,\hfill & \mathrm{with}{J}_1(x;-1/2)=V_{d/2}(x;2s),\hfill \end{array}\right.$$

where $w_1(x;2s)$ is the Weibull density (see (45)), $w_3(x;2s)$ is the generalized gamma density0 (see (46)) and $v_{d/2}(x;2s)$ is the density of the inverse Pareto distribution $V_{d/2}(x;2s)$ defined in (49).

Integral $J_2(x;\gamma )={\int }_0^{\infty }{y}^{-1}\left(q_{1}x{y}^{\gamma }+q_2{x}_2{y}^{2\gamma }\right)g_{d/2}\left(x{y}^{\gamma }\right)s{y}^{-2}{e}^{-s/y}dy$ is the integral by $g_n^{-1}$ in the expansion (9). Then, the use of (71) and (72) leads to

$$J_2(x;\gamma )=q_1{J}_2(x;\gamma ,2,1)+q_3{J}_2(x;\gamma ,2,3)=q_1^{*}+q_3^{*}.$$

Integration by parts in the last integral by $n^{-1}$ in (9) for $\gamma =\pm 1$ leads to -4.6cm0cm

$$\begin{array}{ccc}\hfill J_3(x;\gamma ,d)& =& {\int }_0^{\infty }{G}_d\left(x{y}^{\gamma }\right)d{h}_{2;s}\left(y\right)=J_4(x;\gamma ,d)+J_4^{*}(x;\gamma ,d),\hfill \\ \hfill J_4(x;\gamma ,d)& =& -\frac{s(s-1)\gamma x^{d/2}}{2^{d/2+1}\mathsf{\Gamma }(d/2)}{\int }_0^{\infty }{y}^{\gamma d/2-3}{e}^{-x{y}^{\gamma }/2-s/y}dy=-\frac{s(s-1)\gamma x^{d/2}}{2^{d/2+1}\mathsf{\Gamma }(d/2)}{K}_{(\gamma d-5)/2}^{**}(x/2,s),\hfill \\ \hfill J_4^{*}(x;\gamma ,d)& =& -\frac{s\gamma x^{d/2}}{2^{d/2}\mathsf{\Gamma }(d/2)}{\int }_0^{\infty }{y}^{\gamma d/2-3}{e}^{-x{y}^{\gamma }/2-s/y}{Q}_1\left(ny\right)dy,\hfill \end{array}$$

(79)

where $Q_1\left(y\right)$ is defined in (33). Suppose $\gamma =1$. We get with (65)

$$J_4(x;1,1)=-\frac{(s-1)x(\sqrt{2sx}+1)}{4s}{w}_1(x;2s)\mathrm{and}{J}_4(x;1,3)=-\frac{(s-1)x^2}{2\sqrt{2sx}}{w}_3(x;2s)$$

For $\gamma =-1$ using (65), we see that

$$J_4(x;-1,d)=\frac{s(s-1)x^{d/2}\sqrt{2sx}}{2^{1+d/2}\mathsf{\Gamma }(d/2)}{M}_{(d+4)/2}\left((x+2s)/2\right)=\frac{(s-1)x(2+d)}{2(x+2s)}{v}_{d/2}(x;2s).$$

In Lemma A4, ${sup}_x{n}^{-1}{J}_4^{*}(x;\gamma ,d)\le c\left(s\right)n^{-2}$ for $\gamma =\pm 1$ is proved.

If $\gamma =0$, then $J_3(x;0,d)=G_d\left(x\right)(h_{2;s}(\infty )-{lim}_{y\to 0}{h}_{2;s}\left(y\right))=0$.

Combining the above estimates proves Theorem 2. □

9. Conclusions

Chebyshev–Edgeworth expansions are derived for the distributions of various statistics from samples with random sample sizes. The construction of these asymptotic expansions is based on the given asymptotic expansions for the distributions of statistics of samples with a fixed sample sizes as well as those of the distributions of the random sample sizes.

The asymptotic laws are scale mixtures of the underlying standard normal or chi-square distributions with gamma or inverse exponential mixing distributions. The results hold for a whole family of asymptotically normal or chi-squared statistics since a formal construction of asymptotic expansions are developed. In addition to the random sample size, a normalization factor for the examined statistics also has a significant influence on the limit distribution. As limit laws, Student, standard normal, Laplace, inverse Pareto, generalized gamma, generalized Laplace and weighted sums of generalized gamma distributions occur. As statistica the random mean, the scale-mixed normalized Student t-distribution and the Student’s t-statistic under non-normality with normal limit law, as well as Hotelling’s generalized $T_0^2$ and scale mixture of chi-squared statistics with chi-square limit laws, are considered. The bounds for the corresponding residuals are presented in terms of inequalities.

Appendix A.1. Lemmas A1 and A2

Lemma A1.

Consider the statistics estimated in (15), (18), (21), (26) and (27). Let $g_n$ be a sequence with $0<g_n\uparrow \infty$ as $n\to \infty$ and $\gamma \in \{-1/2,0,1/2,1\}$. Then, with some computable constant $0<C^{*}\left(\gamma \right)<\infty$, we obtain

$$D_n={sup}_x{\int }_{1/g_n}^{\infty }\left|\frac{{\displaystyle \partial }}{{\displaystyle \partial y}}\left(F\left(x{y}^{\gamma }\right)+\frac{f_1\left(x{y}^{\gamma }\right)}{\sqrt{g_{n}y}}+\frac{f_2\left(x{y}^{\gamma }\right)}{y{g}_n}\right)\right|dy\le C^{*}\left(\gamma \right),$$

where $F\left(x\right)$, $f_1\left(x\right)$ and $f_2\left(x\right)$ are defined in the approximation estimates (15), (18), (21), (26) and (27).

Proof of Lemma A1.

The statistics in (15), (18) and (21) satisfy Assumption 1 with the normal limit distribution $\mathsf{\Phi }\left(x\right)$. To estimate $D_n={sup}_x\left|D_n\left(x\right)\right|$, we consider the cases $x\ne 0$ and $x=0$.

Let $x\ne 0$. Since $\frac{{\displaystyle \partial }}{{\displaystyle \partial y}}\mathsf{\Phi }\left(x{y}^{\gamma }\right)=0$ for $\gamma =0$ and $\frac{{\displaystyle \partial }}{{\displaystyle \partial y}}\mathsf{\Phi }\left(x{y}^{\gamma }\right)=\gamma x{y}^{\gamma -1}\phi \left(x{y}^{\gamma }\right)dy$ has constant $\mathrm{sign}\left(\gamma x\right)$ for $\gamma =\pm 1/2$ and $y>0$, we find

$${\int }_{1/g_n}^{\infty }\left|\frac{{\displaystyle \partial }}{{\displaystyle \partial y}}\mathsf{\Phi }\left(x{y}^{\gamma }\right)\right|dy=\left|{\int }_{1/g_n}^{\infty }\gamma x{y}^{\gamma -1}\phi \left(x{y}^{\gamma }\right)dy\right|=\left\{\begin{array}{cc}1-\mathsf{\Phi }\left(x{g}_n^{-\gamma }\right)\le 1/2\hfill & \mathrm{for}x>0.\hfill \\ \mathsf{\Phi }\left(x{g}_n^{-\gamma }\right)\le 1/2\hfill & \mathrm{for}x<0.\hfill \end{array}\right.$$

From (A1) and (A2), it follows that $\left|\frac{{\displaystyle \partial }}{{\displaystyle \partial y}}\left(\frac{{\displaystyle f_k\left(x{y}^{\gamma }\right)}}{{\displaystyle {\left(g_{n}y\right)}^{k/2}}}\right)\right|\le 2c_k^{**}/k$, which proves the first case. Moreover, $D_n\left(0\right)=\left|Q_1\left(0\right)\right|$ since $Q_2\left(0\right)=0$ for the considered statistics.

Consider now the statistics estimated in (26) and (27) with limit chi-square distributions. We only need to examine $x>0$ and $\gamma \in \{0,\pm 1\}$. In the cases now under review, we have $f_1\left(x\right)=0$ and $f_2\left(z\right)=(Az+B{z}^2)g_d\left(z\right)$ with some real constants A and B. The proof is completed with (A1) and (A2),

${\int }_{1/g_n}^{\infty }\left|\frac{{\displaystyle \partial }}{{\displaystyle \partial y}}{G}_d\left(xy\gamma \right)\right|dy=\left|{\int }_{1/g_n}^{\infty }\frac{{\displaystyle \partial }}{{\displaystyle \partial y}}{G}_d\left(xy\gamma \right)dy\right|\le 1\mathrm{and}{\int }_{1/g_n}^{\infty }\left|\frac{{\displaystyle \partial }}{{\displaystyle \partial y}}\left(\frac{{\displaystyle f_2\left(x{y}^{\gamma }\right)}}{{\displaystyle g_{n}y}}\right)\right|dy\le c_2^{**}$. □

Next, the integrals in (10) and (11) in Proposition 2 for the gamma limit distributions $H\left(y\right)=G_{r,r}\left(y\right)$ and the inverse exponential limit distribution $H\left(y\right)=exp\{-s/y\}$ are estimated.

Lemma A2.

(i) The conditions (6), (7) and (8) in Proposition 2 are satisfied for $G_{r,r}\left(y\right)$ and $W_s\left(y\right)=e^{-s/y}$.

(ii) Let $\gamma \in \{0,\pm 1/2\}$. Consider $f_1\left(x\right)$ given in (16) and $f_2\left(z\right)$ is given in (16) or (18) for statistics occurring in (15), (18) and (21) with limiting distribution $\mathsf{\Phi }\left(x\right)$.

(iia) Let the mixing distribution be $H\left(y\right)=G_{r,r}\left(y\right)$ with $g_n=r(n-1)+1$, $b=min\{r,2\}$ and $h_2\left(y\right)=h_{2;r}\left(y\right)=g_{r,r}\left(y\right)\left((y-1)(2-r)+2Q_1\left(g_{n}y\right)\right),y>0$. Then, we obtain with $k=1,2$

$$\begin{array}{ccc}\hfill \underset{x}{sup}\left|I_1(x,n)\right|\le \underset{x}{sup}{\int }_{1/g_n}^{\infty }\left|\frac{f_1\left(x{y}^{\gamma }\right)}{{\left(g_{n}y\right)}^{1/2}}\right|d{G}_{r,r}\left(y\right)\le c_1^{*}{g}_n^{-r}& for& 0<r<1/2,\gamma \in \{0,\pm 1/2\},\hfill \end{array}$$

(A3)

$$\begin{array}{ccc}\hfill {sup}_x\left|I_1(x,n)\right|\le c_1^{*}{g}_n^{-1/2}ln{g}_n& for& r=1/2,\gamma =\pm \frac{1}{2},\hfill \end{array}$$

(A4)

$$\begin{array}{ccc}\hfill \underset{x}{sup}\left|I_2(x,n)\right|\le \underset{x}{sup}{\int }_{1/g_n}^{\infty }\left|\frac{f_2\left(x{y}^{\gamma }\right)}{g_{n}y}\right|d{G}_{r,r}\left(y\right)\le c_2^{*}{g}_n^{-r}& for& 0<r<1,\gamma \in \{0,\pm 1/2\},\hfill \end{array}$$

(A5)

$$\begin{array}{ccc}\hfill {sup}_x\left|I_2(x,n)\right|\le c_3{g}_n^{-1}& for& r=1,\gamma =\pm 1/2,\hfill \end{array}$$

(A6)

$$\begin{array}{ccc}\hfill {sup}_x|I_k(x,n)-g_n^{-k/2}{f}_k\left(x\right)ln{g}_n|\le c_4{g}_n^{-k/2}& for& r=k/2,\gamma =0,\hfill \end{array}$$

(A7)

$$\underset{x}{sup}\left|I_{2+k}(x,n)\right|=\underset{x}{sup}\left|{\int }_{1/g_n}^{\infty }\frac{{\displaystyle f_k\left(x{y}^{\gamma }\right)}}{{\displaystyle n{g}_n^{k/2}y}}d{h}_{2;r}\left(y\right)\right|\le \left\{\begin{array}{cc}{c}_5\left(r\right)g_n^{-r},\hfill & r>1,r\ne 1+k/2,\hfill \\ c_6\left(r\right)g_n^{-1-k/2}lnn,\hfill & r=1+k/2.\hfill \end{array}\right.$$

(A8)

(iib) Now, consider the mixing distribution $H\left(y\right)=W_s\left(y\right)=e^{-s/y}$ with $g_n=n$, $b=2$ and $h_2\left(y\right)=h_{2;s}\left(y\right)=s{e}^{-s/y}\left(s-1+2Q_1\left(ny\right)\right)/\left(2y^2\right),y>0$. Then, apply it to $I_4(x,n)$ in (11)

$${sup}_x\left|I_4(x,n)\right|={sup}_x\left|{\int }_{1/n}^{\infty }\frac{{\displaystyle f_2\left(x{y}^{\gamma }\right)}}{{\displaystyle n^{2}y}}d{h}_{2;s}\left(y\right)\right|\le c_6\left(s\right)n^{-2},fors>0,\gamma \in \{0,\pm 1/2\}.$$

(A9)

(iii) Put $\gamma \in \{0,\pm 1\}$. Consider $f_2\left(x\right)=(Ax+B{x}^2)g_d\left(x\right)$ for statistics occurring in (26) and (27) satisfying Assumption 1 with the chi-square distribution $G_d\left(x\right)$.

(iiia) The mixing distribution is $H\left(y\right)=G_{r,r}\left(y\right)$ as in Case (ia) above. Then, for $\gamma \in \{0,\pm 1\}$,

$${sup}_x\left|I_2(x,n)\right|\le {sup}_x{\int }_{1/g_n}^{\infty }\left|\frac{f_2\left(x{y}^{\gamma }\right)}{g_{n}y}\right|d{G}_{r,r}\left(y\right)\le \frac{c_2^{*}{r}^r}{(r-1)\mathsf{\Gamma }\left(r\right)}{g}_n^{-r}forr<1,$$

(A10)

$$\left.\begin{array}{cc}{sup}_x\left|I_2(x,n)\right|\le c_2^{*}{n}^{-1}\hfill & with\gamma =\pm 1/2,\hfill \\ {sup}_x|I_2(x,n)-n^{-1}{f}_2\left(x\right)lnn|\le c_2^{*}{n}^{-1}\hfill & with\gamma =0,\hfill \end{array}\right\}forr=1,$$

(A11)

$${sup}_x\left|I_4(x,n)\right|={sup}_x\left|{\int }_{1/g_n}^{\infty }\frac{{\displaystyle f_2\left(x{y}^{\gamma }\right)}}{{\displaystyle n{g}_{n}y}}d{h}_{2;r}\left(y\right)\right|\le \left\{\begin{array}{cc}{c}_3\left(r\right)g_n^{-min\{r,2\}},\hfill & forr>1,r\ne 2,\hfill \\ c_4\left(r\right)g_n^{-2}lnn,\hfill & forr=2.\hfill \end{array}\right.$$

(A12)

(iiib) The mixing distribution is $H\left(y\right)=W_s\left(y\right)=e^{-s/y}$ with $g_n=n$ and $b=2$ as in Case (iib). Then,

$${sup}_x\left|I_4(x,n)\right|=\underset{x}{sup}\left|{\int }_{1/g_n}^{\infty }\frac{{\displaystyle f_2\left(x{y}^{\gamma }\right)}}{{\displaystyle n^{2}y}}d{h}_{2;s}\left(y\right)\right|\le C_5\left(r\right)n^{-2}.fors>0,\gamma \in \{0,\pm 1/2\}.$$

(A13)

Proof of Lemma A2.

(i) Insertion of $G_{r,r}\left(y\right)$ with $h_{2,r}\left(y\right)$ and $W_s\left(y\right)=e^{-s/y}$ with $h_{2,s}\left(y\right)$ and simple calculation result in the necessary estimates in (6)–(8). In the case of $W_s\left(y\right)=e^{-s/y}$, one even gets for all terms exponentially fast decrease.

(ii) The limit distribution of the considered statistics is standard normal $\mathsf{\Phi }\left(x\right)$.

(iia) Let $H\left(x\right)=G_{r,r}\left(x\right)$. Using (A2), the estimations (A3) and (A5) for $r<k/2$, with $k=1,2$, are

$${sup}_x\left|I_k(x,n)\right|\le \frac{c_k^{*}{r}^r}{g_n^{k/2}\mathsf{\Gamma }\left(r\right)}{\int }_{1/g_n}^{\infty }{y}^{r-1-k/2}dy\le \frac{c_k^{*}{r}^r}{(k/2-r)\mathsf{\Gamma }\left(r\right)}{g}_n^{-r}.$$

Taking into account

$$0\le ln{g}_n-{\int }_{1/g_n}^1\frac{e^{-ry}}{y}dy={\int }_{1/g_n}^1\frac{1-e^{-ry}}{y}dy\le r\mathrm{and}{\int }_1^{\infty }\frac{e^{-ry}}{y}dy\le e^{-r}/rforr>0,$$

(A14)

the bound (A4) follows from

$$|I_1(x,n)|\le \frac{c_1^{*}}{{\left(2g_n\right)}^{1/2}\mathsf{\Gamma }(1/2)}\left({\int }_1^{\infty }\frac{e^{-y/2}}{y}dy+{\int }_{1/g_n}^1\frac{e^{-y/2}}{y}dy\right)\le \frac{c_1^{*}(2e^{-1/2}+ln{g}_n)}{\mathsf{\Gamma }(1/2){\left(2g_n\right)}^{1/2}}.$$

If $r=1$ with $d_2^{*}={sup}_z\left\{\right|z^{-1}{f}_2\left(z\right)\left|\phi (z/\sqrt{2})\right\}$, we find $|f_2\left(z\right)|\le d_2^{*}\left|z\right|\phi (z/\sqrt{2})$ and the bound (A6) follows from

$$|I_2(x,n)|\le \frac{d_2^{*}\left|x\right|}{\sqrt{2\pi }n}{\int }_{1/n}^{\infty }{y}^{\gamma -1}{e}^{-(y+x^2{y}^{2\gamma }/4)}dy\mathrm{with}\gamma =\pm 1/2,$$

where for $\gamma =1/2$ using $\left|x\right|{(1+x^2/4)}^{-1/2}\le 2$, we obtain

$$|I_2(x,n)|\le \frac{d_2^{*}\left|x\right|}{\sqrt{2\pi }n}{\int }_{1/n}^{\infty }{y}^{1/2-1}{e}^{-(1+x^2/4)y}dy\le \frac{d_2^{*}\left|x\right|\mathsf{\Gamma }(1/2)}{\sqrt{2\pi }{(1+x^2/4)}^{1/2}}{n}^{-1}\le \frac{\sqrt{2}{d}_2^{*}}{n}$$

and, in the case of $\gamma =-1/2$, the substitution $z=x^2/\left(4y\right)$ for $x\ne 0$ leads to

$$I_2(x,n)\le \frac{c_2^{*}\left|x\right|}{\sqrt{2\pi }n}{\int }_{1/n}^{\infty }{y}^{-1-1/2}{e}^{-(y+x^2/\left(4y\right))}dy\le \frac{2c_2^{*}}{\sqrt{2\pi }n}{\int }_0^{\infty }{z}^{-1/2}{e}^{-z}dz\le \frac{\sqrt{2}{d}_2^{*}}{n}.$$

Finally, if $\gamma =0$, then $f_k\left(x{y}^{\gamma }\right)=f_k\left(x\right)$ does not depend on y. Then, (A7) follows from (A1), (A2), and (A14) for $r=k/2$.

Let $r>1$. Integration by parts for Lebesgue–Stieltjes integrals $I_{k+2}(x,n)$, $k=1,2$, in (11) leads to

$${sup}_x{I}_{k+2}(x,n)\le \frac{1}{n{g}_n^{k/2}}\left(c_k^{*}|h_{2;r}(1/g_n)|+{sup}_x{\int }_{1/g_n}^{\infty }\frac{|Q_k\left(x{y}^{\gamma }\right)|}{y^{1+k/2}}\left|h_{2;r}\left(y\right)\right|dy\right)$$

(A15)

with bound $c_k^{*}$ given in (A2). Defining $C_r^{*}=\frac{{\displaystyle r^r}}{{\displaystyle 2r\mathsf{\Gamma }\left(r\right)}}{sup}_y\{e^{-ry}\left(\right|y-1\left|\right|2-r|+1)\}<\infty$, we find

$${\int }_{1/g_n}^{\infty }\frac{|h_{2;r}\left(y\right)|}{y^{1+k/2}}dy\le C_r^{*}{\int }_{1/g_n}^{\infty }{y}^{r-2-k/2}dy=\frac{C_r^{*}}{(1+k/2-r)}{g}_n^{-r+1+k/2}\mathrm{for}1<r<1+k/2$$

and, with $C_r^{**}=\frac{{\displaystyle r^{r-1}}}{{\displaystyle 2\mathsf{\Gamma }\left(r\right)}}{sup}_y\left\{\right(e^{-ry/2}\left(\right|y-1\left|\right|2-r|+1)\}<\infty$, we obtain

$${\int }_{1/g_n}^{\infty }\frac{|h_{2;r}\left(y\right)|}{y^{1+k/2}}dy\le C_r^{**}{\int }_{1/g_n}^{\infty }{y}^{r-2-k/2}{e}^{-ry/2}dy\le \frac{C_r^{**}\mathsf{\Gamma }(r-1-k/2)}{{(r/2)}^{r-1-k/2}}\mathrm{for}r>1+k/2.$$

Hence, using $g_n\le rn$ for $r>1$, we obtain (A8) and, for $r>1$, $r\ne 1+k/2$.

For $r=1+k/2$, the second integral in the line above is an exponential integral. Therefore, with (A14), we find (A8) for $r=1+k/2$, too.

(iib) The mixing distribution is $H\left(y\right)=W_s\left(y\right)=e^{-s/y}$ with $g_n=n$. Since $b=2$, only $I_4(x,n)$ has to be estimated. Integration by parts for $I_4(x,n)$ in (11) leads to (A15) with $k=2$, $g_n=n$ and $h_{2,s}\left(y\right)$ instead of $h_{2,r}\left(y\right)$. Hence, (A9) follows from

$${\int }_{1/n}^{\infty }\frac{|h_{2;s}\left(y\right)|}{y^2}dy\le s(s+2){\int }_{1/n}^{\infty }{y}^{-4}{e}^{-s/y}dy\le \frac{s+2}{s^2}{\int }_0^{sn}{z}^2{e}^{-z}dz\le \frac{(s+2)\mathsf{\Gamma }\left(3\right)}{s^2}.$$

(A16)

(iii) The limit distribution of statistics in (26) and (27) is chi-square distribution $G_u\left(x\right)$ defined in (17). In the considered cases $f_1\left(x\right)=0$. Let $\gamma \in \{0,\pm 1\}$. Consider $f_2\left(x\right)=(Ax+B{x}^2)g_d\left(x\right)$ with chi-square density $g_d\left(x\right)$.

(iiia) Let $H\left(y\right)=G_{r,r}\left(y\right)$. We have to estimate $I_2(x,n)$ for $r\le 1$ and $I_4(x,n)$ for $r>1$. The bound (A10) for $0<r<1$ follows from (A2) and

$${sup}_x\left|I_2(x,n)\right|\le \frac{c_2^{*}{r}^r}{g_n\mathsf{\Gamma }\left(r\right)}{\int }_{1/g_n}^{\infty }{y}^{r-2}{e}^{-ry}dy\le \frac{c_2^{*}{r}^r}{(r-1)\mathsf{\Gamma }\left(r\right)}{g}_n^{-r}\mathrm{for}\gamma \in \{0,\pm 1\}.$$

If $r=1$ with $C_2^{*}={sup}_z\left\{|A+Bz|\frac{{\displaystyle 1}}{{\displaystyle 2^{d/2}\mathsf{\Gamma }(d/2)}}{e}^{-z/4}\right\}<\infty$, we find $|f_2\left(z\right)|\le C_2^{*}{z}^{d/2}{e}^{-z/4}$ and

$$|I_2(x,n)|\le \frac{C_2^{*}{x}^{d/2}}{g_n}{\int }_{1/g_n}^{\infty }{y}^{-1+d/2}{e}^{-(1+x/4)y}dy\le \frac{C_2^{*}{x}^{d/2}}{g_n{(1+x/4)}^{d/2}}\le \frac{4^{d/2}{C}_2^{*}}{g_n}\mathrm{for}\gamma =1.$$

in the case of $\gamma =-1$ using variable transformation $z=x/\left(4y\right)$ for $x>0$ one has

$$|I_2(x,n)|\le \frac{C_2^{*}{x}^{d/2}}{g_n}{\int }_{1/g_n}^{\infty }\frac{e^{-x/\left(4y\right)}}{y^{1+d/2}}dy\le \frac{C_2^{*}{x}^{d/2}}{g_n{(x/4)}^{d/2}}{\int }_0^{\infty }{z}^{-1+d/2}{e}^{-z}dz\le \frac{C_2^{*}{4}^{d/2}\mathsf{\Gamma }(d/2)}{g_n}.$$

If $\gamma =0$ then $f_2\left(x{y}^{\gamma }\right)=f_2\left(x\right)$, noting (A14) and $g_n=n$ for $r=1$, we prove (A11).

Let now $r>1$. It remains to estimate $I_4(x,n)$. Using (A15) with $k=2$, remembering (A2), we obtain (A12) in the same way as for $r>1$ with $k=2$ in case (iia) above.

(iiib) The limit distribution $H\left(y\right)=W_s\left(y\right)=e^{s/y}$ with $g_n=n$ and $b=2$. As in Case (iib), taking into consideration (A16), we obtain (A13). □

Appendix A.2. Lemmas A3 and A4

We show that the integrals $J_4^{*}(x;\gamma )$ and $J_4^{*}(x;\gamma ,d)$ in the proofs of Theorems 1 and 2 have the order of the remaining terms. Therefore, the involved jump correcting function $Q_1\left(y\right)=1/2-(y-\left[y\right])$ occurring in (32) and (38) has no effect on the second approximation. The function $Q_1\left(y\right)$ is periodic with period 1. The Fourier series expansion of $Q_1\left(y\right)$ at all non-integer points y is

$$Q_1\left(y\right)=1/2-(y-\left[y\right])={\sum }_{k=1}^{\infty }\frac{sin\left(2\pi ky\right)}{k\pi }y\ne \left[y\right]$$

(A17)

(see formula 5.4.2.9 in [40] with $a=0$).

Lemma A3.

Let $J_4^{*}(x;\pm 1)$ be defined by (76) and (78), respectively. Then, $n^{-1}{J}_4^{*}(x;1/2)\le C{n}^{-r}$ for $r>1$ and $n^{-1}{J}_4^{*}(x;-1/2)\le C{n}^{-2}$.

Proof of Lemma A3.

We begin by considering $Q_1\left(y\right)$ in $J_4^{*}(x;1/2)$ defined in (A17) following the estimate of $J_4^{*}\left(x\right)$ in the proof of Theorem 2 in [11]. Inserting Fourier series expansion of $Q_1\left(y\right)$ into the integral $J_4^{*}(x;1/2)$, interchanging the integral and sum and applying formula (2.5.31.4) in [40] with $\alpha =r-1/2,p=(r+x^2/2)$ and $b=2\pi k{g}_n$, then

$$\begin{array}{ccc}& & J_4^{*}(x;1/2)=\frac{x{r}^{r-1}}{{\left(2\pi \right)}^{3/2}\mathsf{\Gamma }\left(r\right)}\sum _{k=1}^{\infty }\frac{1}{k}{\int }_0^{\infty }{y}^{r-3/2}{e}^{-(r+x^2/2)y}sin\left(2\pi k{g}_{n}y\right)dy\hfill \\ & & =\frac{x{r}^{r-1}\mathsf{\Gamma }(r-1/2)}{{\left(2\pi \right)}^{3/2}\mathsf{\Gamma }\left(r\right)}\sum _{k=1}^{\infty }\frac{sin\left((r-1/2)arctan\left(4\pi k{g}_n/(x^2+2r)\right)\right)}{k{\left({\left(2\pi k{g}_n\right)}^2+{(r+x^2/2)}^2\right)}^{(r-1/2)/2}}=\frac{r^{r-1}\mathsf{\Gamma }(r-1/2)}{2\pi \sqrt{2\pi }\mathsf{\Gamma }\left(r\right)}\sum _{k=1}^{\infty }\frac{a_k(x;n)}{k}.\hfill \end{array}$$

Now, we split the exponent $(r-1/2)/2=(r-1)/2+1/4$ and obtain

$$|a_k(x;n)|\le \frac{\left|x\right|}{{\left({\left(2\pi k{g}_n\right)}^2+{\left(r+x^2/2\right)}^2\right)}^{(r-1)/2+1/4}}\le \frac{\left|x\right|}{{\left(2\pi k{g}_n\right)}^{r-1}{(r+x^2/2)}^{1/2}}\le \frac{\sqrt{2}}{{\left(2\pi k(n-1)\right)}^{r-1}}.$$

Since $r>1$ and $n\ge 2$, the first statement in Lemma A3 follows:

$${sup}_x{n}^{-1}\left|J_4^{*}(x;1/2)\right|\le c\left(r\right)n^{-r}{\sum }_{k=1}^{\infty }{k}^{-r}=c_1\left(r\right)n^{-r}.$$

To prove the second statement about $J_4^{*}(x;-1/2)$, we insert again the Fourier series expansion of $Q_1\left(y\right)$ given in (A17) into $J_4^{*}(x;-1/2)$ and interchange the integral and sum

$$J_4^{*}(x;-1/2)=\frac{x}{2\sqrt{2\pi }}{\sum }_{k=1}^{\infty }\frac{1}{\pi k}{\int }_0^{\infty }{y}^{-1/2}{e}^{-(2y+x^2/\left(2y\right)}sin\left(2\pi k{g}_{n}y\right)dy.$$

Further, we use formula 2.5.37.4 in [40]

$${\int }_0^{\infty }{y}^{-1/2}{e}^{-py-q/y}sin\left(by\right)dy=\frac{\sqrt{\pi }}{\sqrt{p^2+b^2}}{e}^{-2\sqrt{q}{z}_{+}}\left(z_{+}sin\left(2\sqrt{q}{z}_{-}\right)+z_{-}cos\left(2\sqrt{q}{z}_{-}\right)\right)$$

with $2z_{\pm }^2=\sqrt{p^2+b^2}\pm p$, $p=2>0$, $q=x^2/2>0$ and $b=2\pi g_{n}k>0$. Use of the estimates

$$0<z_{-}\le z_{+},\left|x\right|z_{+}{e}^{-\left|x\right|z_{+}}\le e^{-1},\sqrt{p^2+b^2}\ge b=2\pi g_{n}kand{\sum }_{k=1}^{\infty }{k}^{-2}={\pi }^2/6$$

leads to the inequalities

$${sup}_x\frac{1}{n}\left|J_4^{*}(x;-1/2)\right|\le {sup}_x\frac{1}{2\sqrt{2\pi }}{\sum }_{k=1}^{\infty }\frac{\sqrt{\pi }2\left|x\right|z_{+}}{2{\pi }^2{g}_{n}n{k}^2}{e}^{-\sqrt{2}\left|x\right|}\le \frac{1}{e\sqrt{2}12g_{n}n}=C{n}^{-2}$$

(A18)

and Lemma A3 is proven. □

Lemma A4.

Let $J_4^{*}(x;\gamma ,d)$ be defined by (79), then $n^{-1}{J}_4^{*}(x;\gamma ,d)\le C{n}^{-2}$ for $\gamma =\pm 1$.

Proof of Lemma A4.

Using the Fourier series expansion (A17) of the periodic function $Q_1\left(y\right)$, given in (33), and interchange integral and sum, we find

$$J_4^{*}(x;\gamma ,d)=-\frac{s\gamma x^{d/2}}{2^{d/2}\mathsf{\Gamma }(d/2)}{\sum }_{k=1}^{\infty }\frac{1}{k\pi }{\int }_0^{\infty }{y}^{(\gamma d-6)/2}{e}^{-x{y}^{\gamma }/2-s/y}sin\left(2\pi kny\right)dy.$$

(A19)

We begin by estimating $J_4^{*}(x;1,3)$, i.e., the exponent by y in (A19) is $-3/2$. Thus, we can use formula 2.5.37.3 in [40]

$${\int }_0^{\infty }{y}^{-3/2}{e}^{-py-s/y}sin\left(by\right)dy=\frac{\sqrt{\pi }}{\sqrt{s}}{e}^{-2\sqrt{s}{z}_{+}}sin\left(2\sqrt{s}{z}_{-}\right)$$

(A20)

where $p=x/2>0$, $s>0$, $b=2\pi kn>0$ and $2z_{\pm }^2=\sqrt{p^2+b^2}\pm p=\sqrt{x^2/4+{\left(2\pi kn\right)}^2}\pm x/2$. Since

$$z_{+}=\frac{1}{2}{\left({\left(x^2/4+2\pi kn\right)}^{1/2}+x/2\right)}^{1/2}\ge \frac{1}{4}{x}^{1/2}+\frac{1}{8}{\left(2\pi \right)}^{1/4}\left(k^{1/4}+n^{1/4}\right)$$

(A21)

it results in

$$\frac{1}{n}\left|J_4^{*}(x:1,3\right|\le \frac{{\left(sx\right)}^{3/2}}{ns{2}^{1/2}\pi }{\sum }_{k=1}^{\infty }exp\left\{-{\left(sx\right)}^{1/2}/2-{\left(2\pi \right)}^{1/4}\left(k^{1/4}+n^{1/4}\right)/4\right\}\le \frac{C\left(s\right)}{n^2}.$$

Let now $\gamma =1$ and $d=1$. The main difference compared with the previous estimate of $J_4^{*}(x;1,3)$ is that we are facing more technical trouble in order to estimate $J_4^{*}(x;1,1)$. The exponent by y in (A19) is $-5/2$ and we cannot find a closed formula similar to (A19) for this case. To estimate $J_4^{*}$ in the proof of Theorem 5 in [11], we show that differentiation with respect to s under the integral sign in (A20) is allowed. Hence,

$$\begin{array}{ccc}\hfill {\int }_0^{\infty }{y}^{-5/2}{e}^{-py-s/y}sin\left(by\right)dy& =& (\sqrt{\pi }/2)e^{-2\sqrt{s}{z}_{+}}(s^{-3/2}sin\left(2\sqrt{s}{z}_{-}\right)\hfill \\ \hfill +2s^{-1}{z}_{+}sin\left(2\sqrt{s}{z}_{-}\right)& -& 2s^{-1}{z}_{-}cos\left(2\sqrt{s}{z}_{-}\right)).\hfill \end{array}$$

with the same coefficients p, s, b and $z_{\pm }$ as in (A20). The use of (A21) and the obvious inequalities $0<z_{-}\le z_{+}$ and $z_{+}\ge \frac{1}{2}{z}_{+}+\frac{1}{8}{x}^{1/2}+\frac{1}{16}{\left(2\pi \right)}^{1/4}(k^{1/4}$ leads to

$$\frac{1}{n}\left|J_4^{*}(x;1,1)\right|\le \frac{{\left(sx\right)}^{1/2}}{n{2}^{1/2}\pi }{e}^{-{\left(sx\right)}^{1/2}/4-{\left(2\pi \right)}^{1/4}{n}^{1/4}/8}{\sum }_{k=1}^{\infty }\frac{1}{k}{e}^{-{\left(2\pi \right)}^{1/4}{k}^{1/4}/8}\le \frac{C\left(s\right)}{n^2}.$$

Finally, let now $\gamma =-1$.

$$J_4^{*}(x;-1,d)=\frac{s{x}^{d/2}}{2^{d/2}\mathsf{\Gamma }(d/2)}{\sum }_{k=1}^{\infty }\frac{1}{k\pi }{\int }_0^{\infty }{y}^{-(d/2+3)}{e}^{-(x/2+s)/y}sin\left(2\pi kny\right)dy.$$

Partial integration in the integral with $A=d/2+3$, $B=x/2+s$ and $C=2\pi kn$ leads to

$${\int }_0^{\infty }{y}^{-A}{e}^{-B/y}sin\left(Cy\right)dy=-{\int }_0^{\infty }\frac{1}{C}\left(A{y}^{-(A+1)}+B{y}^{-(A+2)}\right)e^{-B/y}cos\left(Cy\right)dy$$

and using (62) to

$${\int }_0^{\infty }\frac{1}{C}\left(A{y}^{-(A+1)}+B{y}^{-(A+2)}\right)e^{-B/y}dy\le \frac{1}{C}\left(\frac{A\mathsf{\Gamma }\left(A\right)}{B^A}+\frac{B\mathsf{\Gamma }(A+1)}{B^{A+1}}\right)=\frac{\mathsf{\Gamma }(A+1)}{C{B}^A}.$$

Therefore,

$$\frac{1}{n}\left|J_4^{*}(x;-1,d)\right|\le \frac{s{x}^{d/2}}{n{2}^{d/2}\mathsf{\Gamma }(d/2)}{\sum }_{k=1}^{\infty }\frac{\mathsf{\Gamma }(d/2+4)}{k^{2}2{\pi }^{2}n{(x/2+s)}^{d/2+3}}\le \frac{C\left(s\right)}{n^2},$$

and Lemma A4 is proven. □