Expansions for the Conditional Density and Distribution of a Standard Estimate

Abstract

Conditioning is a very useful way of using correlated information to reduce the variability of an estimate. Conditioning an estimate on a correlated estimate, reduces its covariance, and so provides more precise inference than using an unconditioned estimate. Here we give expansions in powers of $n^{-1/2}$ for the conditional density and distribution of any multivariate standard estimate based on a sample of size n. Standard estimates include most estimates of interest, including smooth functions of sample means and other empirical estimates. We also show that a conditional estimate is not a standard estimate, so that Edgeworth-Cornish-Fisher expansions cannot be applied directly.

1. Introduction and Summary

Given correlated estimates $\widehat{w}={({\widehat{w}}_1,{\widehat{w}}_2)}^{\prime }$ of unknown parameters $w={(w_1,w_2)}^{\prime }$, inference on $w_1$ can be made more precise by conditioning on ${\widehat{w}}_2$. To see this, suppose that X is a bivariate normal with correlation $\rho \ne 0$. Then

$$var\left(X_1\right|X_2)=(1-{\rho }^2)var\left(X_1\right)<var\left(X_1\right).$$

So if $\widehat{w}$ is an estimate of w based on a sample of size n, and it satisfies the Central Limit Theorem, (CLT),

$$X_n=n^{1/2}(\widehat{w}-w)\stackrel{\mathcal{L}}{\to }X\sim {\mathcal{N}}_2(0,V),\mathrm{as}n\to \infty ,$$

then

$$var\left({\widehat{w}}_1\right|{\widehat{w}}_2)\approx (1-{\rho }^2)var\left({\widehat{w}}_1\right)<var\left({\widehat{w}}_1\right)$$

if $\rho =\mathrm{correlation}{({\widehat{w}}_1,{\widehat{w}}_2)}^{\prime }$ is non-zero. A similar result holds when for $i=1,2,w_i$ has dimension $q_i$, which we now assume. To apply this result to obtain inference on $w_1$ given ${\widehat{w}}_1|{\widehat{w}}_2$, we need to approximate its distribution, ideally beyond its first approximation given by the CLT. This paper uses expansions in powers of $n^{-1/2}$ for the density and distribution of $X_n=n^{1/2}(\widehat{w}-w)$, for a wide class of estimates, called standard estimates.

Suppose that $\widehat{w}$ is a standard estimate of an unknown parameter $w\in R^q$ of a statistical model, based on a sample of size n. That is, $\widehat{w}$ is a consistent estimate, and for $r\ge 1$, its rth order cumulants have magnitude $n^{-(r-1)/2}$ and can be expanded in powers of $n^{-1}$. The coefficients in these expansions are called the cumulant coefficients. This is a very large class of estimates, with potential application to a range of practical problems. For example, $\widehat{w}$ may be a smooth function of one or more sample means, or a smooth functional of one or more empirical distributions. A smooth function of a standard estimate is also a standard estimate: see ref. [1]. Ref. [2] gave the multivariate Edgeworth expansions for the distribution and density of

$$X_n=n^{1/2}(\widehat{w}-w),$$

in powers of $n^{-1/2}$ about the multivariate normal in terms of the Edgeworth coefficients of (3). (For typos, see p25 of ref. [1]. Also replace $\widehat{\theta }$ by $\widehat{\theta }/\theta$ on 4th to last line p1121 and in (23). To line 3 p1138, add $P_{12}=B_{23}/2$). Ref. [3] gave the Edgeworth coefficients explicitly for the Edgeworth expansions to $O\left(n^{-2}\right)$.

Choosing an estimate can be a tradeoff between simplicity and efficiency. Conventional point estimation emphasises efficiency as measured by mean square error. The maximum liklihood estimate is attractive as it is asymptotically efficient in this sense. However their cumulant coefficients generally take much more work to obtain than those of a moment estimate. See refs. [4,5]. But whether one chooses a simple estimate or a more complicated one, it will generally be a standard estimate.

Turning to conditioning, as noted, this is a very useful way of using correlated information to reduce the variability of estimates, and to make inference on unknown parameters more precise. This is the motivation for this paper. To emphasise when $w_i,{\widehat{w}}_i$ are vectors, we bold them. In Section 4 we take $q\ge 2$, and write $w,\widehat{w}$ and $X_n$ as $\left({\displaystyle \genfrac{}{}{0pt}{}{{\mathbf{w}}_1}{{\mathbf{w}}_2}}\right)$, $\left({\displaystyle \genfrac{}{}{0pt}{}{{\widehat{\mathbf{w}}}_1}{{\widehat{\mathbf{w}}}_2}}\right)$ and $\left({\displaystyle \genfrac{}{}{0pt}{}{{\mathbf{X}}_{n1}}{{\mathbf{X}}_{n2}}}\right)$ of dimensions $\left({\displaystyle \genfrac{}{}{0pt}{}{q_1}{q_2}}\right)$. Just as the distribution of $X_n$ allows inference on w, the conditional distribution of ${\mathbf{X}}_{n1}$ given ${\mathbf{X}}_{n2}$, allows inference on ${\mathbf{w}}_1$ for a given ${\mathbf{w}}_2$. The covariance of ${\widehat{\mathbf{w}}}_1|{\widehat{\mathbf{w}}}_2$ can be substantially less than that of ${\widehat{\mathbf{w}}}_1$. Only when ${\widehat{\mathbf{w}}}_1$ and ${\widehat{\mathbf{w}}}_2$ are uncorrelated, is there no advantage in conditioning. Given a statistical model, its unknown parameters w, will consist of one or more parameters of primary interest, ${\mathbf{w}}_1$, and the others. (For example, for an autoregressive time series with mean $\mu$, autocorrelation $\rho$, and variance of residuals ${\sigma }^2$, the parameter of primary interest is $\mu$.) When conditioning one can choose ${\mathbf{w}}_2$ to be all of the other parameters, or more simply, the single parameter $w_2$ which maximises the estimated correlation of ${\widehat{w}}_2$ with ${\widehat{\mathbf{w}}}_1$. This is another trade-off between efficiency and simplicity, as increasing $q_2$ will reduce the conditional variance.

We shall see that for V the asymptotic covariance of $X_n$,

$$\begin{array}{c}\mathrm{as}n\to \infty ,X_n=n^{1/2}(\widehat{w}-w)\stackrel{\mathcal{L}}{\to }X\sim {\mathcal{N}}_q(0,V),\hfill \end{array}$$

(1)

the multivariate normal on $R^q$, with density and distribution

$$\begin{array}{c}{\varphi }_V\left(x\right)={\left(2\pi \right)}^{-q/2}{\left(detV\right)}^{-1/2}exp(-x^{\prime }{V}^{-1}x/2),{\mathrm{\Phi }}_V\left(x\right)={\int }_{-\infty }^x{\varphi }_V\left(x\right)dx.\hfill \\ \mathrm{So},{\mathbf{X}}_{n1}\left|({\mathbf{X}}_{n2}={\mathbf{x}}_2)\stackrel{\mathcal{L}}{\to }{\mathbf{X}}_1\right|({\mathbf{X}}_2={\mathbf{x}}_2)\sim {\mathcal{N}}_{q_1}({\mu }_{1\cdot 2},V_{1\cdot 2}),\hfill \end{array}$$

where $V_{1\cdot 2}$ is a function of V, and ${\mu }_{1\cdot 2}$ is a function of V and is also linear in ${\mathbf{x}}_2$. If $q_1=1$, this leads in Section 4 to 1- or 2-sided confidence intervals for ${\mathbf{w}}_1|({\mathbf{X}}_{n2}={\mathbf{x}}_2)$, of error $O\left(n^{-1/2}\right)$ or $O\left(n^{-1}\right)$. So unlike traditional confidence regions (including confidence intervals), the conditional versions depend on the value of the unknown ${\mathbf{w}}_2$. This gives a new level of sophistication to them over traditional confidence regions. While this paper does not deal with Studentized estimates, that next step can be done using ref. [6] or ref. [1]. The ${\mathbf{x}}_2$ of most interest are small.

Theorems 1 and 2 give our main results: explicit expansions to $O\left(n^{-2}\right)$ for the conditional density and distribution of ${\mathbf{X}}_{n1}$ given ${\mathbf{X}}_{n2}$, that is, for the conditional density and distribution of ${\widehat{\mathbf{w}}}_1-{\mathbf{w}}_1$ given ${\widehat{\mathbf{w}}}_2-{\mathbf{w}}_2$. In other words, it gives the likely position of ${\mathbf{w}}_1$ for any given ${\mathbf{w}}_2$. The main difficulty is integrating the density. Theorem 2 does this in terms of ${\overline{I}}^{1-k}$ of (42), the integral of the multivariate Hermite polynomial, with respect to the conditional normal density. Note 1 gives ${\overline{I}}^{1-k}$ in terms of derivatives of the multivariate normal distribution. Theorem 3 gives ${\overline{I}}^{1-k}$ in terms of the partial moments of the conditional distribution. If $q_1=1$, then Theorem 4 gives ${\overline{I}}^{1-k}$ in terms of the unit normal distribution and density.

Section 4 specialises to the case $q_1=q_2=1$. Examples are the condtional distribution and density of a bivariate sample mean, of entangled gamma random variables, and of a sample mean given the sample variance. Section 5 and Section 6 give conclusions, discussion, and suggestions for future research. Appendix A gives expansions for the conditional moments of ${\mathbf{X}}_{n1}|({\mathbf{X}}_{n2}={\mathbf{x}}_2).$ It shows that ${\widehat{\mathbf{w}}}_1$ given ${\mathbf{X}}_{n2}$, is neither a standard estimate, nor a Type B estimate, so that Edgeworth-Cornish-Fisher expansions do not apply to it.

Ref. [7] (pp. 34–36) argue that an ideal choice of conditioning variable ${\widehat{\mathbf{w}}}_2$ would be one whose distribution does not depend on ${\mathbf{w}}_1$. But this is generally not possible except for some exponential families. An example when it is true, is when $w_1$ and $w_2$ are location and scale parameters: on p54 they essentially suggest choosing $w_2=nvar{\widehat{w}}_1$. This is our motivation for Example 4. For some examples, see ref. [8]. Their (7.5) gave a form for the 3rd order expansion for the conditional density of a sample mean to $O\left(n^{-3/2}\right)$, but they did not attempt to integrate it.

Conditional expansions for the sample mean were given in Chapter 12 of [9], and used in Sections 2.3 and 2.5 of [10] to show bootstrap consistency. For some other results on conditional distributions, see refs. [11,12,13,14,15,16].

2. Multivariate Edgeworth Expansions

Suppose that $\widehat{w}$ is a standard estimate of $w\in R^q$ with respect to n. (n is typically the sample size.) That is, $E\widehat{w}\to w$ as $n\to \infty$, where we use $E$ for expected value, and for $r\ge 1$ and $1\le i_1,\dots ,i_r\le q,$ the rth order cumulants of $\widehat{w}={({\widehat{w}}_1,\dots ,{\widehat{w}}_q)}^{\prime }$ can be expanded as

$$\begin{array}{c}{\overline{k}}^{1-r}=k^{i_1\dots i_r}=\kappa ({\widehat{w}}_{i_1},\dots ,{\widehat{w}}_{i_r})\approx \sum _{d=r-1}^{\infty }{n}^{-d}{\overline{k}}_d^{1-r},\mathrm{where}{\overline{k}}_d^{1-r}=k_d^{i_1\dots i_r},\hfill \end{array}$$

(2)

where ≈ indicates an asymptotic expansion, and the cumulant coefficients ${\overline{k}}_d^{1-r}$ may depend on n but are bounded as $n\to \infty$. So the bar replaces each $i_k$ by k. For example ${\overline{k}}_0^1=w^{i_1}$ and ${\overline{k}}_1^{12}=k_1^{i_1{i}_2}.$We reserve $i_k$ for this bar notation to avoid double subscripts. (1) holds with $V=\left({\overline{k}}_1^{12}\right),q\times q$. V may depend on n, but we assume that $detV$ is bounded away from 0.

$$\begin{array}{c}\mathrm{Let}{\overline{P}}_r^{1-k}=P_r^{i_1\dots i_k}\mathrm{be}\mathit{the}\mathit{rth}\mathit{Edgeworth}\mathit{coefficient}\mathrm{of}\widehat{w},\hfill \end{array}$$

(3)

for $q\ge 1\le r\le 3$. These are Bell polynomials in the cumulant coefficients of (2), as defined and given in [3]. Their importance lies in their central role in the Edgeworth expansions of $X_n$ of (1). (When $q=1$ and $\widehat{w}$ is a sample mean, the Edgeworth coefficients were given for all r in [17]. For typos, see pp. 24–25 of [1].)

Set $P\left(A\right)=$ Probability A is true. By [2], or [1], for $\widehat{w}$ non-lattice, the distribution and density of $X_n$ can be expanded as

$$\begin{array}{c}P(X_n\le x)\approx \sum _{r=0}^{\infty }{n}^{-r/2}{P}_r\left(x\right),p_{X_n}\left(x\right)\approx \sum _{r=0}^{\infty }{n}^{-r/2}{p}_r\left(x\right),x\in R^q,\hfill \end{array}$$

(4)

where $P_0\left(x\right)={\mathrm{\Phi }}_V\left(x\right),p_0\left(x\right)={\varphi }_V\left(x\right),$ and for $r\ge 1,P_r\left(x\right)={\sum }_{k=1}^{3r}[P_{rk}\left(x\right):k-r\mathrm{even}],$

$$\begin{array}{c}{p}_r\left(x\right)/{\varphi }_V\left(x\right)=\sum _{k=1}^{3r}[{\tilde{p}}_{rk}:k-r\mathrm{even}]={\tilde{p}}_r\left(x\right)\mathrm{say},\hfill \end{array}$$

(5)

$$\begin{array}{c}{P}_{rk}\left(x\right)={\overline{P}}_r^{1-k}{\overline{H}}_{\ast }^{1-k},{\tilde{p}}_{rk}={\overline{P}}_r^{1-k}{\overline{H}}^{1-k},\hfill \end{array}$$

(6)

$$\begin{array}{c}{\overline{H}}_{\ast }^{1-k}={\overline{H}}_{\ast }^{1-k}(x,V)={\overline{O}}^{1-k}{\mathrm{\Phi }}_V\left(x\right)={\int }_{-\infty }^x{\overline{H}}^{1-k}{\varphi }_V\left(x\right)dx,\hfill \end{array}$$

(7)

$$\begin{array}{c}{\overline{O}}^{1-k}=(-{\overline{\partial }}_1)\dots (-{\overline{\partial }}_k),{\overline{\partial }}_k={\partial }_{i_k},{\partial }_i=\partial /\partial x_i,\hfill \end{array}$$

$$\begin{array}{c}{\overline{H}}^{1-k}=H^{i_1\dots i_k}={\varphi }_V{\left(x\right)}^{-1}{\overline{O}}^{1-k}{\varphi }_V\left(x\right)=E({\overline{y}}_1+I{\overline{Y}}_1)\dots ({\overline{y}}_k+I{\overline{Y}}_k)\hfill \end{array}$$

(8)

$$\begin{array}{c}\mathrm{and}I=\sqrt{-1},y=V^{-1}x,Y=V^{-1}X\sim {\mathcal{N}}_q(0,V^{-1}).\hfill \end{array}$$

(9)

${\overline{H}}^{1-k}(x,V)={\overline{H}}^{1-k}$ is the multivariate Hermite polynomial. We use the tensor summation convention, repetition of $i_1,\dots ,i_k$ in (6) implies their implicit summation over their range, $1,\dots ,q$. Ref. [3] gave ${\overline{H}}^{1-k}$ explicitly for $k\le 6$ and for $k\le 9$ when $q=2$.

$$\begin{array}{c}\mathrm{Set}{\overline{\mu }}^{1-2k}=E{\overline{Y}}_1\dots {\overline{Y}}_{2k}=\sum ^{1.3\dots (2k-1)}{\overline{V}}^{12}\dots {\overline{V}}^{2k-1,2k},\hfill \end{array}$$

(10)

where ${\sum }^N{\overline{f}}^{1-2k}$ sums ${\overline{f}}^{1-2k}$ over all N permutations of $i_1,\dots ,i_{2k}$ giving distinct values. For example,

$$\begin{array}{c}{\overline{H}}^1={\overline{y}}_1,{\overline{H}}^{12}={\overline{y}}_1{\overline{y}}_2-{\overline{V}}^{12},\hfill \\ {\overline{H}}^{1-3}={\overline{y}}_1{\overline{y}}_2{\overline{y}}_3-\sum ^3{\overline{y}}_1{\overline{V}}^{23}={\overline{y}}_1{\overline{y}}_2{\overline{y}}_3-{\overline{y}}_1{\overline{V}}^{23}-{\overline{y}}_2{\overline{V}}^{13}-{\overline{y}}_3{\overline{V}}^{12},\hfill \end{array}$$

$$\begin{array}{c}{\overline{H}}_{\ast }^1={\overline{J}}^1,{\overline{H}}_{\ast }^{12}={\overline{J}}^{12}-{\overline{V}}^{12}{\mathrm{\Phi }}_V\left(x\right),{\overline{H}}_{\ast }^{1-3}={\overline{J}}^{123}-\sum ^3{\overline{J}}^1{\overline{V}}^{23},\mathrm{where}\hfill \end{array}$$

$$\begin{array}{c}{\overline{J}}^{1-k}={\overline{J}}^{1-k}(x,V)=E{\overline{Y}}_1\dots {\overline{Y}}_{k}I(X\le x)={\overline{V}}^{1,k+1}\dots {\overline{V}}^{k,2k}{\overline{M}}_V^{k+1-2k},\hfill \end{array}$$

(11)

$$\begin{array}{c}\mathrm{and}{\overline{M}}_V^{a-b}={\overline{M}}^{a-b}(x,V)={\int }_{-\infty }^x{\overline{x}}_a\dots {\overline{x}}_b{\varphi }_V\left(x\right)dx,\mathrm{for}{\overline{x}}_a=x_{i_a}.\hfill \end{array}$$

(12)

$$\begin{array}{c}\mathrm{So},P_1\left(x\right)=\sum _{k=1,3}{P}_{1k}\left(x\right),P_{11}\left(x\right)={\overline{k}}_1^1{\overline{H}}_{\ast }^1,P_{13}\left(x\right)={\overline{k}}_2^{1-3}{\overline{H}}_{\ast }^{1-3}/6,\hfill \end{array}$$

$$\begin{array}{c}{\tilde{p}}_1\left(x\right)=p_1\left(x\right)/{\varphi }_V\left(x\right)=\sum _{k=1,3}{\tilde{p}}_{1k},{\tilde{p}}_{11}={\overline{k}}_1^1{\overline{H}}^1,{\tilde{p}}_{13}={\overline{k}}_2^{1-3}{\overline{H}}^{1-3}/6.\hfill \end{array}$$

(13)

(So the repeated $i_{k+1},\dots ,i_{2k}$ in (11) implies their repeated summatioin over $1,\dots ,q$.) $P_2\left(x\right),P_3\left(x\right)$ are given explicitly in [3]. So (4) with the ${\overline{P}}_r^{1-k}$ in [3] give the Edgeworth expansions for the distribution and density of $X_n$ of (1) to $O\left(n^{-2}\right)$. ${\tilde{p}}_{rk}$ and $P_{rk}$ each have $q^k$ terms, but many are duplicates as ${\overline{P}}_r^{1-k}$ is symmetric in $i_1,\dots ,i_k$. This is exploited by the notation of Section 4 of [3] to greatly reduce the number of terms in (6).

By (5), the density of $X_n$ relative to its asymptotic value is

$$p_{X_n}\left(x\right)/{\varphi }_V\left(x\right)\approx 1+\sum _{r=1}^{\infty }{n}^{-r/2}{\tilde{p}}_r\left(x\right)=1+n^{-1/2}{\tilde{p}}_1\left(x\right)+O\left(n^{-1}\right),\mathrm{for}x\in R^q,$$

and for measurable $C\subset R^q$,

$$\begin{array}{c}P(X_n\in C)\approx {\mathrm{\Phi }}_V\left(C\right)+\sum _{r=1}^{\infty }{n}^{-r/2}{p}_{rC},\mathrm{where}\mathrm{for}r\ge 1,\hfill \\ p_{rC}=E{p}_r\left(X\right)I(X\in C)={\int }_C{p}_r\left(x\right){\varphi }_V\left(x\right)dx=\sum _{k=1}^{3r}[{\tilde{p}}_{rk}\left(C\right):k-r\mathrm{even}],\hfill \\ {\tilde{p}}_{rk}\left(C\right)=E{\tilde{p}}_{rk}\left(X\right)I(X\in C)={\int }_C{\tilde{p}}_{rk}\left(x\right){\varphi }_V\left(x\right)dx={\overline{P}}_r^{1-k}{\overline{H}}^{1-k}\left(C\right),\hfill \\ \mathrm{and}{\overline{H}}^{1-k}\left(C\right)=E{\overline{H}}^{1-k}(X,V)I(X\in C)={\int }_C{\overline{H}}^{1-k}{\varphi }_V\left(x\right)dx.\hfill \end{array}$$

If $-C=C$, then for r odd, ${\overline{Q}}^{1-r}={\tilde{p}}_{rk}\left(C\right)=p_{rC}=0,$ so that

$$\begin{array}{c}P(X_n\in C)\approx {\mathrm{\Phi }}_V\left(C\right)+\sum _{r=1}^{\infty }{n}^{-r}{p}_{2rC}={\mathrm{\Phi }}_V\left(C\right)+n^{-1}{p}_{2C}+O\left(n^{-2}\right).\hfill \end{array}$$

(14)

Examples 3 and 4 of [3] gave $p_{2C}$ for

$C=\{x:x^{\prime }{V}^{-1}x\le u\}$, and $C=\{x:|{\left(V^{-1/2}x\right)}_j|\le u_j,j=1,\dots ,q\}$.

3. The Conditional Density and Distribution

For $q=q_1+q_2,q_1\ge 1,$ and $q_2\ge 1,$ partition $w,\widehat{w},X\sim {\mathcal{N}}_q(0,V),X_n=n^{1/2}(\widehat{w}-w),x$ and $y=V^{-1}x$ as $\left({\displaystyle \genfrac{}{}{0pt}{}{{\mathbf{w}}_1}{{\mathbf{w}}_2}}\right),\left({\displaystyle \genfrac{}{}{0pt}{}{{\widehat{\mathbf{w}}}_1}{{\widehat{\mathbf{w}}}_2}}\right),\left({\displaystyle \genfrac{}{}{0pt}{}{{\mathbf{X}}_1}{{\mathbf{X}}_2}}\right),\left({\displaystyle \genfrac{}{}{0pt}{}{{\mathbf{X}}_{n1}}{{\mathbf{X}}_{n2}}}\right),\left({\displaystyle \genfrac{}{}{0pt}{}{{\mathbf{x}}_1}{{\mathbf{x}}_2}}\right)$ and $\left({\displaystyle \genfrac{}{}{0pt}{}{{\mathbf{y}}_1}{{\mathbf{y}}_2}}\right),$ where ${\mathbf{w}}_i,{\widehat{\mathbf{w}}}_i,{\mathbf{X}}_i,{\mathbf{X}}_{ni},{\mathbf{x}}_i,{\mathbf{y}}_i$ are vectors of length $q_i$. Partition $V,V^{-1}$ as $\left({\mathbf{V}}_{ij}\right),\left({\mathbf{V}}^{ij}\right),2\times 2,$ where ${\mathbf{V}}_{ij},{\mathbf{V}}^{ij}$ are $q_i\times q_j$.

$$\begin{array}{c}\mathrm{Set}{\mathbf{X}}_{1\cdot 2}={\mathbf{X}}_1|({\mathbf{X}}_2={\mathbf{x}}_2),{\mathbf{X}}_{n1\cdot 2}={\mathbf{X}}_{n1}|({\mathbf{X}}_{n2}={\mathbf{x}}_2),\hfill \end{array}$$

(15)

$$\begin{array}{c}{\widehat{\mathbf{w}}}_{1\cdot 2}={\widehat{\mathbf{w}}}_1|({\mathbf{X}}_{n2}={\mathbf{x}}_2)={\mathbf{w}}_1+n^{-1/2}{\mathbf{X}}_{n1\cdot 2}.\hfill \end{array}$$

(16)

Now we come to the main purpose of this paper. Theorem 1 expands the conditional density of ${\mathbf{X}}_{n1\cdot 2}$ about the conditional density of ${\mathbf{X}}_{1\cdot 2}$. Its derivation is straightforward, the only novel feature being the use of Lemma 2 to find the reciprocal of a series, using Bell polynomials. Theorem 2 integrates the conditional density to obtain the expansion for the conditional distribution of ${\mathbf{X}}_{n1\cdot 2}$ about the conditional distribution of ${\mathbf{X}}_{1\cdot 2}$ in terms of ${\overline{I}}^{1-k}$ of (42) below, the integral of the Hermite polynomial ${\overline{H}}^{1-k}$ of (8), with respect to the conditional normal density. Note 1 gives ${\overline{I}}^{1-k}$ in terms of derivatives of the multivariate normal distribution. Theorem 3 gives ${\overline{I}}^{1-k}$ in terms of the partial moments of the conditional normal distribution. For ${\mathbf{X}}_{1\cdot 2}$ of (15), set

$$\begin{array}{c}{\mu }_{1\cdot 2}=E{\mathbf{X}}_{1\cdot 2}={\mathbf{V}}_{12}{\mathbf{V}}_{22}^{-1}{\mathbf{x}}_2\in R^{q_1},\hfill \end{array}$$

(17)

$$\begin{array}{c}{V}_{1\cdot 2}=covar{\mathbf{X}}_{1\cdot 2}={\mathbf{V}}_{11}-{\mathbf{V}}_{12}{\mathbf{V}}_{22}^{-1}{\mathbf{V}}_{21}=V_0\mathrm{say},\in R^{q_1\times q_1}.\hfill \end{array}$$

(18)

$$\begin{array}{c}\mathrm{So},{\mathbf{X}}_{1\cdot 2}\sim {\mathcal{N}}_{q_1}({\mu }_{1\cdot 2},V_{1\cdot 2}).\hfill \end{array}$$

(19)

Lemma 1.

The elements of $\left({\mathbf{V}}^{ij}\right)=V^{-1}$ are

$$\begin{array}{cc}\hfill & {\mathbf{V}}^{11}=V_{1\cdot 2}^{-1},V^{12}=-{\mathbf{V}}^{11}{\mathbf{V}}_{12}{\mathbf{V}}_{22}^{-1}=-{\mathbf{V}}_{11}^{-1}{\mathbf{V}}_{12}{\mathbf{V}}^{22},\hfill \\ \hfill & V^{21}=-{\mathbf{V}}^{22}{\mathbf{V}}_{21}{\mathbf{V}}_{11}^{-1}=-{\mathbf{V}}_{22}^{-1}{\mathbf{V}}_{21}{\mathbf{V}}^{11},\hfill \\ \hfill & {\mathbf{V}}^{22}=V_{2\cdot 1}^{-1},\mathit{where}{V}_{2\cdot 1}={\mathbf{V}}_{22}-{\mathbf{V}}_{21}{\mathbf{V}}_{11}^{-1}{\mathbf{V}}_{12}\in R^{q_2\times q_2}.\hfill \end{array}$$

$$\mathit{For}i=1,2,\mathit{set}{A}_i={\mathbf{V}}^{i1}{\mathbf{V}}_{12}{\mathbf{V}}_{22}^{-1}+{\mathbf{V}}^{i2}.\mathit{Then}{A}_1=0_{q_1\times q_2},A_2={\mathbf{V}}_{22}^{-1}.$$

(20)

Proof. 

$V{V}^{-1}=V^{-1}V=I_q$ gives 8 equations relating $\left\{{\mathbf{V}}^{ij}\right\}$ and $\left\{{\mathbf{V}}_{ij}\right\}$. Now solve for $\left\{{\mathbf{V}}^{ij}\right\}$.

So $A_1=0_{q_1\times q_2},A_2={\mathbf{V}}^{22}B{\mathbf{V}}_{22}^{-1}$ for $B={\mathbf{V}}_{22}-{\mathbf{V}}_{21}{\mathbf{V}}_{11}^{-1}{\mathbf{V}}_{12}={\left({\mathbf{V}}^{22}\right)}^{-1}.$ □

Since $Q={\mathbf{V}}_{11}-V_{1\cdot 2}\ge 0_{q_1\times q_1}$ in the sense that $x^{\prime }Qx\ge 0$ for $x\in R^{q_1}$, ${\mathbf{X}}_{1\cdot 2}$ is less variable than ${\mathbf{X}}_1$, and ${\mathbf{X}}_{n1\cdot 2}$ is less variable than ${\mathbf{X}}_{n1}$, unless ${\mathbf{X}}_1$ and ${\mathbf{X}}_2$ are uncorrelated, that is, ${\mathbf{V}}_{12}$ is a matrix of zeros.

The conditional density of ${\mathbf{X}}_{n1\cdot 2}$ is

$$\begin{array}{c}{p}_{n1\cdot 2}\left({\mathbf{x}}_1\right)=p_{X_n}\left(x\right)/p_{X_{n2}}\left({\mathbf{x}}_2\right)={\varphi }_{1\cdot 2}\left({\mathbf{x}}_1\right)(1+S)/(1+S_2),\hfill \end{array}$$

(21)

$$\mathrm{where}S=p_{X_n}\left(x\right)/{\varphi }_V\left(x\right)-1\approx \sum _{r=1}^{\infty }{n}^{-r/2}{\tilde{p}}_r\left(x\right)\mathrm{of}(6),$$

$$\begin{array}{c}{S}_2=p_{X_{n2}}\left({\mathbf{x}}_2\right)/{\varphi }_{{\mathbf{V}}_{22}}\left({\mathbf{x}}_2\right)-1\approx \sum _{r=1}^{\infty }{n}^{-r/2}{f}_r,\mathrm{for}{f}_r=p_r^{\ast }\left({\mathbf{x}}_2\right),\hfill \end{array}$$

(22)

where $p_r^{\ast }\left({\mathbf{x}}_2\right)$ is ${\tilde{p}}_r\left(x\right)$ of (6) for ${\mathbf{X}}_{n2}$, and ${\varphi }_{1\cdot 2}\left({\mathbf{x}}_1\right)$ is the density of ${\mathbf{X}}_{1\cdot 2}$ of (15). By (4)–(6), Section 2.5 of [18], for $V_0$ of (18),

$$\begin{array}{c}{\varphi }_{1\cdot 2}\left({\mathbf{x}}_1\right)={\varphi }_V\left(x\right)/{\varphi }_{{\mathbf{V}}_{22}}\left({\mathbf{x}}_2\right)={\varphi }_{V_0}\left(u\right),\mathrm{where}u={\mathbf{x}}_1-{\mu }_{1\cdot 2}\in R^{q_1}.\hfill \end{array}$$

(23)

So the distribution of ${\mathbf{X}}_1|({\mathbf{X}}_2={\mathbf{x}}_2)$ is

$$\begin{array}{c}{\mathrm{\Phi }}_{1\cdot 2}\left({\mathbf{x}}_1\right)={\mathrm{\Phi }}_{V_0}\left(u\right),\mathrm{for}{V}_0\mathrm{of}(18).\hfill \end{array}$$

(24)

For ${\mu }_{1\cdot 2}$ of (17), $V_{1\cdot 2}$ of (18), and $v\in R^{q_1}$, set

$$\begin{array}{c}{x}_1(x_2,v)={\mu }_{1\cdot 2}+V_{1\cdot 2}^{1/2}v={\mathbf{V}}_{12}{\mathbf{V}}_{22}^{-1}{\mathbf{x}}_2+V_{1\cdot 2}^{1/2}v.\hfill \end{array}$$

(25)

Corollary 1.

Suppose that $q_1=1$. Then for $v=V_0^{-1/2}u$ of (23),

$$\begin{array}{cc}\hfill & {\varphi }_{1\cdot 2}\left({\mathbf{x}}_1\right)=V_0^{-1/2}\varphi \left(v\right),P(X_{1\cdot 2}<x_1(x_2,v))=\mathrm{\Phi }\left(v\right),\hfill \\ \hfill & P({\widehat{w}}_{1\cdot 2}<w_1+n^{-1/2}{x}_1(x_2,v))=P(X_{n1\cdot 2}<x_1(x_2,v))=\mathrm{\Phi }\left(v\right)+O\left(n^{-1/2}\right),\hfill \\ \hfill & P\left(\right|w_1-{\widehat{w}}_{1\cdot 2}|<n^{-1/2}{x}_1(x_2,v)) =P(|X_{n1\cdot 2}|<x_1(x_2,v))\hfill \\ \hfill & =2\mathrm{\Phi }\left(v\right)-1+O\left(n^{-1}\right)\mathrm{if}v>0,\hfill \\ \hfill & P(x_1(x_2,-v)<X_{n1\cdot 2}<x_1(x_2,v))=2\mathrm{\Phi }\left(v\right)-1+O\left(n^{-1}\right),\mathrm{if}v>0.\hfill \end{array}$$

(26)

Replacing V by an estimate will usually give 1- and 2-sided conditional confidence intervals of error $O\left(n^{-1/2}\right)$ and $O\left(n^{-1}\right)$ for ${\widehat{w}}_1-w_1$ given ${\widehat{\mathbf{w}}}_2-{\mathbf{w}}_2$.

$$\begin{array}{c}\mathrm{Set}{\overline{H}}_q^{1-k}={\overline{H}}^{1-k}={\overline{H}}^{1-k}(x,V),\mathrm{and}{\overline{H}}_{q_2}^{1-k}={\overline{H}}^{1-k}({\mathbf{x}}_2,{\mathbf{V}}_{22}).\hfill \end{array}$$

So ${\overline{H}}_{q_2}^{1-k}$ is given by replacing $y=V^{-1}x$ and $\left(V^{ij}\right)=V^{-1}$ in ${\overline{H}}_q^{1-k}$ by

$$\begin{array}{c}z={\mathbf{V}}_{22}^{-1}{\mathbf{x}}_2\mathrm{and}\left(U^{ij}\right)={\mathbf{V}}_{22}^{-1}.\mathrm{For}\mathrm{example}{\overline{H}}_{q_2}^{12}={\overline{z}}_1{\overline{z}}_2-{\overline{U}}^{12}.\hfill \end{array}$$

(27)

By (5) and (6), for $r\ge 1$, $p_r^{\ast }\left({\mathbf{x}}_2\right)$ of (22) is given by

$$\begin{array}{c}{p}_r^{\ast }\left({\mathbf{x}}_2\right)=\sum _{k=1}^{3r}[p_{rk}^{\ast }:k-r\mathrm{even}],\mathrm{where}{p}_{rk}^{\ast }={\overline{P}}_r^{1-k}{\overline{H}}_{q_2}^{1-k},\hfill \end{array}$$

(28)

and implicit summation in (28) for $i_1,\dots ,i_k$ is now over $q_1+1,\dots ,q$. So,

$$\begin{array}{c}{p}_1^{\ast }\left({\mathbf{x}}_2\right)=\sum _{k=1,3}{p}_{1k}^{\ast },p_{11}^{\ast }=\sum _{i_1=q_1+1}^q{\overline{k}}_1^1{\overline{H}}_{q_2}^1,p_{13}^{\ast }=\sum _{i_1,i_2,i_3=q_1+1}^q{\overline{k}}_2^{1-3}{\overline{H}}_{q_2}^{1-3}/6,\hfill \\ \mathrm{where}{\overline{H}}_{q_2}^1={\overline{z}}_1,{\overline{H}}_{q_2}^{1-3}={\overline{z}}_1{\overline{z}}_2{\overline{z}}_3-\sum ^3{\overline{U}}^{12}{\overline{z}}_3,\hfill \\ p_2^{\ast }\left({\mathbf{x}}_2\right)=\sum _{k=2,4,6}{p}_{2k}^{\ast },p_3^{\ast }\left({\mathbf{x}}_2\right)=\sum _{k=1,3,5,7,9}{p}_{3k}^{\ast },\mathrm{for}{p}_{rk}^{\ast }\mathrm{of}(28).\hfill \end{array}$$

Ordinary Bell polynomials. For a sequence $e=(e_1,e_2,\dots )$ from R, the partial ordinary Bell polynomial ${\tilde{B}}_{rs}={\tilde{B}}_{rs}\left(e\right)$, is defined by the identity

$$\begin{array}{c}\mathrm{for}s=0,1,2,\dots \mathrm{and}z\in R,S^s=\sum _{r=s}^{\infty }{z}^r{\tilde{B}}_{rs}\left(e\right),\mathrm{where}S=\sum _{r=1}^{\infty }{z}^r{e}_r.\hfill \end{array}$$

(29)

$$\mathrm{So},{\tilde{B}}_{r0}={\delta }_{r0},{\tilde{B}}_{r1}=e_r,{\tilde{B}}_{rr}=e_1^r,{\tilde{B}}_{32}=2e_1{e}_2,$$

where ${\delta }_{00}=1,{\delta }_{r0}=0$ for $r\ne 0.$ They are tabled on p309 of [19]. To obtain (21), we use

Lemma 2.

Take ${\tilde{B}}_{rs}\left(e\right)$ of (29). Set $S_2={\sum }_{r=1}^{\infty }{z}^r{f}_r$ for $f_r\in R$. Then

$$\begin{array}{cc}\hfill & {(1+S_2)}^{-1}=\sum _{r=0}^{\infty }{z}^r{C}_r,\mathit{where}{C}_r=B_r^{\ast }(-f),B_r^{\ast }\left(e\right)=\sum _{s=0}^r{\tilde{B}}_{rs}\left(e\right).\hfill \end{array}$$

(30)

$$\mathit{So},B_0^{\ast }\left(e\right)=1,B_1^{\ast }\left(e\right)=e_1,B_2^{\ast }\left(e\right)=e_2+e_1^2,B_3^{\ast }\left(e\right)=e_3+2e_1{e}_2+e_1^3,$$

$$\begin{array}{cc}\hfill & C_0=1,C_1=-f_1,C_2=f_1^2-f_2,C_3=-f_1^3+2f_1{f}_2-f_3.\hfill \end{array}$$

(31)

Proof. 

$$\begin{array}{cc}\hfill & {(1+S_2)}^{-1}=\sum _{s=0}^{\infty }{(-S_2)}^s,\mathrm{and}{(-S_2)}^s=\sum _{r=s}^{\infty }{z}^r{\tilde{B}}_{rs}(-f).\hfill \end{array}$$

Now swap summations. □

Theorem 1.

Take ${\tilde{p}}_r\left(x\right)$ of (6) and $C_r=B_r^{\ast }(-f)$ of (30) with

$$\begin{array}{cc}\hfill & f_r=p_r^{\ast }\left({\mathbf{x}}_2\right)\mathit{of}(28).\hfill \end{array}$$

(32)

The conditional density $p_{n1\cdot 2}\left({\mathbf{x}}_1\right)$ of (21), relative to ${\varphi }_{1\cdot 2}\left({\mathbf{x}}_1\right)$ of (23), is

$$\begin{array}{cc}\hfill & p_{n1\cdot 2}\left({\mathbf{x}}_1\right)/{\varphi }_{1\cdot 2}\left({\mathbf{x}}_1\right)\approx \sum _{r=0}^{\infty }{n}^{-r/2}{D}_r,\mathit{where}{D}_r=C_r\otimes {\tilde{p}}_r\left(x\right),\hfill \end{array}$$

(33)

and for sequences $(a_0,a_1,\dots )$ and $(b_0,b_1,\dots ),a_r\otimes b_r={\sum }_{i=0}^r{a}_i{b}_{r-i}.$ So,

$$\begin{array}{cc}\hfill & D_0={\tilde{p}}_0\left(x\right)=1,D_1=C_1+{\tilde{p}}_1\left(x\right),D_2=C_2+C_1{\tilde{p}}_1\left(x\right)+{\tilde{p}}_2\left(x\right),\hfill \end{array}$$

(34)

$$\begin{array}{cc}\hfill & D_3=C_3+C_2{\tilde{p}}_1\left(x\right)+C_1{\tilde{p}}_2\left(x\right)+{\tilde{p}}_3\left(x\right).\hfill \end{array}$$

(35)

Proof. 

This follows from (21) and Lemma 2. □

So $D_0,\dots ,D_3$ of (34) and (35) give the conditional density to $O\left(n^{-2}\right)$. We call (33) the relative conditional density. We now give our main result, an expansion for the conditional distribution of ${\mathbf{X}}_{n1}|({\mathbf{X}}_{n2}={\mathbf{x}}_2)$. As noted, Theorem 2 gives this in terms of ${\overline{I}}^{1-k}$ of (42) below, an integral of the Hermite polynomial ${\overline{H}}^{1-k}$ of (8), and Note 1 gives ${\overline{I}}^{1-k}$ in terms of derivatives of the multivariate normal distribution. Theorem 3 gives ${\overline{I}}^{1-k}$ in terms of the partial moments of the conditional distribution ${\mathrm{\Phi }}_{1\cdot 2}\left({\mathbf{x}}_1\right)$ of (24).

When $q_1=1$, Theorem 4 gives ${\overline{I}}^{1-k}$ in terms of $\mathrm{\Phi }\left(v\right)$ and $\varphi \left(v\right)$ for

$$\begin{array}{c}v=V_{1\cdot 2}^{-1/2}u=V_{1\cdot 2}^{-1/2}(x_1-{\mu }_{1\cdot 2})\in R^{q_1}.\hfill \end{array}$$

(36)

Theorem 2.

Take $C_r,D_r$ of Theorem 1. Set ${\tilde{p}}_0\left(x\right)=1.$ The conditional distribution of ${\mathbf{X}}_{n1}$ given ${\mathbf{X}}_{n2}$, about ${\mathrm{\Phi }}_{1\cdot 2}\left({\mathbf{x}}_1\right)$ of (24), has the expansion

$$\begin{array}{cc}\hfill & P_{n1\cdot 2}\left({\mathbf{x}}_1\right)=P({\mathbf{X}}_{n1\cdot 2})\le {\mathbf{x}}_1\approx \sum _{r=0}^{\infty }{n}^{-r/2}{G}_r,\hfill \end{array}$$

(37)

$$\begin{array}{cc}\hfill & \mathit{where}{G}_r={\int }_{-\infty }^{{\mathbf{x}}_1}{D}_{r}d{\mathrm{\Phi }}_{1\cdot 2}\left({\mathbf{x}}_1\right)=C_r\otimes g_r,\mathit{and}\hfill \end{array}$$

(38)

$$\begin{array}{cc}\hfill & g_r={\int }_{-\infty }^{{\mathbf{x}}_1}{\tilde{p}}_r\left(x\right)d{\mathrm{\Phi }}_{1\cdot 2}\left({\mathbf{x}}_1\right).\mathit{So},G_0=g_0={\mathrm{\Phi }}_{1\cdot 2}\left({\mathbf{x}}_1\right)={\mathrm{\Phi }}_{V_0}\left(u\right)\mathit{of}(24),\hfill \end{array}$$

(39)

$$\begin{array}{cc}\hfill & \mathit{for}r\ge 1,g_r=\sum _{k=1}^{3r}[g_{rk}:k-r\mathit{even}],\mathit{where}\mathit{for}{\tilde{p}}_{rk}\mathrm{of}(6),\hfill \end{array}$$

(40)

$$\begin{array}{cc}\hfill & g_{rk}={\int }_{-\infty }^{{\mathbf{x}}_1}{\tilde{p}}_{rk}d{\mathrm{\Phi }}_{1\cdot 2}\left({\mathbf{x}}_1\right)={\overline{P}}_r^{1-k}{\overline{I}}^{1-k},\mathit{and}\mathit{for}1\le i_1,\dots ,i_k\le q,\hfill \end{array}$$

(41)

$$\begin{array}{cc}\hfill & {\overline{I}}^{1-k}=I^{i_1\dots i_k}={\int }_{-\infty }^{{\mathbf{x}}_1}{\overline{H}}_q^{1-k}{\varphi }_{1\cdot 2}\left({\mathbf{x}}_1\right)d{\mathbf{x}}_1,\mathit{for}{\varphi }_{1\cdot 2}\left({\mathbf{x}}_1\right)\mathit{of}(23).\hfill \end{array}$$

(42)

Proof. 

(40) holds by (6). (41) holds by (6). Now use (23). □

$$\mathrm{So}{P}_{n1\cdot 2}\left({\mathbf{x}}_1\right)={\mathrm{\Phi }}_{V_0}\left(u\right)+\sum _{r=1}^3{n}^{-r/2}{G}_r+O\left(n^{-2}\right),\mathrm{where}{G}_1=g_1-f_1{g}_0,$$

$$\begin{array}{c}{G}_2=g_2-f_1{g}_1+C_2{g}_0,G_3=g_3-f_1{g}_2+C_2{g}_1+C_3{g}_0,\hfill \end{array}$$

(43)

for $C_r$ of (31). $g_1=g_{11}+g_{13}$ is given by ${\overline{I}}^1,{\overline{I}}^{1-3}$, $g_2=g_{22}+g_{24}+g_{26}$ is given by ${\overline{I}}^{12},{\overline{I}}^{1-4},{\overline{I}}^{1-6},$ and $g_3=\sum (g_{3k}:k=1,3,5,7,9)$ is given by ${\overline{I}}^1,{\overline{I}}^{1-3},\dots ,{\overline{I}}^{1-9}.$

Note 1.

Set ${\partial }^{†}={\mathrm{\Pi }}_{i=q_1+1}^q{\partial }_i.$ By (23),

$${\overline{I}}^{1-k}={\varphi }_{{\mathbf{V}}_{22}}{\left({\mathbf{x}}_2\right)}^{-1}{\overline{L}}^{1-k},\mathit{where}$$

$$\begin{array}{c}{\overline{L}}^{1-k}={\int }_{-\infty }^{{\mathbf{x}}_1}{\overline{H}}_q^{1-k}{\varphi }_V\left(x\right)d{\mathbf{x}}_1=(-{\overline{\partial }}_1)\dots (-{\overline{\partial }}_k){\partial }^{†}{\mathrm{\Phi }}_V\left(x\right).\hfill \end{array}$$

(44)

Comparing ${\overline{L}}^{1-k}$ with the Hermite function ${\overline{H}}_{\ast }^{1-k}$ of (7), we can call ${\overline{L}}^{1-k}$ the partial Hermite function. When $q=2$, see (53).

By (39), $G_r$ in (37) is given by $C_r$ of (32) and $g_r$ of (40). Viewing ${\overline{H}}_q^{1-k}$ as a polynomial in ${\mathbf{x}}_1={\mu }_{1\cdot 2}+u$ for u of (23), ${\overline{I}}^{1-k}$ is linear in

$${\int }_{-\infty }^{{\mathbf{x}}_1}{x}_{i_1}\dots x_{i_s}{\varphi }_{1\cdot 2}\left({\mathbf{x}}_1\right)d{\mathbf{x}}_1={\int }_{-\infty }^u{({\mu }_{1\cdot 2}+u)}_{i_1}\dots {({\mu }_{1\cdot 2}+u)}_{i_s}{\varphi }_{V_0}\left(u\right)du$$

for $0\le s\le k,1\le i_1,\dots ,i_s\le q_1$. So ${\overline{I}}^{1-k}$ can be expanded in terms of the partial moments of

$$\begin{array}{c}M={\mathrm{\Phi }}_{1\cdot 2}\left({\mathbf{x}}_1\right)={\mathrm{\Phi }}_{V_0}\left(u\right),\hfill \end{array}$$

(45)

$$\begin{array}{c}{\overline{M}}^{a-b}={\overline{M}}^{a-b}(u,V_0)=M_{i_a\dots i_b}(u,V_0)={\int }_{-\infty }^u{u}_{i_a}\dots u_{i_b}{\varphi }_{V_0}\left(u\right)du.\hfill \end{array}$$

(46)

This has only $q_1$ integrals, while (12) has q integrals.

Lemma 3.

For $u={\mathbf{x}}_1-{\mu }_{1\cdot 2}$, $y=V^{-1}x=\alpha +\mathrm{\Lambda }u$, where

$$\begin{array}{cc}\hfill & \mathrm{\Lambda }=\left({\displaystyle \genfrac{}{}{0pt}{}{{\mathbf{V}}^{11}}{{\mathbf{V}}^{21}}}\right)\in R^{q\times q_1},\alpha =\left({\displaystyle \genfrac{}{}{0pt}{}{{\alpha }_1}{{\alpha }_2}}\right),{\alpha }_1=0_{q_1},{\alpha }_2={\mathbf{V}}_{22}^{-1}{\mathbf{x}}_2.\hfill \end{array}$$

(47)

Proof. 

$y=\left({\displaystyle \genfrac{}{}{0pt}{}{{\mathbf{y}}_1}{{\mathbf{y}}_2}}\right)$, where ${\mathbf{y}}_i={\mathbf{V}}^{i1}{\mathbf{x}}_1+{\mathbf{V}}^{i2}{\mathbf{x}}_2={\alpha }_i+{\mathbf{V}}^{i1}u$, and ${\alpha }_i=A_i{\mathbf{x}}_2$ for $A_i$ of (20). □

Our main result, Theorem 2, gave the conditional distribution expansion in terms of ${\overline{I}}^{1-k}$ of (42). Note 4.1 gave these in terms of the derivatives of ${\mathrm{\Phi }}_V\left(x\right)$. We now give ${\overline{I}}^{1-k}$ in terms of ${\overline{J}}^{1-k}$, the partial moments of the conditional distribution ${\mathrm{\Phi }}_{1\cdot 2}\left({\mathbf{x}}_1\right)$ of (24). As in (10), for any $\pi =(m,\dots ,n)$, set ${\sum }^N{c}_{\pi }=\sum c_{\pi }$ summed over all, N say, permutations of $\pi$ giving distinct $c_{\pi }$. For example, ${\sum }^2{c}_{23}=c_{23}+c_{32}$.

Theorem 3.

Take ${\overline{J}}^{1-k}(x,V)$ of (11), u of (24), M of (45), ${\overline{M}}^{a-b}$ of (46), $\mathrm{\Lambda },\alpha$ of (47), and$1\le i_1,\dots ,i_k\le q$. Set

$$\begin{array}{cc}\hfill & {\overline{K}}^{1-k}=K^{i_1\dots i_k}={\int }_{-\infty }^u{\left(\mathrm{\Lambda }u\right)}_{i_1}\dots {\left(\mathrm{\Lambda }u\right)}_{i_k}{\varphi }_{V_0}\left(u\right)du={\mathrm{\Lambda }}_{i_1{j}_1}\dots {\mathrm{\Lambda }}_{i_k{j}_k}{M}^{j_1,\dots j_k},\hfill \end{array}$$

where $j_1,\dots j_k$ sum over their range $1,\dots ,q_1.$ So

$$\begin{array}{cc}\hfill & {\overline{K}}^{1-k}={\overline{\mathrm{\Lambda }}}_{1,k+1}\dots {\overline{\mathrm{\Lambda }}}_{k,2k}{\overline{M}}^{k+1-2k}.\hfill \\ \hfill & \mathit{For}\mathit{example},{\overline{K}}^1={\overline{\mathrm{\Lambda }}}_{12}{\overline{M}}^2,{\overline{K}}^{12}={\overline{\mathrm{\Lambda }}}_{13}{\overline{\mathrm{\Lambda }}}_{24}{\overline{M}}^{34},{\overline{K}}^{123}={\overline{\mathrm{\Lambda }}}_{14}{\overline{\mathrm{\Lambda }}}_{25}{\overline{\mathrm{\Lambda }}}_{36}{\overline{M}}^{456}.\hfill \end{array}$$

(48)

$$\begin{array}{cc}\hfill & \mathit{Set}{\overline{J}}_0^{1-k}={\overline{J}}^{1-k}(u,V_0)={\int }_{-\infty }^u{\overline{y}}_1\dots {\overline{y}}_k{\varphi }_{V_0}\left(u\right)du:\hfill \\ \hfill & {\overline{J}}_0^{1-k}={\overline{\alpha }}_1\dots {\overline{\alpha }}_{k}M+\sum ^{\left({\displaystyle \genfrac{}{}{0pt}{}{k}{1}}\right)}{\overline{\alpha }}_1\dots {\overline{\alpha }}_{k-1}{\overline{K}}^k+\sum ^{\left({\displaystyle \genfrac{}{}{0pt}{}{k}{2}}\right)}{\overline{\alpha }}_1\dots {\overline{\alpha }}_{k-2}{\overline{K}}^{k-1,k}+\dots +{\overline{K}}^{1-k}.\hfill \end{array}$$

(49)

$$\begin{array}{cc}\hfill & \mathit{For}\mathit{example},{\overline{J}}_0^1={\overline{\alpha }}_{1}M+{\overline{K}}^1,{\overline{J}}_0^{12}={\overline{\alpha }}_1{\overline{\alpha }}_{2}M+\sum ^2{\overline{\alpha }}_1{\overline{K}}^2+{\overline{K}}^{12},\hfill \\ \hfill & {\overline{J}}_0^{1-3}={\overline{\alpha }}_1{\overline{\alpha }}_2{\overline{\alpha }}_{3}M+\sum ^3({\overline{\alpha }}_1{\overline{\alpha }}_2{\overline{K}}^3+{\overline{\alpha }}_1{\overline{K}}^{23})+{\overline{K}}^{1-3},\hfill \\ \hfill & {\overline{J}}_0^{1-4}={\overline{\alpha }}_1\dots {\overline{\alpha }}_{4}M+\sum ^4({\overline{\alpha }}_1{\overline{\alpha }}_2{\overline{\alpha }}_3{\overline{K}}^4+{\overline{\alpha }}_1{\overline{K}}^{234})+\sum ^6{\overline{\alpha }}_1{\overline{\alpha }}_2{\overline{K}}^{34}+{\overline{K}}^{1-4},\hfill \\ \hfill & {\overline{J}}_0^{1-5}={\overline{\alpha }}_1\dots {\overline{\alpha }}_{5}M+\sum ^5({\overline{\alpha }}_1\dots {\overline{\alpha }}_4{\overline{K}}^5+{\overline{\alpha }}_1{\overline{K}}^{2-5})+\sum ^{10}({\overline{\alpha }}_1{\overline{\alpha }}_2{\overline{\alpha }}_3{\overline{K}}^{45}\hfill \\ \hfill & +{\overline{\alpha }}_1{\overline{\alpha }}_2{\overline{K}}^{3-5})+{\overline{K}}^{1-5},\hfill \\ \hfill & {\overline{J}}_0^{1-6}={\overline{\alpha }}_1\dots {\overline{\alpha }}_{6}M+\sum ^6({\overline{\alpha }}_1\dots {\overline{\alpha }}_5{\overline{K}}^6+{\overline{\alpha }}_1{\overline{K}}^{2-6})+\sum ^{15}({\overline{\alpha }}_1\dots {\overline{\alpha }}_4{\overline{K}}^{56}\hfill \\ \hfill & +{\overline{\alpha }}_1{\overline{\alpha }}_2{\overline{K}}^{3-6})+\sum ^{20}{\overline{\alpha }}_1{\overline{\alpha }}_2{\overline{\alpha }}_3{\overline{K}}^{4-6}+{\overline{K}}^{1-6},\hfill \\ \hfill & \mathit{For}{\overline{\mu }}^{1-2k}\mathit{of}(10),{\overline{I}}^1={\overline{J}}_0^1,{\overline{I}}^{12}={\overline{J}}_0^{12}-M{\overline{V}}^{12},{\overline{I}}^{1-3}={\overline{J}}_0^{1-3}-\sum ^3{\overline{J}}_0^1{\overline{V}}^{23},\hfill \\ \hfill & {\overline{I}}^{1-4}={\overline{J}}_0^{1-4}-\sum ^6{\overline{J}}_0^{12}{\overline{V}}^{34}+M{\overline{\mu }}^{1-4},{\overline{I}}^{1-5}={\overline{J}}_0^{1-5}-\sum ^{10}{\overline{J}}_0^{1-3}{\overline{V}}^{45}+\sum ^5{\overline{J}}_0^1{\overline{\mu }}^{2-5},\hfill \\ \hfill & {\overline{I}}^{1-6}={\overline{J}}_0^{1-6}-\sum ^{15}{\overline{J}}_0^{1-4}{\overline{V}}^{56}+\sum ^{15}{\overline{J}}_0^{12}{\overline{\mu }}^{3-6}-M{\overline{\mu }}^{1-6}.\hfill \end{array}$$

Proof. 

Since ${\mathbf{x}}_1=\mu +u,y=\mathrm{\Lambda }{\mathbf{x}}_1+\left({\displaystyle \genfrac{}{}{0pt}{}{{\mathbf{V}}^{12}}{{\mathbf{V}}^{22}}}\right){\mathbf{x}}_2=\alpha +\mathrm{\Lambda }u\in R^q.$ Substitute $y=\alpha +\mathrm{\Lambda }u$ into the expressions for ${\overline{H}}^{1-k}.$ Now multiply by ${\varphi }_{V_0}\left(u\right)$ and integrate from $-\infty$ to u. □

This gives the ${\overline{I}}^{1-k}$ needed for $g_1,g_2,G_1,G_2$. The ${\overline{I}}^{1-k},k=7,9$ needed for $g_3,G_3$ can be written down similarly in terms of the partial moments using ${\overline{H}}_q^{1-k}$ for $k=7,9.$ We now show that if $q_1=1$, we only need the partial moments of $\mathrm{\Phi }\left(v\right)$ at v of (36), and that these are easily written in terms of $\mathrm{\Phi }\left(v\right)$ and $\varphi \left(v\right)\times$ a polynomial in v of (36).

The case $q_1=1.$ So ${\mathbf{w}}_1=w_1,{\widehat{\mathbf{w}}}_1={\widehat{w}}_1,{\mathbf{X}}_1=X_1,{\mathbf{X}}_{n1}=X_{n1},{\mathbf{V}}_{11}=V_{11}.$

Theorem 4.

For $q_1=1$, $1\le k\le 6,{\overline{I}}^{1-k}$ is given by Theorem 3 with

$$\begin{array}{cc}\hfill & {\alpha }_1=0,{\overline{K}}^{1-k}={\overline{\mathrm{\Lambda }}}_1\dots {\overline{\mathrm{\Lambda }}}_k{\sigma }^k{\gamma }_k,\mathit{where}\mathrm{\Lambda }=\left({\displaystyle \genfrac{}{}{0pt}{}{V^{11}}{{\mathbf{V}}^{21}}}\right)\in R^q,\hfill \end{array}$$

$$\begin{array}{cc}\hfill & \sigma =V_{1\cdot 2}^{1/2}\mathit{of}(18),{\gamma }_k={\int }_{-\infty }^v{v}^k\varphi \left(v\right)dv,\mathit{for}v\mathit{of}(36).\hfill \end{array}$$

(50)

$$\mathit{So}{\gamma }_0=\mathrm{\Phi }\left(v\right),{\gamma }_1=-\varphi \left(v\right),{\gamma }_k=v^{k-1}{\gamma }_1+(k-1){\gamma }_{k-2},\mathit{for}k\ge 2:$$

(51)

$$\begin{array}{cc}\hfill & {\gamma }_2={\gamma }_0+v{\gamma }_1,{\gamma }_3=(v^2+2){\gamma }_1,{\gamma }_4=3{\gamma }_0+(v^3+3v){\gamma }_1,\hfill \\ \hfill & {\gamma }_5=(v^4+4v^2+4.2){\gamma }_1,{\gamma }_6=5.3{\gamma }_0+(v^5+5v^3+5.3v){\gamma }_1,\hfill \\ \hfill & {\gamma }_7=(v^6+6v^4+6.4v^2+6.4.2){\gamma }_1,\hfill \\ \hfill & {\gamma }_8=7.5.3{\gamma }_0+(v^7+7v^5+7.5v^3+7.5.3v){\gamma }_1,\hfill \\ \hfill & {\gamma }_9=(v^8+8v^6+8.6v^4+8.6.4v^2+8.6.4.2){\gamma }_1,\hfill \end{array}$$

where dot denotes multiplication. Also, $G_0=\mathrm{\Phi }\left(v\right)$.

Proof. 

For v of (36), by (23), ${\varphi }_{1\cdot 2}\left(x_1\right)={\sigma }^{-1}\varphi \left(v\right).$ (51) follows from integration by parts. By (48), $K^{1-k}={\overline{\mathrm{\Lambda }}}_1\dots {\overline{\mathrm{\Lambda }}}_k{M}^{1^k}$ where $M^{1^k}={\int }_{-\infty }^u{u}^{k}d\mathrm{\Phi }(u/\sigma )={\sigma }^k{\gamma }_k.$ That $G_0=\mathrm{\Phi }\left(v\right),$ follows from (39). □

By (37), for $C_r$ of (32) and v of (36), the conditional distribution of $X_{n1\cdot 2}$ is

$$\begin{array}{c}P(X_{n1\cdot 2}/\sigma \le v)\approx \mathrm{\Phi }\left(v\right)+\sum _{r=1}^{\infty }{n}^{-r/2}{G}_r,\mathrm{where}{G}_r=C_r\otimes g_r,\hfill \end{array}$$

(52)

as in (43), and $g_r$ is given by (40) in terms of the integrated Hermite polynomial, ${\overline{I}}^{1-k}$ of (42) given by Theorems 3 and 4.

4. The Case ${\mathit{q}}_{\mathbf{1}}={\mathit{q}}_{\mathbf{2}}=\mathbf{1}$

Theorem 3.2 gave the conditional Edgeworth expansion in terms of ${\overline{I}}^{1-k}$ of (42). Theorem 3.3 gave ${\overline{I}}^{1-k}$ needed for $g_{rk}$ of (41) and $G_1,G_2$ of (37), in terms of the partial moments ${\overline{M}}^{a-b}$ of (46). When $q_1=1$, Theorem 4 gave ${\overline{I}}^{1-k}$ in terms of $\mathrm{\Phi }\left(v\right)$ and its partial moments for v of (36). But now $q=2$ so that $i_1,\dots ,i_k=1$ or 2. So for $(I,y,Y)$ of (9), we switch notation to

$$\begin{array}{c}{H}_{ab}={(-{\partial }_1)}^a{(-{\partial }_2)}^b{\varphi }_V\left(x\right)=E{(y_1+I{Y}_1)}^a{(y_2+I{Y}_2)}^b,\hfill \\ H_{ab}^{\ast }={(-{\partial }_1)}^a{(-{\partial }_2)}^b{\mathrm{\Phi }}_V\left(x\right)={\int }_{-\infty }^x{H}_{ab}{\varphi }_V\left(x\right)dx.\hfill \\ \mathrm{So}{H}_{ab}^{\ast }=H_{a-1,b-1}{\varphi }_V\left(x\right)\mathrm{if}a\ge 2,b\ge 1,\hfill \\ H_{10}^{\ast }={\int }_{-\infty }^{x_2}{\varphi }_V\left(x\right)d{x}_2={\partial }_1{\mathrm{\Phi }}_V\left(x\right),H_{a0}^{\ast }={(-{\partial }_1)}^{a-1}{H}_{10}^{\ast }\mathrm{if}a\ge 2,\hfill \\ H_{01}^{\ast }={\int }_{-\infty }^{x_1}{\varphi }_V\left(x\right)d{x}_1={\partial }_2{\mathrm{\Phi }}_V\left(x\right),H_{0b}^{\ast }={(-{\partial }_2)}^{b-1}{H}_{01}^{\ast }\mathrm{if}b\ge 1,\hfill \end{array}$$

$$L^{1^a{2}^b}={(-{\partial }_1)}^a{(-{\partial }_2)}^{b+1}{\mathrm{\Phi }}_V\left(x\right)=H_{a,b+1}^{\ast },$$

(53)

for ${\overline{L}}^{1-k}$ of (44). Similarly, write (2) as

$${\kappa }_{ab}({\widehat{w}}_1,{\widehat{w}}_2)\approx \sum _{d=a+b-1}^{\infty }{n}^{-d}{k}_{abd},\mathrm{for}a+b\ge 1,\mathrm{where}{k}_{abd}=k_d^{1^a{2}^b},\mathrm{and}$$

$$\begin{array}{c}\mathrm{set}{K}_{ab}=K^{1^a{2}^b},J_{ab}=J_0^{1^a{2}^b},I_{ab}=I^{1^a{2}^b}={\int }_{-\infty }^{x_1}{H}_{ab}\left(x\right){\varphi }_{1\cdot 2}\left(x_1\right)d{x}_1.\hfill \end{array}$$

(54)

Also, we switch from ${\overline{P}}_r^{1-k}$ to

$$\begin{array}{c}{P}_r\left(ab\right)=\left({\displaystyle \genfrac{}{}{0pt}{}{a+b}{a}}\right)P_r^{1^a{2}^b}.\hfill \end{array}$$

given for $r\le 3$ in Section 4 of [3]. So,

$${\tilde{p}}_{rk}=\sum _{b=0}^k{P}_r(k-b,b)H_{k-b,b},P_{rk}\left(x\right)=\sum _{b=0}^k{P}_r(k-b,b)H_{k-b,b}^{\ast }.$$

(55)

$$\begin{array}{c}\mathrm{So},{\tilde{p}}_{r1}=P_r\left(10\right)H_{10}+P_r\left(01\right)H_{01},{\tilde{p}}_{11}=k_{101}{y}_1+k_{011}{y}_2,\hfill \\ {\tilde{p}}_{13}=P_1\left(30\right)H_{30}+P_1\left(21\right)H_{21}+P_1\left(12\right)H_{12}+P_1\left(03\right)H_{03}.\hfill \end{array}$$

$P_r\left(ba\right)$ is just $P_r\left(ab\right)$ with 1 and 2 reversed. For the other ${\tilde{p}}_{rk}$ and $P_{rk}\left(x\right)$ needed for $r\le 3$, see Section 4 of [3]. Our main result for this section, Theorem 7, gives simple formulas for $I_{ab}$ and for $g_r$ of (40), the main ingredient needed in Theorem 2 for the expansion of the conditional distribution.

Theorem 5.

The conditional density of $X_{n1\cdot 2}$ of (15), is given by Theorem 1 where $f_r=p_r^{\ast }\left({\mathbf{x}}_2\right)$ is given by (28) in terms of

$$\begin{array}{cc}\hfill & p_{rk}^{\ast }=P_r\left(0k\right)H_k^{\ast },\mathit{where}{H}_k^{\ast }=H_k(z,V_{22})\mathit{and}z=V_{22}^{-1}{x}_2.\hfill \end{array}$$

(56)

$$\begin{array}{cc}\hfill & \mathit{For}\mathit{example},H_1^{\ast }=z,H_2^{\ast }=z^2-V_{22}^{-1},H_3^{\ast }=z^3-3z{V}_{22}^{-1},\hfill \end{array}$$

(57)

$$\begin{array}{cc}\hfill & H_4^{\ast }=z^4-15z^2{V}_{22}^{-1}+3V_{22}^{-2},H_5^{\ast }=z^5-10z^3{V}_{22}^{-1}+15z{V}_{22}^{-2},\hfill \end{array}$$

(58)

$$\begin{array}{cc}\hfill & H_6^{\ast }=z^6-15z^4{V}_{22}^{-1}+45z^2{V}_{22}^{-2}-15V_{22}^{-3}.\hfill \end{array}$$

(59)

Proof. 

This follows from Theorem 1. □

Theorem 6 gives a laborious expression for the conditional distribution.

However Theorem 7 gives a huge simplification.

Theorem 6.

The conditional distribution of $X_{n1\cdot 2}$ of (15), is given by Theorem 2 with $\mathrm{\Lambda },\sigma ,{\gamma }_s$ of Theorem 4 as follows. For $k-r$ even, $g_{rk}$ of (41) is given by

$$\begin{array}{cc}\hfill & g_{rk}=\sum _{b=0}^k{P}_r(k-b,b)I_{k-b,b},\hfill \end{array}$$

(60)

where $I_{ab}$ of (54) is given for $a+b=k$, as follows in terms of ${\mathrm{\Lambda }}_i=V^{i1}$.

$$K_{ab}={\mathrm{\Lambda }}_1^a{\mathrm{\Lambda }}_2^b{\sigma }^{a+b}{\gamma }_{a+b},\mathit{and}{J}_{k0}=\sum _{s=0}^k{\alpha }_1^{k-s}{K}_{s0},\mathit{for}{K}_{s0}={\left({\mathrm{\Lambda }}_1\sigma \right)}^s{\gamma }_s.$$

(61)

$$\begin{array}{cc}\hfill & \mathit{For}k=1:I_{10}=J_{10}={\alpha }_1{\gamma }_0+{\mathrm{\Lambda }}_1\sigma {\gamma }_1.\hfill \\ \hfill & \mathit{For}k=2:I_{20}=J_{20}-{\gamma }_0{V}^{11},I_{11}=J_{11}-{\gamma }_0{V}^{12},\hfill \end{array}$$

$$\begin{array}{cc}\hfill & J_{11}={\alpha }_1{\alpha }_2{\gamma }_0+\sigma {\gamma }_1\sum ^2{\alpha }_1{\mathrm{\Lambda }}_2+{\mathrm{\Lambda }}_1{\mathrm{\Lambda }}_2{\sigma }^2{\gamma }_2.\hfill \\ \hfill & \mathit{For}k=3:I_{30}=J_{30}-3J_{10}{V}^{11},I_{21}=J_{21}-(2J_{10}{V}^{12}+J_{01}{V}^{11}),\hfill \\ \hfill & J_{21}={\alpha }_1^2{\alpha }_2{\gamma }_0+X_{21}+X_{12}+K_{21},\mathit{where}\hfill \\ \hfill & X_{21}={\alpha }_1^2{K}_{01}+2{\alpha }_1{\alpha }_2{K}_{10},X_{12}=2{\alpha }_1{K}_{11}+{\alpha }_2{K}_{20}.\hfill \\ \hfill & \mathit{For}k=4:I_{40}=J_{40}-6J_{20}{V}^{11}+3{\gamma }_0{\left(V^{11}\right)}^2,\hfill \\ \hfill & I_{31}=J_{31}-S_6+{\gamma }_0{S}_3,\mathit{where}{S}_6=3J_{20}{V}^{22}+3J_{11}{V}^{12},S_3=3V^{11}{V}^{12},\hfill \\ \hfill & J_{31}={\alpha }_1^3{\alpha }_2{\gamma }_0+X_{31}+X_{22}+X_{13}+K_{31},\mathit{where}{X}_{31}={\alpha }_1^3{K}_{01}+3{\alpha }_1^2{\alpha }_2{K}_{10},\hfill \\ \hfill & X_{22}=4{\alpha }_1^2{K}_{11}+2{\alpha }_1{\alpha }_2{K}_{20},X_{13}=3{\alpha }_1{K}_{21}+6{\alpha }_2{K}_{30},\hfill \\ \hfill & I_{22}=J_{22}-S_6+{\gamma }_0{S}_3,\mathit{where}{S}_6=J_{20}{V}^{22}+4J_{11}{V}^{12}+J_{02}{V}^{11},\hfill \\ \hfill & S_3={\mu }^{1122}=V^{11}{V}^{22}+2{\left(V^{12}\right)}^2,\hfill \\ \hfill & J_{22}={\alpha }_1^2{\alpha }_2^2{\gamma }_0+X_{31}+X_{22}+X_{13}+K_{22},\mathit{where}{X}_{31}=2{\alpha }_1^2{\alpha }_2{K}_{01}+2{\alpha }_1{\alpha }_2^2{K}_{02},\hfill \\ \hfill & X_{22}={\alpha }_1^2{K}_{02}+4{\alpha }_1{\alpha }_2{K}_{11}+{\alpha }_2^2{K}_{20},X_{13}=2{\alpha }_1{K}_{12}+2{\alpha }_2{K}_{21}.\hfill \\ \hfill & \mathit{For}k=5:I_{50}=J_{50}-10J_{30}{V}^{11}+15J_{10}{\left(V^{11}\right)}^2,\hfill \\ \hfill & I_{41}=J_{41}-S_{10}+S_{15},\mathit{where}{S}_{10}=6J_{21}{V}^{11}+4J_{30}{V}^{12},\hfill \\ \hfill & S_{15}=12J_{10}{V}^{11}{V}^{12}+3J_{01}{\left(V^{11}\right)}^2,\hfill \\ \hfill & J_{41}={\alpha }_1^4{\alpha }_2{\gamma }_0+X_{41}+X_{32}+X_{23}+X_{14}+K_{41},\mathit{where},\hfill \\ \hfill & X_{41}=4{\alpha }_1^3{\alpha }_2{K}_{10}+{\alpha }_1^4{K}_{01},X_{32}=5{\alpha }_1^2{\alpha }_2{K}_{20}+5{\alpha }_1^3{K}_{11},\hfill \\ \hfill & X_{23}=6{\alpha }_1^2{K}_{21}+4{\alpha }_1{\alpha }_2{K}_{30},X_{14}=4{\alpha }_1{K}_{31}+{\alpha }_2{K}_{40},\hfill \\ \hfill & I_{32}=J_{32}-S_{10}+S_{15},\mathit{where}{S}_{10}=3J_{12}{V}^{11}+6J_{21}{V}^{12}+J_{30}{V}^{22},\hfill \\ \hfill & S_{15}=3J_{10}{\mu }^{1122}+6J_{01}{V}^{11}{V}^{12},\hfill \\ \hfill & J_{32}={\alpha }_1^3{\alpha }_2^2{\gamma }_0+X_{41}+X_{32}+X_{23}+X_{14}+K_{32},\mathit{where},\hfill \\ \hfill & X_{41}=3{\alpha }_1^2{\alpha }_2^2{K}_{10}+2{\alpha }_1^3{\alpha }_2{K}_{01},X_{32}=3{\alpha }_1{\alpha }_2^2{K}_{20}+6{\alpha }_1^2{\alpha }_2{K}_{11}+{\alpha }_1^3{K}_{02},\hfill \\ \hfill & X_{23}=3{\alpha }_1^2{K}_{12}+6{\alpha }_1{\alpha }_2{K}_{21}+{\alpha }_2^2{K}_{30},X_{14}=3{\alpha }_1{K}_{22}+2{\alpha }_2{K}_{31}.\hfill \\ \hfill & \mathit{For}k=6:I_{60}=J_{60}-15J_{40}{V}^{11}+45J_{20}{\left(V^{11}\right)}^2-15{\gamma }_0{\left(V^{11}\right)}^3,\hfill \\ \hfill & I_{51}=J_{51}-S_{15}+S_{45}-{\gamma }_0{S}_{15}^{\prime },\mathit{where}{S}_{15}=5V^{12}{J}_{40}+10V^{11}{J}_{31},\hfill \\ \hfill & S_{45}=30V^{11}{V}^{12}{J}_{20}+15{\left(V^{11}\right)}^2{J}_{11},S_{15}^{\prime }=15{\gamma }_0{\left(V^{11}\right)}^2{V}^{12},\hfill \\ \hfill & J_{51}={\alpha }_1^5\alpha 2{\gamma }_0+X_{51}+X_{42}+X_{33}+X_{24}+X_{15}+K_{51},\mathit{where}\hfill \\ \hfill & X_{51}={\alpha }_1^5{K}_{01}+5{\alpha }_1^4{\alpha }_2{K}_{10},X_{42}=5{\alpha }_1^4{K}_{11}+10{\alpha }_1^3{\alpha }_2{K}_{20},\hfill \\ \hfill & X_{33}=10{\alpha }_1^3{K}_{21}+10{\alpha }_1^2{\alpha }_2{K}_{30},X_{24}=10{\alpha }_1^2{K}_{31}+5{\alpha }_1{\alpha }_2{K}_{40},\hfill \\ \hfill & X_{15}={\alpha }_2{K}_{60}+5{\alpha }_1{K}_{51},\hfill \\ \hfill & I_{42}=J_{42}-S_{15}+S_{45}-{\gamma }_0{S}_{15}^{\prime },\mathit{where}{S}_{15}=V^{22}{J}_{40}+6V^{11}{J}_{22}+8V^{12}{J}_{31},\hfill \\ \hfill & S_{45}=3{\left(V^{11}\right)}^2{J}_{02}+6{\mu }^{1122}{J}_{20}+24V^{11}{V}^{12}{J}_{11},\hfill \\ \hfill & S_{15}^{\prime }=3{\left(V^{11}\right)}^2{V}^{22}+24(V^{11}{V}^{12}{)}^2+6V^{11}{\mu }^{1122},\hfill \\ \hfill & J_{42}={\alpha }_1^4{\alpha }_2^2{\gamma }_0+X_{51}+X_{42}+X_{33}+X_{24}+X_{15}+K_{42},\mathit{where}\hfill \\ \hfill & X_{51}=2{\alpha }_1^5{K}_{01}+4{\alpha }_1^4{\alpha }_2{K}_{10},X_{42}={\alpha }_1^4{K}_{02}+8{\alpha }_1^3{\alpha }_2{K}_{11}+6{\alpha }_1^2{\alpha }_2^2{K}_{20},\hfill \\ \hfill & X_{33}=10{\alpha }_1^2{\alpha }_2{K}_{12}+10{\alpha }_1{\alpha }_2^2{K}_{21},\hfill \\ \hfill & X_{24}={\alpha }_2^2{K}_{40}+8{\alpha }_1{\alpha }_2{K}_{31}+6{\alpha }_1^2{K}_{22},X_{15}=2{\alpha }_2{K}_{50}+4{\alpha }_1{K}_{41},\hfill \\ \hfill & I_{33}=J_{33}-S_{15}+S_{45}-{\gamma }_0{S}_{15}^{\prime },\mathit{where}{S}_{15}=6V^{11}{J}_{04}+9V^{12}{J}_{22}+6V^{22}{J}_{40},\hfill \\ \hfill & S_{45}=9V^{12}{V}^{22}{J}_{20}+9{\mu }^{1122}{J}_{11}+9V^{12}{V}^{11}{J}_{02},S_{15}^{\prime }=6V^{11}{V}^{12}{V}^{22}+3V^{12}{\mu }^{1122},\hfill \\ \hfill & J_{33}={\alpha }_1^3{\alpha }_2^3{\gamma }_0+X_{51}+X_{42}+X_{33}+X_{24}+X_{15}+K_{33},\mathit{where}\hfill \\ \hfill & X_{51}=2{\alpha }_1^2{\alpha }_2^3{K}_{10}+3{\alpha }_1^3{\alpha }_2^2{K}_{01},X_{42}=6{\alpha }_1{\alpha }_2^3{K}_{20}+3{\alpha }_1^3{\alpha }_2^3{K}_{11}+6{\alpha }_1^3{\alpha }_2{K}_{02},\hfill \\ \hfill & X_{33}={\alpha }_1^3{K}_{03}+9{\alpha }_1^2{\alpha }_2{K}_{12}+9{\alpha }_1{\alpha }_2^2{K}_{21}+{\alpha }_2^3{K}_{30},\hfill \\ \hfill & X_{24}=6{\alpha }_1^2{K}_{13}+3{\alpha }_1{\alpha }_2{K}_{22}+8{\alpha }_2^2{K}_{31},X_{15}=3{\alpha }_1{K}_{23}+3{\alpha }_2{K}_{32}.\hfill \end{array}$$

Also $J_{ba},I_{ba}$ are $J_{ab},I_{ab}$ with ${\alpha }_1,{\mathrm{\Lambda }}_1=V^{11}$ and ${\alpha }_2,{\mathrm{\Lambda }}_2=V^{21}$ of (47) reversed, before setting ${\alpha }_1=0$ and ${\alpha }_2=z=V_{22}^{-1}{x}_2$ by (27). For example, by (61), for $\mathrm{\Lambda },\sigma ,{\gamma }_s$ of Theorem 3.4,

$$\begin{array}{cc}\hfill & I_{10}={\alpha }_1{\gamma }_0+{\mathrm{\Lambda }}_1\sigma {\gamma }_1=V^{11}\sigma {\gamma }_1,I_{01}={\alpha }_2{\gamma }_0+{\mathrm{\Lambda }}_2\sigma {\gamma }_1=z{\gamma }_0+V^{11}\sigma {\gamma }_1,\hfill \end{array}$$

(62)

$$\begin{array}{cc}\hfill & J_{k0}=K_{k0}={\left(V^{11}\sigma \right)}^k{\gamma }_k,J_{0k}=\sum _{s=0}^k{z}^{k-s}{K}_{0s}=z{J}_{0,k-1}+K_{0k}\hfill \end{array}$$

(63)

$$\mathit{where}{K}_{0s}={\left(V^{21}\sigma \right)}^s{\gamma }_s.$$

Proof 

This follows from Theorems 3 and 4. □

This gives the ${\overline{I}}_{ab}$ needed for $g_1,g_2,G_1,G_2$ for the conditional distribution of (37)–(39) to $O\left(n^{-3/2}\right)$. The ${\overline{I}}_{ab}$ needed for $g_3,G_3$ can be written down similarly. We now give a much simpler method for obtaining $g_{rk}$ of (41), and so $g_r$ by (40), and $G_r$ needed for (37) by (38). Theorem 7 gives $g_{rk}$ and $g_r$ in terms of $I_{0k}$ of (54). Theorem 4.4 gives $I_{0k}$ in terms of $J_{0k}$ of (63), a function of $(\mathrm{\Lambda },\sigma ,{\gamma }_s)$ of Theorem 3.4.

Theorem 7.

For v of (36), $I_{ab}$ of (54) is given by

$$\begin{array}{cc}\hfill & I_{ab}=-H_{a-1,b}{\sigma }^{-1}\varphi \left(v\right),\mathit{for}a\ge 1.\hfill \end{array}$$

(64)

For $k\ge r\ge 1$ and $k-r$ even, $g_{rk}$ of (41) is given by

$$\begin{array}{cc}\hfill & g_{rk}=P_r\left(0k\right)I_{0k}-b_{rk}{\sigma }^{-1}\varphi \left(v\right),\mathit{for}{b}_{rk}=\sum _{a=1}^k{P}_r(a,k-a)H_{a-1,k-a}.\hfill \end{array}$$

(65)

So by (40), for $r\ge 1,g_r$ of (39) is given by

$$\begin{array}{cc}\hfill & g_r=\sum _{k=1}^{3r}[P_r\left(0k\right)I_{0k}-b_{rk}{\sigma }^{-1}\varphi \left(v\right):k-r\mathit{even}].\hfill \end{array}$$

(66)

Proof. 

By (60), $g_{rk}=P_r\left(0k\right)I_{0k}+{\sum }_{a=1}^k{P}_r(a,k-a)I_{a,k-a}.$

By (23), ${\varphi }_{1\cdot 2}\left(x_1\right)/{\varphi }_V\left(x\right)={\theta }^{-1}$ where $\theta ={\varphi }_{V_{22}}\left(x_2\right)$ and ${\varphi }_{1\cdot 2}\left(x_1\right)={\sigma }^{-1}\varphi \left(v\right).$

$$\begin{array}{cc}\hfill & \mathrm{So}\mathrm{for}a\ge 1,H_{ab}{\varphi }_V\left(x\right)={(-{\partial }_1)}^a{(-{\partial }_2)}^b=-{\partial }_1\left[H_{a-1,b}{\varphi }_V\left(x\right)\right].\hfill \\ \hfill & \mathrm{So}{I}_{ab}={\theta }^{-1}{\int }_{-\infty }^{x_1}{H}_{ab}{\varphi }_V\left(x\right)d{x}_1=-{\theta }^{-1}{H}_{a-1,b}{\varphi }_V\left(x\right)=-H_{a-1,b}{\sigma }^{-1}\varphi \left(v\right).\hfill \end{array}$$

This proves (64). So,

$$\begin{array}{cc}\hfill & g_{rk}=P_r\left(0k\right)I_{0k}-{\theta }^{-1}{\varphi }_V\left(x\right)\sum [P_r\left(ab\right)H_{a-1,b}:a+b=k,a\ge 1].\hfill \end{array}$$

(65) follows. (66) now follows from (28). □

Note 2.

$b_{rk}$ is just ${\tilde{p}}_{rk}$ of (55) with $(H_{0b},H_{ab})$ replaced by $(0,H_{a-1,b})$ for $a\ge 1$.

So for $r=1,2,3,b_{rk}$ is given in terms of $P_r(.)$ of Section 4, by

$$\begin{array}{c}{b}_{r1}=P_r\left(10\right)=k_r^1=k_{10r},b_{r3}=P_r\left(30\right)H_{20}+P_r\left(21\right)H_{11}+P_r\left(12\right)H_{02},\hfill \end{array}$$

(67)

$$\begin{array}{c}{b}_{22}=P_2\left(20\right)H_{10}+P_2\left(11\right)H_{01},\hfill \end{array}$$

(68)

$$b_{24}=P_2\left(40\right)H_{30}+P_2\left(31\right)H_{21}+P_2\left(22\right)H_{12}+P_2\left(13\right)H_{03}.$$

(69)

$$\begin{array}{c}{b}_{26}=P_2\left(60\right)H_{50}+P_2\left(51\right)H_{41}+P_2\left(42\right)H_{32}+P_2\left(33\right)H_{23}+P\left(24\right)H_{14}\hfill \\ +P_2\left(15\right)H_{05},\hfill \\ b_{35}=P_3\left(50\right)H_{40}+P_3\left(41\right)H_{31}+P_3\left(32\right)H_{22}+P_3\left(23\right)H_{13}+P_3\left(14\right)H_{04},\hfill \\ b_{37}=P_3\left(70\right)H_{60}+P_3\left(61\right)H_{51}+P_3\left(52\right)H_{42}+P_3\left(43\right)H_{33}+P_3\left(34\right)H_{24}\hfill \\ +P_3\left(25\right)H_{15}+P_3\left(16\right)H_{06},\hfill \end{array}$$

$$\begin{array}{c}{b}_{39}=P_3\left(90\right)H_{80}+P_3\left(81\right)H_{71}+P_3\left(72\right)H_{62}+P_3\left(63\right)H_{53}+P_3\left(54\right)H_{44}\hfill \\ +P_3\left(45\right)H_{35}+P_3\left(36\right)H_{26}+P_3\left(27\right)H_{17}+P_3\left(18\right)H_{08}.\hfill \end{array}$$

(70)

This gives $g_{rk}$ and $g_r$ of (40) for $r\le 3$, and so the conditional distribution $P_{1\cdot 2}\left(x_1\right)$ of (37), to $O\left(n^{-2}\right)$, in terms of $I_{0k}$ of (54) and the coefficients $P_r\left(ab\right)$.

Theorem 8.

The $I_{0k}$ needed for $g_1,g_2,g_3$ of (66) and (38) are given in terms of ${\gamma }_0=\mathrm{\Phi }\left(v\right),v$ of (36), and $J_{0k}$ of (63), by

$$\begin{array}{cc}\hfill & I_{01}=J_{01},I_{02}=J_{02}-{\gamma }_0{V}^{22},I_{03}=J_{03}-3J_{01}{V}^{22},\hfill \\ \hfill & I_{04}=J_{04}-6J_{02}{V}^{22}+3{\gamma }_0{\left(V^{22}\right)}^2,\hfill \\ \hfill & I_{05}=J_{05}-10J_{03}{V}^{22}+15J_{01}{\left(V^{22}\right)}^2,\hfill \\ \hfill & I_{06}=J_{06}-15J_{04}{V}^{22}+45J_{02}{\left(V^{22}\right)}^2-15{\gamma }_0{\left(V^{22}\right)}^3,\hfill \\ \hfill & I_{07}=J_{07}-21J_{05}{V}^{22}+105J_{03}{\left(V^{22}\right)}^2-105J_{01}{\left(V^{22}\right)}^3,\hfill \\ \hfill & I_{08}=J_{08}-28J_{06}{V}^{22}+210J_{04}{\left(V^{22}\right)}^2-420J_{02}{\left(V^{22}\right)}^3+105{\gamma }_0{\left(V^{22}\right)}^4,\hfill \\ \hfill & I_{09}=J_{09}-36J_{07}{V}^{22}+378J_{05}{\left(V^{22}\right)}^2-1260J_{03}{\left(V^{22}\right)}^3+945J_{01}{\left(V^{22}\right)}^4.\hfill \end{array}$$

Proof. 

For $k\le 6,I_{0k}$ follow from Theorem 2.

By the proof of Theorem 3, $I_{0k}$ can be read off [3] and the univariate Hermite polynomials $H_k\left(u\right)$ given in terms of $I=\sqrt{-1}$ by expanding

$$\begin{array}{cc}\hfill & H_k=H_k\left(u\right)=\varphi {\left(u\right)}^{-1}{(-d/du)}^k\varphi \left(u\right)=E{(u+IN)}^k,\mathrm{for}k\ge 0.\hfill \end{array}$$

□

To summarise, the conditional density of $X_{n1\cdot 2}$ of (15), is given by Theorem 5, and the conditional distribution is given by (37), (41) in terms of $g_r$ of (66) and $I_{0k}$ of Theorem 8.

Example 1.

Conditioning when $\widehat{w}\in R^2$ is the mean of a sample with cumulants ${\kappa }_{ab}$. The non-zero $P_r\left(ab\right)$ were given in Example 6 of [3]. So $b_{rk}=0$ for $\left(rk\right)=\left(11\right),\left(22\right),\left(31\right),\left(33\right),$ and for $r=1,2,3,$ other $b_{rk}$ are given by (67)–(70) starting

$$\begin{array}{cc}\hfill & 6b_{13}={\kappa }_{30}{H}_{20}+3{\kappa }_{21}{H}_{11}+{\kappa }_{12}{H}_{02},\hfill \end{array}$$

(71)

$$\begin{array}{cc}\hfill & 24b_{24}={\kappa }_{40}{H}_{30}+4{\kappa }_{31}{H}_{21}+6{\kappa }_{22}{H}_{12}+4{\kappa }_{13}{H}_{03},\hfill \end{array}$$

(72)

$$\begin{array}{cc}\hfill & 72b_{26}={\kappa }_{30}^2{H}_{50}+6{\kappa }_{30}{\kappa }_{21}{H}_{41}+3(2{\kappa }_{30}{\kappa }_{12}+3{\kappa }_{21}^2)H_{32}+12({\kappa }_{30}{\kappa }_{03}\hfill \\ \hfill & +9{\kappa }_{21}{\kappa }_{12})H_{23}+3(2{\kappa }_{03}{\kappa }_{21}+3{\kappa }_{12}^2)H_{14}+6{\kappa }_{03}{\kappa }_{12}{H}_{05}.\hfill \end{array}$$

(73)

The relative conditional density is given to $O\left(n^{-2}\right)$ by (33) in terms of ${\tilde{p}}_r$ of (6), ${\tilde{p}}_{rk}$ of (55), $f_r=p_r^{\ast }\left(x_2\right)$ of (28) for $r\le 3$, and $H_k^{\ast }$ of (56) for $k\le 9$.

$$\begin{array}{cc}\hfill & \mathit{So},f_1=p_{13}^{\ast }=P_1\left(03\right)H_3^{\ast },P_1\left(03\right)={\kappa }_{03}/6,\hfill \\ \hfill & f_2=p_{24}^{\ast }+p_{26}^{\ast },p_{24}^{\ast }=P_2\left(04\right)H_4^{\ast },P_2\left(04\right)={\kappa }_{04}/24,\hfill \\ \hfill & p_{26}^{\ast }=P_2\left(06\right)H_6^{\ast },P_2\left(06\right)={\kappa }_{03}^2/72,\hfill \end{array}$$

$$\begin{array}{cc}\hfill & f_3=\sum _{k=5,7,9}{p}_{3k}^{\ast },p_{3k}^{\ast }=P_3\left(0k\right)H_k^{\ast },P_3\left(05\right)={\kappa }_{05}/120,\hfill \\ \hfill & P_3\left(07\right)={\kappa }_{04}{\kappa }_{03}/144,P_3\left(09\right)={({\kappa }_{03}/6)}^3.\hfill \end{array}$$

The conditional distribution is given by (52) with $g_r$ of (66), starting

$$\begin{array}{cc}\hfill & G_0=g_0=\mathrm{\Phi }\left(v\right),g_1={\kappa }_{03}{I}_{03}/6-b_{13}{\sigma }^{-1}\varphi \left(v\right),\hfill \end{array}$$

(74)

$$\mathit{for}v\mathrm{of}(36),\mathit{with}{\sigma }^2=V_0={\kappa }_{20}-{\kappa }_{11}^2/{\kappa }_{02},{\mu }_{1\cdot 2}={\kappa }_{11}{\kappa }_{02}^{-1}{x}_2,$$

$I_{03}$ of Theorem 8, and $b_{13}$ of (71). As noted this is a far simpler result than using Theorem 6.

$$\begin{array}{cc}\hfill & \mathit{Similarly},g_2={\kappa }_{04}{I}_{04}/24+{\kappa }_{03}^2{I}_{06}/72-(b_{24}+b_{26}){\sigma }^{-1}\varphi \left(v\right),\hfill \\ \hfill & g_3=\sum _{k=5,7,9}[P_3\left(0k\right)I_{0k}-b_{3k}{\sigma }^{-1}\varphi \left(v\right)],\hfill \end{array}$$

for $b_{24},b_{26}$ of (72), (73) and $b_{3k}$ above.

Example 2.

We now build on  the entangled gamma  model of Example 7 of [3], which gave the $P_r\left(ab\right)$ needed. Let $G_0,G_1,G_2$ be independent gamma random variables with means $\gamma ={\gamma }_0,{\gamma }_1,{\gamma }_2$. For $i=1,2$, set $X_i=G_0+G_i,w_i=E{X}_i=\gamma +{\gamma }_i$, and let $\widehat{w}$ be the mean of a random sample of size n distributed as $(X_1,X_2)$. So, $E\widehat{w}=w,$ and $n\widehat{w}\stackrel{\mathcal{L}}{=}{(G_{n0}+G_{n1},G_{n0}+G_{n2})}^{\prime }$ where $G_{n0},G_{n1},G_{n2}$ are independent gamma random variables with means $n\gamma ,n{\gamma }_1,n{\gamma }_2$. The rth order cumulants of $X={(X_1,X_2)}^{\prime }$ are ${\kappa }^{i^r}=(r-1)!w_i,$ and otherwise $(r-1)!\gamma$. Now suppose that ${\gamma }_i\equiv 1$, the entangled exponential model. So $q=2$, $X_{n1}$ and $X_{n2}$ have correlation $1/2$,

$$\begin{array}{cc}\hfill & V=\left(\begin{array}{cc}2& 1\\ 1& 2\end{array}\right),V_{12}{V}_{22}^{-1}=1/2,V_{1\cdot 2}=3/2,V^{-1}=\left(\begin{array}{cc}2& -1\\ -1& 2\end{array}\right)/3,\hfill \\ \hfill & P\left(X_{n1}\right|({\mathbf{X}}_{n2}={\mathbf{x}}_2)<x_1(x_2,u))=\mathrm{\Phi }\left(u\right)+O\left(n^{-1/2}\right),\hfill \end{array}$$

for $x_1(x_2,v)$ of (25), that is, $x_1(x_2,u)=x_2/2+{(3/2)}^{1/2}u$. Figure 1 plots the conditional asymptotic quantiles of $X_{n1\cdot 2}$, that is, $x_1(x_2,u)$, for $\mathrm{\Phi }\left(u\right)=0.01,0.0025,0.1,0,0.9,0.975,0.99$. To $O\left(n^{-1/2}\right)$, given n and $\widehat{\mathbf{w}}$, this figure is equivalent to a figure of $w_1$ versus $w_2$. That is, Figure 1 shows to $O\left(n^{-1/2}\right)$, the likely value of $w_1={\widehat{w}}_1-n^{-1/2}{x}_1$ for a given value of $w_2={\widehat{w}}_2-n^{-1/2}{x}_2.$ In fact by (26), $-X_{n1\cdot 2}=n^{1/2}(w_1-{\widehat{w}}_{1\cdot 2})$ lies between the outer limits with probability 0.98+$O\left(n^{-1}\right)$. So although labelled as $x_1$ versus $x_2$, the figure can be viewed as showing the likely value of $w_1={\widehat{w}}_1-n^{-1/2}{x}_1$ for a given value of $w_2={\widehat{w}}_2-n^{-1/2}{x}_2.$

We now give $C_r$ of (31), $D_r$ of (33), $H_k^{\ast }$ and $p_{rk}^{\ast }$ of (56), and $g_r$ for $G_r$, the coefficients of the expansion for the conditional distribution of (37).

$$\begin{array}{cc}\hfill & \mathit{So},P_1\left(03\right)=2/3,P_1\left(21\right)=1,P_2\left(04\right)=1/2,P_2\left(31\right)=1,P_2\left(22\right)=3/2,\hfill \\ \hfill & P_2\left(06\right)=2/9,P_2\left(51\right)=2/3,P_2\left(42\right)=7/6,P_2\left(33\right)=26/3\hfill \\ \hfill & P_3\left(05\right)=2/5,P_3\left(41\right)=1,P_3\left(32\right)=2,P_3\left(07\right)=1/3,P_3\left(61\right)=P_3\left(52\right)=5/2,\hfill \\ \hfill & P_3\left(43\right)=3,P_3\left(09\right)=8/27,P_3\left(81\right)=4/27,P_3\left(72\right)=10/27,\hfill \\ \hfill & P_3\left(63\right)=47/756,P_3\left(54\right)=59/945.\hfill \\ \hfill & \mathit{By}\mathit{Theorem}8,\mathit{to}3\mathit{decimal}\mathit{places},I_{03}=J_{03}-2J_{01}=-0.586,\hfill \\ \hfill & I_{04}=J_{04}-4J_{02}+4{\gamma }_0/3=0.871,I_{05}=J_{05}-20J_{03}/3+20J_{01}/9=0.709,\hfill \\ \hfill & I_{06}=J_{06}-10J_{04}+20J_{02}-40{\gamma }_0/9=-3.187,\hfill \\ \hfill & I_{07}=J_{07}-14J_{05}+140J_{03}/3-280J_{01}/9=-12.857,\hfill \\ \hfill & I_{08}=J_{08}-56J_{06}/3+280J_{04}/3-1120J_{02}/3+560{\gamma }_0/27=12.077,\hfill \\ \hfill & I_{09}=J_{09}-24J_{07}+168J_{05}-1120J_{03}+560J_{01}/3=28.278.\hfill \end{array}$$

By Note 2, ${\tilde{p}}_{rk}$ of Example 7 of [3], symmetry, and (66),

$$\begin{array}{cc}\hfill & b_{13}=5H_{20}/3+H_{11},b_{24}=3H_{40}/2+2H_{31},b_{26}=[7H_{50}+12H_{41}+19H_{32}]/9,\hfill \\ \hfill & b_{35}=[3H_{40}+2H_{31}+H_{22}]/5,b_{37}=[9H_{60}+19H_{51}+30H_{42}+18H_{33}]/6,\hfill \\ \hfill & b_{39}=[44H_{80}+83H_{71}+206H_{62}+159H_{53}]/27,\hfill \\ \hfill & g_1=2I_{03}/3+b_{13}{\sigma }^{-1}{\gamma }_1,g_2=I_{04}/2+2I_{06}/9-b_{24}-b_{26},\hfill \\ \hfill & g_3=2I_{05}/5+I_{07}/3+8I_{09}/27-b_{35}-b_{37}-b_{39}.\hfill \end{array}$$

Let us work through 2 numerical examples to get the conditional distribution to $O\left(n^{-2}\right)$. We build on Example 7 of [3]. By Theorem 5, if $x_2=1,$ then $z=1/2$,

$$\begin{array}{cc}\hfill & H_3^{\ast }=-5/8,H_4^{\ast }=-17/16,H_6^{\ast }=-89/64,\hfill \\ \hfill & H_5^{\ast }=41/32,H_7^{\ast }=-461/2^7,H_9^{\ast }=6481/2^9,\hfill \\ \hfill & -C_1=f_1=-5/12,p_{24}^{\ast }=-17/32,p_{26}^{\ast }=-89/288,f_2=-121/144,\hfill \\ \hfill & p_{35}^{\ast }=41/80,p_{37}^{\ast }=-461/384,p_{39}^{\ast }=6481/1728,f_3=52921/17280,\hfill \\ \hfill & C_2=83/72,C_3=-39571/17280.\hfill \end{array}$$

We worked to 8 significant figures, but display less. If $x={(1,1)}^{\prime }$, then

$$\begin{array}{cc}\hfill & D_1=-113/324=-0.349,D_2=120199/2^3{3}^8=2.290,\hfill \\ \hfill & D_3=8896102087/2^7{3}^{12}5=26.156.\hfill \end{array}$$

So to $O\left(n^{-2}\right)$ the relative conditional density of (33) for $n=4,16,64,$ is

$$\begin{array}{cc}\hfill & {(1,1,1)}^{\prime }-{(2^{-1},4^{-1},8^{-1})}^{\prime }0.349+{(4^{-1},{16}^{-1},{64}^{-1})}^{\prime }2.290\hfill \\ \hfill & +{(8^{-1},{64}^{-1},2^{-9})}^{\prime }26.156=\left(\begin{array}{cccc}1& -0.174& +0.573& +3.269\\ 1& -0.087& +0.143& +0.409\\ 1& -0.044& +0.036& +0.051\end{array}\right),\hfill \end{array}$$

so that for $n=4$ and 16 we can only include two terms, and for $n=64$, only three terms. We now give the 1st 3 $g_r,G_r$, needed by (37) for the conditional distribution to $O\left(n^{-2}\right)$. By (50), ${\sigma }^2=3/2,{\sigma }^2=1.225$. By (17), ${\mu }_{1\cdot 2}=x_2/2$.

$$\begin{array}{cc}\hfill & \mathit{For}x={(1,1)}^{\prime },{\mu }_{1\cdot 2}=1/2,\mathit{and}\mathit{by}(18),v=6^{-1/2}=0.408\hfill \\ \hfill & G_0=g_0={\gamma }_0=\mathrm{\Phi }\left(v\right)=0.658,{\gamma }_1=-\varphi \left(v\right)=-0.367,{\gamma }_2=0.509,{\gamma }_3=-0.795,\hfill \\ \hfill & {\gamma }_4=1.501,{\gamma }_5=-3.191,{\gamma }_6=7.500,{\gamma }_7=-19.150,{\gamma }_8=52.500,{\gamma }_9=-153.200.\hfill \\ \hfill & K_{0s}={(-6^{-1/2})}^s{\gamma }_s\Rightarrow K_{01}=0.150,K_{02}=0.0848,K_{03}=0.0541,K_{04}=0.0417,\hfill \\ \hfill & K_{05}=0.0362,K_{06}=0.03472,K_{07}=0.0362,K_{08}=0.0405,K_{09}=0.0483.\hfill \\ \hfill & \mathit{So}\mathit{by}(63),J_{01}=0.479,J_{02}=0.0203,J_{03}=0.372,J_{04}=0.0738,\hfill \\ \hfill & J_{05}=0.0731,J_{06}=0.0713,J_{07}=0.0718,J_{08}=0.441,J_{09}=0.269.\hfill \\ \hfill & \mathit{So}\mathit{for}x={(1,1)}^{\prime },b_{13}=-13/27=-0.481,g_1=-0.246,\hfill \\ \hfill & b_{24}=-47/54,b_{26}=2726/2107,g_2=-0.696,b_{35}=10/27,b_{37}=-9371/4374,\hfill \\ \hfill & b_{39}=163806/59049=2.774,g_3=3.375.\hfill \\ \hfill & \mathit{By}(38),G_1=g_1+C_1{g}_0=0.0281,G_2=-0.040,G_3=0.762.\hfill \end{array}$$

For example for $n=4,16,64,$ to $O\left(n^{-2}\right),P(X_{n1}<1|X_{n2}=1)=$

$$\begin{array}{cc}\hfill & 0.658+0.0141-0.01000+0.0952,n=4,\hfill \\ \hfill & 0.658+0.00703-0.00250+0.0119,n=16,\hfill \\ \hfill & 0.658+0.00351-0.000625+0.00149,n=64,\hfill \end{array}$$

so that divergence begins with the 4th term.

$$\begin{array}{cc}\hfill & \mathit{If}{x}_2=2\mathit{then}z=1,H_3^{\ast }=-1/2,H_4^{\ast }=-23/4,H_6^{\ast }=23/8,H_5^{\ast }=-1/4,\hfill \\ \hfill & H_7^{\ast }=29/8,H_9^{\ast }=-175/16,-C_1=f_1=-1/3,p_{24}^{\ast }=-23/4,p_{26}^{\ast }=23/36,\hfill \\ \hfill & f_2=161/72,p_{35}^{\ast }=-1/10,p_{37}^{\ast }=29/24,p_{39}^{\ast }=-175/54,\hfill \\ \hfill & f_3=-2303/1080=-2.132,C_2=-17/8=-2.125,C_3=733/1080=0.679.\hfill \\ \hfill & \mathit{If}x={(2,2)}^{\prime },\mathit{then}{D}_1=-37/81=-0.457,D_2=0.387,D_3=13.313.\hfill \end{array}$$

So to $O\left(n^{-2}\right)$ the relative conditional density of (33) for $n=4,16,64,$ is

$$\begin{array}{cc}\hfill & {(1,1,1)}^{\prime }-{(2^{-1},4^{-1},8^{-1})}^{\prime }0.457+{(4^{-1},{16}^{-1},{64}^{-1})}^{\prime }0.387\hfill \\ \hfill & +{(8^{-1},{64}^{-1},2^{-9})}^{\prime }13.313=\left(\begin{array}{cccc}1& -0.228& +0.0969& +1.664\\ 1& -0.114& +0.0242& +0.208\\ 1& -0.0571& +0.00605& +0.0260,\end{array}\right),\hfill \end{array}$$

so that we can only include three terms. Finally, we now give the 1st three $g_r,G_r$, needed by (37) for the conditional distribution to $O\left(n^{-2}\right)$.

$$\begin{array}{cc}\hfill & \mathit{For}x={(2,2)}^{\prime },{\mu }_{1\cdot 2}=1,v={(2/3)}^{1/2}=0.816,G_0={\gamma }_0=\mathrm{\Phi }\left(v\right)=0.793,\hfill \\ \hfill & {\gamma }_1=-\varphi \left(v\right)=-0.286,{\gamma }_2=0.559,{\gamma }_3=-0.762,{\gamma }_4=1.522,\hfill \\ \hfill & {\gamma }_5=-3.176,{\gamma }_6=7.511,{\gamma }_7=-19.142,{\gamma }_8=52.505,{\gamma }_9=-153.190.\hfill \\ \hfill & K_{0s}={(-6^{-1/2})}^s{\gamma }_s\Rightarrow K_{01}=0.117,K_{02}=0.0932,K_{03}=0.0519,K_{04}=0.0423,\hfill \\ \hfill & K_{05}=0.0360,K_{06}=0.0348,K_{07}=0.0362,K_{08}=0.0405,K_{09}=0.0483.\hfill \\ \hfill & \mathit{So}\mathit{by}(63),J_{01}=0.910,J_{02}=1.0028,J_{03}=1.055,J_{04}=1.097,\hfill \\ \hfill & J_{05}=1.133,J_{06}=1.168,J_{07}=1.204,J_{08}=1.249,J_{09}=1.293.\hfill \\ \hfill & I_{03}=-0.764,I_{04}=-1.877,I_{05}=-3.877,I_{06}=6.731,I_{07}=6.263,\hfill \\ \hfill & I_{08}=-276.110,I_{09}=-848.735,\hfill \\ \hfill & b_{13}=11/27,g_1=-0.605,b_{24}=-26/27,b_{26}=1660/2187,g_2=0.771,\hfill \\ \hfill & b_{35}=-138/405,b_{37}=20,128/4374,b_{39}=1,795,048/3^{10},g_3=-224.802.\hfill \\ \hfill & \mathit{By}(38),G_1=g_1+C_1{g}_0=0.0180,G_2=-2.463,G_3=4.204.\hfill \end{array}$$

For example for $n=4,16,64,$ to $O\left(n^{-2}\right),P(X_{n1}<2|X_{n2}=2)=$

$$\begin{array}{cc}\hfill & 0.793+0.00902-0.616+0.525,n=4,\hfill \\ \hfill & 0.793+0.00451-0.154+0.131,n=16,\hfill \\ \hfill & 0.793+0.00226-0.0385+0.0164,n=64,\hfill \end{array}$$

so that divergence begins with the 3rd term.

Example 3.

Conditioning when the distribution of $\widehat{w}$ is symmetric about w. Then for r odd, $C_r=D_r=g_{rk}=g_r=0$. By (33), the conditional density is

$$p_{n1\cdot 2}\left({\mathbf{x}}_1\right)={\sigma }^{-1}\varphi \left(v\right)[1+n^{-1}{D}_2+O\left(n^{-2}\right)],\mathit{where}{D}_2={\tilde{p}}_2\left(x\right)-p_2^{\ast }\left(x_2\right),$$

for ${\tilde{p}}_2\left(x\right)$ of Example 1 of [3], $H_k^{\ast }$ of (56), and

$$\begin{array}{cc}\hfill & p_2^{\ast }\left(x_2\right)=k_{022}{H}_2^{\ast }/2+k_{043}{H}_4^{\ast }/24.\hfill \end{array}$$

By (52), the conditional distribution of $X_{n1\cdot 2}$ is

$$\begin{array}{cc}\hfill & \mathrm{\Phi }\left(v\right)+n^{-1}{G}_2+O\left(n^{-2}\right),\mathit{where}{G}_2=g_2-p_2^{\ast }\left(x_2\right)\mathrm{\Phi }\left(v\right),\hfill \\ \hfill & g_2=\sum _{k=2,4}[P_2\left(0k\right)I_2\left(0k\right)-b_{2k}{\sigma }^{-1}\varphi \left(v\right)],\hfill \end{array}$$

for $b_{2k}$ of (68) and (69).

Example 4.

Discussions of pivotal statistics advocate using the distribution of a sample mean, given the sample variance. So $q=2.$ Let ${\widehat{w}}_2,{\widehat{w}}_2$ be the usual unbiased estimates of the mean and variance from a univariate random sample of size n from a distribution with rth cumulant ${\kappa }_r$. So $w_1={\kappa }_1,w_2={\kappa }_2.$ By the last 2 equations of Section 12.15 and (12.35)–(12.38) of [20], the cumulant coefficients needed for ${\overline{P}}_r^{1-k}$ of (3) for $r\le 3$, – the coefficients needed for the conditional density to $O\left(n^{-2}\right)$, in terms of $(i_1^{j_1}{i}_2^{j_2}\dots )={\kappa }_{i_1}^{j_1}{\kappa }_{i_2}^{j_2}\dots$, are

$$\begin{array}{cc}\hfill & k_{201}={\kappa }_2,k_{111}={\kappa }_3,k_{021}={\kappa }_4+2{\kappa }_2^2,\Rightarrow V=\left(\begin{array}{cc}{\kappa }_2& {\kappa }_3\\ {\kappa }_3& {\kappa }_4+2{\kappa }_2^2\end{array}\right),\hfill \\ \hfill & k_{101}=k_{011}=0,k_{302}={\kappa }_3,k_{212}=k_{122}=0,k_{032}=\left(6\right)+12\left(24\right)+4\left(3^2\right)+8\left(2^3\right),\hfill \\ \hfill & k_{202}=k_{112}=0,k_{022}=2\left(2^2\right),k_{403}=\left(4\right),k_{313}=\left(5\right),\hfill \\ \hfill & k_{223}=k_{133}=0,k_{043}=\left(8\right)+24\left(26\right)+32\left(35\right)+32\left(4^2\right)+144\left(2^{2}4\right)+96\left({23}^2\right)\hfill \\ \hfill & +48\left(2^4\right),k_{102}=k_{012}=k_{303}=k_{213}=k_{123}=0,k_{033}=12\left(24\right)+16\left(2^3\right),\hfill \\ \hfill & k_{504}=k_{324}=k_{234}=k_{144}=0,k_{414}=\left(6\right),k_{054}=\left(10\right)+40\left(28\right)+80\left(37\right)\hfill \\ \hfill & +200\left(46\right)+96\left(5^2\right)+480\left(2^{2}6\right)+1280\left(235\right)+1280\left({24}^2\right)+960\left(3^{2}4\right)+1920\left(2^{3}4\right)\hfill \\ \hfill & +1920\left(2^2{3}^2\right)+384\left(2^5\right).\hfill \end{array}$$

(33) gives $D_r$ in terms of ${\tilde{p}}_r$ and $p_r^{\ast }$, that is, in terms of ${\tilde{p}}_{rk}$ and $p_{rk}^{\ast }$ of (28) in terms of $P_r\left(ab\right)$. In this example, many of these are 0. The non-zero $P_r\left(ab\right)$ are in order needed,

$$\begin{array}{cc}\hfill & P_1\left(30\right)={\kappa }_3/6,P_1\left(03\right)=k_{032}/6,P_2\left(02\right)={\kappa }_2^2,P_2\left(40\right)={\kappa }_4/24,\hfill \\ \hfill & P_2\left(04\right)=k_{043}/24,P_2\left(32\right)={\kappa }_5/6,P_2\left(60\right)={\kappa }_3^2/72,\hfill \\ \hfill & P_2\left(06\right)=k_{032}^2/72,P_2\left(33\right)={\kappa }_3{k}_{032}/36.P_3\left(03\right)=k^{033}/6.\hfill \\ \hfill & P_3\left(05\right)=k_{054}/120+k_{022}{k}_{032}/12.P_3\left(70\right)={\kappa }_3{\kappa }_4/144,P_3\left(07\right)=k^{032}{k}_{042}/144,\hfill \\ \hfill & P_3\left(62\right)={\kappa }_3{k}_{313}/36,P_3\left(43\right)=k_{032}{\kappa }_4/144,P_3\left(34\right)=({\kappa }_3{k}_{043}+k_{022}{k}_{313})/144,\hfill \\ \hfill & P_3\left(90\right)={\kappa }_3/6^3,P_3\left(09\right)={(k_{032}/6)}^3,P_3\left(63\right)=3{\kappa }_3^2{k}_{032}/6^3,\hfill \\ \hfill & P_3\left(36\right)=3{\kappa }_3{k}_{032}^2/6^3.\hfill \\ \hfill & \mathit{So},{\tilde{p}}_{11}=0,{\tilde{p}}_{13}=P_1\left(30\right)H_{30}+P_1\left(03\right)H_{03},{\tilde{p}}_{22}=P_2\left(02\right)H_{02},\hfill \\ \hfill & {\tilde{p}}_{24}=P_2\left(40\right)H_{40}+P_2\left(04\right)H_{04}+P_2\left(32\right)H_{31},{\tilde{p}}_{26}=P_2\left(60\right)H_{60}+P_2\left(06\right)H_{06}\hfill \\ \hfill & +P_2\left(33\right)H_{33},{\tilde{p}}_{31}=0,{\tilde{p}}_{33}=P_3\left(30\right)H_{30}+P_3\left(03\right)H_{03},{\tilde{p}}_{35}=P_3\left(05\right)H_{05},\hfill \\ \hfill & {\tilde{p}}_{37}=P_3\left(70\right)H_{70}+P_3\left(2^7\right)H_{07}+P_3\left(62\right)H_{61}+P_3\left(43\right)H_{43}+P_3\left(34\right)H_{34}\hfill \\ \hfill & +P_3\left(25\right)H_{25}+P_3\left(16\right)H_{16}+P_3\left(07\right)H_{07},\hfill \\ \hfill & {\tilde{p}}_{39}=P_3\left(90\right)H_{90}+P_3\left(63\right)H_{63}+P_3\left(36\right)H_{36}+P_3\left(09\right)H_{09}.\hfill \\ \hfill & \mathit{Also},b_{13}=P_1\left(30\right)H_{20},b_{22}=P_2\left(20\right)H_{10}+P_2\left(11\right)H_{01},\hfill \\ \hfill & b_{24}=P_2\left(40\right)H_{30}+P_2\left(31\right)H_{21},b_{26}=P_2\left(60\right)H_{50}+P_2\left(33\right)H_{23},\hfill \\ \hfill & b_{31}=0,b_{33}=P_3\left(30\right)H_{20},b_{35}=0,\hfill \\ \hfill & b_{37}=P_3\left(70\right)H_{60}+P_3\left(61\right)H_{51}+P_3\left(43\right)H_{33}+P_3\left(34\right)H_{24},\hfill \\ \hfill & b_{39}=P_3\left(90\right)H_{80}+P_3\left(63\right)H_{53}+P_3\left(36\right)H_{26}.\hfill \end{array}$$

For $r=1,2,3,{\tilde{p}}_r\left(x\right)$ is now given by (13), $p_r^{\ast }\left(x\right)$, and Section 2 of [3]. By (4) and (33), this gives the conditional density $p_{n1\cdot 2}\left({\mathbf{x}}_1\right)$ to $O\left(n^{-2}\right)$. And (66) gives $g_r$ needed for the conditional distribution $P_{n1\cdot 2}\left({\mathbf{x}}_1\right)$ to $O\left(n^{-2}\right)$.

5. Conclusions

Conditioning is a very useful and basic way to use correlated information to reduce the variability of an estimate. These results provide the means to obtain conditional regions and 1- or 2-sided conditional confidence intervals.

Section 4 gave the conditional density and distribution of ${\mathbf{X}}_{n1}$ given ${\mathbf{X}}_{n2}$ to $O\left(n^{-2}\right)$ where $\left({\displaystyle \genfrac{}{}{0pt}{}{{\mathbf{X}}_{n1}}{{\mathbf{X}}_{n2}}}\right)$ is any partition of $X_n=n^{1/2}(\widehat{w}-w)$. The expansion (33) gave the conditional density of any multivariate standard estimate. Our main result, an explicit expansion for the conditional distribution (37) to $O\left(n^{-2}\right)$, is given in terms of the leading ${\overline{I}}^{1-k}$ of (42). These are given explicitly by Theorems 3.3 and 3.4.

When $q_1=q_2=1,$ Theorem 4.1 simplified the conditional density expansion, and Theorem 7 gave a huge simplification, and the coefficients of the conditional distribution expansion in terms of $I_{0k}=I^{2^k}$ of Theorem 4.4.

Cumulant coefficients can also be used to obtain estimates of bias $O\left(n^{-k}\right)$ for $k\ge 2$: see [21,22,23].

6. Discussion

Ref. [3] gave the density and distribution of $X_n=n^{1/2}(\widehat{w}-w)$ to $O\left(n^{-2}\right)$, for $\widehat{w}\in R^q$ any standard estimate, in terms of functions of the cumulant coefficients ${\overline{k}}_j^{1-r}$ of (2), called the Edgeworth coefficients, ${\overline{P}}_r^{1-k}$.

Most estimates of interest are standard estimates, including smooth functions of sample moments, like the sample skewness, kurtosis, correlation, and any multivariate function of k-statistics. (These are unbiased estimates of cumulants and their products, the most common example being that for a variance.) Unbiased estimates are not needed for Edgeworth expansions, although this does simplify the Edgeworth coefficients, as seen in Examples 1, 2, and 4. However unbiased estimates are not available for most parameters or functions of them, such as the ratio of two means or variances, except for special cases of exponential families. Ref. [1] gave the cumulant coefficients for smooth functions of standard estimates.

A good approximation for the distribution of an estimate, is vital for accurate inference. It enables one to explore the distribution’s dependence on underlying parameters. Our analytic method avoids the need for simulation or jack-knife or bootstrap methods while providing greater accuracy than any of them. Ref. [10] used the Edgeworth expansion to show that the bootstrap gives accuracy to $O\left(n^{-1}\right)$. Ref. [24] said that “2nd order correctness usually cannot be bettered”. But this is not true using our analytic method. Simulation, while popular, can at best shine a light on behaviour, only when there is a small number of parameters, and only for limited values of their range.

Estimates based on a sample of independent, but not identically distributed random vectors, are also generally standard estimates. For example, for a univariate sample mean $\overline{X}=n^{-1}{\sum }_{j=1}^n{X}_{jn}$ where $X_{jn}$ has rth cumulant ${\kappa }_{rjn}$, then ${\kappa }_r\left(\overline{X}\right)=n^{1-r}{\kappa }_r$ where ${\kappa }_r=n^{-1}{\sum }_{j=1}^n{\kappa }_{rjn}$ is the average rth cumulant. For some examples, see [2,25,26,27] The last is for a function of a weighted mean of complex random matrices.

For conditions for the validity of multivariate Edgeworth expansions, see [28] and its references, and Appendix C of [3].

While the use of Edgeworth-Cornish-Fisher expansions is widespread, few papers address how to deal with their divergence for small sample sizes. Refs. [29,30] avoided this question as it did not arise in their examples. In contrast we confronted this in Example 2, the examples of Withers (1984), and in Example 7 of [3].

We now turn to conditioning. Conditioning on ${\widehat{\mathbf{w}}}_2$ makes inference on ${\mathbf{w}}_1$ more precise by reducing the covariance of the estimate. The covariance of ${\widehat{\mathbf{w}}}_1|{\widehat{\mathbf{w}}}_2$ can be substantially less than that of ${\widehat{\mathbf{w}}}_1$. See the references at the end of Section 1.

A conditional distribution by tilting, was first given by [31] up to $O\left(n^{-1}\right)$, for a bivariate sample mean. See Chapter 4 of [32], Compare [8]. Tilting (also known as small sample asympotics, or saddlepoint expansioins), was first used in statistics by [33]. He gave an approximation to the density of a sample mean, good for the whole line, not just in the region where the Central Limit Theorem approximation holds.

Future directions.

1. The results here give the first step for constructing confidence intervals and confidence regions of higher order accuracy. See [6,34]. What is needed next, is an application of [1] to obtain the cumulant coefficients of ${\widehat{\theta }}_i={\widehat{\mathbf{V}}}_{ii}^{-1/2}({\widehat{\mathbf{w}}}_i-{\mathbf{w}}_i),i=1,2,$ or those of $\widehat{\theta }={\widehat{V}}^{-1/2}(\widehat{\mathbf{w}}-\mathbf{w})$. This should be straightforward.

2. When $q_1=1$, our expansion for the conditional distribution of ${\mathbf{X}}_{n1\cdot 2}$ of (15), can be inverted using the Lagrange Inversion Theorem, to give expansions for its percentiles. This should be straightforward. (The quantile expansions of [29] and Withers (1984) do not apply as Appendix A shows that conditional estimates of standard estimates are not standard estimates.)

3. Here we have only considered expansions about the normal. However expansions about other distributions can greatly reduce the number of terms by matching the leading bias coefficient. The framework for this is [2], building on [34]. For expansions about a matching gamma, see [35,36].

4. The results here can be extended to tilted (saddlepoint) expansions by applying the results of [2]. The tilted version of the multivariate distribution and density of a standard estimate are given by Corollaries 3, 4 there, and that of the conditional distribution and density follow from these. For the entangled gamma of Example 2, this requires solving a cubic. See also [37].

5. A possible alternative approach to finding the conditional distribution, is to use conditional cumulants, when these can be found. Section 6.2 of [38] uses conditional cumulants to give the conditional density of a sample mean to $O\left(n^{-3/2}\right)$. Section 5.6 of [39] gave formulas for the 1st 4 cumulants conditional on ${\mathbf{X}}_2={\mathbf{x}}_2$ only when ${\mathbf{X}}_1$ and ${\mathbf{X}}_2$ are uncorrelated. He says that this assumption can be removed, but gives no details how. That is unlikely to give an alternative to our approach, for as well as giving expansions for the first 3 conditional cumulants, Appendix A shows that the conditional estimate is not a standard estimate.

6. Lastly we discuss numerical computation. We have used [40] for our calculations. Its input is $V^{11},V^{12},V^{22}$ and $y_1,y_2$, - not $V_{11},V_{12},V_{22}$ and $x_1,x_2$. There is a function sub2(sb1,sb2) which takes as argument the two subscripts of mu, and returns the value. If global variables mu20, mu02, mu11 are symbolic variables (defined using sympy) then it returns the answer in terms of those, but if they are numeric then it returns a numeric answer. There is another function called biHermite(n, m, y1, y2) which takes the 2 subscripts of H. If y1 and y2 are symbolic, then it returns a symbolic answer, but if they are numeric it returns a numeric answer. A numerical example is given by Example 2, that is, for the case $V_{11}=2,V_{12}=1,V_{22}=2$ and $x_1=x_2=1$ or $x_1=x_2=2$.

Similar software for numerical calculations for Theorems 5, 7 and 8 would be invaluable, as would software for applying the Lagrange Inversion Theorem. (We mention R-4.4.1 for Windows: dmvnorm for the density function of the multivariate normal, mvtnorm for the multivariate normal, qmvnorm for quantiles, and rmvnorm to generate multivariate normal variables.) On bivariate Hermite polynomials, see cran.r-project.org/web/packages/calculus/vignettes/hermite.html accessed on 20 December 2024.