# Composite Tests under Corrupted Data

^{1}

^{2}

^{3}

^{4}

^{5}

^{*}

## Abstract

**:**

## 1. Introduction

#### Statement of the Test Problem

## 2. An Extension of the Likelihood Ratio Test

**Remark**

**1.**

**Proposition**

**2.**

## 3. Minimax Tests under Noisy Data, Least-Favorable Hypotheses

#### 3.1. An Asymptotic Definition for the Least-Favorable Hypotheses

**Theorem**

**3.**

#### 3.2. Identifying the Least-Favorable Hypotheses

**Proposition**

**4.**

#### 3.3. Numerical Performances of the Minimax Test

- In the first case, ${f}_{0}$ is a normal density with expectation 0 and variance 1, whereas ${g}_{0}$ is a normal density with expectation $0.3$ and variance $1$.
- The second case handles a situation where ${f}_{0}$ and ${g}_{0}$ belong to different models: ${f}_{0}$ is a log-normal density with location parameter 1 and scale parameter $0.2$, whereas ${g}_{0}$ is a Weibull density on ${\mathbb{R}}^{+}$ with shape parameter 5 and scale parameter $3$. Those two densities differ strongly, in terms of asymptotic decay. They are, however, very close to one another in terms of their symmetrized Kullback-Leibler divergence (the so-called Jeffrey distance). Indeed, centering on the log-normal distribution ${f}_{0}$, the closest among all Weibull densities is at distance $0.10$—the density ${g}_{0\phantom{\rule{4.pt}{0ex}}}$ is at distance $0.12$ from ${f}_{0}.$

- The noise ${h}_{\delta}$ is a centered normal density with variance ${\delta}^{2}$;
- the noise ${h}_{\delta}$ is a centered Laplace density with parameter $\lambda \left(\delta \right)$;
- the noise ${h}_{\delta}$ is a symmetrized Weibull density with shape parameter $1.5$ and variable scale parameter $\beta \left(\delta \right)$; and
- the noise ${h}_{\delta}$ is Cauchy with density ${h}_{\delta}\left(x\right)=\gamma \left(\delta \right)/\pi (\gamma {\left(\delta \right)}^{2}+{x}^{2})$.

#### 3.3.1. Case A: The Shift Problem

#### Theoretical Power Bound

#### Numerical Power Bound

#### Comparison of the Two Power Curves

#### 3.3.2. Case B: The Tail Thickness Problem

## 4. Some Alternative Statistics for Testing

#### 4.1. A Family of Composite Tests Based on Divergence Distances

#### 4.2. A Practical Choice for Composite Tests Based on Simulation

#### 4.2.1. Case A: The Shift Problem

- Under Gaussian noise, the power remains mostly stable over the values of ${\delta}_{\ast}$, as shown by Figure 5. The tests with statistics ${T}_{n}^{1}$ and ${T}_{n}^{2}$ are equivalently powerful for large values of ${\delta}_{\ast}$, while the first one achieves higher power when ${\delta}_{\ast}$ is small.
- When the noise follows a Laplace distribution, the three power curves overlap the NP power curve, and the different test statistics can be indifferently used. Under such a noise, the alternative hypotheses are extremely well distinguished by the class of tests considered, and this remains true as ${\delta}_{\ast}$ increases (cf. Figure 6).
- Under the Weibull hypothesis, ${T}_{n}^{1}$ and ${T}_{n}^{2}$ perform similarly well, and almost always as well as ${T}_{n,{\delta}_{\ast}}^{1}$, while the power curve associated to ${T}_{n}^{1/2}$ remains below. Figure 7 illustrates that, as ${\delta}_{max}$ increases, the power does not decrease much.
- Under a Cauchy assumption, the alternate hypotheses are less distinguishable than under any other parametric hypothesis on the noise, since the maximal power is about 0.84, while it exceeds 0.9 in cases a, b, and c (cf. Figure 5, Figure 6, Figure 7 and Figure 8). The capacity of the tests to discriminate between $\mathbf{H}\mathbf{0}\left({\delta}_{max}\right)$ and $\mathbf{H}\mathbf{1}\left({\delta}_{max}\right)$ is almost independent of the value of ${\delta}_{max}$, and the power curves are mainly flat.

#### 4.2.2. Case B: The Tail Thickness Problem

- With the noise defined by case A (Gaussian noise), for KL ($\gamma =1$), ${\delta}_{\ast}={\delta}_{max}$ due to Proposition 4 and statistics ${T}_{n}^{1}$ provides the best power uniformly upon ${\delta}_{max}.$ Figure 9 shows a net decrease of the power as ${\delta}_{max}$ increases (recall that the power is evaluated under the least favorable alternative ${G}_{{\delta}_{max}}$).
- When the noise follows a Laplace distribution, the situation is quite peculiar. For any value of $\delta $ in $\Delta $, the modes ${M}_{{G}_{{\delta}_{max}}}\phantom{\rule{4pt}{0ex}}$ and ${M}_{{F}_{{\delta}_{max}}}$ of the distributions of $\left(\right)open="("\; close=")">{f}_{\delta}/{g}_{\delta}$ under ${G}_{{\delta}_{max}}$ and under ${F}_{{\delta}_{max}}$ are quite separated; both larger than $1.$ Also, for $\delta $ all the values of $\left|{\varphi}_{\gamma}\right({M}_{{G}_{{\delta}_{max}}})-{\varphi}_{\gamma}({M}_{{F}_{{\delta}_{max}}}\left)\right|$ are quite large for large values of $\gamma .$ We may infer that the distributions of ${\varphi}_{\gamma}\left(\right)open="("\; close=")">\left(\right)open="("\; close=")">{f}_{\delta}/{g}_{\delta}$ under ${G}_{{\delta}_{max}}$ and under ${F}_{{\delta}_{max}}$ are quite distinct for all $\delta $, which in turn implies that the same fact holds for the distributions of ${T}_{n}^{\gamma}$ for large $\gamma .$ Indeed, simulations presented in Figure 10 show that the maximal power of the test tends to be achieved when $\gamma =2.$
- When the noise follows a symmetric Weibull distribution, the power function when $\gamma =1$ is very close to the power of the LRT between ${F}_{{\delta}_{max}}$ and ${G}_{{\delta}_{max}}$ (cf. Figure 11). Indeed, uniformly on $\delta $, and on x, the ratio $\left(\right)open="("\; close=")">{f}_{\delta}/{g}_{\delta}$ is close to 1. Therefore, the distribution of ${T}_{n}^{1}$ is close to that of ${T}_{n,{\delta}_{max}}^{1}$, which plays in favor of the KL composite test.
- Under a Cauchy distribution, similarly to case A, Figure 12 shows that ${T}_{n}^{\gamma}$ achieves the maximal power for $\gamma =1$ and 2, closely followed by $\gamma =0.5$.

## 5. Conclusions

## Author Contributions

## Funding

## Acknowledgments

## Conflicts of Interest

## Appendix A. Proof of Proposition 2

#### Appendix A.1. The Critical Region of the Test

#### Appendix A.2. The Power Function

#### Appendix A.3. A Synthetic Result

## Appendix B. Proof of Theorem 3

**Theorem**

**A1.**

**Remark**

**A2.**

## Appendix C. Proof of Proposition 4

**Lemma**

**A3.**

**Proof.**

**Lemma**

**A4.**

**Proof.**

**Lemma**

**A5.**

**Proof.**

## References

- Broniatowski, M.; Jurečková, J.; Kalina, J. Likelihood ratio testing under measurement errors. Entropy
**2018**, 20, 966. [Google Scholar] [CrossRef] - Guo, D. Relative entropy and score function: New information-estimation relationships through arbitrary additive perturbation. In Proceedings of the IEEE International Symposium on Information Theory (ISIT 2009), Seoul, Korea, 28 June–3 July 2009; pp. 814–818. [Google Scholar]
- Huber, P.; Strassen, V. Minimax tests and the Neyman-Pearson lemma for capacities. Ann. Stat.
**1973**, 2, 251–273. [Google Scholar] [CrossRef] - Eguchi, S.; Copas, J. Interpreting Kullback-Leibler divergence with the Neyman-Pearson lemma. J. Multivar. Anal.
**2006**, 97, 2034–2040. [Google Scholar] [CrossRef] - Narayanan, K.R.; Srinivasa, A.R. On the thermodynamic temperature of a general distribution. arXiv, 2007; arXiv:0711.1460. [Google Scholar]
- Bahadur, R.R. Stochastic comparison of tests. Ann. Math. Stat.
**1960**, 31, 276–295. [Google Scholar] [CrossRef] - Bahadur, R.R. Some Limit Theorems in Statistics; Society for Industrial and Applied Mathematics: Philadelpha, PA, USA, 1971. [Google Scholar]
- Birgé, L. Vitesses maximales de décroissance des erreurs et tests optimaux associés. Z. Wahrsch. Verw. Gebiete
**1981**, 55, 261–273. [Google Scholar] [CrossRef] - Tusnády, G. On asymptotically optimal tests. Ann. Stat.
**1987**, 5, 385–393. [Google Scholar] [CrossRef] - Liese, F.; Vajda, I. Convex Statistical Distances; Teubner: Leipzig, Germany, 1987. [Google Scholar]
- Tsallis, C. Possible generalization of BG statistics. J. Stat. Phys.
**1987**, 52, 479–485. [Google Scholar] [CrossRef] - Goldie, C. A class of infinitely divisible random variables. Proc. Camb. Philos. Soc.
**1967**, 63, 1141–1143. [Google Scholar] [CrossRef] - Basu, A.; Shioya, H.; Park, C. Statistical Inference: The Minimum Distance Approach; CRC Press: Boca Raton, FL, USA, 2011. [Google Scholar]
- Barndorff-Nielsen, O. Information and Exponential Families in Statistical Theory; John Wiley & Sons: New York, NY, USA, 1978. [Google Scholar]
- Krafft, O.; Plachky, D. Bounds for the power of likelihood ratio tests and their asymptotic properties. Ann. Math. Stat.
**1970**, 41, 1646–1654. [Google Scholar] [CrossRef] - Chernoff, H. Large-sample theory: Parametric case. Ann. Math. Stat.
**1956**, 27, 1–22. [Google Scholar] [CrossRef]

**Figure 1.**Theoretical and numerical power bound of the test of case A under Gaussian noise (with respect to n), for the first kind risk $\alpha =0.05$.

**Figure 2.**Theoretical and numerical power bound of the test of case A under symmetrized Weibull noise (with respect to n), for the first kind risk $\alpha =0.05$.

**Figure 3.**Theoretical and numerical power bound of the test of case A under a symmetrized Laplacian noise (with respect to n), for the first kind risk $\alpha =0.05$.

**Figure 5.**Power of the test of case A under Gaussian noise (with respect to ${\delta}_{max}$), for the first kind risk $\alpha =0.05$ and sample size $n=100$.

**Figure 6.**Power of the test of case A under Laplacian noise (with respect to ${\delta}_{max}$), for the first kind risk $\alpha =0.05$ and sample size $n=100$.

**Figure 7.**Power of the test of case A under symmetrized Weibull noise (with respect to ${\delta}_{max}$), for the first kind risk $\alpha =0.05$ and sample size $n=100$.

**Figure 8.**Power of the test of case A under noise following a Cauchy distribution (with respect to ${\delta}_{max}$), for the first kind risk $\alpha =0.05$ and sample size $n=100$.

**Figure 9.**Power of the test of case B under Gaussian noise (with respect to ${\delta}_{max}$), for the first kind risk $\alpha =0.05$ and sample size $n=100$. The NP curve corresponds to the optimal Neyman Pearson test under ${\delta}_{max}$. The KL, Hellinger, and $G=2$ curves stand respectively for $\gamma =1,\gamma =0.5$, and $\gamma =2$ cases.

**Figure 10.**Power of the test of case B under Laplacian noise (with respect to ${\delta}_{max}$), for the first kind risk $\alpha =0.05$ and sample size $n=100$.

**Figure 11.**Power of the test of case B under symmetrized Weibull noise (with respect to ${\delta}_{max}$), for the first kind risk $\alpha =0.05$ and sample size $n=100$.

**Figure 12.**Power of the test of case B under a noise following a Cauchy distribution (with respect to ${\delta}_{max}$), for the first kind risk $\alpha =0.05$ and sample size $n=100$.

© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).

## Share and Cite

**MDPI and ACS Style**

Broniatowski, M.; Jurečková, J.; Moses, A.K.; Miranda, E.
Composite Tests under Corrupted Data. *Entropy* **2019**, *21*, 63.
https://doi.org/10.3390/e21010063

**AMA Style**

Broniatowski M, Jurečková J, Moses AK, Miranda E.
Composite Tests under Corrupted Data. *Entropy*. 2019; 21(1):63.
https://doi.org/10.3390/e21010063

**Chicago/Turabian Style**

Broniatowski, Michel, Jana Jurečková, Ashok Kumar Moses, and Emilie Miranda.
2019. "Composite Tests under Corrupted Data" *Entropy* 21, no. 1: 63.
https://doi.org/10.3390/e21010063