Abstract
The Ewens–Pitman sampling model (EP-SM) is a distribution for random partitions of the set , with , which is indexed by real parameters and such that either and , or and for some . For , the EP-SM is reduced to the Ewens sampling model (E-SM), which admits a well-known compound Poisson perspective in terms of the log-series compound Poisson sampling model (LS-CPSM). In this paper, we consider a generalisation of the LS-CPSM, referred to as the negative Binomial compound Poisson sampling model (NB-CPSM), and we show that it leads to an extension of the compound Poisson perspective of the E-SM to the more general EP-SM for either , or . The interplay between the NB-CPSM and the EP-SM is then applied to the study of the large n asymptotic behaviour of the number of blocks in the corresponding random partitions—leading to a new proof of Pitman’s diversity. We discuss the proposed results and conjecture that analogous compound Poisson representations may hold for the class of -stable Poisson–Kingman sampling models—of which the EP-SM is a noteworthy special case.
1. Introduction
The Pitman–Yor process is a discrete random probability measure indexed by real parameters and such that either and , or and for some —as can be seen in, e.g., Perman et al. [], Pitman [] and Pitman and Yor []. Let be independent random variables such that is distributed as a Beta distribution with parameter , for , with the convention for that and is undefined for . If and for , such that almost definitely , then the Pitman–Yor process is the random probability measure on such that for . The Dirichlet process (Ferguson []) arises for . Because of the discreteness of , a random sample induces a random partition of by means of the equivalence (Pitman []). Let be the number of blocks of and let , for , be the number of blocks with frequency r of with and . Pitman [] showed that:
with being the ascending factorial of x of order n, i.e., . The distribution (1) is referred to as the Ewens–Pitman sampling model (EP-SM), and for , it reduces to the Ewens sampling model (E-SM) in Ewens []. The Pitman–Yor process plays a critical role in a variety of research areas, such as mathematical population genetics, Bayesian nonparametrics, machine learning, excursion theory, combinatorics and statistical physics. See Pitman [] and Crane [] for a comprehensive treatment of this subject.
The E-SM admits a well-known compound Poisson perspective in terms of the log-series compound Poisson sampling model (LS-CPSM). See Charalambides [] and the references therein for an overview of compound Poisson models. We consider a population of individuals with a random number K of distinct types, and let K be distributed as a Poisson distribution with parameter for and . For , let denote the random number of individuals of type i in the population, and let the ’s be independent of K and independent from each other, with the same distribution:
for . Let and let for , that is, is the random number of equal to r such that and . If denotes a random variable whose distribution coincides with the conditional distribution of given , then (Section 3, Charalambides []) it holds:
The distribution (3) is referred to as the LS-CPSM, and it is equivalent to the E-SM. That is, the distribution (3) coincides with the distribution (1) with . Therefore, the distributions of and coincide with the distributions of and , respectively. Let denote the weak convergence. From Korwar and Hollander [], as , whereas from Ewens [], it follows that as , where is a Poisson random variable with parameter z.
In this paper, we consider a generalisation of the LS-CPSM referred to as the negative binomial compound Poisson sampling model (NB-CPSM). The NB-CPSM is indexed by real parameters and z such that either and or and . The LS-CPSM is recovered by letting and . We show that the NB-CPSM leads to extend the compound Poisson perspective of the E-SM to the more general EP-SM for either , or . That is, we show that: (i) for , the EP-SM (1) admits a representation as a randomised NB-CPSM with and , where the randomisation acts on z with respect a scale mixture between a Gamma and a scaled Mittag–Leffler distribution (Pitman []); (ii) for the NB-CPSM admits a representation in terms of a randomised EP-SM with and for some , where the randomisation acts on m with respect to a tilted Poisson distribution arising from the Wright function (Wright []). The interplay between the NB-CPSM and the EP-SM is then applied to the large n asymptotic behaviour of the number of distinct blocks in the corresponding random partitions. In particular, by combining the randomised representation in (i) with the large n asymptotic behaviour or the number of distinct blocks under the NB-CPSM, we present a new proof of Pitman’s -diversity (Pitman []), namely the large n asymptotic behaviour of under the EP-SM for .
2. A Compound Poisson Perspective of EP-SM
To introduce the NB-CPSM, we considered a population of individuals with a random number K of types and let K be distributed as a Poisson distribution with parameter such that either , and , or , and . For , let be the random number of individuals of type i in the population, and let the be independent of K and independent from each other with the same distribution:
for . Let and for , that is, is the random number of equal to r such that and . If is a random variable whose distribution coincides with the conditional distribution of , given , then it holds (Section 3, Charalambides []):
where is the generalised factorial coefficient (Charalambides []), with the proviso for all , for all and . The distribution (5) is referred to as the NB-CPSM. As , the distribution (4) reduces to the distribution (2), and hence the NB-CPSM (5) is reduced to the LS-CPSM (3). The next theorem states the large n asymptotic behaviour of the counting statistics and arising from the NB-CPSM.
Theorem 1.
Letdenote a Poisson random variable with the parameter. As,
- (i)
- for and :and:
- (ii)
- for and :and:
Proof.
As regards the proof of (6), we start by recalling that the probability generating function of is for any . Now, let be the probability generating function of . The distribution of follows by combining the NB-CPSM (5) with Theorem 2.15 of Charalambides []. In particular, it follows that:
Hereafter, we show that as , for any , which implies (6). In particular, by the direct application of the definition of , we write the following:
where denotes the incomplete gamma function for and denotes the Gamma function for . Accordingly, we write the identity:
Since for any , the proof (6) is completed by showing that, for any :
By the definition of ascending factorials and the reflection formula of the Gamma function, it holds:
In particular, by means of the monotonicity of the function , we can write:
for any such that , and . Note that . Then, we apply (11) to obtain:
Now, by means of Stirling approximation, it holds as . Moreover, we have:
where the finiteness of the integral follows, for any fixed , from the fact that if . This completes the proof of (10) and hence the proof of (6). As regards the proof of (7), we make use of the falling factorial moments of , which follows by combining the NB-CPSM (5) with Theorem 2.15 of Charalambides []. Let be the falling factorial of a of order n, i.e., , for any and with the proviso . Then, we write:
Now, by means of the same argument applied in the proof of statement (6), it holds true that:
Then:
follows from the fact that as . The proof of the large n asymptotics (7) is completed by recalling that the falling factorial moment of order s of is .
As regards the proof of statement (8), let for any and let for any . Then, by direct application of Equation (2.27) of Charalambides [], we write the following identity:
where is the Stirling number of that second type. Now, note that is the moment of order v of a Poisson random variable with parameter . Then, we write:
That is:
where and are independent random variables such that is a Gamma random variable with a shape parameter and a scale parameter 1, and is a Poisson random variable with a parameter w. Accordingly, the distribution of , say , is the following:
for . The discrete component of does not contribute to the expectation (13) so that we focus on the absolutely continuous component, whose density can be written as follows:
where is the Wright function (Wright []). In particular, for :
If we split the integral as for any , the contribution of the latter integral is overwhelming with respect to the contribution of the former. Then, can be equivalently replaced by the asymptotics , as , for some constant solely depending on . See Theorem 2 in Wright []. Hence:
where . Then, the problem is reduced to an integral whose asymptotic behaviour is described in Berg []. From Equation (31) of the Berg [] and Stirling approximation, we have:
This last asymptotic expansion leads directly to (8). Indeed, let be the probability generating function of the random variable , which reads as for . Then, by means of (15), for any fixed we write:
Since (15) holds uniformly in w in a compact set, we consider the function evaluated at some point and extend the validity of (16) with in the place of s, as long as varies in a compact subset of . Thus, we can choose and and notice that as . Thus, and we have:
which implies that as . This completes the proof of (8). As regards the proof (9), let for any and let for any . Similarly to the proof of (7), here we make use of the falling factorial moments of , that is:
At this point, we make use of the same large n arguments applied in the proof of statement (7). In particular, by means of the large n asymptotic (15), as , it holds true that:
Then:
it follows from the fact that as . The proof of the large n asymptotics (9) is completed by recalling that the falling factorial moment of order s of is . □
In the rest of the section, we make use of the NB-CPSM (5) to introduce a compound Poisson perspective of the EP-SM. In particular, our result extends the well-known compound Poisson perspective of the E-SM to the EP-SM for either , or . For let denote the density function of a positive -stable random variable , that is is a random variable for which for any . For and , let be a positive random variable with the density function:
That is, is a scaled Mittag–Leffler random variable (Chapter 1, Pitman []). Let be a Gamma random variable with the scale parameter and shape parameter , and let us assume that is independent of . Then, for , and let:
Finally, for , and , let be a random variable on whose distribution is a tilted Poisson distribution arising from the identity (12). Precisely, for any :
The next theorem makes use of and to set an interplay between NB-CPSM (5) and EP-SM (1). This extends the compound Poisson perspective of the E-SM.
Theorem 2.
Let be distributed as the EP-SM (1) and let be the random variable defined in (17), which is independent of . Moreover, let be distributed as the NB-CPSM (5), and let be the random variable defined in (18), which is independent of . Then:
- (i)
- for and :
- (ii)
- for and :
Proof.
As regards the proof of statement (i), it relies on the classical integral representation of the Gamma function. That is, by applying the integral representation of to the EP-SM (1), for with and , we can write that:
By Equation (13) of Favaro et al. []:
where is the density function of the random variable . This completes the proof of (i).
As regards the proof of statement (ii), for any α < 0, , and , we define the function , and then consider the following identity:
This completes the proof of (ii). □
Theorem 2 presents a compound Poisson perspective of the EP-SM in terms of the NB-CPSM, thus extending the well-known compound Poisson perspective of the E-SM in terms of the LS-CPSM. Statement (i) of Theorem 2 shows that for and , the EP-SM admits a representation in terms of the NB-CPSM with and , where the randomisation acts on the parameter z with respect to the distribution (17). Precisely, this is a compound mixed Poisson sampling model. That is, a compound sampling model in which the distribution of the random number K of distinct types in the population is a mixture of Poisson distributions with respect to the law of . Statement (ii) of Theorem 2 shows that for and , the NB-CPSM admits a representation in terms of a randomised EP-SM with and for some , where the randomisation acts on the parameter m with respect to the distribution (17).
Remark 1.
The randomisation procedure introduced in Theorem 2 is somehow reminiscent of a class of Gibbs-type sampling models introduced in Gnedin and Pitman []. This class is defined from the EP-SM with and , for some , and then it assumes that the parameter m is distributed according to an arbitrary distribution on . This can be seen in Theorem 12 of Gnedin and Pitman [] and Gnedin [] for example. However, differently from the definition of Gnedin and Pitman [], in our context, the distribution of m depends on the sample size n.
For and , Pitman [] first studied the large n asymptotic behaviour of . This can also be seen in Gnedin and Pitman [] and the references therein. Let denote the almost sure convergence, and let be the scaled Mittag–Leffler random variable defined above. Theorem 3.8 of Pitman [] exploited a martingale convergence argument to show that:
as . The random variable is referred to as Pitman’s -diversity. For and for some , the large n asymptotic behaviour of is trivial, that is:
as . We refer to Dolera and Favaro [,] for Berry–Esseen type refinements of (20) and to Favaro et al. [,] and Favaro and James [] for generalisations of (20) with applications to Bayesian nonparametrics. This can also be seen in Pitman [] (Chapter 4) for a general treatment of (20). According to Theorem 2, it is natural to ask whether there exists an interplay between Theorem 1 and the large n asymptotic behaviours (20) and (21). Hereafter, we show that: (i) (20), with the almost sure convergence replaced by the convergence in distribution, arises by combining (6) with (i) of Theorem 2; (ii) (8) arises by combining (21) with (ii) of Theorem 2. This provides an alternative proof of Pitman’s -diversity.
Theorem 3.
Let and under the EP-SM and the NB-CPSM, respectively. As :
- (i)
- For and :
- (ii)
- For and :
Proof.
We show that (22) arises by combining (6) with statement (i) of Theorem 2. For any pair of -valued random variables U and V, let be the total variation distance between the distribution of U and the distribution of V. Furthermore, let denote a Poisson random variable with parameter . For any and , we show that as :
This implies (22). The proof of (24) requires a careful analysis of the probability generating function of . In particular, let us define , where is the Wright–Mainardi function (Mainardi et al. []). Then, we apply Corollary 2 of Dolera and Favaro [] to conclude that as . Finally, we applied inequality (2.2) in Adell and Jodrá [] to obtain:
So that as , and (24) follows. Now, keeping and t fixed as above, we show that (24) entails (22). To this aim, we introduced the Kolmogorov distance which, for any pair of -valued random variables U and V, is defined by . The claim to be proven is equivalent to:
as . We exploit statement (i) of Theorem 2. This leads to the distributional identity . Thus, in view of the basic properties of the Kolmogorov distance:
where the is thought of here as a homogeneous Poisson process with a rate of 1, independent of . The desired conclusion will be reached as soon as we will prove that all the three summands on the right-hand side of (25) go to zero as . Before proceeding, we recall that . Therefore, for the first of these terms, we write:
with . Now, let us define . Accordingly, we can make the above right-hand side major by means of the following quantity:
Then, by exploiting the identity , we can write:
which goes to zero as for any , by Stirling’s approximation. To show that the integral also goes to zero as , we may resort to identities (13)–(14) of Dolera and Favaro [], as well as Lemma 3 therein. In particular, let denote a suitable continuous function independent of n, and such that as and as . Then, we write that:
Since by Lemma 3 of Dolera and Favaro [], both the summands on the above right-hand side go to zero as , again by Stirling’s approximation. Thus, the first summand on the right-hand side of (25) goes to zero as . As for the second summand on the right-hand side of (25), it can be bounded by
By a dominated convergence argument, this quantity goes to zero as as a consequence of (24). Finally, for the third summand on the right-hand side of (25), we can resort to a conditioning argument in order to reduce the problem to a direct application of the law of large numbers for renewal processes (Section 10.2, Grimmett and Stirzaker []). In particular, this leads to for any , which entails that as . Thus, this third term also goes to zero as and (22) follows.
Now, we consider (23), showing that it arises by combining (21) with statement (ii) of Theorem 2. In particular, by an obvious conditioning argument, we can write that as :
At this stage, we consider the probability generating function of and we immediately obtain for and with the same as in (13) and (14). Therefore, the asymptotic expansion we already provided in (15) entails:
as . In particular, (26) follows by applying exactly the same arguments used to prove (8). Now, since:
the claim follows from a direct application of Slutsky’s theorem. This completes the proof. □
3. Discussion
The NB-CPSM is a compound Poisson sampling model generalising the popular LS-CMSM. In this paper, we introduced a compound Poisson perspective of the EP-SM in terms of the NB-CPSM, thus extending the well-known compound Poisson perspective of the E-SM in terms of the LS-CPSM. We conjecture that an analogous perspective holds true for the class of -stable Poisson–Kingman sampling models (Pitman [] and Pitman []), of which the EP-SM is a noteworthy special case. That is, for , we conjecture that an -stable Poisson–Kingman sampling model admits a representation as a randomised NB-CPSM with and , where the randomisation acts on z with respect to a scale mixture between a Gamma and a suitable transformation of the Mittag–Leffler distribution. We believe that such a compound Poisson representation would be critical in order to introduce Berry–Esseen type refinements of the large n asymptotic behaviour of under -stable Poisson–Kingman sampling models. This can be seen in Section 6.1 of Pitman [] and the references therein. Such a line of research aims to extend the preliminary works of Dolera and Favaro [,] on Berry–Esseen type theorems under the EP-SM. Work on this, and on the more general settings induced by normalised random measures (Regazzini et al. []) and Poisson–Kingman models (Pitman []), is ongoing.
Author Contributions
Formal analysis, E.D. and S.F.; writing—original draft preparation, E.D. and S.F.; writing—review and editing, E.D. and S.F. All authors have read and agreed to the published version of the manuscript.
Funding
This research received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme under grant agreement No 817257.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Acknowledgments
The authors thank the editor and two anonymous referees for all their comments and suggestions which remarkably improved the original version of the present paper. Emanuele Dolera and Stefano Favaro wish to express their enormous gratitude to Eugenio Regazzini, whose fundamental contributions to the theory of Bayesian statistics have always been a great source of inspiration, transmitting enthusiasm and method for the development of their own research. The authors gratefully acknowledge the financial support from the Italian Ministry of Education, University and Research (MIUR), “Dipartimenti di Eccellenza” grant 2018–2022.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Perman, M.; Pitman, J.; Yor, M. Size-biased sampling of Poisson point processes and excursions. Probab. Theory Relat. Fields 1992, 92, 21–39. [Google Scholar] [CrossRef]
- Pitman, J. Exchangeable and partially exchangeable random partitions. Probab. Theory Relat. Fields 1995, 102, 145–158. [Google Scholar] [CrossRef]
- Pitman, J.; Yor, M. The two parameter Poisson-Dirichlet distribution derived from a stable subordinator. Ann. Probab. 1997, 25, 855–900. [Google Scholar] [CrossRef]
- Ferguson, T.S. A Bayesian analysis of some nonparametric problems. Ann. Stat. 1973, 1, 209–230. [Google Scholar] [CrossRef]
- Pitman, J. Combinatorial Stochastic Processes; Lecture Notes in Mathematics; Springer: Berlin/Heidelberg, Germany, 2006. [Google Scholar]
- Ewens, W. The sampling theory or selectively neutral alleles. Theor. Popul. Biol. 1972, 3, 87–112. [Google Scholar] [CrossRef]
- Crane, H. The ubiquitous Ewens sampling formula. Stat. Sci. 2016, 31, 1–19. [Google Scholar] [CrossRef]
- Charalambides, C.A. Distributions of random partitions and their applications. Methodol. Comput. Appl. Probab. 2007, 9, 163–193. [Google Scholar] [CrossRef]
- Korwar, R.M.; Hollander, M. Contributions to the theory of Dirichlet processes. Ann. Stat. 1973, 1, 705–711. [Google Scholar] [CrossRef]
- Wright, E.M. The asymptotic expansion of the generalized Bessel function. Proc. Lond. Math. Soc. 1935, 38, 257–270. [Google Scholar] [CrossRef]
- Charalambides, C.A. Combinatorial Methods in Discrete Distributions; Wiley: Hoboken, NJ, USA, 2005. [Google Scholar]
- Berg, L. Asymptotische darstellungen für integrale und reihen mit anwendungen. Math. Nachrichten 1958, 17, 101–135. [Google Scholar] [CrossRef]
- Favaro, S.; James, L.F. A note on nonparametric inference for species variety with Gibbs-type priors. Electron. J. Stat. 2015, 9, 2884–2902. [Google Scholar] [CrossRef]
- Gnedin, A.; Pitman, J. Exchangeable Gibbs partitions and Stirling triangles. J. Math. Sci. 2006, 138, 5674–5685. [Google Scholar] [CrossRef] [Green Version]
- Gnedin, A. A species sampling model with finitely many types. Electron. Commun. Probab. 2010, 8, 79–88. [Google Scholar] [CrossRef]
- Dolera, E.; Favaro, S. A Berry—Esseen theorem for Pitman’s α—Diversity. Ann. Appl. Probab. 2020, 30, 847–869. [Google Scholar] [CrossRef]
- Dolera, E.; Favaro, S. Rates of convergence in de Finetti’s representation theorem, and Hausdorff moment problem. Bernoulli 2020, 26, 1294–1322. [Google Scholar] [CrossRef]
- Favaro, S.; Lijoi, A.; Prünster, I. Asymptotics for a Bayesian nonparametric estimator of species richness. Bernoulli 2012, 18, 1267–1283. [Google Scholar] [CrossRef]
- Favaro, S.; Lijoi, A.; Mena, R.H.; Prünster, I. Bayesian nonparametric inference for species variety with a two parameter Poisson-Dirichlet process prior. J. R. Stat. Soc. Ser. B 2009, 71, 992–1008. [Google Scholar] [CrossRef]
- Mainardi, F.; Mura, A.; Pagnini, G. The M-Wright function in time-fractional diffusion processes: A tutorial survey. Int. J. Differ. Equat. 2010, 104505. [Google Scholar] [CrossRef] [Green Version]
- Adell, J.A.; Jodrá, P. Exact Kolmogorov and total variation distances between some familiar discrete distributions. J. Inequalities Appl. 2006, 64307. [Google Scholar] [CrossRef] [Green Version]
- Grimmett, G.; Stirzaker, D. Probability and Random Processes; Oxford University Press: Oxford, UK, 2001. [Google Scholar]
- Pitman, J. Poisson-Kingman partitions. In Science and Statistics: A Festschrift for Terry Speed; Goldstein, D.R., Ed.; Institute of Mathematical Statistics: Tachikawa, Japan, 2003. [Google Scholar]
- Regazzini, E.; Lijoi, A.; Prünster, I. Distributional results for means of normalized random measures with independent increments. Ann. Stat. 2003, 31, 560–585. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).