Next Article in Journal
Modeling the Static and Dynamic Behaviors of a Large Heavy-Duty Lathe Machine under Rated Loads
Previous Article in Journal
Numerical Simulation of Phase Transitions in Porous Media with Three-Phase Flows Considering Steam Injection into the Oil Reservoir
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Asymptotic Characteristics of the Non-Iterative Estimates of the Linear-by-Linear Association Parameter for Ordinal Log-Linear Models

1
The Advancement Portfolio, University of Sydney, Camperdown, NSW 2006, Australia
2
Department of Applied Sciences, National Textile University, Faisalabad 37610, Pakistan
3
National Institute for Applied Statistics Research Australia (NIASRA), University of Wollongong, Wollongong, NSW 2522, Australia
4
Centre for Multi-Dimensional Data Visualisation (MuViSu), Stellenbosch University, Stellenbosch 7602, South Africa
5
Mathematical Sciences, School of Science, Royal Melbourne Institute of Technology (RMIT), Melbourne, VIC 3000, Australia
*
Author to whom correspondence should be addressed.
Computation 2022, 10(12), 206; https://doi.org/10.3390/computation10120206
Submission received: 19 October 2022 / Revised: 17 November 2022 / Accepted: 18 November 2022 / Published: 24 November 2022

Abstract

:
Over the past decade, a series of procedures has been introduced to estimate, using a non-iterative method, the linear-by-linear association parameter of an ordinal log-linear model. This paper will examine the two key non-iteratively determined estimates of the parameter for the analysis of the association between the two categorical variables that form a contingency table; these are the log and the Beh-Davy non-iterative estimates, referred to simply as the LogNI and the BDNI estimates, respectively. Such an examination will focus on determining their asymptotic characteristics. To do so, a computational study was undertaken for tables of varying sizes to show that these two estimates are asymptotically unbiased. It is also shown that both estimates are asymptotically normally distributed. On the basis of the standard errors, their relative efficiency was established for the 13 commonly analysed contingency tables that appear throughout the literature.

1. Introduction

Log-linear models (LLMs) are one of the most used tools in the analysis of the association between the categorical variables that form a contingency table. Extensive discussions on their development and application can be found in, for example, [1,2,3]. LLMs have been a focal point of research in the statistical and allied disciplines since 1950s and stem from the work of [4], who considered the association between three categorical variables. Since then, many notable contributions have been made to this area of research including those of [5,6,7,8,9,10,11,12,13]—although [14] points out that the term log-linear model was first coined by [15] (p. 119). Much of this work focused on the study of variables consisting of nominally structured categories. However, there are many practical settings where the variables consist of ordered categories. In the past, an analysis of ordered variables would have been undertaken by treating them as nominal variables (this still is the case in some studies even now). Therefore, where a variable consists of ordered categories, it is important to incorporate such a feature into the development of statistical tools used to analyse the association. Such models are commonly referred to as ordinal log-linear models, or OLLMs. A historical account on the development of OLLMs can be found by considering, for example, [3] (pp. 386–395) and [16] (pp. 145–154). Independent discussions of the origins of OLLMs have also been given by [17] and [18]; both authors focused their attention on a two-way contingency table. The development of OLLMs for a singly ordered (column variable) table was discussed by [18], while [17] considered a doubly ordered table. More recent discussions have been made of the type of OLLMs we consider in this paper, which span a variety of different contexts. For example, the books of [1,3] (Section 10.4), [16] (Section 6.2), [19,20] (Section 3.1), (Section 7.1), [21] (p. 248), [22] (Chapter 4), and [23] (Section 6.1.1) all provide various levels of introductory discussion of OLLMs. One may also refer to [24,25,26,27,28,29,30,31,32,33,34,35] for applications and further insights.
An important aspect of LLMs and OLLMs is the estimation of the parameters from these models. In the case of OLLMs for the doubly ordered contingency table (as considered by [17]), the primary parameter of interest is that which reflects the linear-by-linear association between two ordered variables. Traditionally, the estimation of this parameter has involved using a variety of iterative procedures. The two most used procedures are Newton’s algorithm and iterative proportional fitting; one may refer, for example, to [36,37,38,39,40] for more on these algorithms. One may also consider [16] and [19], who provide a detailed account of these methods and have provided a list of computer programs, including GLIM, SPSS, and SAS, for performing the necessary calculations. Rather than considering an iterative algorithm for estimating the association parameter in OLLMs, one may adopt a more direct approach that is built on a non-iterative framework. One such approach is to consider the method originally proposed by [41] and further studied by [40] through empirical studies. The former authors propose one method for estimating the linear-by-linear parameter through non-iterative (direct) means, while the latter authors considered three further, and related, methods. The accuracy and reliability of the non-iterative estimation for the OLLM of a doubly ordered contingency table was investigated by [42,43], who provided a simulation study of these four methods. They demonstrated that using their non-iterative techniques provides exceptionally stable and reliable estimates of the linear-by-linear association parameter when compared with Newton’s method. The links between these non-iterative methods, using the Box-Cox transformation, were demonstrated by [44]. It is this non-iterative method of estimation which we shall focus our attention on in this paper.
With the foundational mathematical links between the non-iterative estimates of the linear-by-linear association parameter established, and their reliability and stability verified through simulation, this paper identifies the asymptotic characteristics of the two key non-iterative estimates studied [40,41,42,43,44]. We shall be paying particular attention to the bias of the estimators—a topic that was briefly examined by [45]. We also examine here the asymptotic distribution and relative efficiency of each of the two non-iterative estimates. To undertake such a study, this paper is divided into five further sections. In Section 2, a brief review of the non-iterative estimation for OLLMs is given, highlighting the two key estimates for which the asymptotic characteristics are considered. Section 3 includes the theoretical and mathematical development of the asymptotic properties and the asymptotic distributions of the two estimates. An evaluation of these properties, through empirical studies and by simulation, is discussed in Section 4. Section 5 provides a discussion of these results and some remarks on the future research in this area of study.

2. Non-Iterative Estimation of the Linear-by-Linear Association Parameter

For a two-way contingency table, N, with I ordered rows and J ordered columns, denotes the proportion of individuals/units in the (i, j)’th cell as p ij = n ij / n , where n ij is the i , j ’th cell value of N, for i = 1 ,   2 ,   I and j = 1 ,   2 ,   ,   J . Therefore, i = 1 I j = 1 J p ij = 1 . Denote p i and p j as the marginal proportion of the i ’th row and j ’th column categories, respectively, such that i = 1 I p i = j = 1 J p j = 1 . Moreover, let m ij be the expected cell frequency of the i , j ’th cell; for example, when the row and column variables are independent, m ij = np i p j , although any appropriate model of association or correlation may be used to determine m ij = np ij . One such model is the ordinal log-linear model—also known as the uniform association model—for the doubly ordered two-way contingency table, which was considered by [40] (and many of the references given above) and is defined as
ln m ij = μ + α i + β j + φ u i u ¯ v j v ¯ .
The parameters are as follows: φ is our parameter of interest and reflects the association between the two categorical variables; μ is the grand mean of the expected cell frequencies, while α i and β j are the main effects of the i ’th row and j ’th column, respectively, such that i = 1 I α i = 0 and j = 1 J β j = 0 . With there being I + J parameters in (1), iterative techniques are commonly used to estimate them. However, the last three can be treated as nuisance parameters [41] (p. 76) and estimated by
μ ^ = ln n + 1 I i = 1 I ln p i + 1 J j = 1 J ln p j ,
α ^ i = ln p i 1 I i = 1 I ln p i
and
β ^ j = ln p j 1 J j = 1 J ln p j .
so that there is only a single parameter that requires estimating, that of φ . This suggests that a direct, non-iterative, method of estimating φ can be used, and we shall now turn our attention to how this can be conducted.
To reflect the structure of the ordinal variable, scores are assigned to each of the categories. For (1), u i and v j are the scores associated with the i ’th row and j ’th column and, depending on the nature of the order, are chosen a priori. For example, when the row and column variables consist of increasingly ordered categories then u 1 < < u I and v 1 < < v J . The mean of the row scores is denoted by u ¯ = i = 1 I p i u i , while v ¯ = j = 1 J p j v j is the mean of the column scores.
The parameter of interest in (1) is φ and is the measure of the linear-by-linear association between the variables since
ln m ij m i + 1 , j + 1 m i , j + 1 m i + 1 , j = φ u i + 1 u i v j + 1 v j .
Therefore, when the row and column scores are chosen such that u i + 1 u i = v j + 1 v j = 1 , φ is the common log-odds ratio of the contingency table.
Four non-iterative estimation methods for the parameter φ were considered by [40], but we shall restrict our attention to examining the two key methods. The first is the estimator
φ ^ LogNI = 1 σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ v j v ¯ ln p ij p i p j
which is referred to as the LogNI estimate due to the presence of the logarithm function in the non-iterative (NI) estimate. The second estimate, and one that was originally proposed by [41], is
φ ^ BDNI = 1 σ I 2 σ J 2 i = 1 I j = 1 J p ij u i u ¯ v j v ¯
and is referred to as the BDNI (Beh-Davy NI) estimate of φ . For (2) and (3), σ I 2 = i = 1 I p i u i 2 u ¯ I 2 and σ J 2 = j = 1 J p j v j 2 v ¯ J 2 . The estimate (3) can be obtained by considering the first-order Taylor series expansion ln p ij p i p j p ij p i p j 1 . Equations (2) and (3) are also linked through the Box-Cox transformation and [45] discussed the features of the estimation procedure using this transformation. An excellent overview of the various features of φ ^ LogNI and φ ^ BDNI for estimating φ from the OLLM of (1) was provided by [46] (p. 221–223) and [47]. The method introduced by [48] was also discussed by [47] and is a method of non-iterative estimation based on weighted mean and Mantel–Haenszel type estimators. A link that exists between φ ^ LogNI and φ ^ BDNI and the correspondence analysis of a double ordered two-way contingency table [49,50,51,52,53] was demonstrated by [54]. In doing so, [54] analysed the relationships that exist between the predictors of drug-likeness used in drug discovery to help filter out small molecules (drugs) that may fail clinical trials; see also [55], who applied a non-iterative approach to ordinal log-linear models in the investigation of a log permeability index in drug discovery. Further practical and technical features of φ ^ LogNI and φ ^ BDNI not discussed here have been examined in the following conference papers by the current authors: [56,57]. The latter of these involved modelling gender-specific associations between temperament and character traits and symptoms of psychological distress, such as anxiety, psychoticism, and depression, to motivate the value of creating gender-specific treatments for psychological distress.
To evaluate the performance and compare the non-iterative estimates of φ using (2) and (3)—and two additional Taylor-series approximations of (2)—with the estimates obtained using the iterative algorithm of Newton’s method, [42,43] performed a series of simulation studies. As part of their studies, strategies needed to be considered for dealing with the presence of random zero-cell frequencies since the logarithm function in (2) leads to non-existent solutions for such cases. There are a variety of different ways in which these zeros can be dealt with. See, for example, [3] (Section 10.6.5), [23] (p. 119) and [58,59,60,61] for a discussion of this issue. In the simulations below, we shall be replacing a zero-cell frequency with 0.05, as [42,43,44] did. Note that determining φ ^ BDNI when random zero-cell frequencies are present does not suffer from this problem. However, the simulation studies of [42,43] suggest that the accuracy and reliability of φ ^ BDNI begins to falter as the dimension of the two-way table increases. Therefore, the discussions made in the following section are limited to the comparison of φ ^ LogNI and φ ^ BDNI .

3. Asymptotic Characteristics of φ ^ L o g N I and φ ^ B D N I

In this section, the mean and variance of the sampling distributions of φ ^ LogNI and φ ^ BDNI are determined. Our discussion of the asymptotic distributional properties of the estimates is made using the delta method
n g T n g θ d N 0 , g θ 2 V T n
where g T n is a function of the variable T n and g θ is a function of the expected value of T n : see, for example, [61] (p. 240) and [3] (p. 73). We shall also be making use of the following restrictions on u i and v j
i = 1 I p i u i u ¯ u i u ¯ = σ I 2 , u i = u i 0 ,   u i u i i = 1 I p j v j v ¯ v j v ¯ = σ J 2 , v j = v j 0 ,   v j v j  
in the derivation of the following results, which determine the mean and variance of φ ^ LogNI and φ ^ BDNI . The bias of these estimates is also considered.

3.1. Unbiasedness of φ ^ L o g N I and φ ^ B D N I

Suppose we first consider the non-iterative estimate of φ given by φ ^ LogNI . By substituting n ij = np ij into (2), the estimate can be alternatively expressed as
φ ^ LogNI = 1 σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ v j v ¯ ln n ij 1 σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ v j v ¯ ln np i p j
Suppose that the cell frequencies, represented as elements of the vector n ~ = n ij ;   i ,   j , are independent Poisson random variables. Then, the random variable on the right-hand side of (6) is ln n ij , so that
E φ ^ LogNI = 1 σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ v j v ¯ E ln n ij 1 σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ v j v ¯ ln np i p j .
By using the delta method, such that
ln n ij ln m ij d N 0 , 1 nm ij
the expectation of φ ^ LogNI can be expressed as
E φ ^ LogNI = 1 σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ v j v ¯ ln m ij 1 σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ v j v ¯ ln np i p j
There are many ways to model the cell values of the contingency table. By considering an unsaturated (linear-by-linear) association model of the type described in [41], (Equation (19)), m ij is the expected cell frequency of the (i, j)’th cell where
m ij = np i p j 1 + φ u i u ¯ σ I v j v ¯ σ J .  
The link between this model and the OLLM of (1) was also shown by [40]. Substituting (10) into (9) yields, after simplification,
E φ ^ LogNI = 1 σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ v j v ¯ ln 1 + φ u i u ¯ σ I v j v ¯ σ J .
By using the first-order Taylor series expansion of the logarithm
ln 1 + φ u i u ¯ σ I v j v ¯ σ J φ u i u ¯ σ I v j v ¯ σ J
and after a little algebra using (5), we obtain the asymptotic expectation of φ ^ LogNI
E φ ^ LogNI = φ .
Equation (12) asserts that φ ^ LogNI is (approximately) an unbiased estimator of the linear-by-linear association parameter φ in the OLLM of (1).
We can similarly show that φ ^ BDNI is also an unbiased estimate of φ . Following the same argument made above for φ ^ LogNI , the expected value for φ ^ BDNI can be derived by taking the expectation of both sides of (3), yielding
E φ ^ BDNI = 1 n σ I 2 σ J 2 i = 1 I j = 1 J m ij u i u ¯ v j v ¯ .
By substituting (10) into (13), and after some simplification, we obtain the expectation of the BDNI estimate
E φ ^ BDNI = φ σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ 2 v j v ¯ 2 .  
By considering the restriction (5) imposed on u i and v j , this expectation simplifies to
E φ ^ BDNI = φ .  

3.2. Variance of φ ^ L o g N I and φ ^ B D N I

We now turn our attention to the derivation of the variance of φ ^ L o g N I and φ ^ B D N I . Consider first the variance of φ ^ LogNI , which is expressed as
V φ ^ LogNI = V [ 1 σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ v j v ¯ ln n ij 1 σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ v j v ¯ ln np i p j ] .
One may note that the second term on the right-hand side is a constant. Therefore, by expanding the above variance expression, the cross-product terms are
1 σ I 2 σ J 2 i k I j l J p i p j p k p l u i u ¯ u k u ¯ v j v ¯ v l v ¯ Cov ln n ij , ln n kl
and are zero from (5). Thus, by using the delta method and simplifying, the variance of φ ^ LogNI is
V φ ^ LogNI = 1 n σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ 2 v j v ¯ 2 m ij 1 .
By following a similar derivation, the variance of φ ^ BDNI is
V φ ^ BDNI = 1 n 2 σ I 2 σ J 2 i = 1 I j = 1 J m ij u i u ¯ 2 v j v ¯ 2 .
When there is complete independence between the two categorical variables, (15) and (16) simplify to zero.

3.3. Asymptotic Distribution of φ ^ L o g N I and φ ^ B D N I

As we discussed when determining the expectation and variance of the estimates of φ ^ LogNI and φ ^ BDNI , here we shall also use the delta method to determine their asymptotic distribution under the assumption that the observed cell frequencies are independent Poisson random variables. For large samples, the delta method implies that the asymptotic distributions of φ ^ LogNI and φ ^ BDNI are (approximately) true normal distributions, as (17) and (18) show, respectively:
φ ^ LogNI φ d N 0 , 1 n σ I 2 σ J 2 i = 1 I j = 1 J p i p j u i u ¯ 2 v j v ¯ 2 m ij 1
and
φ ^ BDNI φ d N 0 , 1 n 2 σ I 2 σ J 2 i = 1 I j = 1 J m ij u i u ¯ 2 v j v ¯ 2
By comparing the expressions for (15) and (16) with (17) and (18), it can be observed that for φ ^ BDNI , the asymptotic variance is smaller than the exact variance. This implies that as the sample size increases, the accuracy and reliability of φ ^ BDNI improves.

4. Empirical and Computational Study

To study the asymptotic characteristics of φ ^ LogNI and φ ^ BDNI , 10,000 contingency tables of varying sizes are randomly generated. We consider contingency tables ranging in size from 2 × 2 to 5 × 5 since in many practical studies involving two-way contingency tables, rarely are tables of a size greater than 5 × 5 considered. However, in such cases, the conclusions from our study here are equally applicable. To reflect the varying magnitude of the cell frequencies (which are assumed to be a Poisson random variable), these values are randomly generated using various values of the Poisson parameter λ. Here, we consider λ values of 1.5, 5, 20, and 50; a small value of λ reflects, on average, small cell frequencies, while large values of λ reflect, on average, large cell frequencies. For each combination of dimension and λ, the non-iterative estimates of φ are calculated, yielding φ ^ LogNI and φ ^ BDNI . Therefore, a population of 10,000 φ ^ LogNI values and a population of 10,000 φ ^ BDNI values is obtained. The mean of the φ ^ LogNI values and the φ ^ BDNI values is denoted by φ ^ LogNI p and φ ^ BDNI p , respectively; note that φ ^ LogNI p and φ ^ BDNI p are therefore the population means of the two non-iterative estimates. From each population of 10,000 non-iterative estimate values, samples of φ ^ LogNI and φ ^ BDNI are randomly selected; small samples of φ ^ LogNI and φ ^ BDNI are deemed to be those representing 0.1%, 1%, and 5% of the population. Similarly, moderate sized samples (15%) and large samples (30% and 50%) are also considered. For each sample size, the mean of the sampling distribution of the φ ^ LogNI and φ ^ BDNI values obtained are denoted by φ ^ LogNI s and φ ^ BDNI s , respectively.

4.1. Unbiasedness of φ ^ L o g N I and φ ^ B D N I

Consider Table 1, which summarises the computational study undertaken to verify the unbiasedness of the LogNI estimate; see (12). It can be observed that for smaller values of λ and small samples, the difference between φ ^ LogNI p and φ ^ LogNI s is relatively large. This difference arises because small values of λ increase the chances of a zero-cell value arising by chance. Even with the addition of 0.05 to account for the presence of the logarithm function in (2), it means that such a value may be a relatively serious remedy; to overcome this remedy, one could substitute for the zero-cell frequency an even smaller non-negative value; for example, [58] (p. 13) suggested replacing a random zero-cell frequency with 0.00000001. However, as the sample size increases, even for smaller λ , the population mean of the estimates obtained from (2), φ ^ LogNI p , and the mean of the sampling distribution, φ ^ LogNI s , are virtually identical. It is also to be noted that for a larger value of λ , the difference between φ ^ LogNI p and φ ^ LogNI s is zero for large samples of φ ^ LogNI and is minimal even for the small sample sizes. Similar conclusions can be reached concerning the bias of the estimates, φ ^ BDNI . The unbiasedness of this non-iterative parameter estimate is apparent from observing the virtually zero difference between φ ^ BDNI p and φ ^ BDNI s that is summarised in Table 2 for the varying contingency table sizes and Poisson parameter λ .

4.2. Asymptotic Variances of φ ^ L o g N I and φ ^ B D N I

The variance of the estimates φ ^ L o g N I and φ ^ B D N I , defined by (17) and (18), respectively, is summarised in Table 3. The table shows that the variance of φ ^ B D N I becomes larger as one considers smaller values of λ and small-sized tables (in particular, for those of size 2 × 2, 2 × 3, 2 × 4, and 2 × 5). This is because when λ has a smaller value (λ = 1.5, say), the cell values that are close to, or exactly, zero dominate the association structure between the variables of the contingency table. Its impact therefore leads to φ ^ B D N I being a poor performing estimate of φ . However, for moderate and larger-sized contingency tables, the variance of φ ^ B D N I is consistently smaller than the variance of φ ^ L o g N I for all values of λ and contingency table sizes. When the value of λ is large (λ = 50, say), the variances for φ ^ L o g N I and φ ^ B D N I are virtually identical.

4.3. Relative Efficiency of φ ^ L o g N I and φ ^ B D N I

To compare the variances of the two non-iterative estimation procedures given by (2) and (3), we consider their relative efficiencies
RE = V φ ^ BDNI V φ ^ LogNI
which are summarised in Table 4 based on the variances given in Table 3. Table 4 shows that φ ^ BDNI is more efficient than φ ^ LogNI for estimating φ for tables of moderate and larger size. It is worth noting that for moderate and larger values of λ, the relative efficiency of φ ^ BDNI approaches 1. This indicates that for contingency tables with large cell values, the performance of both estimates is virtually the same. However, the same cannot be said for small λ values.

4.4. Graphical Display for the Asymptotic Distributions of φ ^ L o g N I and φ ^ B D N I

The asymptotic distributions of φ ^ LogNI and φ ^ BDNI , defined by (17) and (18), are graphically demonstrated by considering Figure 1a–h and Figure 2a–h respectively. The graphical displays are shown for a small (λ = 1.5) and large (λ = 50) Poisson parameter and for a 2 × 2 and 4 × 5 contingency table. The same populations of 10,000 φ ^ LogNI and 10,000 φ ^ BDNI values are again considered here, and the sampling distributions have been generated for 1000 samples ranging in size from n = 10 to n = 5000. The histograms depict the sampling distribution of φ ^ LogNI and φ ^ BDNI . They show that, for a small and large Poisson parameter, and for small and moderately sized contingency tables, the distribution of each non-iterative estimate is asymptotically normally distributed.

4.5. An Empirical Study

To highlight the practical implications of the results described above, we shall consider the relative efficiency of the estimates φ ^ LogNI and φ ^ BDNI by studying 13 of the datasets analysed by [40] (Table 1). These data were selected for their common use in categorical data analysis. They have been given the same labels here as were given by [40]; therefore, further details on the context of the data and the key references in which they appear can be found in [40]. These datasets are summarised in Table 5 and vary in size. The smallest contingency table (Visitor) is of size 3 × 3 while the largest contingency table analysed (Occupation) is of size 8 × 8. The sample size also varies, from n = 132 (for Visitor) to n = 25,263 (for Swedish). All the zero-cell frequencies have been replaced by 0.05. Table 5 summarises the relative efficiency of the estimates, as follows. Defined by (19), for each dataset. From these results, the variance of φ ^ BDNI is always less than, or equal to, the variance of φ ^ LogNI for all the datasets. Note that for the datasets Aberdeen, Denmark, and Swedish, all of which have very large cell frequencies, the two variances are identical, resulting in a relative efficiency of 1. This empirically verifies our earlier findings, which state that as the Poisson parameter increases (leading to large randomly generated cell frequencies), the variance of both estimates is virtually identical.

5. Conclusions

This paper examined the issues of bias, variance, and sampling distribution properties and was concerned with two standard approaches for non-iteratively estimating the linear-by-linear parameter of an ordinal log-linear model. We have done so assuming a Poisson sampling scheme, but it can also be adapted for a multinomial sampling scheme; see, for example, [62] for a study of asymptotic results for multinomial models. These approaches to estimation are easy to determine mathematically and so are easier to compute than their iterative counterparts (including Newton’s method and iterative proportional fitting). We have confirmed that the two non-iterative estimation procedures lead to estimates that are unbiased and asymptotically normally distributed. We have also demonstrated empirically, and through simulation, that the variance of the BDNI estimate is less than the variance of the LogNI estimate. This therefore suggests that the BDNI estimate is a more efficient, and reliable, non-iterative estimate than the LogNI estimate. This seems contrary to the findings originally proposed by [40,42,43] and so requires further examination.
In this paper we have examined the simple case where the OLLM consists of the estimation of a single parameter. At present, the non-iterative estimation procedures have not been generalised to incorporate estimations for models with multiple association parameters. In fact, there is only a limited amount of literature available on the specification of such models and the interpretation of the parameters. Therefore, an investigation of this issue, and into the properties of the non-iterative estimation for such models, is a topic for future consideration.

Author Contributions

Conceptualization, S.Z., E.J.B. and I.L.H.; methodology, S.Z., S.A.C., E.J.B. and I.L.H.; software, S.Z. and S.A.C.; validation, S.Z., S.A.C., E.J.B. and I.L.H.; formal analysis, S.Z. and S.A.C.; investigation, S.Z., S.A.C., E.J.B. and I.L.H.; resources, S.Z., S.A.C., E.J.B. and I.L.H.; data curation, S.Z. and E.J.B.; writing—original draft preparation, S.Z. and S.A.C.; writing—review and editing, E.J.B. and I.L.H.; visualization, S.Z., E.J.B. and I.L.H.; supervision, E.J.B. and I.L.H.; project administration, E.J.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

All data appear in their source that is referenced or has been generated for simulation purposes.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Christensen, R. Log-Linear Models and Logistic Regression, 2nd ed.; Springer: New York, NY, USA, 1997; p. 501. [Google Scholar]
  2. Imrey, P.B.; Koch, G.G.; Stokes, M.E. Categorical data analysis: Some reflections on the log-linear model and logistic regression. Part 1: Historical and methodological overview. Int. Stat. Rev. 1981, 49, 265–283. [Google Scholar] [CrossRef]
  3. Agresti, A. Categorical Data Analysis, 3rd ed.; Wiley: Hoboken, NJ, USA, 2013; p. 752. [Google Scholar]
  4. Bartlett, M.S. Contingency table interactions. J. R. Stat. Soc. 1935, 2, 248–252. [Google Scholar] [CrossRef]
  5. Roy, S.N.; Kastenbaum, M.A. On the hypothesis of no “interaction” in a multi-way contingency table. Ann. Math. Stat. 1956, 27, 749–757. [Google Scholar] [CrossRef]
  6. Darroch, J.N. Interaction in multi factor contingency table. J. R. Stat. Soc. Ser. B 1962, 24, 251–263. [Google Scholar] [CrossRef]
  7. Plackett, R.L. A note on interactions in contingency table. J. R. Stat. Soc. Ser. B 1962, 24, 162–166. [Google Scholar] [CrossRef]
  8. Goodman, L.A. Interactions in multi-dimensional contingency tables. Ann. Math. Stat. 1964, 35, 632–646. [Google Scholar] [CrossRef]
  9. Birch, M.W. Maximum likelihood in three-way contingency table. J. R. Stat. Soc. Ser. B 1963, 25, 220–223. [Google Scholar] [CrossRef]
  10. Birch, M.W. A new proof of Pearson-Fisher theorem. Ann. Math. Stat. 1964, 35, 817–824. [Google Scholar] [CrossRef]
  11. Birch, M.W. The detection of partial association I: The 2 × 2 case. J. R. Stat. Soc. Ser. B 1964, 26, 313–324. [Google Scholar] [CrossRef]
  12. Birch, M.W. The detection of partial association II: The general case. J. R. Stat. Soc. Ser. B 1965, 27, 111–124. [Google Scholar] [CrossRef]
  13. Mantel, N. Model for complex contingency tables and polychotomous dosage response curves. Biometrics 1966, 22, 83–95. [Google Scholar] [CrossRef]
  14. David, H.A. First (?) occurrence of common terms in mathematical statistics. Am. Stat. 1995, 49, 121–133. [Google Scholar] [CrossRef]
  15. Bishop, Y.M.M.; Fienberg, S.E. Incomplete two-dimensional contingency tables. Biometrics 1969, 25, 119–128. [Google Scholar] [CrossRef]
  16. Agresti, A. Analysis of Ordinal Categorical Data, 2nd ed.; Wiley: Hoboken, NJ, USA, 2010; p. 424. [Google Scholar]
  17. Haberman, S.J. Log-linear models for frequency tables with ordered classifications. Biometrics 1974, 36, 589–600. [Google Scholar] [CrossRef]
  18. Simon, G. Alternative analysis for the singly ordered contingency table. J. Am. Stat. Assoc. 1974, 69, 971–976. [Google Scholar] [CrossRef]
  19. Ishii-Kuntz, M. Ordinal Log-Linear Models; Sage Publications Inc.: Thousand Oaks, CA, USA, 1994; p. 72. [Google Scholar]
  20. Clogg, C.C.; Shihadeh, E.S. Statistical Models for Ordinal Variables, 1st ed.; Sage: Thousand Oaks, CA, USA, 1994; p. 192. [Google Scholar]
  21. Simonoff, J.S. Analyzing Categorical Data; Springer: New York, NY, USA, 2003; p. 498. [Google Scholar]
  22. Powers, D.A.; Xie, Y. Statistical Methods for Categorical Data Analysis, 2nd ed; Elsevier Science Ltd: London, UK, 2008; pp. 296. [Google Scholar]
  23. Kateri, M. Contingency Table Analysis; Springer: New York, NY, USA, 2014; p. 304. [Google Scholar]
  24. Ishii-Kuntz, M. Association models in family research. J. Marriage Fam. 1991, 53, 337–348. [Google Scholar] [CrossRef]
  25. Siddiqi, J. Log-linear and log-bilinear models with ordinal categories. J. Soc. Sci. Humanit. 1995, 35, 53–60. [Google Scholar]
  26. Agresti, A. Modelling ordered categorical data: Recent advances and future challenges. Stat. Med. 1999, 18, 2191–2207. [Google Scholar] [CrossRef]
  27. Alin, A. Power-divergence test statistics for testing linear by linear association. Commun. Stat. Simul. Comput. 2009, 38, 1381–1390. [Google Scholar] [CrossRef]
  28. Alin, A. Penalized power-divergence test statistics for testing linear-by-linear association. J. Stat. Comput. Simul. 2012, 82, 227–239. [Google Scholar] [CrossRef]
  29. Bagheban, A.A.; Zayeri, F. A generalization of the uniform association model for assessing rater agreement in ordinal scales. J. Appl. Stat. 2010, 37, 1265–1273. [Google Scholar] [CrossRef]
  30. Beh, E.J.; Farver, T.B. A numerical evaluation of the classification of Portuguese red wine. Curr. Anal. Chem. 2012, 8, 218–223. [Google Scholar] [CrossRef] [Green Version]
  31. Kateri, M. Φ-divergence in contingency table analysis. Entropy 2018, 20, 324. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Kateri, M. Families of generalized quasisymmetry models: A Φ-divergence approach. Symmetry 2021, 13, 2297. [Google Scholar] [CrossRef]
  33. Pham, T.M.; Kateri, M. Inference for ordinal log-linear models based on algebraic statistics. J. Algebr. Stat. 2019, 10, 30–50. [Google Scholar] [CrossRef]
  34. Hakimi, A.; Farughi, H.; Amiri, A.; Arkat, J. Phase II monitoring of the ordinal multivariate categorical processes. Adv. Ind. Eng. 2021, 55, 249–267. [Google Scholar] [CrossRef]
  35. Fujisawa, K.; Tahata, K. Quasi association models for square contingency tables with ordinal categories. Symmetry 2022, 14, 805. [Google Scholar] [CrossRef]
  36. Haberman, S.J. The Analysis of Frequency Data; University of Chicago Press: Chicago, IL, USA, 1974; p. 419. [Google Scholar]
  37. Goodman, L.A. Simple models for the analysis of association in cross-classifications having ordered categories. J. Am. Stat. Assoc. 1979, 74, 537–552. [Google Scholar] [CrossRef]
  38. Goodman, L.A. Three elementary views of log-linear models for the analysis of cross-classifications having ordered categories. Sociol. Methodol. 1981, 12, 193–239. [Google Scholar] [CrossRef]
  39. Clogg, C.C. Some models for the analysis of association in multiway cross classifications having ordered categories. J. Am. Stat. Assoc. 1982, 77, 803–815. [Google Scholar] [CrossRef]
  40. Beh, E.J.; Farver, T.B. An evaluation of non-iterative methods for estimating the linear-by-linear parameter for ordinal log-linear models. Aust. N. Z. J. Stat. 2009, 51, 335–352, Erratum in: Aust. N. Z. J. Stat. 2010, 52, 241–242. [Google Scholar] [CrossRef]
  41. Beh, E.J.; Davy, P.J. A non-iterative alternative to ordinal log-linear models. J. Appl. Math. Decis. Sci. 2004, 7, 67–86. [Google Scholar] [CrossRef]
  42. Beh, E.J.; Farver, T.B. On estimating the linear-by-linear parameter for ordinal log-linear models: A computational study. ISRN Comput. Math. 2012, 2012, 340415. [Google Scholar] [CrossRef] [Green Version]
  43. Beh, E.J.; Farver, T.B. A computational study assessing maximum likelihood and non-iterative methods for estimating the linear-by-linear parameter for ordinal log-linear models. ISRN Comput. Math. 2012, 2012, 396831. [Google Scholar] [CrossRef] [Green Version]
  44. Beh, E.J.; Farver, T.B. The Box-Cox transformation and non-iterative estimation methods for ordinal log-linear models. Aust. N. Z. J. Stat. 2012, 54, 475–484. [Google Scholar] [CrossRef]
  45. Zafar, S.; Cheema, S.A.; Beh, E.J.; Hudson, I.L. A study of bias for non-iterative estimates of the linear-by-linear association parameter from the ordinal log-linear model. In Advances on Latent Variables—Methods, Models and Applications; Bretari, E., Carpita, M., Eds.; Vita e Pensiero Publishers: Milan, Italy, 2013; p. 6. ISBN 978 88 343 2556. [Google Scholar]
  46. Von Eye, A.; Mun, E.-Y. Log-Linear Modeling: Concepts, Interpretation and Application; Wiley: Hoboken, NJ, USA, 2013; p. 472. [Google Scholar]
  47. Espendiller, M. Association in Contingency Tables: An Information Theoretic Approach. Unpublished. Ph.D. Thesis, RWTH Aachen University, Aachen, Germany, 2017. [Google Scholar] [CrossRef]
  48. Clayton, D.G. Some odds ratio statistics for the analysis of ordered categorical data. Biometrika 1974, 61, 525–531. [Google Scholar] [CrossRef]
  49. Beh, E.J. Simple correspondence analysis of ordinal cross-classifications using orthogonal polynomials. Biom. J. 1997, 29, 589–613. [Google Scholar] [CrossRef]
  50. Beh, E.J.; Lombardo, R. Correspondence Analysis: Theory, Methods and New Strategies, 1st ed.; Wiley: Chichester, UK, 2014; p. 592. [Google Scholar]
  51. Beh, E.J.; Lombardo, R. An Introduction to Correspondence Analysis, 1st ed.; Wiley: Chichester, UK, 2021; p. 240. [Google Scholar]
  52. Beh, E.J.; Lombardo, R. Features of the polynomial biplot for ordered contingency tables. J. Comput. Graph. Stat. 2022, 31, 403–412. [Google Scholar] [CrossRef]
  53. Lombardo, R.; Beh, E.J.; Kroonenberg, P.M. Modelling trends in ordered correspondence analysis using orthogonal polynomials. Psychometrika 2016, 81, 325–349. [Google Scholar] [CrossRef]
  54. Zafar, S.; Cheema, S.A.; Beh, E.J.; Hudson, I.L.; Hudson, S.A.; Abell, A.D. Linking ordinal log-linear models with correspondence analysis: An application to estimating drug-likeness in the drug discovery process. In MODSIM2013, Proceedings of the 20th International Congress on Modelling and Simulation, Adelaide, Australia, 1–6 December 2013; Piantadosi, J., Anderssen, R.S., Boland, J., Eds.; Modelling and Simulation Society of Australia and New Zealand: Canberra, Australia; pp. 1945–1951. ISBN 978-0-9872143-3-1. [CrossRef]
  55. Zafar, S.; Beh, E.J.; Hudson, I.L. Non-iterative estimation methods for the association parameters of the ordinal log-linear models for three-way tables. In Proceedings of the Australian Statistics Conference 2016 (ASC2016), Canberra, Australia, 5–8 December 2016. [Google Scholar]
  56. Zafar, S.; Hudson, I.L.; Beh, E.J.; Abell, A. A non-iterative approach to ordinal log-linear models: Investigations of log D in drug discovery. In Proceedings of the 31st International Workshop on Statistical Modelling, Rennes, France, 4–8 July 2016. [Google Scholar]
  57. Zafar, S.; Hudson, I.L.; Beh, E.J.; Joyce, P.R. Modelling risk profiles of depression symptoms using Cloninger’s temperament and character traits: A non-iterative approach to assess linear-by-linear association within ordered contingency tables. In MODSIM2015, Proceedings of the 21st International Congress on Modelling and Simulation (MODSIM2015), Melbourne, Australia, 12-15 December 2015; Weber, T., McPhee, M.J., Anderssen, R.S., Eds.; Modelling and Simulation Society of Australia and New Zealand: Canberra, Australia, 2015; pp. 1668–1674. ISBN 978-0-9872143-5-5. [Google Scholar]
  58. Evers, N.; Namboodri, N.K. Monte-Carlo assessment of the stability of log-linear estimates in small sample. In Proceedings of American Statistical Association, Social Statistics Section, Washington, DC, USA; American Statistical Association: Alexandria, VA, USA, 1977. [Google Scholar]
  59. Clogg, C.C.; Eliason, S.R. Some common problems in log-linear analysis. Sociol. Methods Res. 1987, 15, 4–44. [Google Scholar] [CrossRef]
  60. Fienberg, S.E. The Analysis of Cross Classified Categorical Data, 2nd ed.; Springer: New York, NY, USA, 2007; p. 198. [Google Scholar]
  61. Casella, G.; Berger, R.L. Statistical Inference, 2nd ed.; Cengage Learning: Duxbury, MA, USA, 2002; p. 686. [Google Scholar]
  62. Akoto, I.; Mexia, J.T.; Marques, F.J. Asymptotic Results for Multinomial Models. Symmetry 2021, 13, 2173. [Google Scholar] [CrossRef]
Figure 1. Sampling distribution of φ ^ LogNI for various λ and n.
Figure 1. Sampling distribution of φ ^ LogNI for various λ and n.
Computation 10 00206 g001
Figure 2. Graphical display of asymptotic distribution of φ ^ BDNI . .
Figure 2. Graphical display of asymptotic distribution of φ ^ BDNI . .
Computation 10 00206 g002
Table 1. Property of unbiasedness of φ ^ LogNI for varying dimensions, sample sizes, and λ s of simulated contingency tables.
Table 1. Property of unbiasedness of φ ^ LogNI for varying dimensions, sample sizes, and λ s of simulated contingency tables.
Size of Contingency Table
λn2 × 23 × 34 × 45 × 52 × 32 × 42 × 53 × 43 × 54 × 5
φ ^ LogNI p φ ^ LogNI s φ ^ LogNI p φ ^ LogNI s φ ^ LogNI p φ ^ LogNI s φ ^ LogNI p φ ^ LogNI s φ ^ LogNI p φ ^ LogNI s φ ^ LogNI p φ ^ LogNI s φ ^ LogNI p φ ^ LogNI s φ ^ LogNI p φ ^ LogNI s φ ^ LogNI p φ ^ LogNI s φ ^ LogNI p φ ^ LogNI s
1.50.1%−0.0017−0.00180.00260.00430.00330.00130.00400.0054−0.0091−0.01340.00250.00220.00440.00190.00730.00800.00240.0023−0.0024−0.0070
1%−0.0014−0.0011−0.0008−0.00010.00160.0011−0.0058−0.00690.00580.0061−0.0010−0.00100.00760.0083−0.0040−0.0049−0.0075−0.00780.00380.0041
5%0.00210.0024−0.0016−0.0014−0.0042−0.0034−0.0039−0.00410.00150.00110.00100.0011−0.0029−0.0024−0.0042−0.0042−0.0065−0.0063−0.0032−0.0033
15%−0.0002−0.00020.00950.00930.00250.00210.00440.00440.00960.0099−0.0028−0.00270.00230.00240.00430.00470.00680.00710.00390.0044
30%−0.0015−0.0015−0.0066−0.0066−0.0030−0.0030−0.0027−0.00270.00130.0013−0.0007−0.0007−0.0042−0.00420.00430.0043−0.0009−0.0009−0.0031−0.0031
50%0.00160.0016−0.0046−0.00460.00340.00340.00430.00430.00470.0047−0.0016−0.0016−0.0058−0.00580.00280.00280.00110.0011−0.0001−0.0001
50.1%0.00020.0004−0.00080.00210.0001−0.00020.00070.0028−0.0041−0.00280.0022−0.00110.00290.0028−0.0029−0.0032−0.0018−0.00170.00010.0018
1%−0.0007−0.0004−0.0007−0.00120.00250.00260.00170.00150.00660.0074−0.0018−0.00190.00260.00240.00060.00070.00110.0014−0.0010−0.0008
5%0.00020.0003−0.0029−0.00290.00070.00090.00000.0000−0.0014−0.0018−0.0004−0.0007−0.0012−0.00130.00220.0024−0.0013−0.00110.00020.0002
15%−0.0002−0.00020.00200.0020−0.0015−0.0016−0.0013−0.00120.00190.00170.00300.0032−0.0015−0.0013−0.0007−0.0007−0.0028−0.00290.00140.0012
30%−0.0002−0.0002−0.0027−0.0027−0.0007−0.00070.00010.00010.00280.0028−0.0015−0.00150.00050.0005−0.0017−0.0017−0.0003−0.0003−0.0034−0.0034
50%−0.0026−0.0026−0.0005−0.00070.00230.00230.00270.00270.00160.0016−0.0003−0.0003−0.0009−0.00090.00130.00130.00180.00180.00210.0021
200.1%−0.0004−0.00130.0011−0.0005−0.0002−0.00010.00120.0017−0.0002−0.0009−0.0010−0.0001−0.0003−0.0003−0.00020.00040.00100.0005−0.0001−0.0004
1%0.00070.0004−0.0001−0.0003−0.0006−0.00070.00030.00030.00060.00040.00060.0006−0.00020.0002−0.0001−0.00010.00030.00030.00040.0004
5%0.00190.0021−0.0008−0.00070.00100.00100.00050.0004−0.0009−0.0011−0.0013−0.00150.00060.00080.00040.0004−0.0003−0.0003−0.0008−0.0008
15%0.00180.00180.00030.0003−0.0009−0.00100.00030.00030.00180.00180.00050.0006−0.0010−0.00100.00070.00060.00110.0011−0.0007−0.0007
30%−0.0014−0.00140.00050.00050.00030.0003−0.0001−0.0001−0.0004−0.00040.00060.00060.00100.00100.00140.00140.00040.0004−0.0004−0.0004
50%−0.0013−0.0013−0.0024−0.0024−0.0004−0.0004−0.0002−0.00020.00040.00040.00130.0013−0.0006−0.00060.00170.0017−0.0013−0.00130.00070.0007
500.1%0.00030.0018−0.0001−0.00010.00040.0010−0.0004−0.0006−0.0007−0.00020.00040.00190.00040.0002−0.0004−0.00040.00030.0004−0.0006−0.0005
1%−0.0007−0.00030.00040.00040.00010.0001−0.0002−0.0001−0.0007−0.0006−0.0001−0.0003−0.0002−0.0002−0.0001−0.00020.00050.00050.00020.0002
5%0.00050.00040.00130.0012−0.0005−0.0005−0.0001−0.00010.00030.0004−0.0005−0.00050.00120.00120.00060.00060.00020.0002−0.0004−0.0004
15%0.00040.0004−0.0006−0.00060.00010.0001−0.0003−0.0003−0.0008−0.00080.00080.00080.00040.0004−0.0003−0.0002−0.0002−0.0002−0.0005−0.0005
30%0.00090.00090.00030.0003−0.0003−0.00030.00040.0004−0.0006−0.00060.00020.00020.00060.00060.00000.00000.00010.00010.00000.0000
50%0.00160.00160.00050.0005−0.0003−0.0003−0.0004−0.0004−0.0003−0.00030.00040.00040.00010.00010.00030.00030.00010.0001−0.0002−0.0002
Table 2. Property of unbiasedness of φ ^ BDNI for varying dimensions and λ s of simulated contingency tables.
Table 2. Property of unbiasedness of φ ^ BDNI for varying dimensions and λ s of simulated contingency tables.
Size of Contingency Table
λn2 × 23 × 34 × 45 × 52 × 32 × 42 × 53 × 43 × 54 × 5
φ ^ BDNI p φ ^ BDNI s φ ^ BDNI p φ ^ BDNI s φ ^ BDNI p φ ^ BDNI s φ ^ BDNI p φ ^ BDNI s φ ^ BDNI p φ ^ BDNI s φ ^ BDNI p φ ^ BDNI s φ ^ BDNI p φ ^ BDNI s φ ^ BDNI p φ ^ BDNI s φ ^ BDNI p φ ^ BDNI s φ ^ BDNI p φ ^ BDNI s
1.50.1%−0.0010−0.00200.00160.00250.00190.00230.00180.0015−0.0048−0.00120.00160.00170.00360.00020.00430.00400.00140.0045−0.0021−0.0002
1%−0.0010−0.00040.0000−0.00010.00090.0020−0.0035−0.00310.00180.0031−0.0006−0.00070.00400.0042−0.0008−0.0009−0.0045−0.00510.00250.0035
5%0.00100.0010−0.0012−0.0011−0.0024−0.0024−0.0001−0.00010.00080.00110.00030.0001−0.0012−0.0011−0.0031−0.0031−0.0031−0.0033−0.0030−0.0031
15%−0.0003−0.00030.00420.00430.00240.00230.00360.00360.00570.0053−0.0017−0.00170.00190.00230.00070.00070.00430.00430.00140.0013
30%−0.0011−0.0012−0.0038−0.0038−0.0023−0.0023−0.0020−0.00200.00090.0009−0.0001−0.0001−0.0025−0.00250.00330.0033−0.0009−0.0009−0.0012−0.0012
50%0.00070.0007−0.0037−0.00370.00240.00240.00210.00210.00320.0032−0.0016−0.0016−0.0030−0.00300.00110.00110.00100.00100.0001−0.0001
50.1%0.00010.0011−0.0014−0.00020.00020.00210.00050.0001−0.0035−0.00250.00180.00110.00290.0016−0.0020−0.0006−0.0011−0.00090.00030.0012
1%−0.0007−0.0007−0.0007−0.00050.00220.00200.00100.00170.00450.0047−0.0015−0.00250.00200.00220.00090.00120.00140.0015−0.0008−0.0010
5%0.00010.0002−0.0022−0.00220.00060.0009−0.0001−0.0002−0.0010−0.0012−0.0006−0.0006−0.0005−0.00070.00200.0020−0.0009−0.00090.00020.0001
15%−0.0001−0.00010.00120.0012−0.0010−0.0010−0.0005−0.00050.00150.00170.00210.0021−0.0011−0.00130.00000.0000−0.0027−0.00280.00130.0013
30%−0.0002−0.0002−0.0027−0.0027−0.0009−0.00090.00030.00030.00240.0024−0.0011−0.0011−0.0003−0.0003−0.0008−0.0008−0.0001−0.0001−0.0023−0.0023
50%−0.0018−0.0018−0.0014−0.00140.00160.00160.00270.00270.00220.0022−0.0001−0.0001−0.0006−0.00060.00070.00070.00190.00190.00130.0013
200.1%−0.0004−0.00180.00110.0009−0.0002−0.00040.00110.0008−0.0002−0.0012−0.00100.0000−0.0003−0.0003−0.00020.00000.00090.0012−0.0001−0.0001
1%0.00070.0012−0.0002−0.0002−0.0007−0.00060.00040.00040.00050.00090.00050.0002−0.0001−0.0001−0.00010.00030.00020.00030.00040.0004
5%0.00190.0020−0.0007−0.00060.00100.00100.00040.0004−0.0009−0.0009−0.0012−0.00120.00060.00040.00050.0004−0.0003−0.0003−0.0008−0.0007
15%0.00180.00180.00030.0003−0.0009−0.00090.00030.00030.00170.00170.00050.0005−0.0010−0.00090.00060.00060.00120.0012−0.0007−0.0007
30%−0.0014−0.00140.00060.00060.00020.0002−0.0001−0.0001−0.0004−0.00040.00060.00060.00090.00090.00140.00140.00030.0003−0.0004−0.0004
50%−0.0014−0.0014−0.0023−0.0023−0.0004−0.0004−0.0002−0.00020.00040.00040.00130.0013−0.0005−0.00050.00170.0017−0.0012−0.00120.00070.0007
500.1%0.0003−0.0012−0.0001−0.00030.00040.0006−0.0004−0.0003−0.0007−0.00030.00040.00040.0004−0.0003−0.0004−0.00040.00030.0008−0.00060.0001
1%−0.0007−0.00080.00040.00030.00010.0001−0.0002−0.0001−0.0007−0.0007−0.0001−0.0002−0.00020.0000−0.0001−0.00020.00040.00050.00020.0002
5%0.00040.00040.00120.0012−0.0005−0.0005−0.0001−0.00010.00030.0003−0.0005−0.00050.00120.00130.00060.00070.00020.0001−0.0004−0.0004
15%0.00040.0004−0.0006−0.00060.00010.0001−0.0003−0.0003−0.0008−0.00080.00080.00080.00040.0004−0.0002−0.0002−0.0002−0.0002−0.0004−0.0004
30%0.00090.00090.00030.0003−0.0003−0.00030.00040.0004−0.0006−0.00060.00020.00020.00060.0006−0.0001−0.00010.00010.00010.00000.0000
50%0.00160.00160.00050.0005−0.0002−0.0002−0.0004−0.0003−0.0003−0.00030.00040.00040.00010.00010.00030.00030.00010.0001−0.0002−0.0002
Table 3. Asymptotic variances of φ ^ LogNI and φ ^ BDNI for varying dimensions and λ s of simulated contingency tables.
Table 3. Asymptotic variances of φ ^ LogNI and φ ^ BDNI for varying dimensions and λ s of simulated contingency tables.
Size of Contingency Table
λn2 × 23 × 34 × 45 × 52 × 32 × 42 × 53 × 43 × 54 × 5
V φ ^ BDNI V φ ^ LogNI V φ ^ BDNI V φ ^ LogNI V φ ^ BDNI V φ ^ LogNI V φ ^ BDNI V φ ^ LogNI V φ ^ BDNI V φ ^ LogNI V φ ^ BDNI V φ ^ LogNI V φ ^ BDNI V φ ^ LogNI V φ ^ BDNI V φ ^ LogNI V φ ^ BDNI V φ ^ LogNI V φ ^ BDNI V φ ^ LogNI
1.50.1%1.20 × 1091.31 × 10−19.82 × 10−31.35 × 10−22.15 × 10−32.50 × 10−37.92 × 10−48.76 × 10−41.23 × 1033.34 × 10−22.84 × 10−11.47 × 10−21.05 × 10−27.51 × 10−34.11 × 10−35.00 × 10−32.45 × 10−32.87 × 10−31.28 × 10−31.45 × 10−3
1%1.21 × 1091.30 × 10−11.12 × 10−21.16 × 10−22.09 × 10−32.41 × 10−37.96 × 10−48.79 × 10−41.24 × 1033.55 × 10−21.64 × 10−11.43 × 10−26.39 × 10−37.51 × 10−34.10 × 10−35.10 × 10−32.44 × 10−32.83 × 10−31.29 × 10−31.45 × 10−3
5%1.23 × 1091.32 × 10−18.63 × 10−31.23 × 10−22.11 × 10−32.44 × 10−37.92 × 10−48.71 × 10−41.34 × 1033.27 × 10−22.07 × 1001.45 × 10−26.34 × 10−37.44 × 10−34.27 × 10−35.16 × 10−32.43 × 10−32.83 × 10−31.29 × 10−31.46 × 10−3
15%9.77 × 1081.37 × 10−18.62 × 10−31.49 × 10−22.09 × 10−32.43 × 10−37.97 × 10−48.80 × 10−41.25 × 1003.50 × 10−21.37 × 10−11.45 × 10−26.36 × 10−37.67 × 10−34.14 × 10−34.99 × 10−32.43 × 10−32.85 × 10−31.29 × 10−31.45 × 10−3
30%5.50 × 10101.21 × 10−18.56 × 10−31.11 × 10−22.10 × 10−32.45 × 10−37.97 × 10−48.77 × 10−43.93 × 1013.23 × 10−22.27 × 10−21.45 × 10−26.28 × 10−37.61 × 10−34.10 × 10−35.09 × 10−32.44 × 10−32.82 × 10−31.29 × 10−31.46 × 10−3
50%2.74 × 10101.31 × 10−18.47 × 10−32.29 × 10−22.11 × 10−32.47 × 10−37.94 × 10−48.76 × 10−41.06 × 1023.43 × 10−21.54 × 10−11.46 × 10−26.39 × 10−37.53 × 10−34.08 × 10−34.96 × 10−32.44 × 10−32.86 × 10−31.29 × 10−31.46 × 10−3
50.1%3.16 × 10−33.38 × 10−35.44 × 10−45.57 × 10−41.66 × 10−41.68 × 10−46.62 × 10−56.68 × 10−51.30 × 10−31.34 × 10−36.94 × 10−47.08 × 10−44.35 × 10−44.40 × 10−42.97 × 10−43.02 × 10−41.89 × 10−41.91 × 10−41.05 × 10−41.06 × 10−4
1%3.17 × 10−33.38 × 10−35.44 × 10−45.56 × 10−41.65 × 10−41.67 × 10−46.63 × 10−56.69 × 10−51.29 × 10−31.34 × 10−36.94 × 10−47.06 × 10−44.34 × 10−44.40 × 10−43.00 × 10−43.05 × 10−41.88 × 10−41.90 × 10−41.04 × 10−41.05 × 10−4
5%3.17 × 10−33.38 × 10−35.46 × 10−45.59 × 10−41.65 × 10−41.68 × 10−46.64 × 10−56.70 × 10−51.28 × 10−31.32 × 10−36.95 × 10−47.06 × 10−44.33 × 10−44.39 × 10−42.98 × 10−43.03 × 10−41.89 × 10−41.91 × 10−41.04 × 10−41.05 × 10−4
15%3.17 × 10−33.38 × 10−35.50 × 10−45.64 × 10−41.65 × 10−41.67 × 10−46.62 × 10−56.67 × 10−51.28 × 10−31.32 × 10−36.97 × 10−47.08 × 10−44.36 × 10−44.41 × 10−43.01 × 10−43.06 × 10−41.89 × 10−41.91 × 10−41.04 × 10−41.05 × 10−4
30%2.09 × 1023.39 × 10−35.45 × 10−45.57 × 10−41.65 × 10−41.67 × 10−46.64 × 10−56.69 × 10−51.30 × 10−31.33 × 10−36.95 × 10−47.09 × 10−44.36 × 10−44.42 × 10−42.99 × 10−43.04 × 10−41.89 × 10−41.91 × 10−41.05 × 10−41.06 × 10−4
50%3.17 × 10−33.39 × 10−35.47 × 10−45.60 × 10−41.65 × 10−41.67 × 10−46.64 × 10−56.69 × 10−51.29 × 10−31.32 × 10−36.97 × 10−47.10 × 10−44.37 × 10−44.43 × 10−43.00 × 10−43.05 × 10−41.90 × 10−41.92 × 10−41.05 × 10−41.06 × 10−4
200.1%1.64 × 10−41.34 × 10−33.16 × 10−53.16 × 10−59.91 × 10−69.91 × 10−64.03 × 10−64.03 × 10−67.18 × 10−57.18 × 10−54.01 × 10−54.01 × 10−52.55 × 10−52.55 × 10−51.77 × 10−51.77 × 10−51.13 × 10−51.13 × 10−56.32 × 10−66.33 × 10−6
1%1.64 × 10−41.64 × 10−43.16 × 10−53.16 × 10−59.89 × 10−69.90 × 10−64.04 × 10−64.04 × 10−67.16 × 10−57.17 × 10−54.00 × 10−54.01 × 10−52.55 × 10−52.55 × 10−51.76 × 10−51.76 × 10−51.12 × 10−51.13 × 10−56.31 × 10−66.31 × 10−6
5%1.64 × 10−41.64 × 10−43.16 × 10−53.16 × 10−59.88 × 10−69.89 × 10−64.04 × 10−64.04 × 10−67.18 × 10−57.18 × 10−53.99 × 10−53.99 × 10−52.56 × 10−52.56 × 10−51.77 × 10−51.77 × 10−51.13 × 10−51.13 × 10−56.32 × 10−66.32 × 10−6
15%1.64 × 10−41.64 × 10−43.16 × 10−53.16 × 10−59.90 × 10−69.90 × 10−64.03 × 10−64.03 × 10−67.19 × 10−57.19 × 10−54.00 × 10−54.00 × 10−52.55 × 10−52.55 × 10−51.76 × 10−51.77 × 10−51.13 × 10−51.13 × 10−56.32 × 10−66.32 × 10−6
30%1.64 × 10−41.64 × 10−43.17 × 10−53.17 × 10−59.89 × 10−69.89 × 10−64.03 × 10−64.03 × 10−67.18 × 10−57.18 × 10−54.00 × 10−54.00 × 10−52.55 × 10−52.55 × 10−51.77 × 10−51.77 × 10−51.13 × 10−51.13 × 10−56.32 × 10−66.32 × 10−6
50%1.64 × 10−41.64 × 10−43.15 × 10−53.15 × 10−59.89 × 10−69.89 × 10−64.03 × 10−64.03 × 10−67.18 × 10−57.18 × 10−54.01 × 10−54.01 × 10−52.55 × 10−52.55 × 10−51.77 × 10−51.77 × 10−51.13 × 10−51.13 × 10−56.32 × 10−66.32 × 10−6
500.1%2.55 × 10−52.55 × 10−54.98 × 10−64.98 × 10−61.57 × 10−61.57 × 10−66.43 × 10−76.43 × 10−71.12 × 10−51.12 × 10−56.31 × 10−66.31 × 10−64.03 × 10−64.03 × 10−62.79 × 10−62.79 × 10−61.79 × 10−61.79 × 10−61.00 × 10−61.00 × 10−6
1%2.54 × 10−52.54 × 10−54.99 × 10−64.99 × 10−61.57 × 10−61.57 × 10−66.42 × 10−76.42 × 10−71.13 × 10−51.13 × 10−56.31 × 10−66.31 × 10−64.03 × 10−64.03 × 10−62.80 × 10−62.80 × 10−61.79 × 10−61.79 × 10−61.00 × 10−61.00 × 10−6
5%2.54 × 10−52.54 × 10−54.99 × 10−64.99 × 10−61.57 × 10−61.57 × 10−66.42 × 10−76.42 × 10−71.12 × 10−51.12 × 10−56.31 × 10−66.31 × 10−64.03 × 10−64.03 × 10−62.80 × 10−62.80 × 10−61.79 × 10−61.79 × 10−61.01 × 10−61.01 × 10−6
15%2.55 × 10−52.55 × 10−54.98 × 10−64.98 × 10−61.57 × 10−61.57 × 10−66.42 × 10−76.42 × 10−71.13 × 10−51.13 × 10−56.32 × 10−66.32 × 10−64.03 × 10−64.03 × 10−62.80 × 10−62.80 × 10−61.79 × 10−61.79 × 10−61.00 × 10−61.00 × 10−6
30%2.55 × 10−52.55 × 10−54.98 × 10−64.98 × 10−61.57 × 10−61.57 × 10−66.43 × 10−76.43 × 10−71.13 × 10−51.13 × 10−56.32 × 10−66.32 × 10−64.03 × 10−64.03 × 10−62.80 × 10−62.80 × 10−61.79 × 10−61.79 × 10−61.00 × 10−61.00 × 10−6
50%2.54 × 10−52.54 × 10−54.99 × 10−64.99 × 10−61.57 × 10−61.57 × 10−66.42 × 10−76.42 × 10−71.13 × 10−51.13 × 10−56.29 × 10−66.29 × 10−64.03 × 10−64.03 × 10−62.80 × 10−62.80 × 10−61.79 × 10−61.79 × 10−61.00 × 10−61.00 × 10−6
Table 4. Relative efficiencies, RE, of φ ^ LogNI and φ ^ BDNI for varying dimensions and λ s of simulated contingency tables.
Table 4. Relative efficiencies, RE, of φ ^ LogNI and φ ^ BDNI for varying dimensions and λ s of simulated contingency tables.
Size of Contingency Table
λn2 × 23 × 34 × 45 × 52 × 32 × 42 × 53 × 43 × 54 × 5
1.50.1%9,189,606,1210.727849560.858854590.904532236992.4119.315671.4010920.8211980.8546020.885681
1%9,240,148,5090.962023130.865698790.906076934833.5911.429920.8514440.803740.8603280.885121
5%9,334,020,6050.699061250.862256390.908559340875.57142.98420.8531470.8280060.8609190.886632
15%7,134,124,2620.577584610.861987720.905476835.836119.4240740.829110.8296650.8535020.889904
30%4.5422 × 10110.774004850.858787190.90921361218.3041.5691960.8253330.8064180.8657890.884679
50%2.0874 × 10110.37019730.855749670.90675573102.50910.560860.8476280.8225090.8518450.888767
50.1%0.933988030.978074890.987869160.99141410.9699940.9805040.9879170.9832660.987520.989555
1%0.939078450.977466330.986984520.99125390.9647270.9818220.9869710.983110.988340.989857
5%0.937323910.978219170.987654070.99158090.9693240.9835930.9871180.9853810.9867630.989947
15%0.936857050.975562750.988761690.99195140.9702510.9844320.9882780.9839980.9873230.990359
30%61704.35880.977819520.987725860.99143440.9714970.981230.9869970.9831680.9878510.990201
50%0.935174170.976732070.987460030.99176180.9739750.9808960.9865410.9834510.9873560.989454
200.1%0.122851760.999737340.999737020.9998170.9996220.9997560.9997870.9997030.9997670.999772
1%0.999552240.999657130.999743760.99983170.9997620.9996920.9997850.9997550.9997290.999804
5%0.999606420.999676570.999753180.99981850.9997510.9997710.9997710.9997170.9997690.999792
15%0.999753820.999624950.999764030.99981310.999710.9997970.9998020.9997260.9997620.999803
30%0.999862210.999665880.999761520.99982270.9996950.9997990.9997790.9997450.9997690.999796
50%0.999949440.999613420.999740010.99981510.9997690.9998150.9997850.99970.9997850.999781
500.1%0.999950920.999956840.999961160.99997540.9999630.999970.9999770.9999570.9999630.999965
1%0.999981920.999957710.999962470.99997270.9999680.9999610.999980.9999570.999970.99997
5%0.999963420.999942060.999964340.99997170.9999790.9999650.9999670.9999540.9999620.999966
15%0.999917970.999955850.999968160.99997450.999970.9999720.9999720.9999540.9999630.999967
30%0.999981940.999954790.999963080.99997120.999970.9999590.9999720.9999580.999970.99997
50%0.999934740.999949460.999970710.99997540.9999560.9999780.9999730.9999710.9999690.999969
Table 5. Standard errors and efficiency of φ ^ B D N I and φ ^ L o g N I for 13 datasets.
Table 5. Standard errors and efficiency of φ ^ B D N I and φ ^ L o g N I for 13 datasets.
Data n V φ ^ LogNI V φ ^ BDNI Efficiency
Calcium (4 × 4)1367.9032 × 10−56.0528 × 10−50.76587
Dreams (5 × 4)2332.2753 × 10−52.0794 × 10−50.91389
Aberdeen (4 × 5)22,3612.5000 × 10−92.5000 × 10−91.00000
Caithness (4 × 5)53874.8400 × 10−83.6100 × 10−80.74587
Denmark (4 × 5)70251.9600 × 10−81.9600 × 10−81.00000
Swedish (4 × 5)25,2631.6000 × 10−91.6000 × 10−91.00000
Visitor (3 × 3)1327.5690 × 10−55.9598 × 10−50.78740
Socec (4 × 6)16603.8440 × 10−73.6000 × 10−70.93652
Occupation (8 × 8)34981.3690 × 10−71.2960 × 10−70.94668
Dumping (4 × 3)4175.8081 × 10−65.7600 × 10−60.99172
Ideology (3 × 3)10831.0201 × 10−68.4640 × 10−70.82972
Status (3 × 3)34973.6100 × 10−82.8900 × 10−80.80055
Opinion (4 × 4)9261.3225 × 10−61.2544 × 10−60.94851
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zafar, S.; Cheema, S.A.; Beh, E.J.; Hudson, I.L. Asymptotic Characteristics of the Non-Iterative Estimates of the Linear-by-Linear Association Parameter for Ordinal Log-Linear Models. Computation 2022, 10, 206. https://doi.org/10.3390/computation10120206

AMA Style

Zafar S, Cheema SA, Beh EJ, Hudson IL. Asymptotic Characteristics of the Non-Iterative Estimates of the Linear-by-Linear Association Parameter for Ordinal Log-Linear Models. Computation. 2022; 10(12):206. https://doi.org/10.3390/computation10120206

Chicago/Turabian Style

Zafar, Sidra, Salman A. Cheema, Eric J. Beh, and Irene L. Hudson. 2022. "Asymptotic Characteristics of the Non-Iterative Estimates of the Linear-by-Linear Association Parameter for Ordinal Log-Linear Models" Computation 10, no. 12: 206. https://doi.org/10.3390/computation10120206

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop