Calculation of Entropy for a Sinusoid with Beta-Distributed Phase

Abstract

In this paper, an analytical expression is developed for the differential entropy of a sinusoid with a Beta-distributed phase angle. This particular signal model is prevalent in optical communications, however an expression for the associated differential entropy does not currently exist. The expression we derive is approximate as it relies on a series expansion for one of the key terms needed in the derivation. However, we are able to show that the approximation is accurate (error $\le 5\%$) for a wide variety of Beta parameter choices.

1. Introduction

The concept of entropy as a measure of information was introduced by Shannon [1] and has since been discussed in many books (e.g., see [2], [3]). Entropy has played a central role in the field of communications, providing limits on both data compression and channel capacity [2]. Entropy-based signal processing techniques and analysis have also enjoyed a great deal of success in a diverse set of applications ranging from ecological system monitoring [4] to crystallography [5]. Successful application of entropy-based approaches is often predicated on having analytical expressions for the entropy of a given signal model, particularly in the communications field (e.g., see [6]. For some probability distributions expressions for differential entropy are well known (e.g., see Table 17.1 in reference [2]) while for others such expressions have not yet been derived.

This work derives the differential entropy for harmonic signals with non-uniform (Beta) distributed phase. In a number of applications the signal under study is harmonic and the primary uncertainty mechanism giving rise to the probability distribution is the phase noise which can be distributed non-uniformly. Optical communications strategies, for example, often involve the phase modulation of a carrier signal and subsequent demodulation at the receiver. The measured photocurrent at the receiver takes the general form [7]

$$\begin{array}{c}\hfill I(t)=I_1\left(1-\cos \left(\Delta \theta (t)+\Delta \varphi (t)\right)\right)\end{array}$$

(1)

where $I_1$ is a scalar amplitude, $\Delta \theta (t)$ contains the desired information, and $\Delta \varphi (t)$ represents the noise. In differential phase shift keying, the probability distribution function associated with $\Delta \varphi (t)$ has been modeled both as a Gaussian and as a uni-modal (but not Gaussian) distribution [7], [8]. Specifically, Ho [9] found the distribution to be a convolution of a Gaussian and a non-central chi-squared distribution with two degrees-of-freedom.

An additional situation in which the signal model (1) appears is in interferometric measurement or detection systems [10]. In these applications the goal is still the same as in communications: to recover the parameter $\Delta \theta$ given phase noise $\Delta \varphi$. The work of Arie et al. considered a Gaussian phase model [10] while Freitas [11] considered a non-Gaussian phase-noise model. Calculation of the differential entropy for the case of a sinusoid with non-uniform phase distributions does not appear in the literature however.

This paper will therefore derive the differential entropy for the sine wave for the case when the phase angle is Beta-distributed. The Beta distribution is an extremely flexible distribution possessing finite support and can be made, via appropriate choice of parameters, to approximate a number of other well-known distributions. The uniform distribution, for example, is a special case of the Beta distribution. It will be shown, in fact, that for appropriate choice of parameters the differential entropy for the Beta-distributed phase case reduces to that of the well-known expression for differential entropy associated with a uniform distributed phase.

2. Mathematical Development and Results

The following notation will be utilized. The differential entropy for a continuous random variable, X, with probability density function $p(x)$ is given by

$$\begin{array}{c}\hfill h(X)=-\underset{S}{\overset{}{\int }}p(x)log\left[p(x)\right]dx\end{array}$$

(2)

where $S=\left\{x\right|p(x)>0\}$ is the support set of X. Here log usually means ${log}_2$. If the log is taken to the base e, the notation $h_e(X)$ is used. Consider the sinusoidal signal written as:

$$Y=A\sin \theta$$

where θ is uniformly distributed on $[-\pi ,\pi ]$ (A similar discussion applies if $Y=A\sin (\omega \theta )$ or $Y=A\sin (\theta +\varphi )$, where ω and ϕ are constants). It is well known that this signal has a probability density function given by

$$\begin{array}{ccc}\hfill p(y)& =& \frac{1}{\pi \sqrt{A^2-y^2}}-A<y<A\hfill \end{array}$$

(3)

and possesses zero mean and variance ${\sigma }^2=A^2/2$ [12]. For this distribution the associated differential entropy can be computed by introducing the transformation $z=\frac{y}{2A}+\frac{1}{2}$ which yields the probability density function

$$\begin{array}{ccc}\hfill p(z)& =& \frac{1}{\pi \sqrt{z(1-z)}}\hfill \\ & =& \frac{\Gamma \left[1\right]}{\Gamma \left[\frac{1}{2}\right]\Gamma \left[\frac{1}{2}\right]}{z}^{-\frac{1}{2}}{(1-z)}^{-\frac{1}{2}}\hfill \end{array}$$

(4)

where $\Gamma (·)$ is the Gamma function. Equation (4) defines the Beta distribution, with differential entropy given by

$$\begin{array}{ccc}\hfill h_e(Z)& =& \ln \left(B(\frac{1}{2},\frac{1}{2})\right)+\Psi \left(\frac{1}{2}\right)-\Psi \left(1\right)\hfill \\ & =& \ln (\pi )-\gamma -2\ln (2)+\gamma \hfill \\ & =& \ln \left(\frac{\pi }{4}\right)\hfill \end{array}$$

(5)

where $B(·,·)$ is the Beta function and $\Psi (·)$ is the Digamma function (see Cover & Thomas [2] p. 486) so

$$h(Z)={log}_2\left(\frac{\pi }{4}\right)\mathrm{bits}.$$

(6)

Consequently

$$\begin{array}{ccc}\hfill h(Y)& =& h(2AZ-A)=h(2AZ)=h(Z)+{log}_2\left(\left|2A\right|\right)\hfill \\ & =& {log}_2\left(\frac{\pi A}{2}\right)\hfill \end{array}$$

(7)

Note that $h(Y)$ can be positive or negative, depending on the value of A. This is a well known result, e.g., see [6]. Indeed the entropy of arbitrary Beta distributions is known [13]. Next it will be shown that the result given by Equation (7) is a special case of the differential entropy of a sine-wave with a Beta-distributed phase angle.

The probability density function for a Beta-distributed random variable on [0,1] is expressed as:

$$\begin{array}{c}\hfill f(x)=\frac{\Gamma (\eta +\gamma )}{\Gamma (\eta )\Gamma (\gamma )}{x}^{\gamma -1}{(1-x)}^{\eta -1}0\le x\le 1\end{array}$$

(8)

where $\eta >0$, $\gamma >0$.

The transformation $\theta =\pi (x-\frac{1}{2})$ provides

$$\begin{array}{c}\hfill f(\theta )=\frac{1}{\pi }\frac{\Gamma (\eta +\gamma )}{\Gamma (\eta )\Gamma (\gamma )}{\left(\frac{1}{2}+\frac{\theta }{\pi }\right)}^{\gamma -1}{\left(\frac{1}{2}-\frac{\theta }{\pi }\right)}^{\eta -1}-\frac{\pi }{2}\le \theta \le \frac{\pi }{2}\end{array}$$

(9)

as the Beta distribution on the interval $[-\frac{\pi }{2},\frac{\pi }{2}]$. Consequently, the sine wave $Z=A\sin \theta$, where θ is Beta-distributed on $[-\frac{\pi }{2},\frac{\pi }{2}]$ has probability density function:

$$\begin{array}{ccc}\hfill p(z)& =& \frac{\frac{1}{\pi }\frac{\Gamma (\eta +\gamma )}{\Gamma (\eta )\Gamma (\gamma )}{\left(\frac{1}{2}+\frac{\theta }{\pi }\right)}^{\gamma -1}{\left(\frac{1}{2}-\frac{\theta }{\pi }\right)}^{\eta -1}}{A\cos \theta }\hfill \\ & =& \frac{1}{\pi }\frac{\Gamma (\eta +\gamma )}{\Gamma (\eta )\Gamma (\gamma )}\frac{{\left(\frac{1}{2}+\frac{1}{\pi }{\sin }^{-1}\frac{z}{A}\right)}^{\gamma -1}{\left(\frac{1}{2}-\frac{1}{\pi }{\sin }^{-1}\frac{z}{A}\right)}^{\eta -1}}{\sqrt{A^2-z^2}}-A<z<A\hfill \end{array}$$

(10)

The differential entropy for Z in nats, is calculated as follows:

$$\begin{array}{c}\hfill h_e(Z)=-\underset{-A}{\overset{A}{\int }}\frac{1}{\pi }\frac{\Gamma (\eta +\gamma )}{\Gamma (\eta )\Gamma (\gamma )}\frac{{\left(\frac{1}{2}+\frac{1}{\pi }{\sin }^{-1}\frac{z}{A}\right)}^{\gamma -1}{\left(\frac{1}{2}-\frac{1}{\pi }{\sin }^{-1}\frac{z}{A}\right)}^{\eta -1}}{\sqrt{A^2-z^2}}\cdots \\ \hfill \ln \left[\frac{\frac{1}{\pi }\frac{\Gamma (\eta +\gamma )}{\Gamma (\eta )\Gamma (\gamma )}{\left(\frac{1}{2}+\frac{1}{\pi }{\sin }^{-1}\frac{z}{A}\right)}^{\gamma -1}{\left(\frac{1}{2}-\frac{1}{\pi }{\sin }^{-1}\frac{z}{A}\right)}^{\eta -1}}{\sqrt{A^2-z^2}}\right]dz\end{array}$$

(11)

Letting $w={\sin }^{-1}\left(\frac{z}{A}\right)$, so $z=A\sin w$ and $dz=A\cos wdw$, gives:

$$\begin{array}{c}\hfill h_e(Z)=-\underset{-\frac{\pi }{2}}{\overset{\frac{\pi }{2}}{\int }}\frac{1}{\pi }\frac{\Gamma (\eta +\gamma )}{\Gamma (\eta )\Gamma (\gamma )}\frac{{\left(\frac{1}{2}+\frac{w}{\pi }\right)}^{\gamma -1}{\left(\frac{1}{2}-\frac{w}{\pi }\right)}^{\eta -1}}{A\cos w}\left[\ln \left(\frac{1}{\pi }\frac{\Gamma (\eta +\gamma )}{\Gamma (\eta )\Gamma (\gamma )}\right)\right.\\ \hfill \left.+(\gamma -1)\ln \left(\frac{1}{2}+\frac{w}{\pi }\right)+(\eta -1)\ln \left(\frac{1}{2}-\frac{w}{\pi }\right)-\ln (A\cos w)\right]A\cos wdw\end{array}$$

(12)

so

$$\begin{array}{cc}\hfill h_e(Z)=\ln \left[\pi B(\eta ,\gamma )\right]& -\frac{1}{\pi B(\eta ,\gamma )}\left[(\gamma -1)\underset{-\frac{\pi }{2}}{\overset{\frac{\pi }{2}}{\int }}{\left(\frac{1}{2}+\frac{w}{\pi }\right)}^{\gamma -1}{\left(\frac{1}{2}-\frac{w}{\pi }\right)}^{\eta -1}\ln \left(\frac{1}{2}+\frac{w}{\pi }\right)dw\right.\hfill \\ & +(\eta -1)\underset{-\frac{\pi }{2}}{\overset{\frac{\pi }{2}}{\int }}{\left(\frac{1}{2}+\frac{w}{\pi }\right)}^{\gamma -1}{\left(\frac{1}{2}-\frac{w}{\pi }\right)}^{\eta -1}\ln \left(\frac{1}{2}-\frac{w}{\pi }\right)dw\hfill \\ & -\left.\underset{-\frac{\pi }{2}}{\overset{\frac{\pi }{2}}{\int }}{\left(\frac{1}{2}+\frac{w}{\pi }\right)}^{\gamma -1}{\left(\frac{1}{2}-\frac{w}{\pi }\right)}^{\eta -1}\ln (A\cos w)dw\right]\hfill \end{array}$$

(13)

where we have made the substitution for the Beta function $B(\eta ,\gamma )=\frac{\Gamma (\eta )\Gamma (\gamma )}{\Gamma (\eta +\gamma )}$.

Setting $u=\frac{1}{2}+\frac{w}{\pi }$ in the first integral of Equation (13) leads to:

$$\pi \underset{0}{\overset{1}{\int }}{u}^{\gamma -1}{(1-u)}^{\eta -1}\ln udu$$

which is equal to

$$\begin{array}{c}\hfill \pi B(\eta ,\gamma )[\Psi (\gamma )-\Psi (\gamma +\eta )]\end{array}$$

(14)

from formula 4.253(1) of Gradshteyn and Ryzhik [14]. Similarly, setting $v=\frac{1}{2}-\frac{w}{\pi }$ in the second integral gives:

$$\begin{array}{c}\hfill \pi B(\eta ,\gamma )[\Psi (\eta )-\Psi (\gamma +\eta )]\end{array}$$

(15)

Finally, setting $u=\frac{1}{2}+\frac{w}{\pi }$ in the third integral and noting that $\sin \pi u=\sin (w+\frac{\pi }{2})=\cos w$, we obtain

$$\begin{array}{cc}\hfill \underset{-\frac{\pi }{2}}{\overset{\frac{\pi }{2}}{\int }}{\left(\frac{1}{2}+\frac{w}{\pi }\right)}^{\gamma -1}{\left(\frac{1}{2}-\frac{w}{\pi }\right)}^{\eta -1}& \ln (A\cos w)dw=\pi \underset{0}{\overset{1}{\int }}{u}^{\gamma -1}{(1-u)}^{\eta -1}\ln (A\sin \pi u)du\hfill \\ & =\pi \left[\ln A\underset{0}{\overset{1}{\int }}{u}^{\gamma -1}{(1-u)}^{\eta -1}du+\underset{0}{\overset{1}{\int }}{u}^{\gamma -1}{(1-u)}^{\eta -1}\ln (\sin \pi u)du\right]\hfill \\ & =\pi B(\eta ,\gamma )\ln A+\pi \underset{0}{\overset{1}{\int }}{u}^{\gamma -1}{(1-u)}^{\eta -1}\ln (\sin \pi u)du\hfill \end{array}$$

(16)

Collecting terms gives

$$\begin{array}{cc}\hfill h_e(Z)& =\ln [\pi AB(\eta ,\gamma )]-(\gamma -1)\Psi (\gamma )-(\eta -1)\Psi (\eta )+(\eta +\gamma -2)\Psi (\gamma +\eta )\hfill \\ & +\frac{1}{B(\eta ,\gamma )}\underset{0}{\overset{1}{\int }}{u}^{\gamma -1}{(1-u)}^{\eta -1}\ln (\sin \pi u)du\hfill \end{array}$$

(17)

The last term is the average of the function $\ln (\sin \pi u)du$ over the Beta distribution. Unfortunately, there does not appear to be an analytic solution for this integral.

A variety of Beta distributions (taken from Hahn and Shapiro, [15]) are shown in Figure 1, along with the corresponding differential entropy, h, for a sine wave of amplitude $A=1$. These entropies are expressed in bits, so the values of $h_e$ obtained from Equation (17) are divided by $\ln 2$. The last term in (17) is calculated by standard numerical integration techniques.

Figure 1. Beta distributions with different parameter values and the associated entropy values, h, (in bits).

We now derive an analytic approximation for the integral term in Equation (17) which is valid when $\eta \ge 1$ and $\gamma \ge 1$. This technique is based on the following integral found in Gradshteyn and Ryzhik ([14], formula 3.768(11)):

$$\begin{array}{c}\hfill \underset{0}{\overset{1}{\int }}{u}^{\gamma -1}{(1-u)}^{\eta -1}\sin audu=-\frac{i}{2}B(\eta ,\gamma )\left[{}_1{\text{F}}_1(\gamma ;\gamma +\eta ;ia)-{}_1{\text{F}}_1(\gamma ;\gamma +\eta ;-ia)\right]\end{array}$$

(18)

and its companion (formula 3.768(12)):

$$\begin{array}{c}\hfill \underset{0}{\overset{1}{\int }}{u}^{\gamma -1}{(1-u)}^{\eta -1}\cos audu=\frac{1}{2}B(\eta ,\gamma )\left[{}_1{\text{F}}_1(\gamma ;\gamma +\eta ;ia)+{}_1{\text{F}}_1(\gamma ;\gamma +\eta ;-ia)\right]\end{array}$$

(19)

both expressed in terms of generalized hypergeometric series. In fact, ${}_1{\text{F}}_1$ is defined by:

$$\begin{array}{c}\hfill {}_1{\text{F}}_1(\alpha ;\beta ;\zeta )=\sum _{n=0}^{\infty }\frac{{(\alpha )}_n}{{(\beta )}_n}\frac{{\zeta }^n}{n!}\end{array}$$

(20)

where ${(\alpha )}_n$ denotes the product $\alpha (\alpha +1)(\alpha +2)\cdots (\alpha +n-1)$ for $n>0$ and ${(\alpha )}_0=1$. ${(\beta )}_n$ is similarly defined. Note that Mathematica also gives expressions for the integrals in (18) and (19); these formulas are in terms of the ${}_2{\text{F}}_3$ generalized hypergeometric series and, with a bit of manipulation, can be shown to be equivalent to the expressions above.

We make use of the power series expansion:

$$\begin{array}{c}\hfill \ln (1-x)=-\left(x+\frac{x^2}{2}+\frac{x^3}{3}+\frac{x^4}{4}+\dots \right)\end{array}$$

which converges for $\left|x\right|<1$, and apply it to $x=1-\sin \pi u$ since $|1-\sin \pi u|<1$ for $0<u<1$. This gives

$$\ln (\sin \pi u)=-\left[(1-\sin \pi u)+\frac{{(1-\sin \pi u)}^2}{2}+\frac{{(1-\sin \pi u)}^3}{3}+\frac{{(1-\sin \pi u)}^4}{4}+\dots \right]$$

We wish to choose N such that the first N terms of this series converge closely enough to $\ln (\sin \pi u)$ for purposes of calculating the integral in Equation (17). We have found that this approximation will be valid when $\eta \ge 1$ and $\gamma \ge 1$. If either η or γ is less than unity, then the contribution to the integral near the endpoints at $u=0$ and $u=1$ will exceed the precision of the power series convergence near those points.

Accordingly,

$$\begin{array}{c}\hfill \ln (\sin \pi u)\approx -\left[1-\sin \pi u+\frac{1}{2}(1-2\sin \pi u+{\sin }^2\pi u)+\frac{1}{3}(1-3\sin \pi u+3{\sin }^2\pi u-{\sin }^3\pi u)+\dots \right.\\ \hfill \left.+\frac{1}{N}\sum _{i=0}^N\left(\genfrac{}{}{0pt}{}{N}{i}\right){(-1)}^i{(\sin \pi u)}^i\right]\end{array}$$

Collecting the coefficients of like powers of $\sin \pi u$, we can write $\ln (\sin \pi u)$ as

$$\begin{array}{c}\hfill \ln (\sin \pi u)\approx -\sum _{j=0}^N{d}_j(N){(\sin \pi u)}^j\end{array}$$

(21)

where

$$d_0(N)=\sum _{k=1}^N\frac{1}{k}$$

and

$$d_j(N)={(-1)}^j\sum _{k=j}^N\frac{1}{k}\left(\genfrac{}{}{0pt}{}{k}{j}\right)j=1,2,\dots ,N.$$

This is an unusual approximation since it is clear that the coefficients diverge as $N\to \infty$. However, the coefficients have alternating signs and our calculations show that the approximation is increasingly good for small values of N up to about $N=50$, at which point we begin losing precision. For example consider the approximation obtained with $N=24$ terms. In this case the coefficients are given by the values shown in Table 1.

Table 1. Coefficients for the approximation of $\ln (\sin (\pi u))$ using $N=24$ terms.

j	0	1	2	3	4	5	6	7	8	9	10	11	12
$d_j(N)$	3.776	-24	138	-674.67	2656.5	-8500.8	22433	-49443	91934	-145278	196126	-226922	225346
j	13	14	15	16	17	18	19	20	21	22	23	24
$d_j(N)$	192011	140090	-87167	45967	-20359	7477.6	-2237.1	531.30	-96.38	12.55	-1.043	0.0417

Table 1. Coefficients for the approximation of $\ln (\sin (\pi u))$ using $N=24$ terms.

j	0	1	2	3	4	5	6	7	8	9	10	11	12
$d_j(N)$	3.776	-24	138	-674.67	2656.5	-8500.8	22433	-49443	91934	-145278	196126	-226922	225346
j	13	14	15	16	17	18	19	20	21	22	23	24
$d_j(N)$	192011	140090	-87167	45967	-20359	7477.6	-2237.1	531.30	-96.38	12.55	-1.043	0.0417

We further expand Equation (21) by expressing powers of $\sin x$ as linear combinations of sines and cosines of multiples of x (see Gradshteyn and Ryzhik, [4] pp. 25-26). In general, for any positive integer n,

$$\begin{array}{c}\hfill {(\sin x)}^{2n}=\frac{1}{2^{2n}}\left[\sum _{k=0}^{n-1}{(-1)}^{n-k}2\left(\genfrac{}{}{0pt}{}{2n}{k}\right)\cos (2(n-k)x)+\left(\genfrac{}{}{0pt}{}{2n}{n}\right)\right]\end{array}$$

(22)

and

$$\begin{array}{c}\hfill {(\sin x)}^{2n-1}=\frac{1}{2^{2n-2}}\sum _{k=0}^{n-1}{(-1)}^{n+k-1}\left(\genfrac{}{}{0pt}{}{2n-1}{k}\right)\sin ((2n-2k-1)x)\end{array}$$

(23)

Combining (21), (22), and (23) leads to the conclusion that $\ln (\sin \pi u)$ is (approximately) expressible as a linear combination of terms of the form $\sin (m\pi u)$, $\cos (m\pi u)$, and constant terms. Consequently, the integral in Equation (17):

$${\int }_0^1{u}^{\gamma -1}{(1-u)}^{\eta -1}\ln (\sin \pi u)du$$

can be written as a linear combination of integrals of the form:

$${\int }_0^1{u}^{\gamma -1}{(1-u)}^{\eta -1}du=B(\eta ,\gamma )$$

$${\int }_0^1{u}^{\gamma -1}{(1-u)}^{\eta -1}\sin (m\pi u)du$$

$$\begin{array}{c}\hfill {\int }_0^1{u}^{\gamma -1}{(1-u)}^{\eta -1}\cos (m\pi u)du\end{array}$$

which are given analytically by Equations (18) and (19).

Results for this analytic approximation are shown in Table 2 for two values of N. The last term of Equation (17) is shown, as well as the resulting value of differential entropy $h_e(Z)$ in nats. Again, the amplitude of the sine wave is taken to be $A=1$. Clearly the approximation is a good one, particularly for $N=45$. We find that for a wide variety of Beta parameters the error in the approximation is $\le 5\%$. For larger values of N, we find that the quality of the results degrade. Specifically, we find that the values in the range $40\le N\le 50$ give the best results.

Table 2. Accuracy of the Analytical Approximations of the Entropy for Various Values of $\eta \ge 1$ and $\gamma \ge 1$.

		$\frac{1}{B(\eta ,\gamma )}{\int }_0^1{u}^{\gamma -1}{(1-u)}^{\eta -1}\ln (\sin \pi u)du$			Entropy $h_e(Z)$ (in nats)
			Analytical Approximation			Analytical Approximation
η	γ	Numerical Integration	$N=24$	$N=45$	Numerical Integration	$N=24$	$N=45$
1	1	-0.6931	-0.6677	-0.6793	0.4516	0.4771	0.4654
2	2	-0.3278	-0.3268	-0.3274	0.6919	0.6928	0.6922
3	3	-0.2141	-0.2140	-0.2141	0.6627	0.6628	0.6628
5	5	-0.1264	-0.1264	-0.1264	0.5377	0.5377	0.5377
2	1	-0.6931	-0.6677	-0.6793	0.2584	0.2839	0.2723
1.5	3	-0.4970	-0.4916	-0.4948	0.3747	0.3801	0.3769
1.5	5	-0.7485	-0.7377	-0.7443	-0.1837	-0.1729	-0.1794
3	1.5	-0.4970	-0.4916	-0.4948	0.3747	0.3801	0.3769
5	1.5	-0.7485	-0.7377	-0.7443	-0.1837	-0.1729	-0.1794

Table 2. Accuracy of the Analytical Approximations of the Entropy for Various Values of $\eta \ge 1$ and $\gamma \ge 1$.

		$\frac{1}{B(\eta ,\gamma )}{\int }_0^1{u}^{\gamma -1}{(1-u)}^{\eta -1}\ln (\sin \pi u)du$			Entropy $h_e(Z)$ (in nats)
			Analytical Approximation			Analytical Approximation
η	γ	Numerical Integration	$N=24$	$N=45$	Numerical Integration	$N=24$	$N=45$
1	1	-0.6931	-0.6677	-0.6793	0.4516	0.4771	0.4654
2	2	-0.3278	-0.3268	-0.3274	0.6919	0.6928	0.6922
3	3	-0.2141	-0.2140	-0.2141	0.6627	0.6628	0.6628
5	5	-0.1264	-0.1264	-0.1264	0.5377	0.5377	0.5377
2	1	-0.6931	-0.6677	-0.6793	0.2584	0.2839	0.2723
1.5	3	-0.4970	-0.4916	-0.4948	0.3747	0.3801	0.3769
1.5	5	-0.7485	-0.7377	-0.7443	-0.1837	-0.1729	-0.1794
3	1.5	-0.4970	-0.4916	-0.4948	0.3747	0.3801	0.3769
5	1.5	-0.7485	-0.7377	-0.7443	-0.1837	-0.1729	-0.1794

3. Conclusions

This paper provides an analytical approximation for the differential entropy of a sine wave with a Beta-distributed phase angle. The results predicted by the expression are in good agreement with those obtained via numerical integration for Beta distribution parameters $\eta \ge 1$ and $\gamma \ge 1$. For all parameter combinations we have looked at, the error in the approximation is $\le 5\%$ when a reasonable number of terms are used in the approximation ($N=45$). The result for a uniformly-distributed phase angle is also included as a special case of our more general result. The derived expression may prove useful in entropy-based calculations for signals in which a non-uniform phase distribution model is appropriate.