Wrapped normal distribution explained

In probability theory and directional statistics, a wrapped normal distribution is a wrapped probability distribution that results from the "wrapping" of the normal distribution around the unit circle. It finds application in the theory of Brownian motion and is a solution to the heat equation for periodic boundary conditions. It is closely approximated by the von Mises distribution, which, due to its mathematical simplicity and tractability, is the most commonly used distribution in directional statistics.^[1]

Definition

The probability density function of the wrapped normal distribution is^[2]

WN(\theta;\mu,\sigma)=	1
	\sigma\sqrt{2\pi

} \sum^_ \exp \left[\frac{-(\theta - \mu + 2\pi k)^2}{2 \sigma^2} \right],where μ and σ are the mean and standard deviation of the unwrapped distribution, respectively. Expressing the above density function in terms of the characteristic function of the normal distribution yields:^[2]

WN(\theta;\mu,\sigma)=	1
	2\pi

	infty
\sum
	n=-infty

	-\sigma²ⁿ^{2/2+in(\theta-\mu)}
e		=

	1	\vartheta\left(
	2\pi

	\theta-\mu	,
	2\pi

	i\sigma²
	2\pi

\right),

where

\vartheta(\theta,\tau)

is the Jacobi theta function, given by

	infty
\vartheta(\theta,\tau)=\sum
	n=-infty

(w²⁾ⁿ

	n²
q

wherew\equive^i\pi

and

q\equive^i\pi\tau.

The wrapped normal distribution may also be expressed in terms of the Jacobi triple product:^[3]

WN(\theta;\mu,\sigma)=	1
	2\pi

	infty
\prod
	n=1

(1-q^n)(1+q^n-1/2z)(1+q^n-1/2/z).

where

z=e^{i(\theta-\mu)}

and

	-\sigma²
q=e

Moments

In terms of the circular variable

z=e^i\theta

the circular moments of the wrapped normal distribution are the characteristic function of the normal distribution evaluated at integer arguments:

\langle

	n\rangle=\int
z
	\Gamma

e^in\thetaf_{WN(\theta;\mu,\sigma)d\theta}=

	in\mu-n^2\sigma^2/2
e

where

\Gamma

is some interval of length

2\pi

. The first moment is then the average value of z, also known as the mean resultant, or mean resultant vector:

\langlez

	i\mu-\sigma^2/2
\rangle=e

The mean angle is

\theta_{\mu=Arg\langle}z\rangle=\mu

and the length of the mean resultant is

R=|\langlez\rangle|=

	-\sigma^2/2
e

The circular standard deviation, which is a useful measure of dispersion for the wrapped normal distribution and its close relative, the von Mises distribution is given by:

s=ln(R^-2)^1/2=\sigma

Estimation of parameters

A series of N measurements z_n = e^iθ_n drawn from a wrapped normal distribution may be used to estimate certain parameters of the distribution. The average of the series is defined as

\overline{z}=	1
	N

	N
\sum
	n=1

z_n

and its expectation value will be just the first moment:

	i\mu-\sigma^2/2
\langle\overline{z}\rangle=e

In other words, is an unbiased estimator of the first moment. If we assume that the mean μ lies in the interval [-π, π), then Arg will be a (biased) estimator of the mean μ.

Viewing the z_n as a set of vectors in the complex plane, the ² statistic is the square of the length of the averaged vector:

\overline{R}^{2=\overline{z}\overline{z}

}=\left(*	1
	N

	N
\sum
	n=1

2+\left(	1
	N

\cos\theta

n\right)

	N
\sum
	n=1

	2
\sin\theta
	n\right)

and its expected value is:

\left\langle\overline{R}^{2\right\rangle}=

	1	+
	N

	N-1
	N

	-\sigma²
e

In other words, the statistic

2=	N
	N-1

2-	1
	N

\left(\overline{R}

\right)

will be an unbiased estimator of e^-σ2, and ln(1/R_e²) will be a (biased) estimator of σ²

Entropy

The information entropy of the wrapped normal distribution is defined as:^[2]

H=-\int_\Gammaf_{WN(\theta;\mu,\sigma)ln(f}_{WN(\theta;\mu,\sigma))d\theta}

where

\Gamma

is any interval of length

2\pi

. Defining

z=e^{i(\theta-\mu)}

and

	-\sigma²
q=e

, the Jacobi triple product representation for the wrapped normal is:

f_{WN(\theta;\mu,\sigma)}=

	\phi(q)
	2\pi

	infty
\prod
	m=1

(1+q^m-1/2z)(1+q^m-1/2z^-1)

where

\phi(q)

is the Euler function. The logarithm of the density of the wrapped normal distribution may be written:

ln(f_{WN(\theta;\mu,\sigma))=}ln\left(

	\phi(q)
	2\pi

	inftyln(1+q
\right)+\sum
	m=1

^m-1/2

	inftyln(1+q
z)+\sum
	m=1

^m-1/2z^-1)

Using the series expansion for the logarithm:

	infty
ln(1+x)=-\sum
	k=1

	(-1)^k
	k

x^k

the logarithmic sums may be written as:

	inftyln(1+q
\sum
	m=1

^m-1/2z^\pm

	infty
)=-\sum
	m=1

	infty
\sum
	k=1

	(-1)^k
	k

q^mk-k/2z^\pm=

	infty
-\sum
	k=1

	(-1)^k
	k

	q^k/2
	1-q^k

z^\pm

so that the logarithm of density of the wrapped normal distribution may be written as:

ln(f

WN(\theta;\mu,\sigma))=ln\left(	\phi(q)
	2\pi

	infty
\right)-\sum
	k=1

	(-1)^k
	k

	q^k/2
	1-q^k

(z^k+z^-k)

which is essentially a Fourier series in

\theta

. Using the characteristic function representation for the wrapped normal distribution in the left side of the integral:

f_{WN(\theta;\mu,\sigma)}=

	1
	2\pi

	infty
\sum
	n=-infty

	n^2/2
q

zⁿ

the entropy may be written:

H=-ln\left(

	\phi(q)	\right)+
	2\pi

	1
	2\pi

\int_\Gamma\left(

	infty
\sum
	k=1

	(-1)^k
	k

	(n^2+k)/2
q

1-q^k

\left(z^n+k+z^n-k\right)\right)d\theta

which may be integrated to yield:

H=-ln\left(

	\phi(q)
	2\pi

	infty
\right)+2\sum
	k=1

	(-1)^k
	k

	(k^2+k)/2
q

1-q^k

References

Book: Borradaile, Graham . Statistics of Earth Science Data . 2003 . Springer . 978-3-540-43603-4 . 31 Dec 2009 .
Book: Fisher, N. I. . Statistical Analysis of Circular Data . 1996 . Cambridge University Press . 978-0-521-56890-6. 2010-02-09 .
Breitenberger . Ernst . 1963 . Analogues of the normal distribution on the circle and the sphere . Biometrika . 50 . 1/2 . 81–88 . 10.2307/2333749. 2333749 . subscription .

External links

Circular Values Math and Statistics with C++11, A C++11 infrastructure for circular values (angles, time-of-day, etc.) mathematics and statistics

Notes and References

D. . Collett . T. . Lewis . Discriminating Between the Von Mises and Wrapped Normal Distributions . Australian Journal of Statistics . 23 . 1 . 1981 . 73–79 . 10.1111/j.1467-842X.1981.tb00763.x .
Book: Mardia, Kantilal . Directional Statistics . Kantilal Mardia . Jupp, Peter E. . 1999. Wiley . 978-0-471-95333-3 .
Book: Whittaker, E. T. . . E. T. Whittaker . Watson, G. N. . G. N. Watson . 2009 . Book Jungle . 978-1-4385-2815-1 .

Wrapped normal distribution explained

Definition

Moments

Estimation of parameters

Entropy

See also

References

External links

Notes and References