Formation matrix explained

L(\theta)

. They are the matrix inverses of the Fisher information matrix and the observed information matrix, respectively.[1]

\theta

, its inverse represents a measure of the dispersion or variance for an estimator of

\theta

. The formation matrix is therefore related to the covariance matrix of an estimator and is central to the Cramér–Rao bound, which establishes a lower bound on the variance of unbiased estimators. These matrices appear naturally in the asymptotic expansion of the distribution of many statistics related to the likelihood ratio.

Currently, no single notation for formation matrices is universally used. In works by Ole E. Barndorff-Nielsen and Peter McCullagh, the symbol

jij

denotes the element in the i-th row and j-th column of the observed formation matrix. An alternative notation,

gij

, arises from the geometric interpretation of the Fisher information matrix as a metric tensor, denoted

gij

. Following Einstein notation, these are related by

gikgkj=

j
\delta
i
.

See also

References

Notes and References

  1. Edwards (1984) p104