Formation matrix explained
. They are the matrix inverses of the Fisher information matrix and the observed information matrix, respectively.
[1]
, its inverse represents a measure of the dispersion or variance for an
estimator of
. The formation matrix is therefore related to the
covariance matrix of an estimator and is central to the
Cramér–Rao bound, which establishes a lower bound on the variance of unbiased estimators. These matrices appear naturally in the
asymptotic expansion of the distribution of many statistics related to the
likelihood ratio.
Currently, no single notation for formation matrices is universally used. In works by Ole E. Barndorff-Nielsen and Peter McCullagh, the symbol
denotes the element in the i-th row and j-th column of the observed formation matrix. An alternative notation,
, arises from the
geometric interpretation of the Fisher information matrix as a
metric tensor, denoted
. Following
Einstein notation, these are related by
.
See also
References
- Barndorff-Nielsen, O.E., Cox, D.R. (1989), Asymptotic Techniques for Use in Statistics, Chapman and Hall, London.
- Barndorff-Nielsen, O.E., Cox, D.R., (1994). Inference and Asymptotics. Chapman & Hall, London.
- P. McCullagh, "Tensor Methods in Statistics", Monographs on Statistics and Applied Probability, Chapman and Hall, 1987.
- Edwards, A.W.F. (1984) Likelihood. CUP.
Notes and References
- Edwards (1984) p104