AI engineering glossary · Statistics inference
What is fisher information?
Fisher information: A measure of how much information a sample carries about an unknown parameter, defined as the expected curvature (negative second derivative) of the log-likelihood at the true value. Sharper curvature means more precise estimation.
Fisher information: an example
For n coin flips, the information about p is n / (p(1 - p)), so more flips give sharper estimates.
Related terms
More Statistics inference terms
- Fisher's exact test
- Frequentist inference
- Generalised linear model
- Guardrail metric
- Heteroscedasticity
- Homoscedasticity
- Instrumental variable
- Interaction term
Where you learn it
Fisher information is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.