Index

• alternative hypothesis Definition 20.1
• ascent property Proposition 19.2
• asymptotic normality of the MLE Theorem 17.1
• asymptotically efficient estimator Definition 17.2
• asymptotically unbiased estimator Definition 2.4
• Bayes estimator §26.3
  • posterior mean Lemma 26.7
• Bayes factor §28.2
• Bayes’ theorem Proposition A.20
  • for the parameter Lemma 26.2
• Bayesian test Definition 28.4
• bias Definition 2.1
• bias-variance decomposition Lemma 2.7
• Cauchy–Schwarz inequality Lemma A.8
• central limit theorem Theorem A.15
• change of variable Proposition A.19
• Chebyshev’s inequality Lemma A.6
• chi-squared distribution Definition A.2
  • mean and variance Lemma A.3
• chi-squared test for a variance Proposition 29.3
• complete data §19.1
• complete statistic Definition 10.3
  • examples Proposition 10.6
• complete-data log-likelihood §19.1
• completeness Definition 10.3
• composite hypothesis Definition 20.1
• conditional expectation
  • law of total variance Proposition A.11
  • taking out what is known Proposition A.10
  • tower property Proposition A.9
• confidence bound §25.5
• confidence interval Definition 25.1
  • by inverting a test Lemma 25.6
  • one-sided §25.5
  • Wald Proposition 25.7
• confidence level Definition 25.1
• confidence set §25.1
• conjugate prior Definition 26.3
  • exponential family Proposition 26.4
  • normal-normal Proposition 26.6
• conservative test §20.5
• consistent estimator Definition 2.9
  • and asymptotic unbiasedness Corollary 2.13
  • and mean squared error Lemma 2.11
  • maximum likelihood estimator Theorem 16.3
• continuous mapping theorem Proposition A.17
• convergence
  • in distribution Definition A.13
  • in probability Definition A.12
• convergence in distribution Definition A.13
• convergence in probability Definition A.12
• covariance Proposition A.1
• coverage probability Definition 25.1
• Cramer–Rao inequality Theorem 13.2
  • attainment Proposition 13.5
  • for a function of the parameter Proposition 13.3
  • multiparameter Proposition 14.5
• credibility Definition 28.1
• credible interval Definition 28.1
  • equal-tailed Definition 28.1
  • highest posterior density Definition 28.2
• critical region Definition 20.2
• critical value §20.2
• cumulant §7.3
• cumulant function Definition 7.9
  • moments of the natural statistic Lemma 7.10
• cumulant generating function §7.3
• curved exponential family §7.2
• delta method Proposition A.18
• density §1.1
• efficiency Definition 13.4
  • asymptotic Definition 17.2
• efficient estimator Definition 13.4
• EM algorithm Definition 19.1
  • ascent property Proposition 19.2
  • complete-data log-likelihood §19.1
  • fixed points Proposition 19.3
• estimate Definition 1.4
• estimator Definition 1.4
  • asymptotically efficient Definition 17.2
  • asymptotically unbiased Definition 2.4
  • Bayes §26.3
  • consistent Definition 2.9
  • efficient Definition 13.4
  • family of §1.2
  • maximum likelihood Definition 5.1
  • method of moments Definition 4.6
  • unbiased Definition 2.1
  • uniformly minimum variance unbiased Definition 10.4
• expectation
  • linearity Proposition A.1
• exponential family Definition 7.1
  • completeness Proposition 10.6
  • conjugate prior Proposition 26.4
  • curved §7.2
  • Fisher information Proposition 11.9
  • full rank Definition 7.8
  • $k$-parameter Definition 7.6
  • mean and variance Lemma 7.10
  • one-parameter Definition 7.1
  • sample from Lemma 7.5
  • shape §7.1—§7.1
  • sufficient statistic Corollary 8.5
• $F$ distribution Definition A.5
• $F$-test §29.4
• factorisation theorem Proposition 8.3
• family of estimators §1.2
• Fisher information Definition 11.2
  • additivity Proposition 11.4
  • in an exponential family Proposition 11.9
  • information identity Lemma 11.3
  • matrix Definition 14.2
  • reparametrisation Proposition 11.10
• Fisher information matrix Definition 14.2
  • information identity Proposition 14.3
  • properties Proposition 14.4
• Fisher–Neyman factorisation theorem Proposition 8.3
• flat prior §26.4
• full rank Definition 7.8
• generalised likelihood ratio Definition 23.1
• generalised likelihood-ratio test Definition 23.1
• highest posterior density interval Definition 28.2
• HPD interval, see highest posterior density interval
• hyperparameter Definition 26.1
• hypothesis Definition 20.1
  • alternative Definition 20.1
  • composite Definition 20.1
  • null Definition 20.1
  • simple Definition 20.1
• identifiability Definition 4.10
• improper prior §26.4
• index, see index
• indicator function §8.2
• inequality
  • Cauchy–Schwarz Lemma A.8
  • Chebyshev’s Lemma A.6
  • Jensen’s Lemma A.7
  • Markov’s Lemma 2.10
• information identity Lemma 11.3
• invariance of the MLE Proposition 5.6
• Jeffreys prior Definition 26.8
  • invariance Proposition 26.9
  • location and scale models Proposition 26.11
• Jensen’s inequality Lemma A.7
• joint density §4.1
• Kullback–Leibler divergence §16.2
• label switching §19.5
• latent variable §19.1
• law of large numbers Proposition A.14
• law of total variance Proposition A.11
• Lehmann–Scheffe theorem Theorem 10.5
• level of a test Definition 20.5
• likelihood equation §5.1
• likelihood function Definition 4.1
• likelihood ratio §22.2
  • at the true parameter Lemma 16.2
• likelihood-ratio test Definition 23.1
  • Wilks’ theorem Theorem 23.3
• log-likelihood Definition 4.1
• log-odds Example 7.2
• log-partition function, see cumulant function
• Markov’s inequality Lemma 2.10
• maximum likelihood estimator Definition 5.1
  • asymptotic normality Theorem 17.1
  • consistency Theorem 16.3
  • invariance Proposition 5.6
  • standard error Corollary 17.3
• mean squared error Definition 2.6
  • bias-variance decomposition Lemma 2.7
• method of moments Lecture 4
• method of moments estimator Definition 4.6
• minimal sufficient statistic Definition 8.10
  • criterion Proposition 8.11
• mixture model §19.1
• MLE, see maximum likelihood estimator
• moment
  • population §4.3
  • sample §4.3
• moment generating function §7.3
• most powerful test Definition 22.1
• natural parameter Definition 7.1
• natural parameter space Definition 7.9
• natural parametrisation Definition 7.9
• natural statistic Definition 7.1
• nested models §23.1
• Neyman–Pearson lemma Theorem 22.2
• normal distribution
  • conjugate prior Proposition 26.6
  • sample mean and sample variance Proposition A.4
  • test for the variance Proposition 29.3
• nuisance parameter §14.5
• null hypothesis Definition 20.1
• observed data §19.1
• one-sided test Proposition 22.4
• order statistics
  • maximum and minimum Proposition 8.8
• $p$-value Definition 20.8
• parameter Definition 1.1
• parameter space Definition 1.1
• parametric model Definition 1.1
• pivot, see pivotal quantity
• pivotal quantity Definition 25.2
• posterior density Definition 26.1
  • Bayes’ theorem Lemma 26.2
• posterior distribution Lecture 26
• posterior mean Lemma 26.7
• posterior odds Definition 28.6
• posterior probability Definition 28.4
• power Definition 20.4
• power function Definition 20.4
• prior density Definition 26.1
• prior distribution Lecture 26
  • conjugate Definition 26.3
  • flat §26.4
  • improper §26.4
  • Jeffreys Definition 26.8
• prior odds Definition 28.6
• probability generating function §7.3
• probability mass function, see probability weights
• probability weights §1.1
• random sample §1.1
• Rao–Blackwell theorem Proposition 10.1
  • Rao–Blackwellisation §10.1
• Rao–Blackwellisation §10.1
• regularity conditions Definition 16.1
• sample mean
  • consistency Example 2.12
  • mean and variance Lemma 2.2
• sample variance §2.1
  • normal sample Proposition A.4
  • unbiasedness Lemma 2.3
• sampling distribution §1.2
• score function Definition 4.4
  • covariance with a statistic Lemma 13.1
  • mean zero Lemma 11.1
• score test §23.4
• score vector Definition 14.1
• significance level §20.3
• simple hypothesis Definition 20.1
• size of a test Definition 20.5
• Slutsky’s theorem Proposition A.16
• standard error §17.3
  • of the MLE Corollary 17.3
• statistic Definition 1.3
  • complete Definition 10.3
  • minimal sufficient Definition 8.10
  • natural Definition 7.1
  • sufficient Definition 8.1
  • test §20.2
• sufficient statistic Definition 8.1
  • factorisation theorem Proposition 8.3
  • in an exponential family Corollary 8.5
  • minimal Definition 8.10
• super-efficiency Example 13.6
• $t$ distribution Definition A.5
• $t$-interval Example 25.4
• $t$-test Proposition 29.1
  • one-sample Proposition 29.1
  • paired §29.4
  • two-sample §29.4
• taking out what is known Proposition A.10
• test Definition 20.2
  • Bayesian Definition 28.4
  • conservative §20.5
  • likelihood-ratio Definition 23.1
  • most powerful Definition 22.1
  • one-sided Proposition 22.4
  • score §23.4
  • uniformly most powerful §22.4
  • Wald §23.4
• test function Definition 20.2
• test inversion Lemma 25.6
• test statistic §20.2
• tower property Proposition A.9
• true parameter value §1.1
• type I error Definition 20.3
• type II error Definition 20.3
• UMVUE, see uniformly minimum variance unbiased estimator
• unbiased estimator Definition 2.1
  • asymptotically Definition 2.4
• uniformly minimum variance unbiased estimator Definition 10.4
  • Lehmann–Scheffe theorem Theorem 10.5
• uniformly most powerful test §22.4
  • non-existence for two-sided alternatives Proposition 22.5
  • one-sided alternative Proposition 22.4
• variance
  • of a linear function Proposition A.1
• Wald interval Proposition 25.7
• Wald test §23.4
• weak law of large numbers Proposition A.14
• Wilks’ theorem Theorem 23.3