SDS 384-11:Theoretical Statistics
While measure theory is not a pre-requisite for this class, you can use Peter Hoff's notes on measure theory if needed.
01/15,17 : Syllabus [PDF] , and stochastic convergence [Slides].
01/12,17 : More stochastic convergence [Slides]. Chapter 2 Van-der-vaart
: HW1 is posted [here]. Latex file [here]. Solutions are [here] .
01/31, 2/1 : Concentration inequalities I (Markov, Chebychev, Hoeffding's Lemma, SubGaussian RVs) [Slides].
Reading : Martin's book chapter on concentration inequalities [here].
02/1,6 : Concentration inequalities II (Subexponential RV's, JL Lemma) [Slides].
02/10,15 : Concentration inequalities III (Martingales, Azuma-Hoeffding, McDiarmid's inequality) [Slides].
01/24 : HW2 is posted [here]. Latex file at the same link as HW1. Solutions are [here].
02/10,15 : Concentration inequalities III (The Gaussian Lipschitz theorem) [Slides].
02/13 : Concentration inequalities IV (Talagrand's inequality) [Slides].
02/13 : Terry Tao's notes for Talagrand's inequality [Here].
02/13 : The USVT paper by Sourav Chatterjee [Here].
02/13,18 : Efron-Stein inequality [Slides].
Reading : Chapter 4 from Gabor Lugosi's notes [here].
02/23 : U statistics (definitions, concentration) [Slides].
03/2 : Reading: how it all started. [Paul Halmos's 1946 paper].
02/25 : U statistics cont. (variance calculation, examples) [Slides].
03/2 : U statistics cont. (Normal convergence) [Slides].
02/18 : HW3 is posted [here]. Latex file in the same link as before
03/7 : Uniform Law of Large Numbers (Intro) [here].
03/9 : Uniform Law of Large Numbers II (Symmetrization, Rademacher complexity) [here].
Reading : Martin's book chapter 4 and 5
04/20 : Uniform Law of Large Numbers III (VC dimension, Sauer's Lemma) [here].
01/24 : HW4 is posted [here]. Latex file in same link as before.
03/21 : Uniform Law of Large Numbers IV (Covering number, packing number) [here].
04/27 : Uniform Law of Large Numbers V (Example: operator norm) [here].
04/27 : Uniform Law of Large Numbers VI (Stochastic processes and covering numbers) [here].
04/27 : Uniform Law of Large Numbers VII (Dudley's chaining) [here].
04/16 : HW5 is posted. [here]. Solutions are [here]. Latex on same link.
04/30, 5/1 : Covariance estimation [here].