Download - Bounded normal mean minimax estimation
![Page 1: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/1.jpg)
SECTION 1SECTION 2
Estimating a Bounded Normal Mean
Jacopo Primavera
TSI-EuroBayes StudentUniversity Paris Dauphine
21 November 2011 / Reading Seminar on Classics
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 2: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/2.jpg)
SECTION 1SECTION 2
"ALL MODELS ARE WRONG, BUT SOME AREUSEFUL"
G. E. P. Box
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 3: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/3.jpg)
SECTION 1SECTION 2
PRESENTING THE PROBLEM
One observation x ∼ N(θ,1)
θ ∈ [−m,m] ⊂ RSquared loss (θ − δ(x))2
R(θ, δ) = MSE(δ) = BIAS(δ) + VAR(δ)
MINIMAX ESTIMATOR δMM = argminδ
[supθ
R(θ, δ)]
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 4: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/4.jpg)
SECTION 1SECTION 2
SUMMARY
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 5: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/5.jpg)
SECTION 1SECTION 2
SUMMARY
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 6: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/6.jpg)
SECTION 1SECTION 2
Outline
1 SECTION 1THE CANDIDATES2-POINTS PRIOR
2 SECTION 2AND WHEN m GETS LARGE?CLOSING THE LOOP
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 7: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/7.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
Outline
1 SECTION 1THE CANDIDATES2-POINTS PRIOR
2 SECTION 2AND WHEN m GETS LARGE?CLOSING THE LOOP
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 8: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/8.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SAMPLE MEAN
δSM = x
Main characteristicDOES NOT INVOLVEPRIOR INFORMATION
PropertiesΘ BOUNDED⇒ NOT Minimax
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 9: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/9.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
MLE
δMLE (x)−m for x ≤ −mx for x ∈ (−m,m)
m for x ≥ m
Main characteristicA SELECTOR ESTIMATOR
PropertiesΘ BOUNDED⇒ δMLE dominates δSM
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 10: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/10.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
DECISION THEORY
FORMALIZING THE CHOICE
Frequentist approachRESTRICT ∆
U = SET UNBIASED δ
CHOOSE UMVE
Decision-oriented approach(i) K OPTIMAL CRITERIA(ii) CHOOSE δ
MINIMIZING R(θ, δ)W.R.T K
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 11: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/11.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
BAYES ESTIMATOR
(i) PROBABILITY MEASURE τ ON Θ
(ii) CRITERIA = Eτ
(iii) Eτ [R(θ, δ)] = r(τ, δ)
(iv) minδ
[r(τ, δ)] = r(τ, δB) = r(τ)
(v) δB BAYES RULE
Bayes method and Decision theoryNATURAL ORDERING CRITERIATHE VERSATILITY OF τ MAKES BAYESIAN METHODCOHERENT WITH DECISION THEORYWHICH PRIOR INDUCES MINIMAXITY ?
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 12: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/12.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
BAYES ESTIMATOR
(i) PROBABILITY MEASURE τ ON Θ
(ii) CRITERIA = Eτ
(iii) Eτ [R(θ, δ)] = r(τ, δ)
(iv) minδ
[r(τ, δ)] = r(τ, δB) = r(τ)
(v) δB BAYES RULE
Bayes method and Decision theoryNATURAL ORDERING CRITERIATHE VERSATILITY OF τ MAKES BAYESIAN METHODCOHERENT WITH DECISION THEORYWHICH PRIOR INDUCES MINIMAXITY ?
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 13: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/13.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
GAME THEORY
Two-person zero-sum game
Θ Set of all possible strategies player 1A Set of all possible strategies player 2L Gain function (pl. 1) and loss function (pl.2)
RATIONAL PLAYER LOOK FOR A GUARANTEEWHATEVER OPPONENT’S MOVEMINIMAX STRATEGY ARISE NATURALLYMINIMAX STRATEGY FOR PLAYER TWO ≡ MAXIMINSTRATEGY FOR PLAYER ONE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 14: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/14.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
GAME THEORY
Two-person zero-sum game
Θ Set of all possible strategies player 1A Set of all possible strategies player 2L Gain function (pl. 1) and loss function (pl.2)
RATIONAL PLAYER LOOK FOR A GUARANTEEWHATEVER OPPONENT’S MOVEMINIMAX STRATEGY ARISE NATURALLYMINIMAX STRATEGY FOR PLAYER TWO ≡ MAXIMINSTRATEGY FOR PLAYER ONE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 15: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/15.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
THE LINK
THE LINK
PLAYER II
PLAYER IMAXIMIN STRATEGYGAIN-ORIENTEDRATIONALITY
STATISTICIAN
NATURELEAST FAVORABLESTATE OF NATURELEAST FAVORABLEDISTRIBUTION
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 16: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/16.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
THE LINK
THE LINK
PLAYER IIPLAYER I
MAXIMIN STRATEGYGAIN-ORIENTEDRATIONALITY
STATISTICIANNATURE
LEAST FAVORABLESTATE OF NATURELEAST FAVORABLEDISTRIBUTION
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 17: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/17.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
THE LINK
THE LINK
PLAYER IIPLAYER IMAXIMIN STRATEGY
GAIN-ORIENTEDRATIONALITY
STATISTICIANNATURELEAST FAVORABLESTATE OF NATURE
LEAST FAVORABLEDISTRIBUTION
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 18: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/18.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
THE LINK
THE LINK
PLAYER IIPLAYER IMAXIMIN STRATEGYGAIN-ORIENTEDRATIONALITY
STATISTICIANNATURELEAST FAVORABLESTATE OF NATURELEAST FAVORABLEDISTRIBUTION
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 19: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/19.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SIMPLE EXAMPLE
UNDER MINIMAXCOMPARE sup
θ[R]
δ1 OPTIMAL
UNDER BAYES
τ p.d.f. on Θ
COMPARE Eτ [R]
τ SUCH THAT δ1 � δ1
SUFFICIENT BIAS TOθ0
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 20: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/20.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SIMPLE EXAMPLE
UNDER MINIMAXCOMPARE sup
θ[R]
δ1 OPTIMAL
UNDER BAYES
τ p.d.f. on Θ
COMPARE Eτ [R]
τ SUCH THAT δ1 � δ1
SUFFICIENT BIAS TOθ0
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 21: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/21.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SIMPLE EXAMPLE
UNDER MINIMAXCOMPARE sup
θ[R]
δ1 OPTIMAL
UNDER BAYESτ p.d.f. on Θ
COMPARE Eτ [R]
τ SUCH THAT δ1 � δ1
SUFFICIENT BIAS TOθ0
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 22: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/22.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
LEAST FAVORABLE PRIOR
LEAST FAVORABLE FOCUSES ON θ’s MAXIMAL RISKPOINTS FOR A GENERIC BAYES RULE
LEAST FAVORABLE MAXIMIZE THE BAYES RISK
Lemmar(τ, δB
τ ) ≥ R(θ, δBτ ) ∀θ ∈ Θ ⇒
δBτ MINIMAX
τ LEAST FAVORABLE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 23: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/23.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
LEAST FAVORABLE PRIOR
LEAST FAVORABLE FOCUSES ON θ’s MAXIMAL RISKPOINTS FOR A GENERIC BAYES RULE
LEAST FAVORABLE MAXIMIZE THE BAYES RISK
Lemmar(τ, δB
τ ) ≥ R(θ, δBτ ) ∀θ ∈ Θ ⇒
δBτ MINIMAX
τ LEAST FAVORABLE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 24: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/24.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
LEAST FAVORABLE PRIOR
LEAST FAVORABLE FOCUSES ON θ’s MAXIMAL RISKPOINTS FOR A GENERIC BAYES RULE
LEAST FAVORABLE MAXIMIZE THE BAYES RISK
Lemmar(τ, δB
τ ) ≥ R(θ, δBτ ) ∀θ ∈ Θ ⇒
δBτ MINIMAX
τ LEAST FAVORABLE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 25: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/25.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
GUESSING MINIMAX DECISION
GUESS MAX. RISK PTS.
Suppose θ = +mLIKELY SAMPLES∈ [m − 1,m + 1]
HIGHLY BIASEDINTERVAL
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 26: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/26.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
GUESSING MINIMAX DECISION
GUESS MAX. RISK PTS.
Suppose θ = +m
LIKELY SAMPLES∈ [m − 1,m + 1]
HIGHLY BIASEDINTERVAL
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 27: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/27.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
GUESSING MINIMAX DECISION
GUESS MAX. RISK PTS.
Suppose θ = +mLIKELY SAMPLES∈ [m − 1,m + 1]
HIGHLY BIASEDINTERVAL
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 28: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/28.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
GUESSING MINIMAX DECISION
GUESS MAX. RISK PTS.
Suppose θ = +mLIKELY SAMPLES∈ [m − 1,m + 1]
HIGHLY BIASEDINTERVAL
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 29: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/29.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
Outline
1 SECTION 1THE CANDIDATES2-POINTS PRIOR
2 SECTION 2AND WHEN m GETS LARGE?CLOSING THE LOOP
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 30: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/30.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
A BAYES RULE
CONCENTRATING ONTHE BOUNDS
τ◦m TWO-POINTS
PRIORδ◦m(x) =
m × tanh(m × x)
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 31: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/31.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
A BAYES RULE
CONCENTRATING ONTHE BOUNDSτ◦m TWO-POINTS
PRIOR
δ◦m(x) =
m × tanh(m × x)
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 32: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/32.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
A BAYES RULE
CONCENTRATING ONTHE BOUNDSτ◦m TWO-POINTS
PRIORδ◦m(x) =
m × tanh(m × x)
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 33: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/33.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SHRINKING TO THE BOUNDS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 34: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/34.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SHRINKING TO THE BOUNDS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 35: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/35.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SHRINKING TO THE BOUNDS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 36: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/36.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SHRINKING TO THE BOUNDS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 37: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/37.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
CONDITIONS FOR MINIMAXITY
minimaxity of δ◦m depends on the interval width
Theorem
x ∼ N(θ,1)
θ ∼ [−m,m]
m ≤ m0
L Gaussian loss
δ◦m minimaxτ◦m least favorable
Numerical solution for m0
1.056742
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 38: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/38.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
CONDITIONS FOR MINIMAXITY
minimaxity of δ◦m depends on the interval width
Theorem
x ∼ N(θ,1)
θ ∼ [−m,m]
m ≤ m0
L Gaussian loss
δ◦m minimaxτ◦m least favorable
Numerical solution for m0
1.056742
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 39: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/39.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
CONDITIONS FOR MINIMAXITY
minimaxity of δ◦m depends on the interval width
Theorem
x ∼ N(θ,1)
θ ∼ [−m,m]
m ≤ m0
L Gaussian loss
δ◦m minimaxτ◦m least favorable
Numerical solution for m0
1.056742
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 40: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/40.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
CONDITIONS FOR MINIMAXITY
minimaxity of δ◦m depends on the interval width
Theorem
x ∼ N(θ,1)
θ ∼ [−m,m]
m ≤ m0
L Gaussian loss
δ◦m minimaxτ◦m least favorable
Numerical solution for m0
1.056742
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 41: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/41.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
NUMERICAL EVIDENCE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 42: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/42.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
NUMERICAL EVIDENCE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 43: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/43.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
NUMERICAL EVIDENCE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 44: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/44.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
NUMERICAL EVIDENCE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 45: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/45.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - 1ST STEP
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
R′ At most 3 sign chg(−+)(+−)(−+)
R′(0) = 0
R′(θ) = −R′(−θ)
Extremum for θ > 0 is(−+)
R even function⇒ Maximum attainedat 0 or at the bounds
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 46: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/46.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - 1ST STEP
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
R′ At most 3 sign chg
(−+)(+−)(−+)
R′(0) = 0
R′(θ) = −R′(−θ)
Extremum for θ > 0 is(−+)
R even function⇒ Maximum attainedat 0 or at the bounds
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 47: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/47.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - 1ST STEP
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
R′ At most 3 sign chg(−+)(+−)(−+)
R′(0) = 0
R′(θ) = −R′(−θ)
Extremum for θ > 0 is(−+)
R even function⇒ Maximum attainedat 0 or at the bounds
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 48: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/48.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - 1ST STEP
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
R′ At most 3 sign chg(−+)(+−)(−+)
R′(0) = 0
R′(θ) = −R′(−θ)
Extremum for θ > 0 is(−+)
R even function⇒ Maximum attainedat 0 or at the bounds
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 49: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/49.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - 1ST STEP
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
R′ At most 3 sign chg(−+)(+−)(−+)
R′(0) = 0
R′(θ) = −R′(−θ)
Extremum for θ > 0 is(−+)
R even function⇒ Maximum attainedat 0 or at the bounds
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 50: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/50.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - 1ST STEP
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
R′ At most 3 sign chg(−+)(+−)(−+)
R′(0) = 0
R′(θ) = −R′(−θ)
Extremum for θ > 0 is(−+)
R even function⇒ Maximum attainedat 0 or at the bounds
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 51: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/51.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - 1ST STEP
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
R′ At most 3 sign chg(−+)(+−)(−+)
R′(0) = 0
R′(θ) = −R′(−θ)
Extremum for θ > 0 is(−+)
R even function
⇒ Maximum attainedat 0 or at the bounds
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 52: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/52.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - 1ST STEP
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
R′ At most 3 sign chg(−+)(+−)(−+)
R′(0) = 0
R′(θ) = −R′(−θ)
Extremum for θ > 0 is(−+)
R even function⇒ Maximum attainedat 0 or at the bounds
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 53: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/53.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - CONCLUSION
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
∃m0 such that R(m)≥ R(0) ∀m ≤ m0
r(τ◦m, δ
◦m) = 1
2R(−m) +12R(m) = R(m, δ
◦m)
= implies ≥⇒ Theorem is proved
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 54: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/54.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - CONCLUSION
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
∃m0 such that R(m)≥ R(0) ∀m ≤ m0
r(τ◦m, δ
◦m) = 1
2R(−m) +12R(m) = R(m, δ
◦m)
= implies ≥⇒ Theorem is proved
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 55: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/55.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - CONCLUSION
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
∃m0 such that R(m)≥ R(0) ∀m ≤ m0
r(τ◦m, δ
◦m) = 1
2R(−m) +12R(m) = R(m, δ
◦m)
= implies ≥
⇒ Theorem is proved
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 56: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/56.jpg)
SECTION 1SECTION 2
THE CANDIDATES2-POINTS PRIOR
SKETCHING THE PROOF - CONCLUSION
Prove that r(τ◦m, δ
◦m) ≥ R(θ, δ
◦m) ∀θ ∈ Θ
∃m0 such that R(m)≥ R(0) ∀m ≤ m0
r(τ◦m, δ
◦m) = 1
2R(−m) +12R(m) = R(m, δ
◦m)
= implies ≥⇒ Theorem is proved
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 57: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/57.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
Outline
1 SECTION 1THE CANDIDATES2-POINTS PRIOR
2 SECTION 2AND WHEN m GETS LARGE?CLOSING THE LOOP
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 58: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/58.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
HOW TO PROCEED
AS LONG AS Θ IS COMPACTR(θ, δτ ) analytic and 6= cost
⇓
THE NUMBER OF MAXIMAL RISK θ’s ISFINITESτ =SUPPORT OF τLS FINITE
IN GENERALcard{Sτ} INCREASES AS m INCREASES
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 59: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/59.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
HOW TO PROCEED
AS LONG AS Θ IS COMPACTR(θ, δτ ) analytic and 6= cost
⇓THE NUMBER OF MAXIMAL RISK θ’s ISFINITE
Sτ =SUPPORT OF τLS FINITE
IN GENERALcard{Sτ} INCREASES AS m INCREASES
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 60: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/60.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
HOW TO PROCEED
AS LONG AS Θ IS COMPACTR(θ, δτ ) analytic and 6= cost
⇓THE NUMBER OF MAXIMAL RISK θ’s ISFINITESτ =SUPPORT OF τLS FINITE
IN GENERALcard{Sτ} INCREASES AS m INCREASES
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 61: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/61.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
HOW TO PROCEED
AS LONG AS Θ IS COMPACTR(θ, δτ ) analytic and 6= cost
⇓THE NUMBER OF MAXIMAL RISK θ’s ISFINITESτ =SUPPORT OF τLS FINITE
IN GENERALcard{Sτ} INCREASES AS m INCREASES
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 62: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/62.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GUESSING MINIMAX DECISION m>1
GUESS THE NEXT MAX.RISK PT.
Suppose θ = 0LIKELY SAMPLES∈ [−1,1]
LARGE RANGE (= 2)suppose θ 6= 0 and6= ±mSMALLER RANGE(≤ 2)
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 63: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/63.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GUESSING MINIMAX DECISION m>1
GUESS THE NEXT MAX.RISK PT.
Suppose θ = 0
LIKELY SAMPLES∈ [−1,1]
LARGE RANGE (= 2)suppose θ 6= 0 and6= ±mSMALLER RANGE(≤ 2)
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 64: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/64.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GUESSING MINIMAX DECISION m>1
GUESS THE NEXT MAX.RISK PT.
Suppose θ = 0LIKELY SAMPLES∈ [−1,1]
LARGE RANGE (= 2)suppose θ 6= 0 and6= ±mSMALLER RANGE(≤ 2)
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 65: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/65.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GUESSING MINIMAX DECISION m>1
GUESS THE NEXT MAX.RISK PT.
Suppose θ = 0LIKELY SAMPLES∈ [−1,1]
LARGE RANGE (= 2)
suppose θ 6= 0 and6= ±mSMALLER RANGE(≤ 2)
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 66: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/66.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GUESSING MINIMAX DECISION m>1
GUESS THE NEXT MAX.RISK PT.
Suppose θ = 0LIKELY SAMPLES∈ [−1,1]
LARGE RANGE (= 2)suppose θ 6= 0 and6= ±m
SMALLER RANGE(≤ 2)
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 67: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/67.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GUESSING MINIMAX DECISION m>1
GUESS THE NEXT MAX.RISK PT.
Suppose θ = 0LIKELY SAMPLES∈ [−1,1]
LARGE RANGE (= 2)suppose θ 6= 0 and6= ±mSMALLER RANGE(≤ 2)
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 68: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/68.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
3-POINTS PRIOR
the expression
δαm(x) = (1−α)mtanh(mx)
1−α+αexp(m22 )sech(mx)
when 1.4 ≤ m ≤ 1.6∃α∗ such that δαm(x) is minimax and ταm is least favorable
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 69: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/69.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
3-POINTS PRIOR
the expression
δαm(x) = (1−α)mtanh(mx)
1−α+αexp(m22 )sech(mx)
when 1.4 ≤ m ≤ 1.6∃α∗ such that δαm(x) is minimax and ταm is least favorable
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 70: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/70.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
NUMERICAL EVIDENCE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 71: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/71.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
NUMERICAL EVIDENCE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 72: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/72.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
NUMERICAL EVIDENCE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 73: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/73.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
4-PTS PRIOR
θ’s max risk pts w.r.t a generic bayes rule
MAX BIAS → BOUNDSMAX VARIANCE → PTS FAR FROM BOUNDS
Due to normal symmetryθMS ’s pop up pairwise around zero
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 74: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/74.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
4-PTS PRIOR
θ’s max risk pts w.r.t a generic bayes rule
MAX BIAS → BOUNDSMAX VARIANCE → PTS FAR FROM BOUNDS
Due to normal symmetryθMS ’s pop up pairwise around zero
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 75: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/75.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
4-PTS PRIOR
θ’s max risk pts w.r.t a generic bayes rule
MAX BIAS → BOUNDSMAX VARIANCE → PTS FAR FROM BOUNDS
Due to normal symmetryθMS ’s pop up pairwise around zero
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 76: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/76.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
Outline
1 SECTION 1THE CANDIDATES2-POINTS PRIOR
2 SECTION 2AND WHEN m GETS LARGE?CLOSING THE LOOP
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 77: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/77.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GENERALIZED BAYES RULE
Generalizing the approach
(τn) SEQUENCE OFPROPER PRIORSlim−→ δn = δ0
δ0 GENERALIZEDBAYES RULE
Lemma
δ0 Generalized bayesrulelim−→[rn] ≥ Rδ0(θ) ∀θ<∞
δ0 MINIMAX RULE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 78: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/78.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GENERALIZED BAYES RULE
Generalizing the approach
(τn) SEQUENCE OFPROPER PRIORS
lim−→ δn = δ0
δ0 GENERALIZEDBAYES RULE
Lemma
δ0 Generalized bayesrulelim−→[rn] ≥ Rδ0(θ) ∀θ<∞
δ0 MINIMAX RULE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 79: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/79.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GENERALIZED BAYES RULE
Generalizing the approach
(τn) SEQUENCE OFPROPER PRIORSlim−→ δn = δ0
δ0 GENERALIZEDBAYES RULE
Lemma
δ0 Generalized bayesrulelim−→[rn] ≥ Rδ0(θ) ∀θ<∞
δ0 MINIMAX RULE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 80: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/80.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GENERALIZED BAYES RULE
Generalizing the approach
(τn) SEQUENCE OFPROPER PRIORSlim−→ δn = δ0
δ0 GENERALIZEDBAYES RULE
Lemma
δ0 Generalized bayesrulelim−→[rn] ≥ Rδ0(θ) ∀θ<∞
δ0 MINIMAX RULE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 81: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/81.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GENERALIZED BAYES RULE
Generalizing the approach
(τn) SEQUENCE OFPROPER PRIORSlim−→ δn = δ0
δ0 GENERALIZEDBAYES RULE
Lemma
δ0 Generalized bayesrulelim−→[rn] ≥ Rδ0(θ) ∀θ<∞
δ0 MINIMAX RULE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 82: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/82.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GENERALIZED BAYES RULE
Generalizing the approach
(τn) SEQUENCE OFPROPER PRIORSlim−→ δn = δ0
δ0 GENERALIZEDBAYES RULE
Lemma
δ0 Generalized bayesrule
lim−→[rn] ≥ Rδ0(θ) ∀θ<∞
δ0 MINIMAX RULE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 83: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/83.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GENERALIZED BAYES RULE
Generalizing the approach
(τn) SEQUENCE OFPROPER PRIORSlim−→ δn = δ0
δ0 GENERALIZEDBAYES RULE
Lemma
δ0 Generalized bayesrulelim−→[rn] ≥ Rδ0(θ) ∀θ
<∞
δ0 MINIMAX RULE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 84: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/84.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GENERALIZED BAYES RULE
Generalizing the approach
(τn) SEQUENCE OFPROPER PRIORSlim−→ δn = δ0
δ0 GENERALIZEDBAYES RULE
Lemma
δ0 Generalized bayesrulelim−→[rn] ≥ Rδ0(θ) ∀θ<∞
δ0 MINIMAX RULE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 85: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/85.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
GENERALIZED BAYES RULE
Generalizing the approach
(τn) SEQUENCE OFPROPER PRIORSlim−→ δn = δ0
δ0 GENERALIZEDBAYES RULE
Lemma
δ0 Generalized bayesrulelim−→[rn] ≥ Rδ0(θ) ∀θ<∞
δ0 MINIMAX RULE
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 86: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/86.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
NO MORE BOUNDS
Generalized bayesian approach
τn ∼ N(0,n)τn(θ|x) ∼ N( xn
n+1 ,n
n+1)
δn = xnn+1 → x = δ0
r(τn) =n
n+1 → 1R(θ, δ0) = 1⇒ δ0 MINIMAX
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 87: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/87.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
NO MORE BOUNDS
Generalized bayesian approach
τn ∼ N(0,n)
τn(θ|x) ∼ N( xnn+1 ,
nn+1)
δn = xnn+1 → x = δ0
r(τn) =n
n+1 → 1R(θ, δ0) = 1⇒ δ0 MINIMAX
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 88: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/88.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
NO MORE BOUNDS
Generalized bayesian approach
τn ∼ N(0,n)τn(θ|x) ∼ N( xn
n+1 ,n
n+1)
δn = xnn+1 → x = δ0
r(τn) =n
n+1 → 1R(θ, δ0) = 1⇒ δ0 MINIMAX
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 89: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/89.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
NO MORE BOUNDS
Generalized bayesian approach
τn ∼ N(0,n)τn(θ|x) ∼ N( xn
n+1 ,n
n+1)
δn = xnn+1 → x = δ0
r(τn) =n
n+1 → 1R(θ, δ0) = 1⇒ δ0 MINIMAX
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 90: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/90.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
NO MORE BOUNDS
Generalized bayesian approach
τn ∼ N(0,n)τn(θ|x) ∼ N( xn
n+1 ,n
n+1)
δn = xnn+1 → x = δ0
r(τn) =n
n+1 → 1
R(θ, δ0) = 1⇒ δ0 MINIMAX
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 91: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/91.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
NO MORE BOUNDS
Generalized bayesian approach
τn ∼ N(0,n)τn(θ|x) ∼ N( xn
n+1 ,n
n+1)
δn = xnn+1 → x = δ0
r(τn) =n
n+1 → 1R(θ, δ0) = 1
⇒ δ0 MINIMAX
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 92: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/92.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
NO MORE BOUNDS
Generalized bayesian approach
τn ∼ N(0,n)τn(θ|x) ∼ N( xn
n+1 ,n
n+1)
δn = xnn+1 → x = δ0
r(τn) =n
n+1 → 1R(θ, δ0) = 1⇒ δ0 MINIMAX
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 93: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/93.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
EVERY GOOD ESTIMATOR IS BAYES
Berger and Srinivasan 1978
θ natural parameter exponential familyquadratic lossEVERY ADMISSIBLE ESTIMATOR = GENERALIZEDBAYES ESTIMATOR
Wald 1950
Θ COMPACTRISK SET R CONVEXALL ESTIMATORS HAVE CONTINUOUS RISKFUNCTION⇒ BAYES ESTIMATORS’ SET = COMPLETE CLASS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 94: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/94.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
EVERY GOOD ESTIMATOR IS BAYES
Berger and Srinivasan 1978
θ natural parameter exponential family
quadratic lossEVERY ADMISSIBLE ESTIMATOR = GENERALIZEDBAYES ESTIMATOR
Wald 1950
Θ COMPACTRISK SET R CONVEXALL ESTIMATORS HAVE CONTINUOUS RISKFUNCTION⇒ BAYES ESTIMATORS’ SET = COMPLETE CLASS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 95: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/95.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
EVERY GOOD ESTIMATOR IS BAYES
Berger and Srinivasan 1978
θ natural parameter exponential familyquadratic loss
EVERY ADMISSIBLE ESTIMATOR = GENERALIZEDBAYES ESTIMATOR
Wald 1950
Θ COMPACTRISK SET R CONVEXALL ESTIMATORS HAVE CONTINUOUS RISKFUNCTION⇒ BAYES ESTIMATORS’ SET = COMPLETE CLASS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 96: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/96.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
EVERY GOOD ESTIMATOR IS BAYES
Berger and Srinivasan 1978
θ natural parameter exponential familyquadratic lossEVERY ADMISSIBLE ESTIMATOR = GENERALIZEDBAYES ESTIMATOR
Wald 1950
Θ COMPACTRISK SET R CONVEXALL ESTIMATORS HAVE CONTINUOUS RISKFUNCTION⇒ BAYES ESTIMATORS’ SET = COMPLETE CLASS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 97: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/97.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
EVERY GOOD ESTIMATOR IS BAYES
Berger and Srinivasan 1978
θ natural parameter exponential familyquadratic lossEVERY ADMISSIBLE ESTIMATOR = GENERALIZEDBAYES ESTIMATOR
Wald 1950
Θ COMPACTRISK SET R CONVEXALL ESTIMATORS HAVE CONTINUOUS RISKFUNCTION⇒ BAYES ESTIMATORS’ SET = COMPLETE CLASS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 98: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/98.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
EVERY GOOD ESTIMATOR IS BAYES
Berger and Srinivasan 1978
θ natural parameter exponential familyquadratic lossEVERY ADMISSIBLE ESTIMATOR = GENERALIZEDBAYES ESTIMATOR
Wald 1950Θ COMPACT
RISK SET R CONVEXALL ESTIMATORS HAVE CONTINUOUS RISKFUNCTION⇒ BAYES ESTIMATORS’ SET = COMPLETE CLASS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 99: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/99.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
EVERY GOOD ESTIMATOR IS BAYES
Berger and Srinivasan 1978
θ natural parameter exponential familyquadratic lossEVERY ADMISSIBLE ESTIMATOR = GENERALIZEDBAYES ESTIMATOR
Wald 1950Θ COMPACTRISK SET R CONVEX
ALL ESTIMATORS HAVE CONTINUOUS RISKFUNCTION⇒ BAYES ESTIMATORS’ SET = COMPLETE CLASS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 100: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/100.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
EVERY GOOD ESTIMATOR IS BAYES
Berger and Srinivasan 1978
θ natural parameter exponential familyquadratic lossEVERY ADMISSIBLE ESTIMATOR = GENERALIZEDBAYES ESTIMATOR
Wald 1950Θ COMPACTRISK SET R CONVEXALL ESTIMATORS HAVE CONTINUOUS RISKFUNCTION
⇒ BAYES ESTIMATORS’ SET = COMPLETE CLASS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 101: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/101.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
EVERY GOOD ESTIMATOR IS BAYES
Berger and Srinivasan 1978
θ natural parameter exponential familyquadratic lossEVERY ADMISSIBLE ESTIMATOR = GENERALIZEDBAYES ESTIMATOR
Wald 1950Θ COMPACTRISK SET R CONVEXALL ESTIMATORS HAVE CONTINUOUS RISKFUNCTION⇒ BAYES ESTIMATORS’ SET = COMPLETE CLASS
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 102: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/102.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
AS m GOES TO INFINITY
Bickel 1981Minimize Fisherinformation w.r.t. anypriorcos2(π/2)× x , |x | ≤ 1
ρ(m) = 1− π2
m2 + o(m−2)
as m→∞
Jacopo Primavera Estimating a Bounded Normal Mean
![Page 103: Bounded normal mean minimax estimation](https://reader034.vdocuments.us/reader034/viewer/2022052311/55895d2fd8b42a4f3f8b466b/html5/thumbnails/103.jpg)
SECTION 1SECTION 2
AND WHEN m GETS LARGE?CLOSING THE LOOP
THANK YOU
FOR
YOUR ATTENTION
Jacopo Primavera Estimating a Bounded Normal Mean