DiscoverDepartment of StatisticsPractical pre-asymptotic diagnostic of Monte Carlo estimates in Bayesian inference and machine learning
Practical pre-asymptotic diagnostic of Monte Carlo estimates in Bayesian inference and machine learning

Practical pre-asymptotic diagnostic of Monte Carlo estimates in Bayesian inference and machine learning

Update: 2021-07-29
Share

Description

Aki Vehtari (Aalto University) gives the OxCSML Seminar on Friday 7th May 2021 Abstract: I discuss the use of the Pareto-k diagnostic as a simple and practical approach for estimating both the required minimum sample size and empirical pre-asymptotic convergence rate for Monte Carlo estimates. Even when by construction a Monte Carlo estimate has finite variance the pre-asymptotic behaviour and convergence rate can be very different from the asymptotic behaviour following the central limit theorem. I demonstrate with practical examples in importance sampling, stochastic optimization, and variational inference, which are commonly used in Bayesian inference and machine learning.
Comments 
loading
In Channel
loading
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Practical pre-asymptotic diagnostic of Monte Carlo estimates in Bayesian inference and machine learning

Practical pre-asymptotic diagnostic of Monte Carlo estimates in Bayesian inference and machine learning

Aki Vehtari