bayesian inference and model selection for stochastic ...€¦ · bayesian inference and model...
TRANSCRIPT
![Page 1: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/1.jpg)
Bayesian inference and model selection forstochastic epidemics and othercoupled hidden Markov models
(with special attention to epidemics ofEscherichia coli O157:H7 in cattle)
Simon Spencer
3rd May 2016
![Page 2: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/2.jpg)
Acknowledgements
Panayiota Touloupou
Barbel Finkenstadt RandPeter Neal
TJ McKinleyNigel French, Tom Besser and
Rowland Cobbold
![Page 3: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/3.jpg)
Outline
1. Introduction
2. Bayesian inference for epidemics
3. Model selection for epidemics
4. Scalable inference for epidemics
5. Conclusion
![Page 4: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/4.jpg)
Introduction
![Page 5: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/5.jpg)
Introduction
A typical epidemic model:
Susceptible → Exposed → Infected → Removed
Infections occur according to an inhomogeneous Poisson processwith rate ∝ S(t)I (t).
![Page 6: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/6.jpg)
A simulation
0 20 40 60 80 100
020
4060
8010
0
time
SusceptibleExposedInfectedRemoved
![Page 7: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/7.jpg)
Comments
Statistical inference for epidemic models is hard.
Intractable likelihood – need to know infection times.
Usual solution: large scale data augmentation MCMC.
What are the observed data?
![Page 8: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/8.jpg)
Epidemic data
Historically: final size (single number).
Final size in many sub-populations, e.g. households.
Markov models: removal times.
Who is removed is not needed / recorded.
Individual level diagnostic test results.
To be realistic, tests are imperfect.Temporal resolution of 1 day.
⇒ View epidemic as hidden Markov model
![Page 9: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/9.jpg)
Epidemic data
Historically: final size (single number).
Final size in many sub-populations, e.g. households.
Markov models: removal times.
Who is removed is not needed / recorded.
Individual level diagnostic test results.
To be realistic, tests are imperfect.Temporal resolution of 1 day.
⇒ View epidemic as hidden Markov model
![Page 10: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/10.jpg)
Epidemic data
Historically: final size (single number).
Final size in many sub-populations, e.g. households.
Markov models: removal times.
Who is removed is not needed / recorded.
Individual level diagnostic test results.
To be realistic, tests are imperfect.Temporal resolution of 1 day.
⇒ View epidemic as hidden Markov model
![Page 11: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/11.jpg)
Motivating example: Escherichia coli O157
E. coli O157 is a highly pathogenic form of Escherichia coli.
It can cause severe gastroentestinal illness, haemorrhagicdiarrhoea and even death.
Outbreaks and endemic cases are associated with food, wateror direct contact with infected animals.
Cattle are the main reservoir.
Additional economic burden due to impacts on trade.
![Page 12: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/12.jpg)
Study design
Natural colonization and faecal excretion of E. coli O157 incommercial feedlot.
20 pens containing 8 calves were sampled 27 times over a 99day period.
Each sampling event included a faecal pat sample and arecto-anal mucosal swab (RAMS).
Tests were assumed to have perfect specificity but imperfectsensitivity.
![Page 13: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/13.jpg)
Patterns of infection
0 20 40 60 80 100
12
34
56
78
Positive Tests, Pen 5 (South)
Time (days)
Ani
mal
● ● ● ● ● ● ● ● ●
● ●
● ● ● ●
● ● ● ● ● ● ● ● ● ● ● ●
● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●
● ● ●
● ●
● ● ● ●
● ● ● ●
● ● ● ● ● ● ● ● ●
●
● ● ● ● ● ●
●
● ●
● ● ● ● ● ● ● ● ● ● ●
● ●
● ● ● ● ● ● ● ● ● ● ● ● ● ●
● ● ● ● ● ● ● ● ●
●
● ●
● ● ● ● ● ●
● ● ● ● ● ● ● ● ●
● ● ● ● ● ● ● ●
●
● ● ● ● ● ● ● ● ● ●
● ● ● ● ●
● ● ●
● ● ● ● ● ● ●
● ●
● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●
● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●
● ● ● ●
● ●
●
● ● ● ●
●
RAMSFaecalNegative
![Page 14: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/14.jpg)
Patterns of infection
0 20 40 60 80 100
12
34
56
78
Positive Tests, Pen 7 (North)
Time (days)
Ani
mal
● ● ●
● ●
● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●
●
●
● ●
● ●
●
●
●
● ● ● ● ● ●
●
● ●
● ●
●
● ● ●
● ●
●
● ● ●
●
● ● ● ● ●
● ● ● ●
● ● ●
●
● ● ● ● ● ● ● ● ● ●
● ●
● ●
● ● ● ● ● ●
●
● ● ● ● ● ● ●
● ● ● ● ●
● ● ● ●
● ●
● ●
● ● ● ● ● ● ● ● ● ● ●
● ● ● ● ● ● ● ● ● ● ● ●
● ● ● ●
●
● ● ● ● ●
● ● ●
● ● ● ● ● ● ● ● ● ● ● ● ● ●
● ● ●
● ● ● ●
● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●
● ●
● ● ● ● ● ● ● ● ● ● ●
● ● ● ● ● ● ● ● ●
● ●
● ● ●
●
RAMSFaecalNegative
![Page 15: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/15.jpg)
Bayesian inference for epidemics
![Page 16: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/16.jpg)
Bayesian inference for epidemics
Intractable likelihood: π(y |θ).
Need to impute infection status of individuals x foraugmented likelihood π(y |x ,θ).
Missing data x typically very high dimensional.
![Page 17: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/17.jpg)
Updating the infection status
Standard method by O’Neill and Roberts (1999) involves 3steps:
1 Add a period of infection2 Remove a period of infection3 Move an end-point of a period of infection
This method was designed for SIR models (where individualscan’t be infected twice).
Easily adapted to discrete time models.
![Page 18: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/18.jpg)
Add a period of infection
Current: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
?
Propose: 0 0 0 0 0 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0
1 Choose a block of zeros at random.
2 Propose changing zeros to ones.
3 Accept or reject based on ratio of posteriors.
![Page 19: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/19.jpg)
Remove a period of infection
Current: 0 0 0 0 0 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0
?
Propose: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
1 Choose a complete block of ones.
2 Propose changing ones to zeros.
3 Accept or reject based on ratio of posteriors.
![Page 20: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/20.jpg)
Move an endpoint
Current: 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0
?
Propose: 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 0 0 0 0 0
1 Choose an endpoint of a block of ones.
2 Propose a new location for that endpoint.
3 Accept or reject based on ratio of posteriors.
![Page 21: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/21.jpg)
Some pros and cons
! Considerably fast
! Can handle non-Markov models
% Most of the hidden states are not updated
% High degree of autocorrelation
Slow mixing of the chain and long run length
% Tuning of the maximum block length required.
![Page 22: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/22.jpg)
Alternative approach: FFBS
Discrete time epidemic is a hidden Markov model.
Gibbs step: sample from the full condition distribution of thehidden states.
Use Forward Filtering Backward Sampling algorithm(Carter and Kohn, 1994).
![Page 23: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/23.jpg)
Some pros and cons
! Very good mixing of the MCMC chains
! No tuning required
% Computationally intensive
At each timepoint we need to calculate NC summationsO(TN2C )
% High memory requirements
All T forward variables must be storedThe transition matrix is of dimension NC × NC
N = number of infection states (e.g. 2)C = number of cows (e.g. 8)T = number of timepoints (e.g. 99)
![Page 24: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/24.jpg)
Example: SIS model
Stochastic SIS (Susceptible-Infected-Susceptible) transmissionmodel in discrete time.1
Xp,i ,t infection status for animal i in pen p on day t.
Xp,i,t = 1 – infected/colonized.Xp,i,t = 0 – uninfected/susceptible.
We treat Xp,i ,t as missing data and infer it using MCMC.
Epidemic model parameters updated via Metropolis-Hastingsand test sensitivities updated using Gibbs.
1Spencer et al. (2015) ‘Super’ or just ‘above average’? Supershedders andthe transmission of Escherichia coli O157:H7 among feedlot cattle. Interface12, 20150446.
![Page 25: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/25.jpg)
Susceptible Xp,i,t = 0
Colonized Xp,i,t = 1
Colonization probability:
P 𝑋𝑝,𝑖,𝑡+1 = 1 𝑋𝑝,𝑖,𝑡 = 0 = 1 − exp −𝛼 − 𝛽 𝑋𝑝,𝑗,𝑡𝜌𝕀(𝑆𝑝,𝑗,𝑡>𝜏)
8
𝑗=1
Colonization duration: NegativeBinomial(𝑟, 𝜇)
Pens: 𝑝 = 1⋯20 Animals: 𝑖 = 1⋯8 Time: 𝑡 = 1⋯99 days
![Page 26: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/26.jpg)
Example: Posterior infection probabilities
0 20 40 60 80 100
0.0
0.5
1.0
Pen 5 Animal 5
Time (days)
Pos
terio
r co
loni
zatio
n pr
obab
ility
RAMSFaecal
We can calculate theposterior infectionprobability for every day ofthe study.
0 20 40 60 80 100
12
34
56
78
Pen 5
Time (days)
Ani
mal
●● ●● ● ●● ●●
●●
●● ●●
● ●● ●● ●● ●● ●● ●
●● ●● ● ●● ●● ●● ●● ●● ● ●● ●● ●●
●● ●
● ●
●● ●●
● ●● ●
● ●● ●● ●● ● ●
●
●● ●● ●●
●
● ●
●● ●● ● ●● ●● ●●
●●
●● ● ●● ●● ●● ●● ●● ●
●● ●● ● ●● ●●
●
● ●
● ●● ● ●●
●● ●● ●● ●● ●
●● ●● ● ●● ●
●
●● ●● ●● ● ●● ●
● ●● ●●
●● ●
●● ●● ● ●●
●●
●● ●● ●● ● ●● ●● ●● ●● ●● ●
●● ●● ● ●● ●● ●● ●● ●● ●
●● ●●
●●
●
● ●● ●
0 20 40 60 80 100
12
34
56
78
Pen 8
Time (days)
Ani
mal
●● ●● ● ●● ●
● ●●
●● ●
●
● ●● ●● ●● ●● ●● ●
●● ●
●
● ●● ●
● ●● ●●
●● ● ●● ●● ●● ●● ●●
●
●● ●●
● ●
● ●● ●● ●● ●● ● ●● ●● ●● ●● ●● ●
●● ●● ●
●●
●● ●● ●● ●● ● ●● ●● ●● ●
● ●●
●
●●
●●
● ●● ●● ●
●
●● ●● ● ●● ●● ●● ●● ●
● ●
●● ●●
● ●● ●
● ●
●
●● ●
● ● ●● ●
● ●
● ●
● ●● ●
●● ●● ●
●● ●● ●● ●● ●●
●
●● ●● ●● ●● ●● ●
●● ●
● ● ●
● ●
●
●● ●● ●● ● ●● ●● ●● ●● ●● ●
![Page 27: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/27.jpg)
Model selection for epidemics
![Page 28: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/28.jpg)
Model selection for epidemics
A lot of epidemiologically interesting questions take the form ofmodel selection questions.
What is the transmission mechanism of this disease?
Do infected individuals really exhibit an exposed period?
Do water troughs spread E. coli O157?
![Page 29: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/29.jpg)
Posterior probabilities and marginal likelihoods
Would like the posterior probability in favour of model i .
P(Mi |y) =π(y |Mi )P(Mi )∑j π(y |Mj)P(Mj)
Equivalently, the Bayes factor comparing models i and j .
Bij =π(y |Mi )
π(y |Mj)
All we need is the marginal likelihood,
π(y |Mi ) =
∫π(y |θ,Mi )π(θ|Mi ) dθ
but how can we calculate it?
![Page 30: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/30.jpg)
Posterior probabilities and marginal likelihoods
Would like the posterior probability in favour of model i .
P(Mi |y) =π(y |Mi )P(Mi )∑j π(y |Mj)P(Mj)
Equivalently, the Bayes factor comparing models i and j .
Bij =π(y |Mi )
π(y |Mj)
All we need is the marginal likelihood,
π(y |Mi ) =
∫π(y |θ,Mi )π(θ|Mi ) dθ
but how can we calculate it?
![Page 31: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/31.jpg)
Posterior probabilities and marginal likelihoods
Would like the posterior probability in favour of model i .
P(Mi |y) =π(y |Mi )P(Mi )∑j π(y |Mj)P(Mj)
Equivalently, the Bayes factor comparing models i and j .
Bij =π(y |Mi )
π(y |Mj)
All we need is the marginal likelihood,
π(y |Mi ) =
∫π(y |θ,Mi )π(θ|Mi ) dθ
but how can we calculate it?
![Page 32: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/32.jpg)
Marginal likelihood estimation
Many existing approaches:
Chib’s methodPower posteriorsHarmonic meanBridge sampling
Most direct approach:importance sampling.
Use asymptotic normality of the posteriorto find efficient proposal.
But how to deal with the missing data?
Dr Peter Neal
![Page 33: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/33.jpg)
Marginal likelihood estimation using importance sampling
1 Run MCMC as usual.
2 Fit normal distribution to posterior samples2 ⇒ q(θ).
3 Draw N samples from q(θ).
π(y) =
∫π(y |θ)π(θ) dθ.
2To avoid problems, make q overdispersed relative to the posterior.
![Page 34: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/34.jpg)
Marginal likelihood estimation using importance sampling
1 Run MCMC as usual.
2 Fit normal distribution to posterior samples2 ⇒ q(θ).
3 Draw N samples from q(θ).
π(y) ≈N∑i=1
π(y |θi )π(θi )
q(θi ).
2To avoid problems, make q overdispersed relative to the posterior.
![Page 35: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/35.jpg)
Marginal likelihood estimation with missing data
1 Run MCMC as usual.
2 Fit normal distribution to posterior samples → q(θ).
3 Draw N samples from q(θ).
4 For each sampled θi draw missing data x i from the fullconditional using FFBS.
π(y) ≈N∑i=1
π(y |x i ,θi ) π(x i |θi ) π(θi )
π(x i |y ,θi ) q(θi ).
![Page 36: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/36.jpg)
Simulation study: pneumococcol carriage
Panayiota performed a thorough simulation study3 based onMelegaro at al. (2004).
Household based longitudinal study on carriage ofStreptococcus Pneumoniae.
Data consist of repeated diagnostic tests.
Multi-type model with 11 parameters, 2600 observed data and6500 missing data.
3Touloupou et al. (2016) Model comparison with missing data usingMCMC and importance sampling. arXiv 1512.04743
![Page 37: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/37.jpg)
Results: marginal likelihood estimation
HM
PP
Chib
ISt10
ISt8
ISt6
ISt4
ISmix
ISN4
ISN3
ISN2
ISN1
-931 -929 -927 -925 -923 -921 -919
-1238 -1237 -1236 -1235 -1234 -1233 -1232 -1231 -1230
Log marginal likelihood
-1237.5 -1237.25 -1237
![Page 38: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/38.jpg)
Results: Bayes factor estimation
Do adults and children acquire infection at the same rate?
M1 : kA 6= kCM2 : kA = kC
HM
PP
ISmix
RJ
RJcor
Chib
ISmix
2 5 8 11 15 19 23
2 3 4 5
Log B12
(a) Data simulated from model M1
HM
PP
ISmix
RJ
RJcor
Chib
ISmix
-22 -16 -10 -4 0 4 8
-4 -3 -2 -1 0
Log B12
(b) Data simulated from model M2
![Page 39: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/39.jpg)
Results: Evolution of the log Bayes factor
0 30 60 90 120 150 180 210 240
Time (minutes)
-20
24
68
1012
Log
B 12
RJ pilot + RJcor burn inInitial MCMC run for IS and Chib
HM
PP
RJcor
Chib
IS
![Page 40: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/40.jpg)
Application 1: E. coli O157 in feedlot cattle
Do animals develop immunity over time?
We compare two models for infection period:
Geometric: lack of memory.Negative Binomial: probability of recovery depends onduration of infection.
The Negative Binomial is a generalisation of the Geometric:
Setting Negative Binomial dispersion parameter κ = 1 leads toGeometric.
![Page 41: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/41.jpg)
Application 1: Results0.
00.
51.
01.
5
0 30 60 90 120 150 180Time (in minutes)
Log
BN
G
ISRJMCMC
Time (in minutes)
Log
BN
G
RJMCMC and IS agree on theestimate of the Bayes factor
IS estimator: faster convergence
Bayes factor supports theNegative Binomial model
The longer the colonization, thegreater the probability ofclearance – may indicate animmune response in the host
![Page 42: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/42.jpg)
Application 2: Role of pen area/location1
Pen 14
Pen 15
North Pen 6PenSet Pen 7
Pen Size Pen 86m×17m
Pen 9
Pen 10
Pen 16
Pen 17
Pen 18
Pen 19
Pen 20
Supplement and Premix Storage
Catch pensScale from scale Pen 1House house
Pen 11 South Pen 2Pen
Pen 12 Set Pen 3
Pen 13 Pen Size Pen 46m×37m
Pen 5
North = small
South = big
![Page 43: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/43.jpg)
Application 2: Role of pen area/location
Do north and south pens have different risk of infection?
Allow different external (αs , αn) and/or within-pen (βs , βn)transmission rates.
Candidate models:
External Within-penModel North South North South
1 αn αs βn βs2 α α βn βs3 αn αs β β4 α α β β
![Page 44: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/44.jpg)
Application 2: Posterior probabilities
●
●●
●
0.0
0.2
0.4
0.6
0.8
1 2 3 4Model
Pos
terio
r P
roba
bilit
y
Method IS RJMCMC
RJMCMC and IS provideidentical conclusions.
Evidence to supportdifferent within-pentransmission rates.
Animals in smaller pensmore at risk of within-peninfection
![Page 45: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/45.jpg)
Application 3: Investigating transmission between pens
Additional dataset: pens adjacent in a 12× 2 rectangular grid.
No direct contact across feed buck.
Shared waterers between pairs of adjacent pens.
Pen 24 Pen 23 Pen 22 Pen 21 Pen 20 Pen 19 Pen 18 Pen 17 Pen 16 Pen 15 Pen 14 Pen 13
Pen 1 Pen 2 Pen 3 Pen 4 Pen 5 Pen 6 Pen 7 Pen 8 Pen 9 Pen 10 Pen 11 Pen 12
![Page 46: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/46.jpg)
Application 3: Investigating transmission between pens
Do waterers spread infection?
(a) Model 1: No con-tacts between pens
(b) Model 2: Transmis-sion via a waterer
(c) Model 3: Transmis-sion via any boundary
![Page 47: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/47.jpg)
Application 3: Posterior probabilities
●●
0.2
0.3
0.4
0.5
0.6
1 2 3Model
Pos
terio
r P
roba
bilit
y RJMCMC: hard to design jumpmechanism
Using IS results still possible.
Evidence for transmissionbetween pens sharing a watererrather than another boundary.
![Page 48: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/48.jpg)
Scalable inference for epidemics
![Page 49: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/49.jpg)
Scalable inference for epidemics
Thus far we have been doing inference for small populations.
HouseholdsPens
The FFBS algorithm scales very badly with population size.
We would like an inference method that scales better withpopulation size.
![Page 50: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/50.jpg)
Graphical representation
Diagram of the Markovian epidemic model. Circles are hiddenstates and rectangles are observed data. Arrows representdependencies.
x [1]t−1 x [1]
t x [1]t+1
y[1]t
x [2]t−1 x [2]
t x [2]t+1
y[2]t
x [3]t−1 x [3]
t x [3]t+1
y[3]t
x [1]t−2
y[1]t−2
x [1]t+2 x [1]
t+3
y[1]t+3
x [2]t−2
y[2]t−2
x [2]t+2 x [2]
t+3
y[2]t+3
x [3]t−2
y[3]t−2
x [3]t+2 x [3]
t+3
y[3]t+3
![Page 51: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/51.jpg)
A new approach – the iFFBS algorithm
Reformulate graph:
x [1]t−1 x [1]
t x [1]t+1
Sample
y[1]t
x [2]t−1 x [2]
t x [2]t+1
y[2]t
x [3]t−1 x [3]
t x [3]t+1
y[3]t
Update one individual at a time bysampling from the full conditional:
P(x[c]1:T | y
[1:C ]1:T , x
[−c]1:T ,θ).
⇒ View as coupled hiddenMarkov model
Computational complexityreduced from O(TN2C ) toO(TCN2).
N = number of infection states (e.g. 2)C = number of cows (e.g. 8)T = number of timepoints (e.g. 99)
![Page 52: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/52.jpg)
A new approach – the iFFBS algorithm
Reformulate graph:
x [1]t−1 x [1]
t x [1]t+1
Sample
y[1]t
x [2]t−1 x [2]
t x [2]t+1
y[2]t
x [3]t−1 x [3]
t x [3]t+1
y[3]t
Update one individual at a time bysampling from the full conditional:
P(x[c]1:T | y
[1:C ]1:T , x
[−c]1:T ,θ).
⇒ View as coupled hiddenMarkov model
Computational complexityreduced from O(TN2C ) toO(TCN2).
N = number of infection states (e.g. 2)C = number of cows (e.g. 8)T = number of timepoints (e.g. 99)
![Page 53: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/53.jpg)
Comparison of methods
● ● ● ● ● ● ● ● ●
00.
51
1.5
22.
53
3.5
3 4 5 6 7 8 9 10 11
Animals in pen
Tim
e (in
sec
onds
)
● ● ● ● ● ●●
00.
10.
20.
3
3 4 5 6 7 8 9
Animals in pen
Tim
e (in
sec
onds
)
● Spencer's Dong's fullFFBS iFFBS
●
●●
●●
●●
●●
●●
●●
●●
●●
●●
●●
●●
●● ● ● ● ● ● ●
00.
20.
40.
60.
81
0 5 10 15 20 25 30
Lag
AC
F p
er it
erat
ion
![Page 54: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/54.jpg)
Larger populations
● ● ● ● ● ● ● ● ● ●025
5075
100
125
150
175
100 200 300 400 500 600 700 800 900 1000
Animals in pen
Rel
ativ
e sp
eed
● Spencer'sDong'siFFBS
![Page 55: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/55.jpg)
Conclusion
![Page 56: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/56.jpg)
Conclusion
FFBS algorithm generates better mixing MCMC for parameterinference.
Unlocks direct approach to marginal likelihood estimation.
Allows important epidemiological questions to be answered viamodel selection.
iFFBS can perform inference in large populations – exploitsdependence structure in epidemic data.
![Page 57: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/57.jpg)
What I didn’t say
All of this work (and much more!) has been done byPanayiota.
FFBS and iFFBS can also be used as a Metropolis-Hastingsproposal to fit non-Markovian epidemic models.
Can we do model selection with iFFBS?
Power of iFFBS allows more complex models to be fitted, e.g.multi-strain epidemic models.
![Page 58: Bayesian inference and model selection for stochastic ...€¦ · Bayesian inference and model selection for stochastic epidemics and other coupled hidden Markov models (with special](https://reader033.vdocuments.us/reader033/viewer/2022052803/5f27c6887231121971694d98/html5/thumbnails/58.jpg)
Current work
+C+ ++++ C +
- - - - - - - - - - - -- - - - - - -- - - -- - - - - - - - - - - -- - - - - -- - - -
0.0
0.2
0.4
0.6
0.8
1.0
1 15 29 43 57 71 85 99
Day
Pen
3-Anim
al1
O ++ +M+++ + + + M- - - - - - - - - - - - - - - - -- - - -- - - - - - - - - - - - - - - - -- - - -
0.0
0.2
0.4
0.6
0.8
1.0
1 15 29 43 57 71 85 99
Day
Pen
3-Anim
al4
+ ++ +++++++ + +++++ +++++++ + +O + + + ++ ++ + M- - - - - -
- - - - - - - - - - - - -
0.0
0.2
0.4
0.6
0.8
1.0
1 15 29 43 57 71 85 99
Day
Pen
3-Anim
al6
+++C U ++++
- - - - - - - - - - - -- - - - - - - - -- - - - - - - - - - - -- - - - - - - -- - - -
0.0
0.2
0.4
0.6
0.8
1.0
1 15 29 43 57 71 85 99
Day
Pen
3-Anim
al8
Serotype A C G M O P T U -