bayesian hierarchical modeling for longitudinal frequency data joseph jordan advisor: john c. kern...

41
Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne University May 6, 2005

Upload: leona-carr

Post on 17-Jan-2016

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Bayesian Hierarchical Modeling for Longitudinal Frequency DataJoseph JordanAdvisor: John C. Kern IIDepartment of Mathematics and Computer ScienceDuquesne UniversityMay 6, 2005

Page 2: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Outline

Motivation The Model Model Simulation Model Implementation Metropolis-Hastings Sampling Algorithm Results Conclusion References

Page 3: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Motivation

Yale University Study: The Patrick & Catherine Weldon Donaghue Medical Foundation

Menopausal women in breast cancer remission Acupuncture relief of menopausal symptoms Unlike previous models, this model explicitly

recognizes time dependence through prior distributions

Page 4: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Model Simulations:Study Information

Individuals randomly assigned to 1 of 3 groups

Length of Study: 13 weeks (1 week baseline followed by 12 weeks of “treatment”

Measurement: Hot flush frequency (91 observations)

Page 5: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Motivation:Study Samples

Education Group: 6 individuals given weekly educational sessions

Treatment Group: 16 individuals given weekly acupuncture on effective bodily areas

Placebo Group: 17 individuals given weekly acupuncture on non-effective bodily areas

Page 6: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Motivation:Actual Subject Profile

Page 7: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Motivation:Actual Subject Profile

Page 8: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Mean Hot Flush Frequencies

Page 9: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

The Model:

Page 10: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

The Model:Prior Distributions

Page 11: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

The Model:Prior Distributions (Non-Informative)

Page 12: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Model Simulation:j=.5, j=.9, 2

j=.5

Page 13: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Model Simulation:j=.5, j=.5, 2

j=.5

Page 14: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Model Implementation:Markov Chain Monte Carlo

Metropolis-Hastings Sampling:

Gibbs Sampling:

Page 15: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-Hastings Sampling:Requirements

MUST know posterior distribution for parameter (product of likelihood and prior distributions)

Computational precision issues – utilize natural logs

For example:

Page 16: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-Hastings Sampling: Algorithm

Page 17: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Gibbs Sampling:Requirements

Requirement: MUST know full conditional distribution for parameter

Sample from full conditional distribution; ALWAYS accept *

I

For Example:

Page 18: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Gibbs Sampling:Full Conditional Distributions

Page 19: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsLikelihood for ij

ij: mean hot flush freq on days i and 2i-1 for i=1,…,44, with 45j representing the mean hot flush freq for days 89, 90, 91

Page 20: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsPrior for ij

Page 21: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsDifference in log posterior densities evaluated at *

ij and cij

Page 22: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsLikelihood for j

Page 23: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsPrior for j

Page 24: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsDifference in log posterior densities evaluated at *

j and cj

Page 25: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsUpdating j

Same likelihood as j

Page 26: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsUpdating 2

j

Same likelihood as j

Page 27: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsUpdating 0j

Same posterior as ij’s

Page 28: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsLikelihood Distribution for

Page 29: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsPrior Distribution for

Page 30: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsUpdating

Same likelihood as Uniform prior

Page 31: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Metropolis-HastingsUpdating a and b

Uniform Prior Same likelihood and prior for b

Page 32: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

Hastings Ratios

Page 33: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

ResultsTreatment Group

Page 34: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

ResultsTreatment Group

Page 35: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

ResultsPlacebo Group

Page 36: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

ResultsPlacebo Group

Page 37: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

ResultsEducation Group

Page 38: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

ResultsEducation Group

Page 39: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

ResultsBoxplot for 0’s

Page 40: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

ResultsBoxplot for Exponentiated 0

Page 41: Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne

References

Borgesi, J. 2004. A Piecewise Linear Generalized Poisson Regression Approach to Modeling Longitudinal Frequency Data. Unpublished masters thesis, Duquesne University, Pittsburgh, PA, USA.

Gelman, A., Carlin, J.B., Stern, H.S., and Rubin, D.B. 1995. Bayesian Data Analysis. London: Chapman and Hall.

Gilks, W.R., Richardson, S., and Spiegelhalter, D.J. 1996. Markov Chain Monte Carlo in Practice. London: Chapman and Hall.

Kern, J. and S.M. Cohen. 2005. Menopausal symptom relief with acupuncture: modeling longitudinal frequency data. Vol 34, 3: Communications in Statistics: Simulation and Computation.