2004/11/161 a tutorial on hidden markov models and selected applications in speech recognition...
TRANSCRIPT
2004/11/16 1
A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition
LAWRENCE R. RABINER, FELLOW, IEEEPresented by: Chi-Chun Hsia
2004/11/16 2
Markov ChainMarkov Chain
2004/11/16 3
Markov ChainMarkov Chain
2004/11/16 4
Markov ChainMarkov Chain
And then, what does “hidden” means?
It results in a Geometric Distribution
2004/11/16 5
Extension to Hidden Markov ModelExtension to Hidden Markov Model
2004/11/16 6
Extension to Hidden Markov ModelExtension to Hidden Markov Model
2004/11/16 7
Elements of an HMMElements of an HMM
2004/11/16 8
The Three Basic ProblemsThe Three Basic Problems
2004/11/16 9
Solution to Problem 1Solution to Problem 1
2004/11/16 10
Solution to Problem 1Solution to Problem 1
2004/11/16 11
Forward-Backward ProcedureForward-Backward Procedure
2004/11/16 12
Forward-Backward ProcedureForward-Backward Procedure
2004/11/16 13
Forward-Backward ProcedureForward-Backward Procedure
2004/11/16 14
Forward-Backward ProcedureForward-Backward Procedure
2004/11/16 15
Solution to Problem 2Solution to Problem 2
2004/11/16 16
Solution to Problem 2Solution to Problem 2
2004/11/16 17
Viterbi AlgorithmViterbi Algorithm
2004/11/16 18
Viterbi AlgorithmViterbi Algorithm
2004/11/16 19
Solution to Problem 3Solution to Problem 3
2004/11/16 20
Solution to Problem 3Solution to Problem 3
2004/11/16 21
EM Algorithm for HMMEM Algorithm for HMM
X.D. HUANG, Y. ARIKI, M.A. JACK
HIDDEN MARKOV MODELSFOR SPEECH RECOGNITION
EDINBURGH UNIVERSITY PRESS
2004/11/16 22
Types of HMMsTypes of HMMs
2004/11/16 23
Continuous Type HMMsContinuous Type HMMs
2004/11/16 24
Autoregressive HMMsAutoregressive HMMs
2004/11/16 25
Optimization CriterionOptimization CriterionMaximum Likelihood (ML)
Maximum Mutual Information (MMI)
Minimum Discrimination Information (MDI)
Minimum Classification Error (MCE) Chang.
2004/11/16 26
Implementation Issues for HMMsImplementation Issues for HMMs
• Scaling
• Multiple Observation Sequences
• Initial Estimates of HMM Parameters
• Effect of Insufficient Training Data
• Choice of Model
2004/11/16 27
ScalingScaling
2004/11/16 28
ScalingScaling
2004/11/16 29
ScalingScaling
And so on and on and on and on……………..
2004/11/16 30
Multiple Observation SequencesMultiple Observation Sequences
2004/11/16 31
Initial Estimates of HMM ParametersInitial Estimates of HMM Parameters
2004/11/16 32
Effect of Insufficient Training DataEffect of Insufficient Training Data
2004/11/16 33
Choice of ModelChoice of Model