auditory cortical monitoring prevents speech errors before they happen caroline a. niziolek ucsf...

149
Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck Surgery Biomagnetic Imaging Laboratory Speech Neuroscience Laboratory

Upload: joel-morton

Post on 11-Jan-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Auditory cortical monitoring prevents speech errors

before they happen

Caroline A NiziolekUCSF Depts of Radiology and Otolaryngology ndash Head and Neck

SurgeryBiomagnetic Imaging LaboratorySpeech Neuroscience Laboratory

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 2: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 3: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 4: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 5: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 6: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 7: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 8: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 9: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 10: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 11: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 12: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 13: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 14: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 15: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 16: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 17: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 18: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 19: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 20: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 21: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 22: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 23: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 24: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 25: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 26: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 27: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 28: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 29: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 30: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 31: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 32: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 33: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 34: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 35: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 36: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 37: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 38: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 39: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 40: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 41: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 42: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 43: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 44: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 45: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 46: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 47: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 48: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 49: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 50: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 51: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 52: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 53: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 54: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 55: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 56: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 57: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 58: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 59: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 60: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 61: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 62: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 63: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 64: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 65: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 66: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 67: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 68: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 69: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 70: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 71: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 72: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 73: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 74: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 75: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 76: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 77: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 78: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 79: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 80: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 81: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 82: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 83: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 84: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 85: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 86: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 87: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 88: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 89: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 90: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 91: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 92: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 93: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 94: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 95: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 96: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 97: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 98: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 99: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 100: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 101: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 102: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 103: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 104: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 105: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 106: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 107: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 108: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 109: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 110: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 111: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 112: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 113: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 114: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 115: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 116: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 117: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 118: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 119: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 120: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 121: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 122: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 123: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 124: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 125: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 126: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 127: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 128: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 129: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 130: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 131: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 132: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 133: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 134: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 135: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 136: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 137: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 138: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 139: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 140: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 141: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 142: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 143: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 144: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 145: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 146: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 147: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 148: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space
Page 149: Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space